2023-03-30T07:55:59.866 INFO:root:teuthology version: 0.0.1.dev78+ge372916 2023-03-30T07:55:59.867 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7225993 --owner scheduled_vshankar@teuthology --name vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7225993/orig.config.yaml 2023-03-30T07:55:59.912 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-03-30T07:55:59.995 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7225993 branch: wip-vshankar-testing-20230317.095222 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7225993' kernel: client: branch: testing flavor: default kdb: true sha1: 6c26fb6d76aa35f265ac42f88c0a40a9c564d650 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-vshankar-testing-20230317.095222 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: f03d69a8741c605ae6711afe2c9991ac46095f7d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f03d69a8741c605ae6711afe2c9991ac46095f7d kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230317.095222 sha1: f03d69a8741c605ae6711afe2c9991ac46095f7d owner: scheduled_vshankar@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: f03d69a8741c605ae6711afe2c9991ac46095f7d sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20230317.095222 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f03d69a8741c605ae6711afe2c9991ac46095f7d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f03d69a8741c605ae6711afe2c9991ac46095f7d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi087.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e3729161eecf8e6d09a4069acbb883cdcd5e9f50 timestamp: 2023-03-30_04:16:29 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.803 2023-03-30T07:55:59.995 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f03d69a8741c605ae6711afe2c9991ac46095f7d/qa; will attempt to use it 2023-03-30T07:55:59.996 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f03d69a8741c605ae6711afe2c9991ac46095f7d/qa/tasks 2023-03-30T07:55:59.997 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-03-30T07:55:59.998 INFO:teuthology.task.internal:Checking packages... 2023-03-30T07:56:00.028 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'f03d69a8741c605ae6711afe2c9991ac46095f7d' 2023-03-30T07:56:00.028 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-03-30T07:56:00.029 INFO:teuthology.packaging:ref: None 2023-03-30T07:56:00.029 INFO:teuthology.packaging:tag: None 2023-03-30T07:56:00.029 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230317.095222 2023-03-30T07:56:00.030 INFO:teuthology.packaging:sha1: f03d69a8741c605ae6711afe2c9991ac46095f7d 2023-03-30T07:56:00.030 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-vshankar-testing-20230317.095222 2023-03-30T07:56:00.203 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3066-gf03d69a8-1focal 2023-03-30T07:56:00.203 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-03-30T07:56:00.211 INFO:teuthology.task.internal:no buildpackages task found 2023-03-30T07:56:00.211 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-03-30T07:56:00.218 INFO:teuthology.task.internal:Saving configuration 2023-03-30T07:56:00.234 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-03-30T07:56:00.240 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-30T07:56:00.268 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7225993', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-30 07:49:52.782717', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-03-30T07:56:00.294 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7225993', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-30 07:49:52.781251', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-03-30T07:56:00.295 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-03-30T07:56:00.301 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-03-30T07:56:00.302 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-03-30T07:56:00.302 INFO:teuthology.run_tasks:Running task console_log... 2023-03-30T07:56:00.378 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5d4d749f70>, signals=[15]) 2023-03-30T07:56:00.379 INFO:teuthology.run_tasks:Running task internal.connect... 2023-03-30T07:56:00.386 INFO:teuthology.task.internal:Opening connections... 2023-03-30T07:56:00.386 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2023-03-30T07:56:00.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-30T07:56:00.440 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2023-03-30T07:56:00.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-30T07:56:00.491 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-03-30T07:56:00.498 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2023-03-30T07:56:00.525 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2023-03-30T07:56:00.525 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2023-03-30T07:56:00.572 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu" 2023-03-30T07:56:00.573 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-03-30T07:56:00.573 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu 2023-03-30T07:56:00.573 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian 2023-03-30T07:56:00.573 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-03-30T07:56:00.573 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="20.04" 2023-03-30T07:56:00.573 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/" 2023-03-30T07:56:00.574 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-03-30T07:56:00.574 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-03-30T07:56:00.574 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-03-30T07:56:00.574 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=focal 2023-03-30T07:56:00.574 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=focal 2023-03-30T07:56:00.575 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2023-03-30T07:56:00.602 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2023-03-30T07:56:00.609 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2023-03-30T07:56:00.610 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-03-30T07:56:00.656 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Ubuntu" 2023-03-30T07:56:00.657 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-03-30T07:56:00.657 INFO:teuthology.orchestra.run.smithi115.stdout:ID=ubuntu 2023-03-30T07:56:00.657 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE=debian 2023-03-30T07:56:00.657 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-03-30T07:56:00.657 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="20.04" 2023-03-30T07:56:00.657 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.ubuntu.com/" 2023-03-30T07:56:00.657 INFO:teuthology.orchestra.run.smithi115.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-03-30T07:56:00.658 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-03-30T07:56:00.658 INFO:teuthology.orchestra.run.smithi115.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-03-30T07:56:00.658 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_CODENAME=focal 2023-03-30T07:56:00.658 INFO:teuthology.orchestra.run.smithi115.stdout:UBUNTU_CODENAME=focal 2023-03-30T07:56:00.658 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-03-30T07:56:00.685 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-03-30T07:56:00.695 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-03-30T07:56:00.702 INFO:teuthology.task.internal:Checking for old test directory... 2023-03-30T07:56:00.702 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2023-03-30T07:56:00.704 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2023-03-30T07:56:00.710 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-03-30T07:56:00.716 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-03-30T07:56:00.717 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2023-03-30T07:56:00.719 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2023-03-30T07:56:00.772 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-03-30T07:56:00.829 INFO:teuthology.run_tasks:Running task kernel... 2023-03-30T07:56:00.845 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '6c26fb6d76aa35f265ac42f88c0a40a9c564d650'} 2023-03-30T07:56:00.846 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-03-30T07:56:00.846 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-03-30T07:56:00.847 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-30T07:56:00.847 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-30T07:56:00.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T07:56:00.853 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-03-30T07:56:00.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T07:56:00.857 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-03-30T07:56:01.053 DEBUG:teuthology.task.kernel:sha1 for client.1 is 6c26fb6d76aa35f265ac42f88c0a40a9c564d650 2023-03-30T07:56:01.054 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6c26fb6d76aa35f265ac42f88c0a40a9c564d650"... 2023-03-30T07:56:01.054 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2023-03-30T07:56:01.061 DEBUG:teuthology.task.kernel:sha1 for client.0 is 6c26fb6d76aa35f265ac42f88c0a40a9c564d650 2023-03-30T07:56:01.061 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6c26fb6d76aa35f265ac42f88c0a40a9c564d650"... 2023-03-30T07:56:01.062 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2023-03-30T07:56:01.063 INFO:teuthology.orchestra.run.smithi115.stdout:5.4.0-124-generic 2023-03-30T07:56:01.063 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 6c26fb6d76aa35f265ac42f88c0a40a9c564d650 2023-03-30T07:56:01.063 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-03-30T07:56:01.064 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-03-30T07:56:01.064 DEBUG:teuthology.orchestra.run.smithi115:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-03-30T07:56:01.070 INFO:teuthology.orchestra.run.smithi087.stdout:5.4.0-124-generic 2023-03-30T07:56:01.070 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 6c26fb6d76aa35f265ac42f88c0a40a9c564d650 2023-03-30T07:56:01.070 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-03-30T07:56:01.071 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-03-30T07:56:01.071 DEBUG:teuthology.orchestra.run.smithi087:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-03-30T07:56:01.121 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-03-30T07:56:01.133 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-03-30T07:56:01.219 INFO:teuthology.orchestra.run.smithi115.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-03-30T07:56:01.221 DEBUG:teuthology.orchestra.run.smithi115:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-03-30T07:56:01.249 DEBUG:teuthology.orchestra.run.smithi115:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-03-30T07:56:01.253 INFO:teuthology.orchestra.run.smithi087.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-03-30T07:56:01.255 DEBUG:teuthology.orchestra.run.smithi087:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-03-30T07:56:01.262 DEBUG:teuthology.orchestra.run.smithi115:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-03-30T07:56:01.283 DEBUG:teuthology.orchestra.run.smithi087:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-03-30T07:56:01.296 DEBUG:teuthology.orchestra.run.smithi087:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-03-30T07:56:41.182 INFO:teuthology.orchestra.run.smithi115.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-03-30T07:56:41.182 INFO:teuthology.orchestra.run.smithi115.stderr: * [new branch] main -> origin/main 2023-03-30T07:56:41.232 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20190312 -> 20190312 2023-03-30T07:56:41.232 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20190416 -> 20190416 2023-03-30T07:56:41.232 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20190514 -> 20190514 2023-03-30T07:56:41.233 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20190618 -> 20190618 2023-03-30T07:56:41.233 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20190717 -> 20190717 2023-03-30T07:56:41.233 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20190815 -> 20190815 2023-03-30T07:56:41.233 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20190923 -> 20190923 2023-03-30T07:56:41.234 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20191022 -> 20191022 2023-03-30T07:56:41.235 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20191215 -> 20191215 2023-03-30T07:56:41.235 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200122 -> 20200122 2023-03-30T07:56:41.235 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200316 -> 20200316 2023-03-30T07:56:41.235 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200421 -> 20200421 2023-03-30T07:56:41.235 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200519 -> 20200519 2023-03-30T07:56:41.235 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200619 -> 20200619 2023-03-30T07:56:41.236 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200721 -> 20200721 2023-03-30T07:56:41.236 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200817 -> 20200817 2023-03-30T07:56:41.236 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20200918 -> 20200918 2023-03-30T07:56:41.236 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20201022 -> 20201022 2023-03-30T07:56:41.236 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20201118 -> 20201118 2023-03-30T07:56:41.236 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20201218 -> 20201218 2023-03-30T07:56:41.236 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20210208 -> 20210208 2023-03-30T07:56:41.236 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20210315 -> 20210315 2023-03-30T07:56:41.237 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20210511 -> 20210511 2023-03-30T07:56:41.237 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20210716 -> 20210716 2023-03-30T07:56:41.237 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20210818 -> 20210818 2023-03-30T07:56:41.238 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20210919 -> 20210919 2023-03-30T07:56:41.239 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20211027 -> 20211027 2023-03-30T07:56:41.239 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20211216 -> 20211216 2023-03-30T07:56:41.239 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220209 -> 20220209 2023-03-30T07:56:41.239 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220310 -> 20220310 2023-03-30T07:56:41.239 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220411 -> 20220411 2023-03-30T07:56:41.239 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220509 -> 20220509 2023-03-30T07:56:41.239 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220610 -> 20220610 2023-03-30T07:56:41.240 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220708 -> 20220708 2023-03-30T07:56:41.240 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220815 -> 20220815 2023-03-30T07:56:41.240 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20220913 -> 20220913 2023-03-30T07:56:41.240 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20221012 -> 20221012 2023-03-30T07:56:41.240 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20221109 -> 20221109 2023-03-30T07:56:41.240 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20221214 -> 20221214 2023-03-30T07:56:41.240 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20230117 -> 20230117 2023-03-30T07:56:41.240 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20230210 -> 20230210 2023-03-30T07:56:41.241 INFO:teuthology.orchestra.run.smithi115.stderr: * [new tag] 20230310 -> 20230310 2023-03-30T07:56:41.415 INFO:teuthology.orchestra.run.smithi087.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-03-30T07:56:41.415 INFO:teuthology.orchestra.run.smithi087.stderr: * [new branch] main -> origin/main 2023-03-30T07:56:41.465 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20190312 -> 20190312 2023-03-30T07:56:41.466 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20190416 -> 20190416 2023-03-30T07:56:41.466 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20190514 -> 20190514 2023-03-30T07:56:41.466 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20190618 -> 20190618 2023-03-30T07:56:41.466 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20190717 -> 20190717 2023-03-30T07:56:41.466 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20190815 -> 20190815 2023-03-30T07:56:41.466 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20190923 -> 20190923 2023-03-30T07:56:41.468 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20191022 -> 20191022 2023-03-30T07:56:41.468 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20191215 -> 20191215 2023-03-30T07:56:41.468 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200122 -> 20200122 2023-03-30T07:56:41.468 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200316 -> 20200316 2023-03-30T07:56:41.469 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200421 -> 20200421 2023-03-30T07:56:41.469 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200519 -> 20200519 2023-03-30T07:56:41.469 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200619 -> 20200619 2023-03-30T07:56:41.469 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200721 -> 20200721 2023-03-30T07:56:41.469 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200817 -> 20200817 2023-03-30T07:56:41.469 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20200918 -> 20200918 2023-03-30T07:56:41.469 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20201022 -> 20201022 2023-03-30T07:56:41.470 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20201118 -> 20201118 2023-03-30T07:56:41.470 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20201218 -> 20201218 2023-03-30T07:56:41.470 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20210208 -> 20210208 2023-03-30T07:56:41.470 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20210315 -> 20210315 2023-03-30T07:56:41.470 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20210511 -> 20210511 2023-03-30T07:56:41.470 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20210716 -> 20210716 2023-03-30T07:56:41.470 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20210818 -> 20210818 2023-03-30T07:56:41.472 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20210919 -> 20210919 2023-03-30T07:56:41.472 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20211027 -> 20211027 2023-03-30T07:56:41.472 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20211216 -> 20211216 2023-03-30T07:56:41.472 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220209 -> 20220209 2023-03-30T07:56:41.472 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220310 -> 20220310 2023-03-30T07:56:41.472 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220411 -> 20220411 2023-03-30T07:56:41.472 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220509 -> 20220509 2023-03-30T07:56:41.473 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220610 -> 20220610 2023-03-30T07:56:41.473 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220708 -> 20220708 2023-03-30T07:56:41.473 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220815 -> 20220815 2023-03-30T07:56:41.473 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20220913 -> 20220913 2023-03-30T07:56:41.473 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20221012 -> 20221012 2023-03-30T07:56:41.473 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20221109 -> 20221109 2023-03-30T07:56:41.473 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20221214 -> 20221214 2023-03-30T07:56:41.474 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20230117 -> 20230117 2023-03-30T07:56:41.474 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20230210 -> 20230210 2023-03-30T07:56:41.474 INFO:teuthology.orchestra.run.smithi087.stderr: * [new tag] 20230310 -> 20230310 2023-03-30T07:56:44.273 INFO:teuthology.orchestra.run.smithi115.stderr:Updating files: 51% (1482/2875) Updating files: 52% (1495/2875) Updating files: 53% (1524/2875) Updating files: 54% (1553/2875) Updating files: 55% (1582/2875) Updating files: 56% (1610/2875) Updating files: 57% (1639/2875) Updating files: 58% (1668/2875) Updating files: 59% (1697/2875) Updating files: 60% (1725/2875) Updating files: 61% (1754/2875) Updating files: 62% (1783/2875) Updating files: 63% (1812/2875) Updating files: 64% (1840/2875) Updating files: 65% (1869/2875) Updating files: 66% (1898/2875) Updating files: 66% (1906/2875) Updating files: 67% (1927/2875) Updating files: 68% (1955/2875) Updating files: 69% (1984/2875) Updating files: 70% (2013/2875) Updating files: 71% (2042/2875) Updating files: 72% (2070/2875) Updating files: 73% (2099/2875) Updating files: 74% (2128/2875) Updating files: 75% (2157/2875) Updating files: 76% (2185/2875) Updating files: 77% (2214/2875) Updating files: 78% (2243/2875) Updating files: 79% (2272/2875) Updating files: 80% (2300/2875) Updating files: 81% (2329/2875) Updating files: 82% (2358/2875) Updating files: 83% (2387/2875) Updating files: 84% (2415/2875) Updating files: 85% (2444/2875) Updating files: 86% (2473/2875) Updating files: 87% (2502/2875) Updating files: 88% (2530/2875) Updating files: 89% (2559/2875) Updating files: 90% (2588/2875) Updating files: 91% (2617/2875) Updating files: 92% (2645/2875) Updating files: 93% (2674/2875) Updating files: 94% (2703/2875) Updating files: 95% (2732/2875) Updating files: 96% (2760/2875) Updating files: 97% (2789/2875) Updating files: 97% (2807/2875) Updating files: 98% (2818/2875) Updating files: 99% (2847/2875) Updating files: 100% (2875/2875) Updating files: 100% (2875/2875), done. 2023-03-30T07:56:44.277 INFO:teuthology.orchestra.run.smithi115.stdout:HEAD is now at bcdcfbc linux-firmware: Update firmware file for Intel Bluetooth AX101 2023-03-30T07:56:44.291 INFO:teuthology.task.kernel:Downloading kernel 6c26fb6d76aa35f265ac42f88c0a40a9c564d650 on client.1... 2023-03-30T07:56:44.291 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c26fb6d76aa35f265ac42f88c0a40a9c564d650 2023-03-30T07:56:44.435 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/6c26fb6d76aa35f265ac42f88c0a40a9c564d650/ubuntu/focal/flavors/default/pool/main/l/linux-6.3.0-rc3-g6c26fb6d76aa/ 2023-03-30T07:56:44.436 DEBUG:teuthology.orchestra.run.smithi115:> rm -f /tmp/linux-image.deb && echo linux-image-6.3.0-rc3-g6c26fb6d76aa_6.3.0-rc3-g6c26fb6d76aa-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/6c26fb6d76aa35f265ac42f88c0a40a9c564d650/ubuntu/focal/flavors/default/pool/main/l/linux-6.3.0-rc3-g6c26fb6d76aa/ --input-file=- 2023-03-30T07:56:44.438 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi115.front.sepia.ceph.com to complete... 2023-03-30T07:56:44.514 INFO:teuthology.orchestra.run.smithi087.stderr:Updating files: 51% (1482/2875) Updating files: 52% (1495/2875) Updating files: 53% (1524/2875) Updating files: 54% (1553/2875) Updating files: 55% (1582/2875) Updating files: 56% (1610/2875) Updating files: 57% (1639/2875) Updating files: 58% (1668/2875) Updating files: 59% (1697/2875) Updating files: 60% (1725/2875) Updating files: 61% (1754/2875) Updating files: 62% (1783/2875) Updating files: 63% (1812/2875) Updating files: 64% (1840/2875) Updating files: 65% (1869/2875) Updating files: 66% (1898/2875) Updating files: 66% (1905/2875) Updating files: 67% (1927/2875) Updating files: 68% (1955/2875) Updating files: 69% (1984/2875) Updating files: 70% (2013/2875) Updating files: 71% (2042/2875) Updating files: 72% (2070/2875) Updating files: 73% (2099/2875) Updating files: 74% (2128/2875) Updating files: 75% (2157/2875) Updating files: 76% (2185/2875) Updating files: 77% (2214/2875) Updating files: 78% (2243/2875) Updating files: 79% (2272/2875) Updating files: 80% (2300/2875) Updating files: 81% (2329/2875) Updating files: 82% (2358/2875) Updating files: 83% (2387/2875) Updating files: 84% (2415/2875) Updating files: 85% (2444/2875) Updating files: 86% (2473/2875) Updating files: 87% (2502/2875) Updating files: 88% (2530/2875) Updating files: 89% (2559/2875) Updating files: 90% (2588/2875) Updating files: 91% (2617/2875) Updating files: 92% (2645/2875) Updating files: 93% (2674/2875) Updating files: 94% (2703/2875) Updating files: 95% (2732/2875) Updating files: 96% (2760/2875) Updating files: 97% (2789/2875) Updating files: 97% (2805/2875) Updating files: 98% (2818/2875) Updating files: 99% (2847/2875) Updating files: 100% (2875/2875) Updating files: 100% (2875/2875), done. 2023-03-30T07:56:44.518 INFO:teuthology.orchestra.run.smithi087.stdout:HEAD is now at bcdcfbc linux-firmware: Update firmware file for Intel Bluetooth AX101 2023-03-30T07:56:44.531 INFO:teuthology.task.kernel:Downloading kernel 6c26fb6d76aa35f265ac42f88c0a40a9c564d650 on client.0... 2023-03-30T07:56:44.532 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c26fb6d76aa35f265ac42f88c0a40a9c564d650 2023-03-30T07:56:44.669 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/6c26fb6d76aa35f265ac42f88c0a40a9c564d650/ubuntu/focal/flavors/default/pool/main/l/linux-6.3.0-rc3-g6c26fb6d76aa/ 2023-03-30T07:56:44.670 DEBUG:teuthology.orchestra.run.smithi087:> rm -f /tmp/linux-image.deb && echo linux-image-6.3.0-rc3-g6c26fb6d76aa_6.3.0-rc3-g6c26fb6d76aa-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/6c26fb6d76aa35f265ac42f88c0a40a9c564d650/ubuntu/focal/flavors/default/pool/main/l/linux-6.3.0-rc3-g6c26fb6d76aa/ --input-file=- 2023-03-30T07:56:44.672 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi087.front.sepia.ceph.com to complete... 2023-03-30T07:56:46.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30 07:56:46 URL:https://4.chacra.ceph.com/r/kernel/testing/6c26fb6d76aa35f265ac42f88c0a40a9c564d650/ubuntu/focal/flavors/default/pool/main/l/linux-6.3.0-rc3-g6c26fb6d76aa/linux-image-6.3.0-rc3-g6c26fb6d76aa_6.3.0-rc3-g6c26fb6d76aa-1_amd64.deb [38554028/38554028] -> "/tmp/linux-image.deb" [1] 2023-03-30T07:56:46.099 INFO:teuthology.orchestra.run.smithi115.stderr:FINISHED --2023-03-30 07:56:46-- 2023-03-30T07:56:46.099 INFO:teuthology.orchestra.run.smithi115.stderr:Total wall clock time: 1.6s 2023-03-30T07:56:46.099 INFO:teuthology.orchestra.run.smithi115.stderr:Downloaded: 1 files, 37M in 1.5s (24.4 MB/s) 2023-03-30T07:56:46.100 INFO:teuthology.task.kernel:Installing kernel 6c26fb6d76aa35f265ac42f88c0a40a9c564d650 on client.1... 2023-03-30T07:56:46.101 DEBUG:teuthology.orchestra.run.smithi115:> sudo dpkg -i /tmp/linux-image.deb 2023-03-30T07:56:46.357 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-image-6.3.0-rc3-g6c26fb6d76aa. 2023-03-30T07:56:47.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30 07:56:47 URL:https://4.chacra.ceph.com/r/kernel/testing/6c26fb6d76aa35f265ac42f88c0a40a9c564d650/ubuntu/focal/flavors/default/pool/main/l/linux-6.3.0-rc3-g6c26fb6d76aa/linux-image-6.3.0-rc3-g6c26fb6d76aa_6.3.0-rc3-g6c26fb6d76aa-1_amd64.deb [38554028/38554028] -> "/tmp/linux-image.deb" [1] 2023-03-30T07:56:47.984 INFO:teuthology.orchestra.run.smithi087.stderr:FINISHED --2023-03-30 07:56:47-- 2023-03-30T07:56:47.984 INFO:teuthology.orchestra.run.smithi087.stderr:Total wall clock time: 3.3s 2023-03-30T07:56:47.984 INFO:teuthology.orchestra.run.smithi087.stderr:Downloaded: 1 files, 37M in 3.0s (12.4 MB/s) 2023-03-30T07:56:47.985 INFO:teuthology.task.kernel:Installing kernel 6c26fb6d76aa35f265ac42f88c0a40a9c564d650 on client.0... 2023-03-30T07:56:47.985 DEBUG:teuthology.orchestra.run.smithi087:> sudo dpkg -i /tmp/linux-image.deb 2023-03-30T07:56:48.105 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-03-30T07:56:48.110 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-03-30T07:56:48.242 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-image-6.3.0-rc3-g6c26fb6d76aa (6.3.0-rc3-g6c26fb6d76aa-1) ... 2023-03-30T07:56:48.294 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-image-6.3.0-rc3-g6c26fb6d76aa. 2023-03-30T07:56:50.052 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-03-30T07:56:50.057 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-03-30T07:56:50.280 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-image-6.3.0-rc3-g6c26fb6d76aa (6.3.0-rc3-g6c26fb6d76aa-1) ... 2023-03-30T07:56:51.181 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-image-6.3.0-rc3-g6c26fb6d76aa (6.3.0-rc3-g6c26fb6d76aa-1) ... 2023-03-30T07:56:51.298 INFO:teuthology.orchestra.run.smithi115.stderr:update-initramfs: Generating /boot/initrd.img-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:56:53.345 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-image-6.3.0-rc3-g6c26fb6d76aa (6.3.0-rc3-g6c26fb6d76aa-1) ... 2023-03-30T07:56:53.467 INFO:teuthology.orchestra.run.smithi087.stderr:update-initramfs: Generating /boot/initrd.img-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:15.024 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub' 2023-03-30T07:57:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-03-30T07:57:15.062 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2023-03-30T07:57:15.419 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:15.447 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:15.865 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-03-30T07:57:15.878 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-03-30T07:57:17.487 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub' 2023-03-30T07:57:17.493 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-03-30T07:57:17.517 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2023-03-30T07:57:17.789 INFO:teuthology.orchestra.run.smithi115.stderr:done 2023-03-30T07:57:17.840 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:17.868 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:17.972 DEBUG:teuthology.orchestra.run.smithi115:> dpkg-deb -c /tmp/linux-image.deb 2023-03-30T07:57:17.982 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./ 2023-03-30T07:57:17.982 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./boot/ 2023-03-30T07:57:17.982 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 4289084 2023-03-30 03:03 ./boot/System.map-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:17.997 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 166968 2023-03-30 03:03 ./boot/config-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:17.997 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11175968 2023-03-30 03:03 ./boot/vmlinuz-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:18.019 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./etc/ 2023-03-30T07:57:18.019 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./etc/kernel/ 2023-03-30T07:57:18.019 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./etc/kernel/postinst.d/ 2023-03-30T07:57:18.020 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./etc/kernel/postrm.d/ 2023-03-30T07:57:18.020 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./etc/kernel/preinst.d/ 2023-03-30T07:57:18.020 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./etc/kernel/prerm.d/ 2023-03-30T07:57:18.020 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/ 2023-03-30T07:57:18.020 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/ 2023-03-30T07:57:18.020 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/ 2023-03-30T07:57:18.020 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/ 2023-03-30T07:57:18.021 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/ 2023-03-30T07:57:18.021 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/ 2023-03-30T07:57:18.021 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/ 2023-03-30T07:57:18.021 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 527241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/aesni-intel.ko 2023-03-30T07:57:18.023 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-03-30T07:57:18.024 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-03-30T07:57:18.024 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-03-30T07:57:18.024 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 88505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-03-30T07:57:18.024 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 100081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-03-30T07:57:18.024 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 142185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-03-30T07:57:18.024 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-03-30T07:57:18.025 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-03-30T07:57:18.025 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 78905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-03-30T07:57:18.025 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-03-30T07:57:18.025 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-03-30T07:57:18.025 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/serpent-avx2.ko 2023-03-30T07:57:18.025 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-03-30T07:57:18.025 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-03-30T07:57:18.026 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-03-30T07:57:18.026 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 58273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-03-30T07:57:18.026 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-03-30T07:57:18.026 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-03-30T07:57:18.026 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-03-30T07:57:18.026 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kernel/ 2023-03-30T07:57:18.026 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kernel/cpu/ 2023-03-30T07:57:18.027 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kernel/cpu/mce/ 2023-03-30T07:57:18.027 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-03-30T07:57:18.027 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kernel/cpuid.ko 2023-03-30T07:57:18.027 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kernel/msr.ko 2023-03-30T07:57:18.027 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kvm/ 2023-03-30T07:57:18.027 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 341961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kvm/kvm-amd.ko 2023-03-30T07:57:18.027 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 970945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kvm/kvm-intel.ko 2023-03-30T07:57:18.036 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 2206561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kvm/kvm.ko 2023-03-30T07:57:18.036 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/ 2023-03-30T07:57:18.036 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/af_alg.ko 2023-03-30T07:57:18.036 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/algif_hash.ko 2023-03-30T07:57:18.036 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/algif_skcipher.ko 2023-03-30T07:57:18.036 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/ansi_cprng.ko 2023-03-30T07:57:18.037 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/anubis.ko 2023-03-30T07:57:18.037 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/arc4.ko 2023-03-30T07:57:18.037 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/asymmetric_keys/ 2023-03-30T07:57:18.037 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-03-30T07:57:18.037 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/async_tx/ 2023-03-30T07:57:18.037 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/async_tx/async_memcpy.ko 2023-03-30T07:57:18.037 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/async_tx/async_pq.ko 2023-03-30T07:57:18.038 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/async_tx/async_raid6_recov.ko 2023-03-30T07:57:18.038 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/async_tx/async_tx.ko 2023-03-30T07:57:18.038 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/async_tx/async_xor.ko 2023-03-30T07:57:18.038 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/async_tx/raid6test.ko 2023-03-30T07:57:18.038 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/authenc.ko 2023-03-30T07:57:18.038 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/authencesn.ko 2023-03-30T07:57:18.038 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/blake2b_generic.ko 2023-03-30T07:57:18.039 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/blowfish_common.ko 2023-03-30T07:57:18.039 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/blowfish_generic.ko 2023-03-30T07:57:18.039 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/camellia_generic.ko 2023-03-30T07:57:18.039 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/cast5_generic.ko 2023-03-30T07:57:18.039 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/cast6_generic.ko 2023-03-30T07:57:18.039 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/cast_common.ko 2023-03-30T07:57:18.039 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/ccm.ko 2023-03-30T07:57:18.040 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/cmac.ko 2023-03-30T07:57:18.040 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9089 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/crc32_generic.ko 2023-03-30T07:57:18.040 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/cryptd.ko 2023-03-30T07:57:18.040 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/crypto_engine.ko 2023-03-30T07:57:18.040 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/crypto_simd.ko 2023-03-30T07:57:18.040 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/crypto_user.ko 2023-03-30T07:57:18.040 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/cts.ko 2023-03-30T07:57:18.041 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/des_generic.ko 2023-03-30T07:57:18.041 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/dh_generic.ko 2023-03-30T07:57:18.041 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/echainiv.ko 2023-03-30T07:57:18.041 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/essiv.ko 2023-03-30T07:57:18.041 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/fcrypt.ko 2023-03-30T07:57:18.041 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/khazad.ko 2023-03-30T07:57:18.041 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/lrw.ko 2023-03-30T07:57:18.042 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/lz4.ko 2023-03-30T07:57:18.042 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11089 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/lz4hc.ko 2023-03-30T07:57:18.042 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/md4.ko 2023-03-30T07:57:18.042 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/michael_mic.ko 2023-03-30T07:57:18.042 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/pcbc.ko 2023-03-30T07:57:18.042 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/pcrypt.ko 2023-03-30T07:57:18.042 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/rmd160.ko 2023-03-30T07:57:18.043 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/seed.ko 2023-03-30T07:57:18.043 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/serpent_generic.ko 2023-03-30T07:57:18.043 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 148761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/tcrypt.ko 2023-03-30T07:57:18.043 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/tea.ko 2023-03-30T07:57:18.043 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/twofish_common.ko 2023-03-30T07:57:18.043 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/twofish_generic.ko 2023-03-30T07:57:18.043 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/vmac.ko 2023-03-30T07:57:18.044 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/wp512.ko 2023-03-30T07:57:18.044 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/xcbc.ko 2023-03-30T07:57:18.044 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/xor.ko 2023-03-30T07:57:18.044 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/xts.ko 2023-03-30T07:57:18.044 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/xxhash_generic.ko 2023-03-30T07:57:18.044 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ 2023-03-30T07:57:18.044 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/ 2023-03-30T07:57:18.045 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/acpi_extlog.ko 2023-03-30T07:57:18.045 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/acpi_ipmi.ko 2023-03-30T07:57:18.045 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/acpi_pad.ko 2023-03-30T07:57:18.045 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/apei/ 2023-03-30T07:57:18.045 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/apei/einj.ko 2023-03-30T07:57:18.045 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/ec_sys.ko 2023-03-30T07:57:18.045 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/platform_profile.ko 2023-03-30T07:57:18.046 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/sbs.ko 2023-03-30T07:57:18.046 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/sbshc.ko 2023-03-30T07:57:18.046 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 99905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/video.ko 2023-03-30T07:57:18.046 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/ 2023-03-30T07:57:18.046 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/acard-ahci.ko 2023-03-30T07:57:18.046 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 88185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/ahci.ko 2023-03-30T07:57:18.047 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/ahci_platform.ko 2023-03-30T07:57:18.047 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 84753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/libahci.ko 2023-03-30T07:57:18.047 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/libahci_platform.ko 2023-03-30T07:57:18.047 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_acpi.ko 2023-03-30T07:57:18.047 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_ali.ko 2023-03-30T07:57:18.047 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_amd.ko 2023-03-30T07:57:18.047 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_artop.ko 2023-03-30T07:57:18.048 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_atiixp.ko 2023-03-30T07:57:18.048 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_atp867x.ko 2023-03-30T07:57:18.048 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17089 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_cmd640.ko 2023-03-30T07:57:18.048 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_cmd64x.ko 2023-03-30T07:57:18.048 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_cypress.ko 2023-03-30T07:57:18.048 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_efar.ko 2023-03-30T07:57:18.048 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_hpt366.ko 2023-03-30T07:57:18.048 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_hpt37x.ko 2023-03-30T07:57:18.049 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_hpt3x2n.ko 2023-03-30T07:57:18.049 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_hpt3x3.ko 2023-03-30T07:57:18.049 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_it8213.ko 2023-03-30T07:57:18.049 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_it821x.ko 2023-03-30T07:57:18.049 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_jmicron.ko 2023-03-30T07:57:18.049 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_legacy.ko 2023-03-30T07:57:18.050 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_marvell.ko 2023-03-30T07:57:18.050 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_mpiix.ko 2023-03-30T07:57:18.050 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_netcell.ko 2023-03-30T07:57:18.050 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_ninja32.ko 2023-03-30T07:57:18.050 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_ns87410.ko 2023-03-30T07:57:18.050 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_ns87415.ko 2023-03-30T07:57:18.050 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_oldpiix.ko 2023-03-30T07:57:18.051 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_opti.ko 2023-03-30T07:57:18.051 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_optidma.ko 2023-03-30T07:57:18.051 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_pcmcia.ko 2023-03-30T07:57:18.051 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_pdc2027x.ko 2023-03-30T07:57:18.051 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-03-30T07:57:18.051 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_piccolo.ko 2023-03-30T07:57:18.051 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_radisys.ko 2023-03-30T07:57:18.052 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_rdc.ko 2023-03-30T07:57:18.052 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_rz1000.ko 2023-03-30T07:57:18.052 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_sch.ko 2023-03-30T07:57:18.052 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_serverworks.ko 2023-03-30T07:57:18.052 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_sil680.ko 2023-03-30T07:57:18.052 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19129 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_sl82c105.ko 2023-03-30T07:57:18.052 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_triflex.ko 2023-03-30T07:57:18.053 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_via.ko 2023-03-30T07:57:18.053 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pdc_adma.ko 2023-03-30T07:57:18.053 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_inic162x.ko 2023-03-30T07:57:18.053 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 82793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_mv.ko 2023-03-30T07:57:18.053 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_nv.ko 2023-03-30T07:57:18.053 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_promise.ko 2023-03-30T07:57:18.053 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_qstor.ko 2023-03-30T07:57:18.054 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_sil.ko 2023-03-30T07:57:18.054 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_sil24.ko 2023-03-30T07:57:18.054 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_sis.ko 2023-03-30T07:57:18.054 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_svw.ko 2023-03-30T07:57:18.054 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_sx4.ko 2023-03-30T07:57:18.054 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_uli.ko 2023-03-30T07:57:18.054 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_via.ko 2023-03-30T07:57:18.055 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_vsc.ko 2023-03-30T07:57:18.055 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/auxdisplay/ 2023-03-30T07:57:18.055 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/auxdisplay/ks0108.ko 2023-03-30T07:57:18.055 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/bcma/ 2023-03-30T07:57:18.055 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 121249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/bcma/bcma.ko 2023-03-30T07:57:18.055 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/ 2023-03-30T07:57:18.055 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/aoe/ 2023-03-30T07:57:18.056 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 113145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/aoe/aoe.ko 2023-03-30T07:57:18.056 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/drbd/ 2023-03-30T07:57:18.056 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 963089 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/drbd/drbd.ko 2023-03-30T07:57:18.094 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 172809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/floppy.ko 2023-03-30T07:57:18.094 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/mtip32xx/ 2023-03-30T07:57:18.095 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 93865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-03-30T07:57:18.095 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 113657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/nbd.ko 2023-03-30T07:57:18.095 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/null_blk/ 2023-03-30T07:57:18.095 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 110577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/null_blk/null_blk.ko 2023-03-30T07:57:18.095 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 81753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/pktcdvd.ko 2023-03-30T07:57:18.095 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 253977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/rbd.ko 2023-03-30T07:57:18.095 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/xen-blkback/ 2023-03-30T07:57:18.096 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 97705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-03-30T07:57:18.096 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/zram/ 2023-03-30T07:57:18.096 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/zram/zram.ko 2023-03-30T07:57:18.096 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ 2023-03-30T07:57:18.096 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/applicom.ko 2023-03-30T07:57:18.096 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/hangcheck-timer.ko 2023-03-30T07:57:18.096 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/hw_random/ 2023-03-30T07:57:18.097 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/hw_random/amd-rng.ko 2023-03-30T07:57:18.097 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/hw_random/intel-rng.ko 2023-03-30T07:57:18.097 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-03-30T07:57:18.097 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/hw_random/via-rng.ko 2023-03-30T07:57:18.097 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15089 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/hw_random/virtio-rng.ko 2023-03-30T07:57:18.097 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ipmi/ 2023-03-30T07:57:18.097 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-03-30T07:57:18.098 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 147745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-03-30T07:57:18.098 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-03-30T07:57:18.098 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 138561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ipmi/ipmi_si.ko 2023-03-30T07:57:18.098 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-03-30T07:57:18.098 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-03-30T07:57:18.098 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/lp.ko 2023-03-30T07:57:18.098 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/mwave/ 2023-03-30T07:57:18.099 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 83625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/mwave/mwave.ko 2023-03-30T07:57:18.099 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/nvram.ko 2023-03-30T07:57:18.099 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/pcmcia/ 2023-03-30T07:57:18.099 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 102457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-03-30T07:57:18.099 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-03-30T07:57:18.099 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 83689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/pcmcia/synclink_cs.ko 2023-03-30T07:57:18.099 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ppdev.ko 2023-03-30T07:57:18.100 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tlclk.ko 2023-03-30T07:57:18.100 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/ 2023-03-30T07:57:18.100 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/tpm_atmel.ko 2023-03-30T07:57:18.100 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-03-30T07:57:18.100 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-03-30T07:57:18.100 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-03-30T07:57:18.100 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/tpm_infineon.ko 2023-03-30T07:57:18.101 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/tpm_nsc.ko 2023-03-30T07:57:18.101 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-03-30T07:57:18.101 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/xillybus/ 2023-03-30T07:57:18.101 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/xillybus/xillybus_class.ko 2023-03-30T07:57:18.101 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/xillybus/xillybus_core.ko 2023-03-30T07:57:18.101 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-03-30T07:57:18.101 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/clk/ 2023-03-30T07:57:18.102 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/clk/clk-palmas.ko 2023-03-30T07:57:18.102 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/clk/clk-si5351.ko 2023-03-30T07:57:18.102 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/clk/clk-twl6040.ko 2023-03-30T07:57:18.102 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/clk/clk-wm831x.ko 2023-03-30T07:57:18.102 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/cpufreq/ 2023-03-30T07:57:18.102 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-03-30T07:57:18.102 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/cpufreq/p4-clockmod.ko 2023-03-30T07:57:18.103 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/cpufreq/speedstep-lib.ko 2023-03-30T07:57:18.103 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/ 2023-03-30T07:57:18.103 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/ccp/ 2023-03-30T07:57:18.103 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-03-30T07:57:18.103 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 223113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/ccp/ccp.ko 2023-03-30T07:57:18.103 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/padlock-aes.ko 2023-03-30T07:57:18.103 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/padlock-sha.ko 2023-03-30T07:57:18.103 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/qat/ 2023-03-30T07:57:18.104 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/qat/qat_common/ 2023-03-30T07:57:18.104 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 397793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-03-30T07:57:18.104 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/qat/qat_dh895xcc/ 2023-03-30T07:57:18.104 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-03-30T07:57:18.104 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/virtio/ 2023-03-30T07:57:18.104 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 68121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-03-30T07:57:18.105 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/dca/ 2023-03-30T07:57:18.105 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/dca/dca.ko 2023-03-30T07:57:18.105 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/dma/ 2023-03-30T07:57:18.105 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/dma/dw/ 2023-03-30T07:57:18.105 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/dma/dw/dw_dmac.ko 2023-03-30T07:57:18.105 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/dma/ioat/ 2023-03-30T07:57:18.105 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 122841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/dma/ioat/ioatdma.ko 2023-03-30T07:57:18.106 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/ 2023-03-30T07:57:18.106 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 73825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/amd64_edac.ko 2023-03-30T07:57:18.106 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/e752x_edac.ko 2023-03-30T07:57:18.106 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/edac_mce_amd.ko 2023-03-30T07:57:18.106 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/i3000_edac.ko 2023-03-30T07:57:18.106 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/i3200_edac.ko 2023-03-30T07:57:18.106 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/i5100_edac.ko 2023-03-30T07:57:18.107 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/i5400_edac.ko 2023-03-30T07:57:18.107 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/i7300_edac.ko 2023-03-30T07:57:18.107 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/i7core_edac.ko 2023-03-30T07:57:18.107 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/i82975x_edac.ko 2023-03-30T07:57:18.107 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/ie31200_edac.ko 2023-03-30T07:57:18.107 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 56369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/sb_edac.ko 2023-03-30T07:57:18.107 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/x38_edac.ko 2023-03-30T07:57:18.108 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/ 2023-03-30T07:57:18.108 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/extcon-gpio.ko 2023-03-30T07:57:18.108 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/extcon-max14577.ko 2023-03-30T07:57:18.108 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/extcon-max77693.ko 2023-03-30T07:57:18.108 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/extcon-max8997.ko 2023-03-30T07:57:18.108 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/extcon-palmas.ko 2023-03-30T07:57:18.108 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/extcon-rt8973a.ko 2023-03-30T07:57:18.109 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/extcon-sm5502.ko 2023-03-30T07:57:18.109 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/firmware/ 2023-03-30T07:57:18.109 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/firmware/dmi-sysfs.ko 2023-03-30T07:57:18.109 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/firmware/efi/ 2023-03-30T07:57:18.109 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/firmware/efi/efi-pstore.ko 2023-03-30T07:57:18.109 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/firmware/iscsi_ibft.ko 2023-03-30T07:57:18.109 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/ 2023-03-30T07:57:18.110 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-adp5520.ko 2023-03-30T07:57:18.110 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-amd8111.ko 2023-03-30T07:57:18.110 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-arizona.ko 2023-03-30T07:57:18.110 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-da9052.ko 2023-03-30T07:57:18.110 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-da9055.ko 2023-03-30T07:57:18.110 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-dln2.ko 2023-03-30T07:57:18.110 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 77929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-f7188x.ko 2023-03-30T07:57:18.111 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-generic.ko 2023-03-30T07:57:18.111 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-ich.ko 2023-03-30T07:57:18.111 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-03-30T07:57:18.111 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-kempld.ko 2023-03-30T07:57:18.111 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-lp3943.ko 2023-03-30T07:57:18.111 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-max7300.ko 2023-03-30T07:57:18.111 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-max730x.ko 2023-03-30T07:57:18.112 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-max732x.ko 2023-03-30T07:57:18.112 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-03-30T07:57:18.112 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-pca953x.ko 2023-03-30T07:57:18.112 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-pcf857x.ko 2023-03-30T07:57:18.112 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-rdc321x.ko 2023-03-30T07:57:18.112 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-sch.ko 2023-03-30T07:57:18.112 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-sch311x.ko 2023-03-30T07:57:18.113 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-tps65912.ko 2023-03-30T07:57:18.113 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-twl4030.ko 2023-03-30T07:57:18.113 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-twl6040.ko 2023-03-30T07:57:18.113 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-viperboard.ko 2023-03-30T07:57:18.113 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-vx855.ko 2023-03-30T07:57:18.113 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-wm831x.ko 2023-03-30T07:57:18.113 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-wm8350.ko 2023-03-30T07:57:18.114 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-wm8994.ko 2023-03-30T07:57:18.114 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/ 2023-03-30T07:57:18.114 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-a4tech.ko 2023-03-30T07:57:18.114 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-apple.ko 2023-03-30T07:57:18.114 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-appleir.ko 2023-03-30T07:57:18.114 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-aureal.ko 2023-03-30T07:57:18.114 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-axff.ko 2023-03-30T07:57:18.115 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-belkin.ko 2023-03-30T07:57:18.115 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-cherry.ko 2023-03-30T07:57:18.115 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-chicony.ko 2023-03-30T07:57:18.115 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 58641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-cp2112.ko 2023-03-30T07:57:18.115 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-cypress.ko 2023-03-30T07:57:18.115 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-dr.ko 2023-03-30T07:57:18.115 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-elecom.ko 2023-03-30T07:57:18.116 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-elo.ko 2023-03-30T07:57:18.116 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-emsff.ko 2023-03-30T07:57:18.116 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-ezkey.ko 2023-03-30T07:57:18.116 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-gaff.ko 2023-03-30T07:57:18.116 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-generic.ko 2023-03-30T07:57:18.116 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-gt683r.ko 2023-03-30T07:57:18.116 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-gyration.ko 2023-03-30T07:57:18.117 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-holtek-kbd.ko 2023-03-30T07:57:18.117 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-holtek-mouse.ko 2023-03-30T07:57:18.117 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-holtekff.ko 2023-03-30T07:57:18.117 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-hyperv.ko 2023-03-30T07:57:18.117 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-icade.ko 2023-03-30T07:57:18.117 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-kensington.ko 2023-03-30T07:57:18.117 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-keytouch.ko 2023-03-30T07:57:18.118 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-kye.ko 2023-03-30T07:57:18.118 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-lcpower.ko 2023-03-30T07:57:18.118 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-led.ko 2023-03-30T07:57:18.118 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-lenovo.ko 2023-03-30T07:57:18.118 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-lg-g15.ko 2023-03-30T07:57:18.118 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-logitech-dj.ko 2023-03-30T07:57:18.118 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 94481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-03-30T07:57:18.119 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 80569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-logitech.ko 2023-03-30T07:57:18.119 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-magicmouse.ko 2023-03-30T07:57:18.119 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-microsoft.ko 2023-03-30T07:57:18.119 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-monterey.ko 2023-03-30T07:57:18.119 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-multitouch.ko 2023-03-30T07:57:18.119 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-ntrig.ko 2023-03-30T07:57:18.119 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-ortek.ko 2023-03-30T07:57:18.120 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-penmount.ko 2023-03-30T07:57:18.120 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-petalynx.ko 2023-03-30T07:57:18.120 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 72497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-picolcd.ko 2023-03-30T07:57:18.120 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-pl.ko 2023-03-30T07:57:18.120 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-plantronics.ko 2023-03-30T07:57:18.120 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-primax.ko 2023-03-30T07:57:18.120 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-rmi.ko 2023-03-30T07:57:18.121 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-arvo.ko 2023-03-30T07:57:18.121 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-common.ko 2023-03-30T07:57:18.121 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-isku.ko 2023-03-30T07:57:18.121 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-kone.ko 2023-03-30T07:57:18.121 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-03-30T07:57:18.121 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-konepure.ko 2023-03-30T07:57:18.121 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-03-30T07:57:18.122 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-lua.ko 2023-03-30T07:57:18.122 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-pyra.ko 2023-03-30T07:57:18.122 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-ryos.ko 2023-03-30T07:57:18.122 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-savu.ko 2023-03-30T07:57:18.122 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat.ko 2023-03-30T07:57:18.122 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-saitek.ko 2023-03-30T07:57:18.122 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-samsung.ko 2023-03-30T07:57:18.122 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-sensor-hub.ko 2023-03-30T07:57:18.123 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-sjoy.ko 2023-03-30T07:57:18.123 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-sony.ko 2023-03-30T07:57:18.123 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-speedlink.ko 2023-03-30T07:57:18.123 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-steelseries.ko 2023-03-30T07:57:18.123 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-sunplus.ko 2023-03-30T07:57:18.123 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-thrustmaster.ko 2023-03-30T07:57:18.123 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-tivo.ko 2023-03-30T07:57:18.124 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-tmff.ko 2023-03-30T07:57:18.124 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-topseed.ko 2023-03-30T07:57:18.124 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-twinhan.ko 2023-03-30T07:57:18.124 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 71017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-uclogic.ko 2023-03-30T07:57:18.124 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-waltop.ko 2023-03-30T07:57:18.124 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 143097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-wiimote.ko 2023-03-30T07:57:18.124 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-xinmo.ko 2023-03-30T07:57:18.125 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-zpff.ko 2023-03-30T07:57:18.125 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-zydacron.ko 2023-03-30T07:57:18.125 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 260673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid.ko 2023-03-30T07:57:18.125 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/uhid.ko 2023-03-30T07:57:18.125 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/usbhid/ 2023-03-30T07:57:18.125 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 124897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/usbhid/usbhid.ko 2023-03-30T07:57:18.125 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/usbhid/usbkbd.ko 2023-03-30T07:57:18.126 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/usbhid/usbmouse.ko 2023-03-30T07:57:18.126 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 215033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/wacom.ko 2023-03-30T07:57:18.126 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hv/ 2023-03-30T07:57:18.126 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hv/hv_balloon.ko 2023-03-30T07:57:18.126 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 89177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hv/hv_utils.ko 2023-03-30T07:57:18.126 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 296049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hv/hv_vmbus.ko 2023-03-30T07:57:18.126 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ 2023-03-30T07:57:18.127 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 66169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/abituguru.ko 2023-03-30T07:57:18.127 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/abituguru3.ko 2023-03-30T07:57:18.127 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/acpi_power_meter.ko 2023-03-30T07:57:18.127 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ad7414.ko 2023-03-30T07:57:18.127 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ad7418.ko 2023-03-30T07:57:18.127 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adc128d818.ko 2023-03-30T07:57:18.127 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adm1025.ko 2023-03-30T07:57:18.128 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 97537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adm1026.ko 2023-03-30T07:57:18.128 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adm1029.ko 2023-03-30T07:57:18.128 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adm1031.ko 2023-03-30T07:57:18.128 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adm9240.ko 2023-03-30T07:57:18.128 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ads7828.ko 2023-03-30T07:57:18.128 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adt7410.ko 2023-03-30T07:57:18.128 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adt7411.ko 2023-03-30T07:57:18.129 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 74009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adt7462.ko 2023-03-30T07:57:18.129 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adt7470.ko 2023-03-30T07:57:18.129 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 64393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adt7475.ko 2023-03-30T07:57:18.129 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adt7x10.ko 2023-03-30T07:57:18.129 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/amc6821.ko 2023-03-30T07:57:18.129 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/applesmc.ko 2023-03-30T07:57:18.129 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/asb100.ko 2023-03-30T07:57:18.130 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 58113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/asc7621.ko 2023-03-30T07:57:18.130 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/asus_atk0110.ko 2023-03-30T07:57:18.130 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/atxp1.ko 2023-03-30T07:57:18.130 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/coretemp.ko 2023-03-30T07:57:18.130 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/da9052-hwmon.ko 2023-03-30T07:57:18.130 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/da9055-hwmon.ko 2023-03-30T07:57:18.130 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-03-30T07:57:18.131 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 99161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/dme1737.ko 2023-03-30T07:57:18.131 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ds1621.ko 2023-03-30T07:57:18.131 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ds620.ko 2023-03-30T07:57:18.131 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/emc1403.ko 2023-03-30T07:57:18.131 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/emc2103.ko 2023-03-30T07:57:18.131 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/emc6w201.ko 2023-03-30T07:57:18.131 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 66481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/f71805f.ko 2023-03-30T07:57:18.132 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 94153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/f71882fg.ko 2023-03-30T07:57:18.132 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/f75375s.ko 2023-03-30T07:57:18.132 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/fam15h_power.ko 2023-03-30T07:57:18.132 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/fschmd.ko 2023-03-30T07:57:18.132 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/g760a.ko 2023-03-30T07:57:18.132 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/g762.ko 2023-03-30T07:57:18.132 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/gl518sm.ko 2023-03-30T07:57:18.133 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/gl520sm.ko 2023-03-30T07:57:18.133 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/hih6130.ko 2023-03-30T07:57:18.133 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/hwmon-vid.ko 2023-03-30T07:57:18.133 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/i5500_temp.ko 2023-03-30T07:57:18.133 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/i5k_amb.ko 2023-03-30T07:57:18.133 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ibmaem.ko 2023-03-30T07:57:18.133 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ibmpex.ko 2023-03-30T07:57:18.134 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ina209.ko 2023-03-30T07:57:18.134 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ina2xx.ko 2023-03-30T07:57:18.134 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 125729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/it87.ko 2023-03-30T07:57:18.134 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/jc42.ko 2023-03-30T07:57:18.134 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/k10temp.ko 2023-03-30T07:57:18.134 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/k8temp.ko 2023-03-30T07:57:18.134 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lineage-pem.ko 2023-03-30T07:57:18.135 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm63.ko 2023-03-30T07:57:18.135 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm73.ko 2023-03-30T07:57:18.135 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm75.ko 2023-03-30T07:57:18.135 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm77.ko 2023-03-30T07:57:18.135 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm78.ko 2023-03-30T07:57:18.135 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm80.ko 2023-03-30T07:57:18.136 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm83.ko 2023-03-30T07:57:18.136 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 72337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm85.ko 2023-03-30T07:57:18.136 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm87.ko 2023-03-30T07:57:18.136 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm90.ko 2023-03-30T07:57:18.136 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm92.ko 2023-03-30T07:57:18.136 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 108401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm93.ko 2023-03-30T07:57:18.136 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm95234.ko 2023-03-30T07:57:18.137 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm95241.ko 2023-03-30T07:57:18.137 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm95245.ko 2023-03-30T07:57:18.137 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ltc2945.ko 2023-03-30T07:57:18.137 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ltc4151.ko 2023-03-30T07:57:18.137 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ltc4215.ko 2023-03-30T07:57:18.137 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ltc4222.ko 2023-03-30T07:57:18.137 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ltc4245.ko 2023-03-30T07:57:18.138 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ltc4260.ko 2023-03-30T07:57:18.138 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ltc4261.ko 2023-03-30T07:57:18.138 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/max16065.ko 2023-03-30T07:57:18.138 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/max1619.ko 2023-03-30T07:57:18.138 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/max1668.ko 2023-03-30T07:57:18.138 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/max197.ko 2023-03-30T07:57:18.138 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/max6639.ko 2023-03-30T07:57:18.139 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/max6650.ko 2023-03-30T07:57:18.139 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/max6697.ko 2023-03-30T07:57:18.139 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/mc13783-adc.ko 2023-03-30T07:57:18.139 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/mcp3021.ko 2023-03-30T07:57:18.139 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-03-30T07:57:18.139 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/nct6683.ko 2023-03-30T07:57:18.139 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 114257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/nct6775-core.ko 2023-03-30T07:57:18.140 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/nct6775.ko 2023-03-30T07:57:18.140 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/nct7802.ko 2023-03-30T07:57:18.140 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 81849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pc87360.ko 2023-03-30T07:57:18.140 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pc87427.ko 2023-03-30T07:57:18.140 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pcf8591.ko 2023-03-30T07:57:18.140 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/ 2023-03-30T07:57:18.140 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-03-30T07:57:18.141 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-03-30T07:57:18.141 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-03-30T07:57:18.141 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/max16064.ko 2023-03-30T07:57:18.141 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/max34440.ko 2023-03-30T07:57:18.141 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/max8688.ko 2023-03-30T07:57:18.141 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-03-30T07:57:18.141 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 71425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-03-30T07:57:18.142 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-03-30T07:57:18.142 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-03-30T07:57:18.142 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-03-30T07:57:18.142 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-03-30T07:57:18.142 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/powr1220.ko 2023-03-30T07:57:18.142 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/sch5627.ko 2023-03-30T07:57:18.142 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/sch5636.ko 2023-03-30T07:57:18.143 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/sch56xx-common.ko 2023-03-30T07:57:18.143 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/sht15.ko 2023-03-30T07:57:18.143 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/sht21.ko 2023-03-30T07:57:18.143 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/shtc1.ko 2023-03-30T07:57:18.143 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/sis5595.ko 2023-03-30T07:57:18.143 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/smm665.ko 2023-03-30T07:57:18.143 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/smsc47b397.ko 2023-03-30T07:57:18.144 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/smsc47m1.ko 2023-03-30T07:57:18.144 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/smsc47m192.ko 2023-03-30T07:57:18.144 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/thmc50.ko 2023-03-30T07:57:18.144 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/tmp102.ko 2023-03-30T07:57:18.144 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/tmp103.ko 2023-03-30T07:57:18.144 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/tmp401.ko 2023-03-30T07:57:18.144 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/tmp421.ko 2023-03-30T07:57:18.145 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/via-cputemp.ko 2023-03-30T07:57:18.145 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/via686a.ko 2023-03-30T07:57:18.145 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/vt1211.ko 2023-03-30T07:57:18.145 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/vt8231.ko 2023-03-30T07:57:18.145 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83627ehf.ko 2023-03-30T07:57:18.145 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 78441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83627hf.ko 2023-03-30T07:57:18.145 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83781d.ko 2023-03-30T07:57:18.146 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83791d.ko 2023-03-30T07:57:18.146 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83792d.ko 2023-03-30T07:57:18.146 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 100953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83793.ko 2023-03-30T07:57:18.146 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 119009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83795.ko 2023-03-30T07:57:18.146 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83l785ts.ko 2023-03-30T07:57:18.146 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83l786ng.ko 2023-03-30T07:57:18.147 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-03-30T07:57:18.147 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-03-30T07:57:18.147 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/ 2023-03-30T07:57:18.147 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/algos/ 2023-03-30T07:57:18.147 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-03-30T07:57:18.147 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-03-30T07:57:18.147 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/ 2023-03-30T07:57:18.148 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-03-30T07:57:18.148 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-03-30T07:57:18.148 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-03-30T07:57:18.148 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-03-30T07:57:18.148 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-03-30T07:57:18.148 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-03-30T07:57:18.148 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-03-30T07:57:18.149 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 6201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-03-30T07:57:18.149 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-03-30T07:57:18.149 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-03-30T07:57:18.149 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-03-30T07:57:18.149 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-03-30T07:57:18.149 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-03-30T07:57:18.149 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-03-30T07:57:18.150 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-03-30T07:57:18.150 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-i801.ko 2023-03-30T07:57:18.150 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-isch.ko 2023-03-30T07:57:18.150 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-03-30T07:57:18.150 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-03-30T07:57:18.150 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-03-30T07:57:18.150 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-03-30T07:57:18.151 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-03-30T07:57:18.151 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-parport.ko 2023-03-30T07:57:18.151 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-03-30T07:57:18.151 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-03-30T07:57:18.151 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-03-30T07:57:18.151 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-03-30T07:57:18.151 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-03-30T07:57:18.152 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-03-30T07:57:18.152 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-03-30T07:57:18.152 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-03-30T07:57:18.152 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-03-30T07:57:18.152 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-03-30T07:57:18.152 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-via.ko 2023-03-30T07:57:18.152 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-03-30T07:57:18.153 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-03-30T07:57:18.153 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-03-30T07:57:18.153 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/i2c-mux.ko 2023-03-30T07:57:18.153 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/i2c-smbus.ko 2023-03-30T07:57:18.153 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/i2c-stub.ko 2023-03-30T07:57:18.153 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/muxes/ 2023-03-30T07:57:18.153 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-03-30T07:57:18.154 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-03-30T07:57:18.154 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-03-30T07:57:18.154 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ 2023-03-30T07:57:18.154 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/ 2023-03-30T07:57:18.154 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 264089 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/ib_cm.ko 2023-03-30T07:57:18.154 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 848881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/ib_core.ko 2023-03-30T07:57:18.154 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 68233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/ib_umad.ko 2023-03-30T07:57:18.155 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 321625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-03-30T07:57:18.155 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 96473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/iw_cm.ko 2023-03-30T07:57:18.155 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 271681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/rdma_cm.ko 2023-03-30T07:57:18.155 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-03-30T07:57:18.155 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/ 2023-03-30T07:57:18.155 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/cxgb4/ 2023-03-30T07:57:18.155 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 492057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-03-30T07:57:18.156 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/mlx4/ 2023-03-30T07:57:18.156 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 418801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-03-30T07:57:18.156 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/mlx5/ 2023-03-30T07:57:18.156 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 732713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-03-30T07:57:18.156 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/mthca/ 2023-03-30T07:57:18.156 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 296153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-03-30T07:57:18.156 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/ocrdma/ 2023-03-30T07:57:18.157 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 153241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-03-30T07:57:18.157 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/usnic/ 2023-03-30T07:57:18.157 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 168513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-03-30T07:57:18.157 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/ 2023-03-30T07:57:18.157 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/ipoib/ 2023-03-30T07:57:18.157 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 262729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-03-30T07:57:18.157 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/iser/ 2023-03-30T07:57:18.158 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 99785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-03-30T07:57:18.158 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/isert/ 2023-03-30T07:57:18.158 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 110705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-03-30T07:57:18.158 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/srp/ 2023-03-30T07:57:18.158 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 128705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-03-30T07:57:18.158 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/srpt/ 2023-03-30T07:57:18.158 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 130009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-03-30T07:57:18.159 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/ 2023-03-30T07:57:18.159 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/evbug.ko 2023-03-30T07:57:18.159 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/ff-memless.ko 2023-03-30T07:57:18.159 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/gameport/ 2023-03-30T07:57:18.159 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-03-30T07:57:18.159 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/gameport/fm801-gp.ko 2023-03-30T07:57:18.159 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/gameport/gameport.ko 2023-03-30T07:57:18.160 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/gameport/lightning.ko 2023-03-30T07:57:18.160 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/gameport/ns558.ko 2023-03-30T07:57:18.160 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/joydev.ko 2023-03-30T07:57:18.160 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/ 2023-03-30T07:57:18.160 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-03-30T07:57:18.160 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-03-30T07:57:18.160 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-03-30T07:57:18.161 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-03-30T07:57:18.161 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/gpio_keys.ko 2023-03-30T07:57:18.161 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-03-30T07:57:18.161 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/lkkbd.ko 2023-03-30T07:57:18.161 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/lm8323.ko 2023-03-30T07:57:18.161 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/lm8333.ko 2023-03-30T07:57:18.161 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-03-30T07:57:18.162 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-03-30T07:57:18.162 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-03-30T07:57:18.162 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-03-30T07:57:18.162 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/newtonkbd.ko 2023-03-30T07:57:18.162 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-03-30T07:57:18.162 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/qt1070.ko 2023-03-30T07:57:18.162 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/qt2160.ko 2023-03-30T07:57:18.163 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-03-30T07:57:18.163 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/stowaway.ko 2023-03-30T07:57:18.163 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/sunkbd.ko 2023-03-30T07:57:18.163 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-03-30T07:57:18.163 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-03-30T07:57:18.163 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-03-30T07:57:18.163 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/xtkbd.ko 2023-03-30T07:57:18.164 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/matrix-keymap.ko 2023-03-30T07:57:18.164 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/ 2023-03-30T07:57:18.164 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/appletouch.ko 2023-03-30T07:57:18.164 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/bcm5974.ko 2023-03-30T07:57:18.164 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 122977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/cyapatp.ko 2023-03-30T07:57:18.164 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 88929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/elan_i2c.ko 2023-03-30T07:57:18.164 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/gpio_mouse.ko 2023-03-30T07:57:18.165 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 334057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/psmouse.ko 2023-03-30T07:57:18.165 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/sermouse.ko 2023-03-30T07:57:18.165 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-03-30T07:57:18.165 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/synaptics_usb.ko 2023-03-30T07:57:18.165 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/vsxxxaa.ko 2023-03-30T07:57:18.165 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/rmi4/ 2023-03-30T07:57:18.165 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 107777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/rmi4/rmi_core.ko 2023-03-30T07:57:18.166 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/ 2023-03-30T07:57:18.166 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/altera_ps2.ko 2023-03-30T07:57:18.166 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/arc_ps2.ko 2023-03-30T07:57:18.166 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/ct82c710.ko 2023-03-30T07:57:18.166 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-03-30T07:57:18.166 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/parkbd.ko 2023-03-30T07:57:18.166 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/pcips2.ko 2023-03-30T07:57:18.167 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/ps2mult.ko 2023-03-30T07:57:18.167 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/serio_raw.ko 2023-03-30T07:57:18.167 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/serport.ko 2023-03-30T07:57:18.167 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/sparse-keymap.ko 2023-03-30T07:57:18.167 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/iommu/ 2023-03-30T07:57:18.167 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/iommu/amd/ 2023-03-30T07:57:18.167 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/iommu/amd/iommu_v2.ko 2023-03-30T07:57:18.168 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/ 2023-03-30T07:57:18.168 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-88pm860x.ko 2023-03-30T07:57:18.168 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-adp5520.ko 2023-03-30T07:57:18.168 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-bd2802.ko 2023-03-30T07:57:18.168 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-blinkm.ko 2023-03-30T07:57:18.168 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-da903x.ko 2023-03-30T07:57:18.168 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-da9052.ko 2023-03-30T07:57:18.168 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-gpio.ko 2023-03-30T07:57:18.169 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-lm3530.ko 2023-03-30T07:57:18.169 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-lm3533.ko 2023-03-30T07:57:18.169 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-lm355x.ko 2023-03-30T07:57:18.169 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-lm3642.ko 2023-03-30T07:57:18.169 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-lp3944.ko 2023-03-30T07:57:18.169 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-lp8788.ko 2023-03-30T07:57:18.169 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-max8997.ko 2023-03-30T07:57:18.170 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-mc13783.ko 2023-03-30T07:57:18.170 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-menf21bmc.ko 2023-03-30T07:57:18.170 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-pca9532.ko 2023-03-30T07:57:18.170 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-pca955x.ko 2023-03-30T07:57:18.170 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-pca963x.ko 2023-03-30T07:57:18.170 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-ss4200.ko 2023-03-30T07:57:18.170 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-tca6507.ko 2023-03-30T07:57:18.171 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-wm831x-status.ko 2023-03-30T07:57:18.171 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-wm8350.ko 2023-03-30T07:57:18.171 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ 2023-03-30T07:57:18.171 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-03-30T07:57:18.171 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-03-30T07:57:18.171 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-03-30T07:57:18.171 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-03-30T07:57:18.172 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-03-30T07:57:18.172 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-03-30T07:57:18.172 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-03-30T07:57:18.172 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-03-30T07:57:18.172 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-03-30T07:57:18.172 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/ 2023-03-30T07:57:18.172 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/bcache/ 2023-03-30T07:57:18.173 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 631593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/bcache/bcache.ko 2023-03-30T07:57:18.173 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-bio-prison.ko 2023-03-30T07:57:18.173 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 79553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-bufio.ko 2023-03-30T07:57:18.173 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-cache-smq.ko 2023-03-30T07:57:18.173 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 153889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-cache.ko 2023-03-30T07:57:18.173 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 105449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-crypt.ko 2023-03-30T07:57:18.173 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-delay.ko 2023-03-30T07:57:18.174 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-era.ko 2023-03-30T07:57:18.174 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-flakey.ko 2023-03-30T07:57:18.174 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-log-userspace.ko 2023-03-30T07:57:18.174 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-log.ko 2023-03-30T07:57:18.174 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-mirror.ko 2023-03-30T07:57:18.174 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 77297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-multipath.ko 2023-03-30T07:57:18.174 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-queue-length.ko 2023-03-30T07:57:18.175 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-raid.ko 2023-03-30T07:57:18.175 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-region-hash.ko 2023-03-30T07:57:18.175 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-round-robin.ko 2023-03-30T07:57:18.175 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-service-time.ko 2023-03-30T07:57:18.175 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 108881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-snapshot.ko 2023-03-30T07:57:18.175 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-switch.ko 2023-03-30T07:57:18.175 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 181193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-thin-pool.ko 2023-03-30T07:57:18.176 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-verity.ko 2023-03-30T07:57:18.176 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-zero.ko 2023-03-30T07:57:18.176 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/faulty.ko 2023-03-30T07:57:18.176 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/linear.ko 2023-03-30T07:57:18.176 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/multipath.ko 2023-03-30T07:57:18.176 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/persistent-data/ 2023-03-30T07:57:18.176 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 192417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-03-30T07:57:18.177 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/raid0.ko 2023-03-30T07:57:18.177 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 111041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/raid1.ko 2023-03-30T07:57:18.177 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 158385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/raid10.ko 2023-03-30T07:57:18.177 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 391841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/raid456.ko 2023-03-30T07:57:18.177 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/ 2023-03-30T07:57:18.177 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/ 2023-03-30T07:57:18.177 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 174009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/mptbase.ko 2023-03-30T07:57:18.178 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/mptctl.ko 2023-03-30T07:57:18.178 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/mptfc.ko 2023-03-30T07:57:18.178 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/mptlan.ko 2023-03-30T07:57:18.178 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 122801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/mptsas.ko 2023-03-30T07:57:18.178 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 75937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/mptscsih.ko 2023-03-30T07:57:18.178 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/mptspi.ko 2023-03-30T07:57:18.178 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/ 2023-03-30T07:57:18.179 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/88pm800.ko 2023-03-30T07:57:18.179 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/88pm805.ko 2023-03-30T07:57:18.179 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/88pm80x.ko 2023-03-30T07:57:18.179 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/arizona-i2c.ko 2023-03-30T07:57:18.179 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 121913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/arizona.ko 2023-03-30T07:57:18.180 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/bcm590xx.ko 2023-03-30T07:57:18.180 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/cros_ec_dev.ko 2023-03-30T07:57:18.180 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/dln2.ko 2023-03-30T07:57:18.180 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/janz-cmodio.ko 2023-03-30T07:57:18.180 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/kempld-core.ko 2023-03-30T07:57:18.180 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/lm3533-core.ko 2023-03-30T07:57:18.180 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-03-30T07:57:18.181 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/lp3943.ko 2023-03-30T07:57:18.181 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/lpc_ich.ko 2023-03-30T07:57:18.181 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/lpc_sch.ko 2023-03-30T07:57:18.181 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/max8907.ko 2023-03-30T07:57:18.181 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/mc13xxx-core.ko 2023-03-30T07:57:18.181 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-03-30T07:57:18.181 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/menf21bmc.ko 2023-03-30T07:57:18.182 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/pcf50633-adc.ko 2023-03-30T07:57:18.182 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/pcf50633-gpio.ko 2023-03-30T07:57:18.182 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/pcf50633.ko 2023-03-30T07:57:18.182 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-03-30T07:57:18.182 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/retu-mfd.ko 2023-03-30T07:57:18.182 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 76113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/si476x-core.ko 2023-03-30T07:57:18.182 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/sm501.ko 2023-03-30T07:57:18.183 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-03-30T07:57:18.183 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/tps65010.ko 2023-03-30T07:57:18.183 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/tps6507x.ko 2023-03-30T07:57:18.183 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/viperboard.ko 2023-03-30T07:57:18.183 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/vx855.ko 2023-03-30T07:57:18.183 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/wl1273-core.ko 2023-03-30T07:57:18.183 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/wm8994.ko 2023-03-30T07:57:18.184 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ 2023-03-30T07:57:18.184 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-03-30T07:57:18.184 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ad525x_dpot.ko 2023-03-30T07:57:18.184 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/altera-stapl/ 2023-03-30T07:57:18.184 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-03-30T07:57:18.184 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/apds9802als.ko 2023-03-30T07:57:18.184 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/apds990x.ko 2023-03-30T07:57:18.185 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/bh1770glc.ko 2023-03-30T07:57:18.185 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/c2port/ 2023-03-30T07:57:18.185 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-03-30T07:57:18.185 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/c2port/core.ko 2023-03-30T07:57:18.185 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/cb710/ 2023-03-30T07:57:18.185 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/cb710/cb710.ko 2023-03-30T07:57:18.185 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ds1682.ko 2023-03-30T07:57:18.186 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/dummy-irq.ko 2023-03-30T07:57:18.186 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/echo/ 2023-03-30T07:57:18.186 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/echo/echo.ko 2023-03-30T07:57:18.186 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/eeprom/ 2023-03-30T07:57:18.186 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/eeprom/at24.ko 2023-03-30T07:57:18.186 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/eeprom/eeprom.ko 2023-03-30T07:57:18.186 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-03-30T07:57:18.187 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/eeprom/max6875.ko 2023-03-30T07:57:18.187 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/enclosure.ko 2023-03-30T07:57:18.187 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/genwqe/ 2023-03-30T07:57:18.187 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 151777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-03-30T07:57:18.187 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/hmc6352.ko 2023-03-30T07:57:18.187 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/hpilo.ko 2023-03-30T07:57:18.187 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ibmasm/ 2023-03-30T07:57:18.188 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 72177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-03-30T07:57:18.188 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ics932s401.ko 2023-03-30T07:57:18.188 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/isl29003.ko 2023-03-30T07:57:18.188 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/isl29020.ko 2023-03-30T07:57:18.188 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/lis3lv02d/ 2023-03-30T07:57:18.188 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-03-30T07:57:18.188 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-03-30T07:57:18.189 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/mei/ 2023-03-30T07:57:18.189 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 123577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/mei/mei-me.ko 2023-03-30T07:57:18.189 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 56017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/mei/mei-txe.ko 2023-03-30T07:57:18.189 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 304113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/mei/mei.ko 2023-03-30T07:57:18.189 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30921 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/phantom.ko 2023-03-30T07:57:18.189 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ti-st/ 2023-03-30T07:57:18.189 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 74113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ti-st/st_drv.ko 2023-03-30T07:57:18.190 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/tifm_7xx1.ko 2023-03-30T07:57:18.190 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/tifm_core.ko 2023-03-30T07:57:18.190 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/tsl2550.ko 2023-03-30T07:57:18.190 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/vmw_balloon.ko 2023-03-30T07:57:18.190 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/vmw_vmci/ 2023-03-30T07:57:18.190 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 180377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-03-30T07:57:18.190 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ 2023-03-30T07:57:18.190 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/bonding/ 2023-03-30T07:57:18.191 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 484865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/bonding/bonding.ko 2023-03-30T07:57:18.191 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dsa/ 2023-03-30T07:57:18.191 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dsa/b53/ 2023-03-30T07:57:18.191 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 98553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dsa/b53/b53_common.ko 2023-03-30T07:57:18.191 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dsa/bcm-sf2.ko 2023-03-30T07:57:18.191 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dsa/mv88e6060.ko 2023-03-30T07:57:18.191 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dsa/mv88e6xxx/ 2023-03-30T07:57:18.192 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 446497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-03-30T07:57:18.192 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dummy.ko 2023-03-30T07:57:18.192 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/eql.ko 2023-03-30T07:57:18.192 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/ 2023-03-30T07:57:18.192 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/3com/ 2023-03-30T07:57:18.192 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-03-30T07:57:18.192 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-03-30T07:57:18.193 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 130081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-03-30T07:57:18.193 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 68353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-03-30T07:57:18.193 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/8390/ 2023-03-30T07:57:18.193 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/8390/8390.ko 2023-03-30T07:57:18.193 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-03-30T07:57:18.193 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-03-30T07:57:18.193 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 98625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-03-30T07:57:18.194 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/adaptec/ 2023-03-30T07:57:18.194 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-03-30T07:57:18.194 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/agere/ 2023-03-30T07:57:18.194 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 68713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/agere/et131x.ko 2023-03-30T07:57:18.194 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/alteon/ 2023-03-30T07:57:18.194 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-03-30T07:57:18.195 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/altera/ 2023-03-30T07:57:18.195 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-03-30T07:57:18.195 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/amd/ 2023-03-30T07:57:18.195 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-03-30T07:57:18.195 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-03-30T07:57:18.196 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 86849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-03-30T07:57:18.196 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/ 2023-03-30T07:57:18.196 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/alx/ 2023-03-30T07:57:18.196 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 97153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-03-30T07:57:18.196 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-03-30T07:57:18.196 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 104297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-03-30T07:57:18.196 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-03-30T07:57:18.196 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 89745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-03-30T07:57:18.197 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/atlx/ 2023-03-30T07:57:18.197 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 80993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-03-30T07:57:18.197 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 69273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-03-30T07:57:18.197 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/ 2023-03-30T07:57:18.197 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 77881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-03-30T07:57:18.197 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 176761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-03-30T07:57:18.197 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-03-30T07:57:18.198 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1422009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-03-30T07:57:18.243 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 127561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-03-30T07:57:18.243 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/genet/ 2023-03-30T07:57:18.243 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 130553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-03-30T07:57:18.243 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 311593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-03-30T07:57:18.244 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/brocade/ 2023-03-30T07:57:18.244 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/brocade/bna/ 2023-03-30T07:57:18.244 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 323097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-03-30T07:57:18.244 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/ 2023-03-30T07:57:18.244 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-03-30T07:57:18.244 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 193001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-03-30T07:57:18.244 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-03-30T07:57:18.244 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 345433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-03-30T07:57:18.245 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-03-30T07:57:18.245 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1038497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-03-30T07:57:18.245 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-03-30T07:57:18.245 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 165945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-03-30T07:57:18.245 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-03-30T07:57:18.245 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-03-30T07:57:18.245 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/cisco/ 2023-03-30T07:57:18.246 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/cisco/enic/ 2023-03-30T07:57:18.246 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 203169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-03-30T07:57:18.246 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/ 2023-03-30T07:57:18.246 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/tulip/ 2023-03-30T07:57:18.246 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 68953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-03-30T07:57:18.246 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-03-30T07:57:18.246 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 140721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-03-30T07:57:18.247 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-03-30T07:57:18.247 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-03-30T07:57:18.247 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-03-30T07:57:18.247 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dlink/ 2023-03-30T07:57:18.247 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-03-30T07:57:18.247 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-03-30T07:57:18.247 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dnet.ko 2023-03-30T07:57:18.248 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/ec_bhf.ko 2023-03-30T07:57:18.248 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/emulex/ 2023-03-30T07:57:18.248 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/emulex/benet/ 2023-03-30T07:57:18.248 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 280937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-03-30T07:57:18.248 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/ethoc.ko 2023-03-30T07:57:18.248 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/fealnx.ko 2023-03-30T07:57:18.248 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/fujitsu/ 2023-03-30T07:57:18.248 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-03-30T07:57:18.249 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/ 2023-03-30T07:57:18.249 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 89969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/e100.ko 2023-03-30T07:57:18.249 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/e1000/ 2023-03-30T07:57:18.249 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 295217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-03-30T07:57:18.249 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/e1000e/ 2023-03-30T07:57:18.249 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 583553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-03-30T07:57:18.249 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/fm10k/ 2023-03-30T07:57:18.249 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 245881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-03-30T07:57:18.250 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/i40e/ 2023-03-30T07:57:18.250 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 918193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-03-30T07:57:18.250 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/iavf/ 2023-03-30T07:57:18.250 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 302961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-03-30T07:57:18.250 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/igb/ 2023-03-30T07:57:18.250 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 513361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-03-30T07:57:18.250 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/igbvf/ 2023-03-30T07:57:18.250 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 91417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-03-30T07:57:18.251 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/ixgb/ 2023-03-30T07:57:18.251 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 124121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-03-30T07:57:18.251 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-03-30T07:57:18.251 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 733809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-03-30T07:57:18.251 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-03-30T07:57:18.251 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 151361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-03-30T07:57:18.251 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 86417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/jme.ko 2023-03-30T07:57:18.252 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/marvell/ 2023-03-30T07:57:18.252 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-03-30T07:57:18.252 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 101889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/marvell/skge.ko 2023-03-30T07:57:18.252 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 122185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-03-30T07:57:18.252 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/mellanox/ 2023-03-30T07:57:18.252 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-03-30T07:57:18.252 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 709977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-03-30T07:57:18.252 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 280017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-03-30T07:57:18.253 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-03-30T07:57:18.253 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-03-30T07:57:18.253 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1034713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-03-30T07:57:18.253 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/micrel/ 2023-03-30T07:57:18.253 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-03-30T07:57:18.253 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-03-30T07:57:18.253 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19129 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-03-30T07:57:18.254 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 95169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-03-30T07:57:18.254 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/myricom/ 2023-03-30T07:57:18.254 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-03-30T07:57:18.254 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 108305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-03-30T07:57:18.254 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/natsemi/ 2023-03-30T07:57:18.254 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 72945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-03-30T07:57:18.254 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-03-30T07:57:18.254 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/neterion/ 2023-03-30T07:57:18.255 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 150401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-03-30T07:57:18.255 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/nvidia/ 2023-03-30T07:57:18.255 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 136281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-03-30T07:57:18.255 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/packetengines/ 2023-03-30T07:57:18.255 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-03-30T07:57:18.255 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-03-30T07:57:18.255 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/qlogic/ 2023-03-30T07:57:18.255 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-03-30T07:57:18.256 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 227049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-03-30T07:57:18.256 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 86585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-03-30T07:57:18.256 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-03-30T07:57:18.256 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 671177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-03-30T07:57:18.256 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/rdc/ 2023-03-30T07:57:18.256 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-03-30T07:57:18.256 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/realtek/ 2023-03-30T07:57:18.256 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 66881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-03-30T07:57:18.257 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 83481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-03-30T07:57:18.257 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/realtek/atp.ko 2023-03-30T07:57:18.257 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 183017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-03-30T07:57:18.257 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/samsung/ 2023-03-30T07:57:18.257 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-03-30T07:57:18.257 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 103713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-03-30T07:57:18.257 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sfc/ 2023-03-30T07:57:18.258 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 862513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-03-30T07:57:18.258 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/silan/ 2023-03-30T07:57:18.258 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-03-30T07:57:18.258 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sis/ 2023-03-30T07:57:18.258 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sis/sis190.ko 2023-03-30T07:57:18.258 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 62841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sis/sis900.ko 2023-03-30T07:57:18.258 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/smsc/ 2023-03-30T07:57:18.258 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 61105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-03-30T07:57:18.259 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 66689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-03-30T07:57:18.259 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 72881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-03-30T07:57:18.259 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 67777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-03-30T07:57:18.259 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/stmicro/ 2023-03-30T07:57:18.259 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-03-30T07:57:18.259 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-03-30T07:57:18.259 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-03-30T07:57:18.259 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-03-30T07:57:18.260 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 475081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-03-30T07:57:18.260 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sun/ 2023-03-30T07:57:18.260 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 102945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sun/cassini.ko 2023-03-30T07:57:18.260 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 166097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sun/niu.ko 2023-03-30T07:57:18.260 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sun/sungem.ko 2023-03-30T07:57:18.260 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 83257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-03-30T07:57:18.260 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/tehuti/ 2023-03-30T07:57:18.260 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-03-30T07:57:18.261 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/ti/ 2023-03-30T07:57:18.261 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 86025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/ti/tlan.ko 2023-03-30T07:57:18.261 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/via/ 2023-03-30T07:57:18.261 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 79761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-03-30T07:57:18.261 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 83169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-03-30T07:57:18.261 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/wiznet/ 2023-03-30T07:57:18.261 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 45289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-03-30T07:57:18.262 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-03-30T07:57:18.262 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/xircom/ 2023-03-30T07:57:18.262 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 58025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-03-30T07:57:18.262 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/fddi/ 2023-03-30T07:57:18.262 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/fddi/defxx.ko 2023-03-30T07:57:18.262 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/fddi/skfp/ 2023-03-30T07:57:18.262 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 216481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/fddi/skfp/skfp.ko 2023-03-30T07:57:18.262 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 76673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/geneve.ko 2023-03-30T07:57:18.263 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/hyperv/ 2023-03-30T07:57:18.263 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 234841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-03-30T07:57:18.263 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ieee802154/ 2023-03-30T07:57:18.263 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ieee802154/fakelb.ko 2023-03-30T07:57:18.263 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ifb.ko 2023-03-30T07:57:18.263 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ipvlan/ 2023-03-30T07:57:18.263 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 82705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ipvlan/ipvlan.ko 2023-03-30T07:57:18.263 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/macvlan.ko 2023-03-30T07:57:18.264 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/macvtap.ko 2023-03-30T07:57:18.264 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/mdio/ 2023-03-30T07:57:18.264 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-03-30T07:57:18.264 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-03-30T07:57:18.264 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/mdio/mdio-gpio.ko 2023-03-30T07:57:18.264 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/mdio.ko 2023-03-30T07:57:18.264 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/mii.ko 2023-03-30T07:57:18.264 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/netconsole.ko 2023-03-30T07:57:18.265 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/nlmon.ko 2023-03-30T07:57:18.265 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/pcs/ 2023-03-30T07:57:18.265 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-03-30T07:57:18.265 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-03-30T07:57:18.265 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/ 2023-03-30T07:57:18.265 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/amd.ko 2023-03-30T07:57:18.265 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-03-30T07:57:18.266 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/bcm7xxx.ko 2023-03-30T07:57:18.266 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/bcm87xx.ko 2023-03-30T07:57:18.266 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/broadcom.ko 2023-03-30T07:57:18.266 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/cicada.ko 2023-03-30T07:57:18.266 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/davicom.ko 2023-03-30T07:57:18.266 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/et1011c.ko 2023-03-30T07:57:18.266 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/icplus.ko 2023-03-30T07:57:18.266 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/lxt.ko 2023-03-30T07:57:18.267 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 75673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/marvell.ko 2023-03-30T07:57:18.267 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 74561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/micrel.ko 2023-03-30T07:57:18.267 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/national.ko 2023-03-30T07:57:18.267 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 91361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/phylink.ko 2023-03-30T07:57:18.267 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/qsemi.ko 2023-03-30T07:57:18.267 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/realtek.ko 2023-03-30T07:57:18.267 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/smsc.ko 2023-03-30T07:57:18.267 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/ste10Xp.ko 2023-03-30T07:57:18.268 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/vitesse.ko 2023-03-30T07:57:18.268 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/plip/ 2023-03-30T07:57:18.268 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/plip/plip.ko 2023-03-30T07:57:18.268 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/ 2023-03-30T07:57:18.268 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/bsd_comp.ko 2023-03-30T07:57:18.268 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/ppp_async.ko 2023-03-30T07:57:18.268 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/ppp_deflate.ko 2023-03-30T07:57:18.268 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/ppp_mppe.ko 2023-03-30T07:57:18.269 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/ppp_synctty.ko 2023-03-30T07:57:18.269 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/pppoe.ko 2023-03-30T07:57:18.269 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/pppox.ko 2023-03-30T07:57:18.269 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/pptp.ko 2023-03-30T07:57:18.269 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/sb1000.ko 2023-03-30T07:57:18.269 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/slip/ 2023-03-30T07:57:18.269 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/slip/slip.ko 2023-03-30T07:57:18.270 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/sungem_phy.ko 2023-03-30T07:57:18.270 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 63113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/tap.ko 2023-03-30T07:57:18.270 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/team/ 2023-03-30T07:57:18.270 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 104289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/team/team.ko 2023-03-30T07:57:18.270 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/team/team_mode_activebackup.ko 2023-03-30T07:57:18.270 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/team/team_mode_broadcast.ko 2023-03-30T07:57:18.270 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-03-30T07:57:18.270 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/team/team_mode_random.ko 2023-03-30T07:57:18.271 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-03-30T07:57:18.271 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 86649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/veth.ko 2023-03-30T07:57:18.271 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/vmxnet3/ 2023-03-30T07:57:18.271 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 119985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-03-30T07:57:18.271 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/vxlan/ 2023-03-30T07:57:18.271 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 238977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/vxlan/vxlan.ko 2023-03-30T07:57:18.271 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/xen-netback/ 2023-03-30T07:57:18.271 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 143225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/xen-netback/xen-netback.ko 2023-03-30T07:57:18.272 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ntb/ 2023-03-30T07:57:18.272 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ntb/ntb.ko 2023-03-30T07:57:18.272 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/nvme/ 2023-03-30T07:57:18.272 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/nvme/host/ 2023-03-30T07:57:18.272 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 257481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/nvme/host/nvme-core.ko 2023-03-30T07:57:18.272 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 101281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/nvme/host/nvme.ko 2023-03-30T07:57:18.272 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/parport/ 2023-03-30T07:57:18.272 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 128697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/parport/parport.ko 2023-03-30T07:57:18.273 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/parport/parport_cs.ko 2023-03-30T07:57:18.273 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 83385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/parport/parport_pc.ko 2023-03-30T07:57:18.273 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/parport/parport_serial.ko 2023-03-30T07:57:18.273 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pci/ 2023-03-30T07:57:18.273 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pci/hotplug/ 2023-03-30T07:57:18.273 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-03-30T07:57:18.273 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-03-30T07:57:18.273 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-03-30T07:57:18.274 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pci/pci-stub.ko 2023-03-30T07:57:18.274 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pci/xen-pcifront.ko 2023-03-30T07:57:18.274 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pcmcia/ 2023-03-30T07:57:18.274 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pcmcia/i82092.ko 2023-03-30T07:57:18.274 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 143273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pcmcia/pcmcia.ko 2023-03-30T07:57:18.274 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pcmcia/pcmcia_core.ko 2023-03-30T07:57:18.274 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-03-30T07:57:18.274 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pcmcia/pd6729.ko 2023-03-30T07:57:18.275 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 112481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pcmcia/yenta_socket.ko 2023-03-30T07:57:18.275 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/phy/ 2023-03-30T07:57:18.275 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/phy/broadcom/ 2023-03-30T07:57:18.275 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-03-30T07:57:18.275 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/phy/samsung/ 2023-03-30T07:57:18.275 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-03-30T07:57:18.275 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pinctrl/ 2023-03-30T07:57:18.276 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pinctrl/intel/ 2023-03-30T07:57:18.276 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-03-30T07:57:18.276 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/ 2023-03-30T07:57:18.276 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/ 2023-03-30T07:57:18.276 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-03-30T07:57:18.276 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/cros_ec.ko 2023-03-30T07:57:18.276 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-03-30T07:57:18.276 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-03-30T07:57:18.277 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-03-30T07:57:18.277 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-03-30T07:57:18.277 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-03-30T07:57:18.277 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/ 2023-03-30T07:57:18.277 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 66617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/acer-wmi.ko 2023-03-30T07:57:18.277 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/acerhdf.ko 2023-03-30T07:57:18.277 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/apple-gmux.ko 2023-03-30T07:57:18.278 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/asus-laptop.ko 2023-03-30T07:57:18.278 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-03-30T07:57:18.278 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 105913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/asus-wmi.ko 2023-03-30T07:57:18.278 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/classmate-laptop.ko 2023-03-30T07:57:18.278 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-03-30T07:57:18.278 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-03-30T07:57:18.278 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-03-30T07:57:18.278 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-03-30T07:57:18.279 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/hdaps.ko 2023-03-30T07:57:18.279 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/ibm_rtl.ko 2023-03-30T07:57:18.279 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/intel/ 2023-03-30T07:57:18.279 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-03-30T07:57:18.279 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-03-30T07:57:18.279 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/intel_ips.ko 2023-03-30T07:57:18.279 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/msi-wmi.ko 2023-03-30T07:57:18.280 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/mxm-wmi.ko 2023-03-30T07:57:18.280 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-03-30T07:57:18.280 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/samsung-laptop.ko 2023-03-30T07:57:18.280 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/samsung-q10.ko 2023-03-30T07:57:18.280 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/topstar-laptop.ko 2023-03-30T07:57:18.280 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-03-30T07:57:18.280 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/toshiba_haps.ko 2023-03-30T07:57:18.281 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/wmi-bmof.ko 2023-03-30T07:57:18.281 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/wmi.ko 2023-03-30T07:57:18.281 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/ 2023-03-30T07:57:18.281 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/ 2023-03-30T07:57:18.281 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/88pm860x_battery.ko 2023-03-30T07:57:18.281 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/88pm860x_charger.ko 2023-03-30T07:57:18.281 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/bq2415x_charger.ko 2023-03-30T07:57:18.282 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/bq24190_charger.ko 2023-03-30T07:57:18.282 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/bq24735-charger.ko 2023-03-30T07:57:18.282 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-03-30T07:57:18.282 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/da9030_battery.ko 2023-03-30T07:57:18.282 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/da9052-battery.ko 2023-03-30T07:57:18.282 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/ds2760_battery.ko 2023-03-30T07:57:18.282 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/ds2780_battery.ko 2023-03-30T07:57:18.282 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22921 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/ds2781_battery.ko 2023-03-30T07:57:18.283 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/ds2782_battery.ko 2023-03-30T07:57:18.283 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/gpio-charger.ko 2023-03-30T07:57:18.283 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/isp1704_charger.ko 2023-03-30T07:57:18.283 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/lp8727_charger.ko 2023-03-30T07:57:18.283 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/max14577_charger.ko 2023-03-30T07:57:18.283 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/max17040_battery.ko 2023-03-30T07:57:18.283 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/max17042_battery.ko 2023-03-30T07:57:18.283 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/max8903_charger.ko 2023-03-30T07:57:18.284 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/max8925_power.ko 2023-03-30T07:57:18.284 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/pcf50633-charger.ko 2023-03-30T07:57:18.284 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/sbs-battery.ko 2023-03-30T07:57:18.284 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/test_power.ko 2023-03-30T07:57:18.284 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/tps65090-charger.ko 2023-03-30T07:57:18.284 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/wm831x_backup.ko 2023-03-30T07:57:18.284 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/wm831x_power.ko 2023-03-30T07:57:18.284 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/wm8350_power.ko 2023-03-30T07:57:18.285 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/powercap/ 2023-03-30T07:57:18.285 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/powercap/intel_rapl_common.ko 2023-03-30T07:57:18.285 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/powercap/intel_rapl_msr.ko 2023-03-30T07:57:18.285 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pps/ 2023-03-30T07:57:18.285 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pps/clients/ 2023-03-30T07:57:18.285 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pps/clients/pps-gpio.ko 2023-03-30T07:57:18.285 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pps/clients/pps-ldisc.ko 2023-03-30T07:57:18.286 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pps/clients/pps_parport.ko 2023-03-30T07:57:18.286 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pps/pps_core.ko 2023-03-30T07:57:18.286 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ptp/ 2023-03-30T07:57:18.286 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 64265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ptp/ptp.ko 2023-03-30T07:57:18.286 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ptp/ptp_kvm.ko 2023-03-30T07:57:18.286 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/ 2023-03-30T07:57:18.286 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-88pm80x.ko 2023-03-30T07:57:18.286 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-88pm860x.ko 2023-03-30T07:57:18.287 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-bq32k.ko 2023-03-30T07:57:18.287 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-bq4802.ko 2023-03-30T07:57:18.287 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-da9052.ko 2023-03-30T07:57:18.287 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-da9055.ko 2023-03-30T07:57:18.287 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-da9063.ko 2023-03-30T07:57:18.287 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds1286.ko 2023-03-30T07:57:18.287 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 68081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds1307.ko 2023-03-30T07:57:18.287 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds1374.ko 2023-03-30T07:57:18.288 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds1511.ko 2023-03-30T07:57:18.288 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds1553.ko 2023-03-30T07:57:18.288 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds1672.ko 2023-03-30T07:57:18.288 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds1742.ko 2023-03-30T07:57:18.288 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds2404.ko 2023-03-30T07:57:18.288 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds3232.ko 2023-03-30T07:57:18.288 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-em3027.ko 2023-03-30T07:57:18.288 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-fm3130.ko 2023-03-30T07:57:18.289 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-isl12022.ko 2023-03-30T07:57:18.289 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-isl1208.ko 2023-03-30T07:57:18.289 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-lp8788.ko 2023-03-30T07:57:18.289 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-m41t80.ko 2023-03-30T07:57:18.289 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-m48t35.ko 2023-03-30T07:57:18.289 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-m48t59.ko 2023-03-30T07:57:18.289 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-m48t86.ko 2023-03-30T07:57:18.290 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-max6900.ko 2023-03-30T07:57:18.290 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-max8907.ko 2023-03-30T07:57:18.290 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-max8925.ko 2023-03-30T07:57:18.290 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-max8997.ko 2023-03-30T07:57:18.290 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-max8998.ko 2023-03-30T07:57:18.290 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-03-30T07:57:18.290 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-msm6242.ko 2023-03-30T07:57:18.290 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-palmas.ko 2023-03-30T07:57:18.291 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-pcf2127.ko 2023-03-30T07:57:18.291 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-pcf50633.ko 2023-03-30T07:57:18.291 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-pcf85063.ko 2023-03-30T07:57:18.291 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-pcf8523.ko 2023-03-30T07:57:18.291 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-pcf8563.ko 2023-03-30T07:57:18.291 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-pcf8583.ko 2023-03-30T07:57:18.291 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-rc5t583.ko 2023-03-30T07:57:18.291 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-rp5c01.ko 2023-03-30T07:57:18.292 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-rs5c372.ko 2023-03-30T07:57:18.292 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-03-30T07:57:18.292 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-rx8025.ko 2023-03-30T07:57:18.292 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-rx8581.ko 2023-03-30T07:57:18.292 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-s35390a.ko 2023-03-30T07:57:18.292 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-03-30T07:57:18.292 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-tps6586x.ko 2023-03-30T07:57:18.292 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-tps65910.ko 2023-03-30T07:57:18.293 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-wm831x.ko 2023-03-30T07:57:18.293 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-wm8350.ko 2023-03-30T07:57:18.293 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-x1205.ko 2023-03-30T07:57:18.293 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/ 2023-03-30T07:57:18.293 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 77209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/3w-9xxx.ko 2023-03-30T07:57:18.293 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/3w-sas.ko 2023-03-30T07:57:18.293 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/3w-xxxx.ko 2023-03-30T07:57:18.293 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 134673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/BusLogic.ko 2023-03-30T07:57:18.294 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/a100u2w.ko 2023-03-30T07:57:18.294 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/aacraid/ 2023-03-30T07:57:18.294 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 271161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/aacraid/aacraid.ko 2023-03-30T07:57:18.294 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 100129 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/advansys.ko 2023-03-30T07:57:18.294 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/aic7xxx/ 2023-03-30T07:57:18.294 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 355761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-03-30T07:57:18.294 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 295377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-03-30T07:57:18.295 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/aic94xx/ 2023-03-30T07:57:18.295 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 188825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-03-30T07:57:18.295 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/am53c974.ko 2023-03-30T07:57:18.295 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/arcmsr/ 2023-03-30T07:57:18.295 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 106065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-03-30T07:57:18.295 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/atp870u.ko 2023-03-30T07:57:18.295 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/be2iscsi/ 2023-03-30T07:57:18.295 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 246913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-03-30T07:57:18.296 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/bfa/ 2023-03-30T07:57:18.296 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1172201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/bfa/bfa.ko 2023-03-30T07:57:18.296 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/bnx2fc/ 2023-03-30T07:57:18.296 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 236737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-03-30T07:57:18.296 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/bnx2i/ 2023-03-30T07:57:18.296 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 114969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-03-30T07:57:18.296 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/ch.ko 2023-03-30T07:57:18.296 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/csiostor/ 2023-03-30T07:57:18.297 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 308401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/csiostor/csiostor.ko 2023-03-30T07:57:18.297 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/cxgbi/ 2023-03-30T07:57:18.297 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-03-30T07:57:18.297 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 75689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-03-30T07:57:18.297 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-03-30T07:57:18.297 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 101017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-03-30T07:57:18.297 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 141417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-03-30T07:57:18.297 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 75105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/dc395x.ko 2023-03-30T07:57:18.298 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/dmx3191d.ko 2023-03-30T07:57:18.298 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/esas2r/ 2023-03-30T07:57:18.298 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 211977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/esas2r/esas2r.ko 2023-03-30T07:57:18.298 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/esp_scsi.ko 2023-03-30T07:57:18.298 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/fcoe/ 2023-03-30T07:57:18.298 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 77713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/fcoe/fcoe.ko 2023-03-30T07:57:18.298 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 154601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-03-30T07:57:18.298 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/fdomain.ko 2023-03-30T07:57:18.299 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/fnic/ 2023-03-30T07:57:18.299 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 262025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/fnic/fnic.ko 2023-03-30T07:57:18.299 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 201305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/hpsa.ko 2023-03-30T07:57:18.299 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/hptiop.ko 2023-03-30T07:57:18.299 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/hv_storvsc.ko 2023-03-30T07:57:18.299 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/imm.ko 2023-03-30T07:57:18.299 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/initio.ko 2023-03-30T07:57:18.300 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 285985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/ipr.ko 2023-03-30T07:57:18.300 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 101449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/ips.ko 2023-03-30T07:57:18.300 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/isci/ 2023-03-30T07:57:18.300 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 316817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/isci/isci.ko 2023-03-30T07:57:18.300 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-03-30T07:57:18.300 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/iscsi_tcp.ko 2023-03-30T07:57:18.300 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/libfc/ 2023-03-30T07:57:18.300 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 307937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/libfc/libfc.ko 2023-03-30T07:57:18.301 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 139737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/libiscsi.ko 2023-03-30T07:57:18.301 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/libiscsi_tcp.ko 2023-03-30T07:57:18.301 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/libsas/ 2023-03-30T07:57:18.301 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 212217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/libsas/libsas.ko 2023-03-30T07:57:18.301 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/lpfc/ 2023-03-30T07:57:18.301 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 2194601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/lpfc/lpfc.ko 2023-03-30T07:57:18.301 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/megaraid/ 2023-03-30T07:57:18.301 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 73113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-03-30T07:57:18.302 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-03-30T07:57:18.302 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 310241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-03-30T07:57:18.302 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 84289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/megaraid.ko 2023-03-30T07:57:18.302 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/mpt3sas/ 2023-03-30T07:57:18.302 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 659793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-03-30T07:57:18.302 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/mvsas/ 2023-03-30T07:57:18.302 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 119425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/mvsas/mvsas.ko 2023-03-30T07:57:18.303 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 77665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/mvumi.ko 2023-03-30T07:57:18.303 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pcmcia/ 2023-03-30T07:57:18.303 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 81113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-03-30T07:57:18.303 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-03-30T07:57:18.303 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-03-30T07:57:18.303 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-03-30T07:57:18.303 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pm8001/ 2023-03-30T07:57:18.303 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 360881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-03-30T07:57:18.304 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 123073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pmcraid.ko 2023-03-30T07:57:18.304 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/ppa.ko 2023-03-30T07:57:18.304 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/qla1280.ko 2023-03-30T07:57:18.304 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/qla2xxx/ 2023-03-30T07:57:18.304 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1850353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-03-30T07:57:18.304 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 85353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-03-30T07:57:18.304 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/qla4xxx/ 2023-03-30T07:57:18.304 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 558737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-03-30T07:57:18.305 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/qlogicfas408.ko 2023-03-30T07:57:18.305 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/raid_class.ko 2023-03-30T07:57:18.305 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 242441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/scsi_debug.ko 2023-03-30T07:57:18.305 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 171561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/scsi_transport_fc.ko 2023-03-30T07:57:18.305 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 270153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-03-30T07:57:18.305 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 94049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/scsi_transport_sas.ko 2023-03-30T07:57:18.305 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 72321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/scsi_transport_spi.ko 2023-03-30T07:57:18.305 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/scsi_transport_srp.ko 2023-03-30T07:57:18.306 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/ses.ko 2023-03-30T07:57:18.306 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 115409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/st.ko 2023-03-30T07:57:18.306 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/stex.ko 2023-03-30T07:57:18.306 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/sym53c8xx_2/ 2023-03-30T07:57:18.306 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 161697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-03-30T07:57:18.306 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/virtio_scsi.ko 2023-03-30T07:57:18.306 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/vmw_pvscsi.ko 2023-03-30T07:57:18.306 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/wd719x.ko 2023-03-30T07:57:18.307 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/xen-scsifront.ko 2023-03-30T07:57:18.307 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ssb/ 2023-03-30T07:57:18.307 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 126593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ssb/ssb.ko 2023-03-30T07:57:18.307 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/ 2023-03-30T07:57:18.307 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/iscsi/ 2023-03-30T07:57:18.307 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 730161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-03-30T07:57:18.307 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/loopback/ 2023-03-30T07:57:18.308 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/loopback/tcm_loop.ko 2023-03-30T07:57:18.308 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/target_core_file.ko 2023-03-30T07:57:18.308 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/target_core_iblock.ko 2023-03-30T07:57:18.308 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 913305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/target_core_mod.ko 2023-03-30T07:57:18.308 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/target_core_pscsi.ko 2023-03-30T07:57:18.308 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 121793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/target_core_user.ko 2023-03-30T07:57:18.308 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/tcm_fc/ 2023-03-30T07:57:18.308 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 75905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-03-30T07:57:18.309 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/ 2023-03-30T07:57:18.309 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/ 2023-03-30T07:57:18.309 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/ 2023-03-30T07:57:18.309 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-03-30T07:57:18.309 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-03-30T07:57:18.309 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-03-30T07:57:18.309 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-03-30T07:57:18.309 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-03-30T07:57:18.310 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-03-30T07:57:18.310 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-03-30T07:57:18.310 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-03-30T07:57:18.310 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-03-30T07:57:18.310 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-03-30T07:57:18.310 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-03-30T07:57:18.310 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-03-30T07:57:18.310 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/intel_menlow.ko 2023-03-30T07:57:18.311 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-03-30T07:57:18.311 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-03-30T07:57:18.311 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-03-30T07:57:18.311 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-03-30T07:57:18.311 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/ 2023-03-30T07:57:18.311 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/ipwireless/ 2023-03-30T07:57:18.311 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 77649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-03-30T07:57:18.311 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/moxa.ko 2023-03-30T07:57:18.312 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/mxser.ko 2023-03-30T07:57:18.312 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 104345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/n_gsm.ko 2023-03-30T07:57:18.312 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/n_hdlc.ko 2023-03-30T07:57:18.312 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 67641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/nozomi.ko 2023-03-30T07:57:18.312 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/ 2023-03-30T07:57:18.312 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/8250/ 2023-03-30T07:57:18.312 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-03-30T07:57:18.313 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-03-30T07:57:18.313 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-03-30T07:57:18.313 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/altera_uart.ko 2023-03-30T07:57:18.313 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/arc_uart.ko 2023-03-30T07:57:18.313 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 69473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-03-30T07:57:18.313 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/jsm/ 2023-03-30T07:57:18.313 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 102521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/jsm/jsm.ko 2023-03-30T07:57:18.313 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/rp2.ko 2023-03-30T07:57:18.314 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 51705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/sc16is7xx.ko 2023-03-30T07:57:18.314 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 99985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/synclink_gt.ko 2023-03-30T07:57:18.314 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ufs/ 2023-03-30T07:57:18.314 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ufs/core/ 2023-03-30T07:57:18.314 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 517745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ufs/core/ufshcd-core.ko 2023-03-30T07:57:18.314 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ufs/host/ 2023-03-30T07:57:18.314 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-03-30T07:57:18.314 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-03-30T07:57:18.315 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/ 2023-03-30T07:57:18.315 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio.ko 2023-03-30T07:57:18.315 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_aec.ko 2023-03-30T07:57:18.315 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_cif.ko 2023-03-30T07:57:18.315 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_dmem_genirq.ko 2023-03-30T07:57:18.315 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_mf624.ko 2023-03-30T07:57:18.315 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_netx.ko 2023-03-30T07:57:18.315 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_pci_generic.ko 2023-03-30T07:57:18.316 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-03-30T07:57:18.316 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_sercos3.ko 2023-03-30T07:57:18.316 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/ 2023-03-30T07:57:18.316 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/c67x00/ 2023-03-30T07:57:18.316 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 72777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/c67x00/c67x00.ko 2023-03-30T07:57:18.316 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/chipidea/ 2023-03-30T07:57:18.316 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 144113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-03-30T07:57:18.316 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-03-30T07:57:18.317 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-03-30T07:57:18.317 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-03-30T07:57:18.317 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/class/ 2023-03-30T07:57:18.317 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 85025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/class/cdc-acm.ko 2023-03-30T07:57:18.317 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/class/cdc-wdm.ko 2023-03-30T07:57:18.317 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/class/usblp.ko 2023-03-30T07:57:18.317 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 89409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/class/usbtmc.ko 2023-03-30T07:57:18.318 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/common/ 2023-03-30T07:57:18.318 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/common/ulpi.ko 2023-03-30T07:57:18.318 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/dwc2/ 2023-03-30T07:57:18.318 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-03-30T07:57:18.318 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/dwc3/ 2023-03-30T07:57:18.318 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-03-30T07:57:18.318 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-03-30T07:57:18.318 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 433481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/dwc3/dwc3.ko 2023-03-30T07:57:18.319 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/ 2023-03-30T07:57:18.319 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/ 2023-03-30T07:57:18.319 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/u_ether.ko 2023-03-30T07:57:18.319 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/u_serial.ko 2023-03-30T07:57:18.319 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-03-30T07:57:18.319 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-03-30T07:57:18.319 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-03-30T07:57:18.319 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-03-30T07:57:18.320 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 90865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-03-30T07:57:18.320 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-03-30T07:57:18.320 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 117593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-03-30T07:57:18.320 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-03-30T07:57:18.320 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-03-30T07:57:18.320 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-03-30T07:57:18.320 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-03-30T07:57:18.320 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 83697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-03-30T07:57:18.321 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-03-30T07:57:18.321 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 58001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-03-30T07:57:18.321 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 67977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-03-30T07:57:18.321 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/ 2023-03-30T07:57:18.321 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-03-30T07:57:18.321 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-03-30T07:57:18.321 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-03-30T07:57:18.322 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-03-30T07:57:18.322 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-03-30T07:57:18.322 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-03-30T07:57:18.322 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-03-30T07:57:18.322 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-03-30T07:57:18.322 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-03-30T07:57:18.322 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-03-30T07:57:18.322 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-03-30T07:57:18.323 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-03-30T07:57:18.323 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 61665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-03-30T07:57:18.323 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-03-30T07:57:18.323 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 154681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/libcomposite.ko 2023-03-30T07:57:18.323 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/ 2023-03-30T07:57:18.323 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-03-30T07:57:18.323 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/bdc/ 2023-03-30T07:57:18.323 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 157161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-03-30T07:57:18.324 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-03-30T07:57:18.324 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-03-30T07:57:18.324 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 69193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-03-30T07:57:18.324 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-03-30T07:57:18.324 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 75545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/net2272.ko 2023-03-30T07:57:18.324 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 74529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/net2280.ko 2023-03-30T07:57:18.324 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 72745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-03-30T07:57:18.324 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-03-30T07:57:18.325 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-03-30T07:57:18.325 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 79913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-03-30T07:57:18.325 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 139729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-03-30T07:57:18.325 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/ 2023-03-30T07:57:18.325 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/bcma-hcd.ko 2023-03-30T07:57:18.325 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 79593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/isp116x-hcd.ko 2023-03-30T07:57:18.325 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 87185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-03-30T07:57:18.325 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 78425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-03-30T07:57:18.326 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/sl811-hcd.ko 2023-03-30T07:57:18.326 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/sl811_cs.ko 2023-03-30T07:57:18.326 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/ssb-hcd.ko 2023-03-30T07:57:18.326 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 92241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/u132-hcd.ko 2023-03-30T07:57:18.326 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-03-30T07:57:18.326 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/image/ 2023-03-30T07:57:18.326 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/image/mdc800.ko 2023-03-30T07:57:18.326 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/image/microtek.ko 2023-03-30T07:57:18.327 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/ 2023-03-30T07:57:18.327 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/adutux.ko 2023-03-30T07:57:18.327 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/appledisplay.ko 2023-03-30T07:57:18.327 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-03-30T07:57:18.327 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/cytherm.ko 2023-03-30T07:57:18.327 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/ehset.ko 2023-03-30T07:57:18.327 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/emi26.ko 2023-03-30T07:57:18.328 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/emi62.ko 2023-03-30T07:57:18.328 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/ezusb.ko 2023-03-30T07:57:18.328 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 73217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/ftdi-elan.ko 2023-03-30T07:57:18.328 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/idmouse.ko 2023-03-30T07:57:18.328 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/iowarrior.ko 2023-03-30T07:57:18.328 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/isight_firmware.ko 2023-03-30T07:57:18.328 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/ldusb.ko 2023-03-30T07:57:18.328 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/legousbtower.ko 2023-03-30T07:57:18.329 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/lvstest.ko 2023-03-30T07:57:18.329 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/sisusbvga/ 2023-03-30T07:57:18.329 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 64033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-03-30T07:57:18.329 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/trancevibrator.ko 2023-03-30T07:57:18.329 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/usb3503.ko 2023-03-30T07:57:18.329 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/usblcd.ko 2023-03-30T07:57:18.329 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/usbsevseg.ko 2023-03-30T07:57:18.329 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/usbtest.ko 2023-03-30T07:57:18.330 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/uss720.ko 2023-03-30T07:57:18.330 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/yurex.ko 2023-03-30T07:57:18.330 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/mon/ 2023-03-30T07:57:18.330 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 72321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/mon/usbmon.ko 2023-03-30T07:57:18.330 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/musb/ 2023-03-30T07:57:18.330 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 294641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/musb/musb_hdrc.ko 2023-03-30T07:57:18.330 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/phy/ 2023-03-30T07:57:18.330 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/phy/phy-generic.ko 2023-03-30T07:57:18.331 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-03-30T07:57:18.331 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/phy/phy-isp1301.ko 2023-03-30T07:57:18.331 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/phy/phy-tahvo.ko 2023-03-30T07:57:18.331 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ 2023-03-30T07:57:18.331 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/aircable.ko 2023-03-30T07:57:18.331 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ark3116.ko 2023-03-30T07:57:18.331 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/belkin_sa.ko 2023-03-30T07:57:18.332 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ch341.ko 2023-03-30T07:57:18.332 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 69489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/cp210x.ko 2023-03-30T07:57:18.332 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/cyberjack.ko 2023-03-30T07:57:18.332 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/cypress_m8.ko 2023-03-30T07:57:18.332 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/digi_acceleport.ko 2023-03-30T07:57:18.332 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/empeg.ko 2023-03-30T07:57:18.332 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/f81232.ko 2023-03-30T07:57:18.332 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 174409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ftdi_sio.ko 2023-03-30T07:57:18.333 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/garmin_gps.ko 2023-03-30T07:57:18.333 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 136441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/io_edgeport.ko 2023-03-30T07:57:18.333 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 124025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/io_ti.ko 2023-03-30T07:57:18.333 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 67329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ipaq.ko 2023-03-30T07:57:18.333 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ipw.ko 2023-03-30T07:57:18.333 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ir-usb.ko 2023-03-30T07:57:18.333 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-03-30T07:57:18.333 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 106985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/keyspan.ko 2023-03-30T07:57:18.334 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/keyspan_pda.ko 2023-03-30T07:57:18.334 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/kl5kusb105.ko 2023-03-30T07:57:18.334 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/kobil_sct.ko 2023-03-30T07:57:18.334 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/mct_u232.ko 2023-03-30T07:57:18.334 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/metro-usb.ko 2023-03-30T07:57:18.334 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/mos7720.ko 2023-03-30T07:57:18.334 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 77673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/mos7840.ko 2023-03-30T07:57:18.334 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/mxuport.ko 2023-03-30T07:57:18.335 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/navman.ko 2023-03-30T07:57:18.335 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/omninet.ko 2023-03-30T07:57:18.335 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/opticon.ko 2023-03-30T07:57:18.335 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 186601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/option.ko 2023-03-30T07:57:18.335 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/oti6858.ko 2023-03-30T07:57:18.335 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/pl2303.ko 2023-03-30T07:57:18.335 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/qcaux.ko 2023-03-30T07:57:18.335 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/qcserial.ko 2023-03-30T07:57:18.336 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/quatech2.ko 2023-03-30T07:57:18.336 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/safe_serial.ko 2023-03-30T07:57:18.336 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 50865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/sierra.ko 2023-03-30T07:57:18.336 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/spcp8x5.ko 2023-03-30T07:57:18.336 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ssu100.ko 2023-03-30T07:57:18.336 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/symbolserial.ko 2023-03-30T07:57:18.336 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-03-30T07:57:18.336 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-03-30T07:57:18.337 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/usb_debug.ko 2023-03-30T07:57:18.337 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/usb_wwan.ko 2023-03-30T07:57:18.337 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 122417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/usbserial.ko 2023-03-30T07:57:18.337 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/visor.ko 2023-03-30T07:57:18.337 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/whiteheat.ko 2023-03-30T07:57:18.337 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/wishbone-serial.ko 2023-03-30T07:57:18.337 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/xsens_mt.ko 2023-03-30T07:57:18.338 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ 2023-03-30T07:57:18.338 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/uas.ko 2023-03-30T07:57:18.338 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-alauda.ko 2023-03-30T07:57:18.338 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-cypress.ko 2023-03-30T07:57:18.338 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-datafab.ko 2023-03-30T07:57:18.338 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-03-30T07:57:18.338 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-freecom.ko 2023-03-30T07:57:18.338 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-isd200.ko 2023-03-30T07:57:18.339 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-03-30T07:57:18.339 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-karma.ko 2023-03-30T07:57:18.339 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-onetouch.ko 2023-03-30T07:57:18.339 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-realtek.ko 2023-03-30T07:57:18.339 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-sddr09.ko 2023-03-30T07:57:18.339 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-sddr55.ko 2023-03-30T07:57:18.339 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-usbat.ko 2023-03-30T07:57:18.339 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 176113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/usb-storage.ko 2023-03-30T07:57:18.340 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/usbip/ 2023-03-30T07:57:18.340 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/usbip/usbip-core.ko 2023-03-30T07:57:18.340 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 71009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/usbip/usbip-host.ko 2023-03-30T07:57:18.340 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 104905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-03-30T07:57:18.340 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vfio/ 2023-03-30T07:57:18.340 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vfio/pci/ 2023-03-30T07:57:18.340 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 145057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-03-30T07:57:18.341 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vfio/pci/vfio-pci.ko 2023-03-30T07:57:18.341 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 97561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vfio/vfio.ko 2023-03-30T07:57:18.341 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 71321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-03-30T07:57:18.341 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vhost/ 2023-03-30T07:57:18.341 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 98209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vhost/vhost.ko 2023-03-30T07:57:18.341 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vhost/vhost_iotlb.ko 2023-03-30T07:57:18.341 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vhost/vhost_net.ko 2023-03-30T07:57:18.341 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 88633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vhost/vhost_scsi.ko 2023-03-30T07:57:18.342 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/ 2023-03-30T07:57:18.342 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/ 2023-03-30T07:57:18.342 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-03-30T07:57:18.342 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/aat2870_bl.ko 2023-03-30T07:57:18.342 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/adp5520_bl.ko 2023-03-30T07:57:18.342 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/adp8860_bl.ko 2023-03-30T07:57:18.342 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/adp8870_bl.ko 2023-03-30T07:57:18.342 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/apple_bl.ko 2023-03-30T07:57:18.343 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/as3711_bl.ko 2023-03-30T07:57:18.343 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/bd6107.ko 2023-03-30T07:57:18.343 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/da903x_bl.ko 2023-03-30T07:57:18.343 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/da9052_bl.ko 2023-03-30T07:57:18.343 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/gpio_backlight.ko 2023-03-30T07:57:18.343 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/kb3886_bl.ko 2023-03-30T07:57:18.343 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/lcd.ko 2023-03-30T07:57:18.343 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/lm3533_bl.ko 2023-03-30T07:57:18.344 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/lm3639_bl.ko 2023-03-30T07:57:18.344 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/lv5207lp.ko 2023-03-30T07:57:18.344 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/max8925_bl.ko 2023-03-30T07:57:18.344 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/pandora_bl.ko 2023-03-30T07:57:18.344 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-03-30T07:57:18.344 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/platform_lcd.ko 2023-03-30T07:57:18.344 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/wm831x_bl.ko 2023-03-30T07:57:18.344 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/ 2023-03-30T07:57:18.345 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/masters/ 2023-03-30T07:57:18.345 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/masters/ds2482.ko 2023-03-30T07:57:18.345 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/masters/ds2490.ko 2023-03-30T07:57:18.345 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/masters/matrox_w1.ko 2023-03-30T07:57:18.345 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/masters/w1-gpio.ko 2023-03-30T07:57:18.345 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/ 2023-03-30T07:57:18.346 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-03-30T07:57:18.346 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-03-30T07:57:18.346 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-03-30T07:57:18.346 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-03-30T07:57:18.346 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-03-30T07:57:18.346 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-03-30T07:57:18.346 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-03-30T07:57:18.347 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-03-30T07:57:18.347 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-03-30T07:57:18.347 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 6889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_smem.ko 2023-03-30T07:57:18.347 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_therm.ko 2023-03-30T07:57:18.347 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 101081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/wire.ko 2023-03-30T07:57:18.347 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/ 2023-03-30T07:57:18.347 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/acquirewdt.ko 2023-03-30T07:57:18.347 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/advantechwdt.ko 2023-03-30T07:57:18.348 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18129 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/alim1535_wdt.ko 2023-03-30T07:57:18.348 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/alim7101_wdt.ko 2023-03-30T07:57:18.348 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/cpu5wdt.ko 2023-03-30T07:57:18.348 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/da9052_wdt.ko 2023-03-30T07:57:18.348 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/da9055_wdt.ko 2023-03-30T07:57:18.348 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/da9063_wdt.ko 2023-03-30T07:57:18.348 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/dw_wdt.ko 2023-03-30T07:57:18.348 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/eurotechwdt.ko 2023-03-30T07:57:18.349 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/f71808e_wdt.ko 2023-03-30T07:57:18.349 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/hpwdt.ko 2023-03-30T07:57:18.349 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/i6300esb.ko 2023-03-30T07:57:18.349 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-03-30T07:57:18.349 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/iTCO_wdt.ko 2023-03-30T07:57:18.349 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/ib700wdt.ko 2023-03-30T07:57:18.349 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/ibmasr.ko 2023-03-30T07:57:18.350 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-03-30T07:57:18.350 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/it8712f_wdt.ko 2023-03-30T07:57:18.350 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/it87_wdt.ko 2023-03-30T07:57:18.350 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/kempld_wdt.ko 2023-03-30T07:57:18.350 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/machzwd.ko 2023-03-30T07:57:18.350 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/mena21_wdt.ko 2023-03-30T07:57:18.350 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-03-30T07:57:18.350 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/nv_tco.ko 2023-03-30T07:57:18.351 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-03-30T07:57:18.351 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/pc87413_wdt.ko 2023-03-30T07:57:18.351 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/pcwd_pci.ko 2023-03-30T07:57:18.351 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/pcwd_usb.ko 2023-03-30T07:57:18.351 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/retu_wdt.ko 2023-03-30T07:57:18.351 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-03-30T07:57:18.351 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-03-30T07:57:18.351 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-03-30T07:57:18.352 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/sc1200wdt.ko 2023-03-30T07:57:18.352 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/sch311x_wdt.ko 2023-03-30T07:57:18.352 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-03-30T07:57:18.352 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/softdog.ko 2023-03-30T07:57:18.352 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/sp5100_tco.ko 2023-03-30T07:57:18.352 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/twl4030_wdt.ko 2023-03-30T07:57:18.352 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/via_wdt.ko 2023-03-30T07:57:18.352 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-03-30T07:57:18.353 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/w83877f_wdt.ko 2023-03-30T07:57:18.353 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/w83977f_wdt.ko 2023-03-30T07:57:18.353 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/wafer5823wdt.ko 2023-03-30T07:57:18.353 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/wdt_pci.ko 2023-03-30T07:57:18.353 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/wm831x_wdt.ko 2023-03-30T07:57:18.353 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/wm8350_wdt.ko 2023-03-30T07:57:18.353 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/xen_wdt.ko 2023-03-30T07:57:18.353 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/ 2023-03-30T07:57:18.354 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xen-evtchn.ko 2023-03-30T07:57:18.354 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xen-gntalloc.ko 2023-03-30T07:57:18.354 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xen-gntdev.ko 2023-03-30T07:57:18.354 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xen-pciback/ 2023-03-30T07:57:18.354 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 176105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-03-30T07:57:18.354 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xen-privcmd.ko 2023-03-30T07:57:18.354 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 71513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xen-scsiback.ko 2023-03-30T07:57:18.354 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xenfs/ 2023-03-30T07:57:18.355 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xenfs/xenfs.ko 2023-03-30T07:57:18.355 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ 2023-03-30T07:57:18.355 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/9p/ 2023-03-30T07:57:18.355 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 171305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/9p/9p.ko 2023-03-30T07:57:18.355 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/adfs/ 2023-03-30T07:57:18.355 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/adfs/adfs.ko 2023-03-30T07:57:18.355 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/affs/ 2023-03-30T07:57:18.356 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 162241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/affs/affs.ko 2023-03-30T07:57:18.356 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/afs/ 2023-03-30T07:57:18.356 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 924521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/afs/kafs.ko 2023-03-30T07:57:18.356 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/autofs/ 2023-03-30T07:57:18.356 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 100321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/autofs/autofs4.ko 2023-03-30T07:57:18.356 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/befs/ 2023-03-30T07:57:18.356 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 63977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/befs/befs.ko 2023-03-30T07:57:18.356 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/bfs/ 2023-03-30T07:57:18.357 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/bfs/bfs.ko 2023-03-30T07:57:18.357 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/binfmt_misc.ko 2023-03-30T07:57:18.357 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/btrfs/ 2023-03-30T07:57:18.357 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 3476441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/btrfs/btrfs.ko 2023-03-30T07:57:18.357 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/cachefiles/ 2023-03-30T07:57:18.357 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 299529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/cachefiles/cachefiles.ko 2023-03-30T07:57:18.357 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ceph/ 2023-03-30T07:57:18.357 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1225985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ceph/ceph.ko 2023-03-30T07:57:18.358 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/cifs/ 2023-03-30T07:57:18.358 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 2611009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/cifs/cifs.ko 2023-03-30T07:57:18.358 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/coda/ 2023-03-30T07:57:18.358 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 99153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/coda/coda.ko 2023-03-30T07:57:18.358 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/configfs/ 2023-03-30T07:57:18.358 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 105385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/configfs/configfs.ko 2023-03-30T07:57:18.358 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/cramfs/ 2023-03-30T07:57:18.358 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/cramfs/cramfs.ko 2023-03-30T07:57:18.359 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/dlm/ 2023-03-30T07:57:18.359 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 624153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/dlm/dlm.ko 2023-03-30T07:57:18.359 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/efs/ 2023-03-30T07:57:18.359 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/efs/efs.ko 2023-03-30T07:57:18.359 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/f2fs/ 2023-03-30T07:57:18.359 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1470857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/f2fs/f2fs.ko 2023-03-30T07:57:18.359 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/fat/ 2023-03-30T07:57:18.359 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/fat/msdos.ko 2023-03-30T07:57:18.360 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/freevxfs/ 2023-03-30T07:57:18.360 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 41961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/freevxfs/freevxfs.ko 2023-03-30T07:57:18.360 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/fscache/ 2023-03-30T07:57:18.360 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 218289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/fscache/fscache.ko 2023-03-30T07:57:18.360 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/fuse/ 2023-03-30T07:57:18.360 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/fuse/cuse.ko 2023-03-30T07:57:18.360 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/gfs2/ 2023-03-30T07:57:18.360 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1222017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/gfs2/gfs2.ko 2023-03-30T07:57:18.361 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/hfs/ 2023-03-30T07:57:18.361 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 140857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/hfs/hfs.ko 2023-03-30T07:57:18.361 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/hfsplus/ 2023-03-30T07:57:18.361 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 220953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/hfsplus/hfsplus.ko 2023-03-30T07:57:18.361 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/hpfs/ 2023-03-30T07:57:18.361 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 193145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/hpfs/hpfs.ko 2023-03-30T07:57:18.361 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/isofs/ 2023-03-30T07:57:18.362 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 73961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/isofs/isofs.ko 2023-03-30T07:57:18.362 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/jfs/ 2023-03-30T07:57:18.362 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 418945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/jfs/jfs.ko 2023-03-30T07:57:18.362 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/lockd/ 2023-03-30T07:57:18.362 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 253961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/lockd/lockd.ko 2023-03-30T07:57:18.362 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/minix/ 2023-03-30T07:57:18.362 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 87481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/minix/minix.ko 2023-03-30T07:57:18.362 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/netfs/ 2023-03-30T07:57:18.363 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 128313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/netfs/netfs.ko 2023-03-30T07:57:18.363 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/ 2023-03-30T07:57:18.363 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/blocklayout/ 2023-03-30T07:57:18.363 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 81025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-03-30T07:57:18.363 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/filelayout/ 2023-03-30T07:57:18.363 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 58929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-03-30T07:57:18.363 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/flexfilelayout/ 2023-03-30T07:57:18.363 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 117209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-03-30T07:57:18.364 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1016553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/nfs.ko 2023-03-30T07:57:18.364 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/nfsv2.ko 2023-03-30T07:57:18.364 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 119217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/nfsv3.ko 2023-03-30T07:57:18.364 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 2003113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/nfsv4.ko 2023-03-30T07:57:18.364 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs_common/ 2023-03-30T07:57:18.364 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs_common/grace.ko 2023-03-30T07:57:18.364 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs_common/nfs_acl.ko 2023-03-30T07:57:18.364 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfsd/ 2023-03-30T07:57:18.365 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1400457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfsd/nfsd.ko 2023-03-30T07:57:18.365 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nilfs2/ 2023-03-30T07:57:18.365 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 586417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nilfs2/nilfs2.ko 2023-03-30T07:57:18.365 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/ 2023-03-30T07:57:18.365 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-celtic.ko 2023-03-30T07:57:18.365 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-centeuro.ko 2023-03-30T07:57:18.365 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-croatian.ko 2023-03-30T07:57:18.366 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-cyrillic.ko 2023-03-30T07:57:18.366 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-gaelic.ko 2023-03-30T07:57:18.366 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-greek.ko 2023-03-30T07:57:18.366 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-iceland.ko 2023-03-30T07:57:18.366 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-inuit.ko 2023-03-30T07:57:18.366 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-roman.ko 2023-03-30T07:57:18.366 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-romanian.ko 2023-03-30T07:57:18.366 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-turkish.ko 2023-03-30T07:57:18.367 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_ascii.ko 2023-03-30T07:57:18.367 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp1250.ko 2023-03-30T07:57:18.367 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp1251.ko 2023-03-30T07:57:18.367 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp1255.ko 2023-03-30T07:57:18.367 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp737.ko 2023-03-30T07:57:18.367 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp775.ko 2023-03-30T07:57:18.367 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp850.ko 2023-03-30T07:57:18.367 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp852.ko 2023-03-30T07:57:18.368 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp855.ko 2023-03-30T07:57:18.368 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp857.ko 2023-03-30T07:57:18.368 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp860.ko 2023-03-30T07:57:18.368 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp861.ko 2023-03-30T07:57:18.368 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp862.ko 2023-03-30T07:57:18.368 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp863.ko 2023-03-30T07:57:18.368 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp864.ko 2023-03-30T07:57:18.368 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp865.ko 2023-03-30T07:57:18.369 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp866.ko 2023-03-30T07:57:18.369 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp869.ko 2023-03-30T07:57:18.369 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp874.ko 2023-03-30T07:57:18.369 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 93649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp932.ko 2023-03-30T07:57:18.369 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 142185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp936.ko 2023-03-30T07:57:18.369 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 165321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp949.ko 2023-03-30T07:57:18.369 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 117625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp950.ko 2023-03-30T07:57:18.369 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_euc-jp.ko 2023-03-30T07:57:18.370 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-1.ko 2023-03-30T07:57:18.370 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-13.ko 2023-03-30T07:57:18.370 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-14.ko 2023-03-30T07:57:18.370 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-15.ko 2023-03-30T07:57:18.370 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-2.ko 2023-03-30T07:57:18.370 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-3.ko 2023-03-30T07:57:18.370 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-4.ko 2023-03-30T07:57:18.370 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-5.ko 2023-03-30T07:57:18.371 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-6.ko 2023-03-30T07:57:18.371 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-7.ko 2023-03-30T07:57:18.371 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-9.ko 2023-03-30T07:57:18.371 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_koi8-r.ko 2023-03-30T07:57:18.371 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_koi8-ru.ko 2023-03-30T07:57:18.371 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_koi8-u.ko 2023-03-30T07:57:18.371 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_utf8.ko 2023-03-30T07:57:18.372 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ntfs/ 2023-03-30T07:57:18.372 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 218585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ntfs/ntfs.ko 2023-03-30T07:57:18.372 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/ 2023-03-30T07:57:18.372 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/cluster/ 2023-03-30T07:57:18.372 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 240737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-03-30T07:57:18.372 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/dlm/ 2023-03-30T07:57:18.372 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 439201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-03-30T07:57:18.372 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/dlmfs/ 2023-03-30T07:57:18.373 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-03-30T07:57:18.373 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 2510441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/ocfs2.ko 2023-03-30T07:57:18.373 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-03-30T07:57:18.373 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-03-30T07:57:18.373 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-03-30T07:57:18.373 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/omfs/ 2023-03-30T07:57:18.373 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 52145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/omfs/omfs.ko 2023-03-30T07:57:18.373 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/overlayfs/ 2023-03-30T07:57:18.374 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 320649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/overlayfs/overlay.ko 2023-03-30T07:57:18.374 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-03-30T07:57:18.375 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-03-30T07:57:18.396 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/pstore/ 2023-03-30T07:57:18.396 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/pstore/ramoops.ko 2023-03-30T07:57:18.397 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/qnx4/ 2023-03-30T07:57:18.397 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/qnx4/qnx4.ko 2023-03-30T07:57:18.397 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/qnx6/ 2023-03-30T07:57:18.397 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/qnx6/qnx6.ko 2023-03-30T07:57:18.397 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/quota/ 2023-03-30T07:57:18.397 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/quota/quota_tree.ko 2023-03-30T07:57:18.398 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/quota/quota_v1.ko 2023-03-30T07:57:18.398 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/quota/quota_v2.ko 2023-03-30T07:57:18.398 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/reiserfs/ 2023-03-30T07:57:18.398 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 527801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/reiserfs/reiserfs.ko 2023-03-30T07:57:18.398 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/romfs/ 2023-03-30T07:57:18.398 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/romfs/romfs.ko 2023-03-30T07:57:18.398 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/smbfs_common/ 2023-03-30T07:57:18.398 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 6361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/smbfs_common/cifs_arc4.ko 2023-03-30T07:57:18.399 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/smbfs_common/cifs_md4.ko 2023-03-30T07:57:18.399 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/squashfs/ 2023-03-30T07:57:18.399 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 131193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/squashfs/squashfs.ko 2023-03-30T07:57:18.399 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/sysv/ 2023-03-30T07:57:18.399 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 88441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/sysv/sysv.ko 2023-03-30T07:57:18.399 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/udf/ 2023-03-30T07:57:18.399 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 247873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/udf/udf.ko 2023-03-30T07:57:18.400 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ufs/ 2023-03-30T07:57:18.400 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 160129 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ufs/ufs.ko 2023-03-30T07:57:18.400 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/xfs/ 2023-03-30T07:57:18.400 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 3810937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/xfs/xfs.ko 2023-03-30T07:57:18.400 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/kernel/ 2023-03-30T07:57:18.400 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/kernel/locking/ 2023-03-30T07:57:18.400 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/kernel/locking/locktorture.ko 2023-03-30T07:57:18.400 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/kernel/time/ 2023-03-30T07:57:18.401 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/kernel/time/test_udelay.ko 2023-03-30T07:57:18.401 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/kernel/torture.ko 2023-03-30T07:57:18.401 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/ 2023-03-30T07:57:18.401 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 6033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/crc-itu-t.ko 2023-03-30T07:57:18.401 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 5729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/crc7.ko 2023-03-30T07:57:18.401 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 6081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/crc8.ko 2023-03-30T07:57:18.401 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/crypto/ 2023-03-30T07:57:18.401 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 6305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/crypto/libarc4.ko 2023-03-30T07:57:18.402 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/crypto/libdes.ko 2023-03-30T07:57:18.402 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/interval_tree_test.ko 2023-03-30T07:57:18.402 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/libcrc32c.ko 2023-03-30T07:57:18.402 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/lru_cache.ko 2023-03-30T07:57:18.402 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/lz4/ 2023-03-30T07:57:18.402 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/lz4/lz4_compress.ko 2023-03-30T07:57:18.402 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/lz4/lz4hc_compress.ko 2023-03-30T07:57:18.402 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/math/ 2023-03-30T07:57:18.403 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 5897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/math/cordic.ko 2023-03-30T07:57:18.403 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/memory-notifier-error-inject.ko 2023-03-30T07:57:18.403 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/notifier-error-inject.ko 2023-03-30T07:57:18.403 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/percpu_test.ko 2023-03-30T07:57:18.403 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/pm-notifier-error-inject.ko 2023-03-30T07:57:18.403 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/raid6/ 2023-03-30T07:57:18.403 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 141873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/raid6/raid6_pq.ko 2023-03-30T07:57:18.403 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/rbtree_test.ko 2023-03-30T07:57:18.404 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/reed_solomon/ 2023-03-30T07:57:18.404 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/reed_solomon/reed_solomon.ko 2023-03-30T07:57:18.404 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/test-kstrtox.ko 2023-03-30T07:57:18.404 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/test-string_helpers.ko 2023-03-30T07:57:18.404 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 4760329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/test_bpf.ko 2023-03-30T07:57:18.404 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 48057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/test_firmware.ko 2023-03-30T07:57:18.404 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 5873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/test_module.ko 2023-03-30T07:57:18.405 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/test_user_copy.ko 2023-03-30T07:57:18.405 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/ts_bm.ko 2023-03-30T07:57:18.405 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/ts_fsm.ko 2023-03-30T07:57:18.405 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/ts_kmp.ko 2023-03-30T07:57:18.405 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/xz/ 2023-03-30T07:57:18.405 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/xz/xz_dec_test.ko 2023-03-30T07:57:18.405 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/mm/ 2023-03-30T07:57:18.405 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/mm/hwpoison-inject.ko 2023-03-30T07:57:18.406 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ 2023-03-30T07:57:18.406 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/ 2023-03-30T07:57:18.406 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/6lowpan.ko 2023-03-30T07:57:18.406 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 6553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/nhc_dest.ko 2023-03-30T07:57:18.406 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 6577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/nhc_fragment.ko 2023-03-30T07:57:18.406 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 6553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/nhc_hop.ko 2023-03-30T07:57:18.406 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 6553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/nhc_ipv6.ko 2023-03-30T07:57:18.407 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 6577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/nhc_mobility.ko 2023-03-30T07:57:18.407 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 6577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/nhc_routing.ko 2023-03-30T07:57:18.407 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/nhc_udp.ko 2023-03-30T07:57:18.407 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/802/ 2023-03-30T07:57:18.407 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/802/garp.ko 2023-03-30T07:57:18.407 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/802/mrp.ko 2023-03-30T07:57:18.407 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/802/p8022.ko 2023-03-30T07:57:18.407 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/802/psnap.ko 2023-03-30T07:57:18.408 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/802/stp.ko 2023-03-30T07:57:18.408 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/8021q/ 2023-03-30T07:57:18.408 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 80641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/8021q/8021q.ko 2023-03-30T07:57:18.408 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/9p/ 2023-03-30T07:57:18.408 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 191305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/9p/9pnet.ko 2023-03-30T07:57:18.408 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/9p/9pnet_fd.ko 2023-03-30T07:57:18.408 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/9p/9pnet_rdma.ko 2023-03-30T07:57:18.408 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/9p/9pnet_virtio.ko 2023-03-30T07:57:18.409 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/batman-adv/ 2023-03-30T07:57:18.409 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 652281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/batman-adv/batman-adv.ko 2023-03-30T07:57:18.409 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/ 2023-03-30T07:57:18.409 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 63777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/br_netfilter.ko 2023-03-30T07:57:18.409 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 772145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/bridge.ko 2023-03-30T07:57:18.409 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ 2023-03-30T07:57:18.409 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-03-30T07:57:18.409 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_among.ko 2023-03-30T07:57:18.410 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_arp.ko 2023-03-30T07:57:18.410 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-03-30T07:57:18.410 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-03-30T07:57:18.410 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_ip.ko 2023-03-30T07:57:18.410 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-03-30T07:57:18.410 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_limit.ko 2023-03-30T07:57:18.410 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_log.ko 2023-03-30T07:57:18.410 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_mark.ko 2023-03-30T07:57:18.411 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-03-30T07:57:18.411 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-03-30T07:57:18.411 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-03-30T07:57:18.411 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-03-30T07:57:18.411 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_snat.ko 2023-03-30T07:57:18.411 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_stp.ko 2023-03-30T07:57:18.411 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-03-30T07:57:18.412 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-03-30T07:57:18.412 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-03-30T07:57:18.412 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-03-30T07:57:18.412 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 73961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebtables.ko 2023-03-30T07:57:18.412 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-03-30T07:57:18.412 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-03-30T07:57:18.412 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ceph/ 2023-03-30T07:57:18.412 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1031153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ceph/libceph.ko 2023-03-30T07:57:18.413 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/core/ 2023-03-30T07:57:18.413 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 124297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/core/pktgen.ko 2023-03-30T07:57:18.413 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dccp/ 2023-03-30T07:57:18.413 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 188577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dccp/dccp.ko 2023-03-30T07:57:18.413 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dccp/dccp_diag.ko 2023-03-30T07:57:18.413 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 55633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dccp/dccp_ipv4.ko 2023-03-30T07:57:18.413 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 58905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dccp/dccp_ipv6.ko 2023-03-30T07:57:18.413 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dsa/ 2023-03-30T07:57:18.414 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 272649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dsa/dsa_core.ko 2023-03-30T07:57:18.414 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dsa/tag_brcm.ko 2023-03-30T07:57:18.414 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dsa/tag_dsa.ko 2023-03-30T07:57:18.414 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dsa/tag_none.ko 2023-03-30T07:57:18.414 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dsa/tag_trailer.ko 2023-03-30T07:57:18.414 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/hsr/ 2023-03-30T07:57:18.414 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 99385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/hsr/hsr.ko 2023-03-30T07:57:18.415 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ieee802154/ 2023-03-30T07:57:18.415 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ieee802154/6lowpan/ 2023-03-30T07:57:18.415 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-03-30T07:57:18.415 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 245489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ieee802154/ieee802154.ko 2023-03-30T07:57:18.415 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ieee802154/ieee802154_socket.ko 2023-03-30T07:57:18.415 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/ 2023-03-30T07:57:18.415 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/ah4.ko 2023-03-30T07:57:18.415 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/esp4.ko 2023-03-30T07:57:18.416 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/fou.ko 2023-03-30T07:57:18.416 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/gre.ko 2023-03-30T07:57:18.416 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/inet_diag.ko 2023-03-30T07:57:18.416 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 59737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/ip_gre.ko 2023-03-30T07:57:18.416 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/ip_tunnel.ko 2023-03-30T07:57:18.416 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/ip_vti.ko 2023-03-30T07:57:18.416 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/ipcomp.ko 2023-03-30T07:57:18.416 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/ipip.ko 2023-03-30T07:57:18.417 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/ 2023-03-30T07:57:18.417 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/arp_tables.ko 2023-03-30T07:57:18.417 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-03-30T07:57:18.417 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-03-30T07:57:18.417 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53921 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/ip_tables.ko 2023-03-30T07:57:18.417 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-03-30T07:57:18.417 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-03-30T07:57:18.417 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-03-30T07:57:18.418 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-03-30T07:57:18.418 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-03-30T07:57:18.418 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-03-30T07:57:18.418 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-03-30T07:57:18.418 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-03-30T07:57:18.418 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-03-30T07:57:18.418 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/iptable_security.ko 2023-03-30T07:57:18.419 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-03-30T07:57:18.419 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-03-30T07:57:18.419 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-03-30T07:57:18.419 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-03-30T07:57:18.419 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-03-30T07:57:18.419 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-03-30T07:57:18.419 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-03-30T07:57:18.419 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-03-30T07:57:18.420 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-03-30T07:57:18.420 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-03-30T07:57:18.420 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-03-30T07:57:18.420 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_bic.ko 2023-03-30T07:57:18.420 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_dctcp.ko 2023-03-30T07:57:18.420 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_diag.ko 2023-03-30T07:57:18.420 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_highspeed.ko 2023-03-30T07:57:18.420 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_htcp.ko 2023-03-30T07:57:18.421 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_hybla.ko 2023-03-30T07:57:18.421 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_illinois.ko 2023-03-30T07:57:18.421 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_lp.ko 2023-03-30T07:57:18.421 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_scalable.ko 2023-03-30T07:57:18.421 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_vegas.ko 2023-03-30T07:57:18.421 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_veno.ko 2023-03-30T07:57:18.421 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_westwood.ko 2023-03-30T07:57:18.421 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_yeah.ko 2023-03-30T07:57:18.422 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tunnel4.ko 2023-03-30T07:57:18.422 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15921 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/udp_diag.ko 2023-03-30T07:57:18.422 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/udp_tunnel.ko 2023-03-30T07:57:18.422 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/xfrm4_tunnel.ko 2023-03-30T07:57:18.422 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/ 2023-03-30T07:57:18.422 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/ah6.ko 2023-03-30T07:57:18.422 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/esp6.ko 2023-03-30T07:57:18.423 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/fou6.ko 2023-03-30T07:57:18.423 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 80297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/ip6_gre.ko 2023-03-30T07:57:18.423 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 90857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/ip6_tunnel.ko 2023-03-30T07:57:18.423 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-03-30T07:57:18.423 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/ip6_vti.ko 2023-03-30T07:57:18.423 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/ipcomp6.ko 2023-03-30T07:57:18.423 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/mip6.ko 2023-03-30T07:57:18.423 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ 2023-03-30T07:57:18.424 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-03-30T07:57:18.424 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-03-30T07:57:18.424 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-03-30T07:57:18.424 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-03-30T07:57:18.424 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-03-30T07:57:18.424 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-03-30T07:57:18.424 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-03-30T07:57:18.424 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-03-30T07:57:18.425 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-03-30T07:57:18.425 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-03-30T07:57:18.425 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-03-30T07:57:18.425 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-03-30T07:57:18.425 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-03-30T07:57:18.425 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-03-30T07:57:18.425 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-03-30T07:57:18.426 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-03-30T07:57:18.426 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-03-30T07:57:18.426 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 37929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-03-30T07:57:18.426 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-03-30T07:57:18.426 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-03-30T07:57:18.426 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-03-30T07:57:18.426 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-03-30T07:57:18.426 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-03-30T07:57:18.427 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-03-30T07:57:18.427 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-03-30T07:57:18.427 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 72545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/sit.ko 2023-03-30T07:57:18.427 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/tunnel6.ko 2023-03-30T07:57:18.427 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/xfrm6_tunnel.ko 2023-03-30T07:57:18.427 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/key/ 2023-03-30T07:57:18.427 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 82505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/key/af_key.ko 2023-03-30T07:57:18.427 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/ 2023-03-30T07:57:18.428 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 120329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/l2tp_core.ko 2023-03-30T07:57:18.428 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/l2tp_debugfs.ko 2023-03-30T07:57:18.428 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/l2tp_eth.ko 2023-03-30T07:57:18.428 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 34969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/l2tp_ip.ko 2023-03-30T07:57:18.428 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/l2tp_ip6.ko 2023-03-30T07:57:18.428 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/l2tp_netlink.ko 2023-03-30T07:57:18.428 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 53121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/l2tp_ppp.ko 2023-03-30T07:57:18.428 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/lapb/ 2023-03-30T07:57:18.429 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 46641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/lapb/lapb.ko 2023-03-30T07:57:18.429 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/llc/ 2023-03-30T07:57:18.429 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/llc/llc.ko 2023-03-30T07:57:18.429 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 266497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/llc/llc2.ko 2023-03-30T07:57:18.429 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/mac802154/ 2023-03-30T07:57:18.429 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 279905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/mac802154/mac802154.ko 2023-03-30T07:57:18.429 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/mpls/ 2023-03-30T07:57:18.430 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/mpls/mpls_gso.ko 2023-03-30T07:57:18.430 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ 2023-03-30T07:57:18.430 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ 2023-03-30T07:57:18.430 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 116641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set.ko 2023-03-30T07:57:18.430 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-03-30T07:57:18.430 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-03-30T07:57:18.430 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-03-30T07:57:18.430 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 101537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-03-30T07:57:18.431 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 102681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-03-30T07:57:18.431 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 104097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-03-30T07:57:18.431 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 104697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-03-30T07:57:18.431 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 113953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-03-30T07:57:18.431 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 60665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-03-30T07:57:18.431 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 110721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-03-30T07:57:18.431 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 114241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-03-30T07:57:18.431 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 113889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-03-30T07:57:18.432 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 112713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-03-30T07:57:18.432 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 115777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-03-30T07:57:18.432 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-03-30T07:57:18.432 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ 2023-03-30T07:57:18.432 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 410137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs.ko 2023-03-30T07:57:18.432 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-03-30T07:57:18.432 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-03-30T07:57:18.432 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-03-30T07:57:18.433 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-03-30T07:57:18.433 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-03-30T07:57:18.433 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-03-30T07:57:18.433 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-03-30T07:57:18.433 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-03-30T07:57:18.433 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-03-30T07:57:18.433 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-03-30T07:57:18.434 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13089 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-03-30T07:57:18.434 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-03-30T07:57:18.434 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-03-30T07:57:18.434 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 47601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conncount.ko 2023-03-30T07:57:18.434 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 396769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack.ko 2023-03-30T07:57:18.434 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-03-30T07:57:18.434 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-03-30T07:57:18.434 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-03-30T07:57:18.435 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 117313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_h323.ko 2023-03-30T07:57:18.435 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_irc.ko 2023-03-30T07:57:18.435 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-03-30T07:57:18.435 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 107825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-03-30T07:57:18.435 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-03-30T07:57:18.435 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_sane.ko 2023-03-30T07:57:18.435 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 65305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_sip.ko 2023-03-30T07:57:18.435 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-03-30T07:57:18.436 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-03-30T07:57:18.436 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_dup_netdev.ko 2023-03-30T07:57:18.436 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 86233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_flow_table.ko 2023-03-30T07:57:18.436 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_flow_table_inet.ko 2023-03-30T07:57:18.436 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_log_syslog.ko 2023-03-30T07:57:18.436 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 91201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_nat.ko 2023-03-30T07:57:18.436 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_nat_amanda.ko 2023-03-30T07:57:18.437 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12129 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_nat_ftp.ko 2023-03-30T07:57:18.437 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_nat_irc.ko 2023-03-30T07:57:18.437 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_nat_sip.ko 2023-03-30T07:57:18.437 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_nat_tftp.ko 2023-03-30T07:57:18.437 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_synproxy_core.ko 2023-03-30T07:57:18.437 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 574417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_tables.ko 2023-03-30T07:57:18.437 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 42137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nfnetlink.ko 2023-03-30T07:57:18.437 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nfnetlink_acct.ko 2023-03-30T07:57:18.438 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-03-30T07:57:18.438 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nfnetlink_log.ko 2023-03-30T07:57:18.438 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 21793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nfnetlink_osf.ko 2023-03-30T07:57:18.438 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 49001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nfnetlink_queue.ko 2023-03-30T07:57:18.438 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_chain_nat.ko 2023-03-30T07:57:18.438 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_compat.ko 2023-03-30T07:57:18.438 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 40217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_ct.ko 2023-03-30T07:57:18.438 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_dup_netdev.ko 2023-03-30T07:57:18.439 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_fib.ko 2023-03-30T07:57:18.439 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_fwd_netdev.ko 2023-03-30T07:57:18.439 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_hash.ko 2023-03-30T07:57:18.439 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_limit.ko 2023-03-30T07:57:18.439 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_log.ko 2023-03-30T07:57:18.439 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_masq.ko 2023-03-30T07:57:18.439 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_nat.ko 2023-03-30T07:57:18.440 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_numgen.ko 2023-03-30T07:57:18.440 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_osf.ko 2023-03-30T07:57:18.440 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_queue.ko 2023-03-30T07:57:18.440 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_redir.ko 2023-03-30T07:57:18.440 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_reject.ko 2023-03-30T07:57:18.440 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_reject_inet.ko 2023-03-30T07:57:18.440 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_socket.ko 2023-03-30T07:57:18.440 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_synproxy.ko 2023-03-30T07:57:18.441 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_tproxy.ko 2023-03-30T07:57:18.441 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 98833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/x_tables.ko 2023-03-30T07:57:18.441 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_AUDIT.ko 2023-03-30T07:57:18.441 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_CHECKSUM.ko 2023-03-30T07:57:18.441 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_CLASSIFY.ko 2023-03-30T07:57:18.441 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-03-30T07:57:18.441 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_CT.ko 2023-03-30T07:57:18.441 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_DSCP.ko 2023-03-30T07:57:18.442 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_HL.ko 2023-03-30T07:57:18.442 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_HMARK.ko 2023-03-30T07:57:18.442 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 38513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_IDLETIMER.ko 2023-03-30T07:57:18.442 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_LED.ko 2023-03-30T07:57:18.442 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_LOG.ko 2023-03-30T07:57:18.442 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_MASQUERADE.ko 2023-03-30T07:57:18.442 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_NETMAP.ko 2023-03-30T07:57:18.443 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_NFLOG.ko 2023-03-30T07:57:18.443 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_NFQUEUE.ko 2023-03-30T07:57:18.443 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_RATEEST.ko 2023-03-30T07:57:18.443 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_REDIRECT.ko 2023-03-30T07:57:18.443 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_SECMARK.ko 2023-03-30T07:57:18.443 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_TCPMSS.ko 2023-03-30T07:57:18.443 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-03-30T07:57:18.443 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_TEE.ko 2023-03-30T07:57:18.444 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 16417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_TPROXY.ko 2023-03-30T07:57:18.444 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_TRACE.ko 2023-03-30T07:57:18.444 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_addrtype.ko 2023-03-30T07:57:18.444 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_bpf.ko 2023-03-30T07:57:18.444 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_cgroup.ko 2023-03-30T07:57:18.444 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_cluster.ko 2023-03-30T07:57:18.444 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_comment.ko 2023-03-30T07:57:18.444 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_connbytes.ko 2023-03-30T07:57:18.445 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_connlabel.ko 2023-03-30T07:57:18.445 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_connlimit.ko 2023-03-30T07:57:18.445 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_connmark.ko 2023-03-30T07:57:18.445 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_conntrack.ko 2023-03-30T07:57:18.445 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_cpu.ko 2023-03-30T07:57:18.445 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_dccp.ko 2023-03-30T07:57:18.445 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_devgroup.ko 2023-03-30T07:57:18.445 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_dscp.ko 2023-03-30T07:57:18.446 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_ecn.ko 2023-03-30T07:57:18.446 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_esp.ko 2023-03-30T07:57:18.446 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_hashlimit.ko 2023-03-30T07:57:18.446 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_helper.ko 2023-03-30T07:57:18.446 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_hl.ko 2023-03-30T07:57:18.446 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_ipcomp.ko 2023-03-30T07:57:18.446 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_iprange.ko 2023-03-30T07:57:18.446 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_ipvs.ko 2023-03-30T07:57:18.447 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_l2tp.ko 2023-03-30T07:57:18.447 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_length.ko 2023-03-30T07:57:18.447 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_limit.ko 2023-03-30T07:57:18.447 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_mac.ko 2023-03-30T07:57:18.447 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_mark.ko 2023-03-30T07:57:18.447 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_multiport.ko 2023-03-30T07:57:18.447 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_nat.ko 2023-03-30T07:57:18.447 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_nfacct.ko 2023-03-30T07:57:18.448 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_osf.ko 2023-03-30T07:57:18.448 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_owner.ko 2023-03-30T07:57:18.448 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_physdev.ko 2023-03-30T07:57:18.448 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_pkttype.ko 2023-03-30T07:57:18.448 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_policy.ko 2023-03-30T07:57:18.448 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_quota.ko 2023-03-30T07:57:18.448 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_rateest.ko 2023-03-30T07:57:18.449 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_realm.ko 2023-03-30T07:57:18.449 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_recent.ko 2023-03-30T07:57:18.449 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_sctp.ko 2023-03-30T07:57:18.449 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_set.ko 2023-03-30T07:57:18.449 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_socket.ko 2023-03-30T07:57:18.449 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_state.ko 2023-03-30T07:57:18.449 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_statistic.ko 2023-03-30T07:57:18.449 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_string.ko 2023-03-30T07:57:18.450 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8129 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_tcpmss.ko 2023-03-30T07:57:18.450 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_tcpudp.ko 2023-03-30T07:57:18.450 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_time.ko 2023-03-30T07:57:18.450 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_u32.ko 2023-03-30T07:57:18.450 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netlink/ 2023-03-30T07:57:18.450 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 13417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netlink/netlink_diag.ko 2023-03-30T07:57:18.450 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/nsh/ 2023-03-30T07:57:18.450 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/nsh/nsh.ko 2023-03-30T07:57:18.451 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/openvswitch/ 2023-03-30T07:57:18.451 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 377265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/openvswitch/openvswitch.ko 2023-03-30T07:57:18.451 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/openvswitch/vport-geneve.ko 2023-03-30T07:57:18.451 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/openvswitch/vport-gre.ko 2023-03-30T07:57:18.451 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 11361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/openvswitch/vport-vxlan.ko 2023-03-30T07:57:18.451 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/packet/ 2023-03-30T07:57:18.451 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/packet/af_packet_diag.ko 2023-03-30T07:57:18.451 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/phonet/ 2023-03-30T07:57:18.452 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 109633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/phonet/phonet.ko 2023-03-30T07:57:18.452 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 54353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/phonet/pn_pep.ko 2023-03-30T07:57:18.452 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/rds/ 2023-03-30T07:57:18.452 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 248545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/rds/rds.ko 2023-03-30T07:57:18.452 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 164641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/rds/rds_rdma.ko 2023-03-30T07:57:18.452 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 66441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/rds/rds_tcp.ko 2023-03-30T07:57:18.452 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/rxrpc/ 2023-03-30T07:57:18.452 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 805849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/rxrpc/rxrpc.ko 2023-03-30T07:57:18.453 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/ 2023-03-30T07:57:18.453 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_csum.ko 2023-03-30T07:57:18.453 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_gact.ko 2023-03-30T07:57:18.453 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 25249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_ipt.ko 2023-03-30T07:57:18.453 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_mirred.ko 2023-03-30T07:57:18.453 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_nat.ko 2023-03-30T07:57:18.453 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 39593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_pedit.ko 2023-03-30T07:57:18.454 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 31561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_police.ko 2023-03-30T07:57:18.454 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_simple.ko 2023-03-30T07:57:18.454 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35921 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_skbedit.ko 2023-03-30T07:57:18.454 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 35625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_vlan.ko 2023-03-30T07:57:18.454 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/cls_basic.ko 2023-03-30T07:57:18.454 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/cls_bpf.ko 2023-03-30T07:57:18.454 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/cls_cgroup.ko 2023-03-30T07:57:18.454 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/cls_flow.ko 2023-03-30T07:57:18.455 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/cls_fw.ko 2023-03-30T07:57:18.455 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 36793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/cls_route.ko 2023-03-30T07:57:18.455 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 57985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/cls_u32.ko 2023-03-30T07:57:18.455 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 6945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/em_cmp.ko 2023-03-30T07:57:18.455 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 12969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/em_ipset.ko 2023-03-30T07:57:18.455 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/em_meta.ko 2023-03-30T07:57:18.455 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 7393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/em_nbyte.ko 2023-03-30T07:57:18.455 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/em_text.ko 2023-03-30T07:57:18.456 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 6753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/em_u32.ko 2023-03-30T07:57:18.456 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_choke.ko 2023-03-30T07:57:18.456 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_codel.ko 2023-03-30T07:57:18.456 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 30441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_drr.ko 2023-03-30T07:57:18.456 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 29913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_fq.ko 2023-03-30T07:57:18.456 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_fq_codel.ko 2023-03-30T07:57:18.456 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 32145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_gred.ko 2023-03-30T07:57:18.456 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 44345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_hfsc.ko 2023-03-30T07:57:18.457 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_hhf.ko 2023-03-30T07:57:18.457 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 63001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_htb.ko 2023-03-30T07:57:18.457 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_ingress.ko 2023-03-30T07:57:18.457 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_mqprio.ko 2023-03-30T07:57:18.457 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_mqprio_lib.ko 2023-03-30T07:57:18.457 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_multiq.ko 2023-03-30T07:57:18.457 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 33329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_netem.ko 2023-03-30T07:57:18.457 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 23497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_pie.ko 2023-03-30T07:57:18.458 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_plug.ko 2023-03-30T07:57:18.458 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_prio.ko 2023-03-30T07:57:18.458 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 43969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_qfq.ko 2023-03-30T07:57:18.458 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 28697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_red.ko 2023-03-30T07:57:18.458 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 24881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_sfb.ko 2023-03-30T07:57:18.458 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 27985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_sfq.ko 2023-03-30T07:57:18.458 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_tbf.ko 2023-03-30T07:57:18.458 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 26857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_teql.ko 2023-03-30T07:57:18.459 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sctp/ 2023-03-30T07:57:18.459 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 920881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sctp/sctp.ko 2023-03-30T07:57:18.459 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 18601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sctp/sctp_diag.ko 2023-03-30T07:57:18.459 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sunrpc/ 2023-03-30T07:57:18.459 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sunrpc/auth_gss/ 2023-03-30T07:57:18.459 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 327521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-03-30T07:57:18.459 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 61329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-03-30T07:57:18.460 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 1405649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sunrpc/sunrpc.ko 2023-03-30T07:57:18.460 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sunrpc/xprtrdma/ 2023-03-30T07:57:18.460 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 681905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-03-30T07:57:18.460 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/tipc/ 2023-03-30T07:57:18.460 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 9593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/tipc/diag.ko 2023-03-30T07:57:18.460 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 853201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/tipc/tipc.ko 2023-03-30T07:57:18.460 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/unix/ 2023-03-30T07:57:18.460 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 15233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/unix/unix_diag.ko 2023-03-30T07:57:18.461 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/vmw_vsock/ 2023-03-30T07:57:18.461 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 76569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-03-30T07:57:18.461 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 67537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-03-30T07:57:18.461 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 82401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/vmw_vsock/vsock.ko 2023-03-30T07:57:18.461 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/vmw_vsock/vsock_diag.ko 2023-03-30T07:57:18.461 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 17281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/vmw_vsock/vsock_loopback.ko 2023-03-30T07:57:18.461 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/x25/ 2023-03-30T07:57:18.461 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 124593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/x25/x25.ko 2023-03-30T07:57:18.462 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/xfrm/ 2023-03-30T07:57:18.462 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 20793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/xfrm/xfrm_algo.ko 2023-03-30T07:57:18.462 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 19745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/xfrm/xfrm_ipcomp.ko 2023-03-30T07:57:18.462 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 101145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/xfrm/xfrm_user.ko 2023-03-30T07:57:18.462 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/virt/ 2023-03-30T07:57:18.462 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/virt/lib/ 2023-03-30T07:57:18.462 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 14433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/virt/lib/irqbypass.ko 2023-03-30T07:57:18.462 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 635968 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.alias 2023-03-30T07:57:18.463 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 622072 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.alias.bin 2023-03-30T07:57:18.463 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 8260 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.builtin 2023-03-30T07:57:18.463 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 22530 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.builtin.alias.bin 2023-03-30T07:57:18.463 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 10532 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.builtin.bin 2023-03-30T07:57:18.463 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 70097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.builtin.modinfo 2023-03-30T07:57:18.463 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 146789 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.dep 2023-03-30T07:57:18.463 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 233606 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.dep.bin 2023-03-30T07:57:18.463 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 210 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.devname 2023-03-30T07:57:18.464 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 73038 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.order 2023-03-30T07:57:18.464 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 879 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.softdep 2023-03-30T07:57:18.464 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 251759 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.symbols 2023-03-30T07:57:18.464 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 306289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.symbols.bin 2023-03-30T07:57:18.464 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./usr/ 2023-03-30T07:57:18.464 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./usr/share/ 2023-03-30T07:57:18.464 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./usr/share/doc/ 2023-03-30T07:57:18.464 INFO:teuthology.orchestra.run.smithi115.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./usr/share/doc/linux-image-6.3.0-rc3-g6c26fb6d76aa/ 2023-03-30T07:57:18.465 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 172 2023-03-30 03:03 ./usr/share/doc/linux-image-6.3.0-rc3-g6c26fb6d76aa/changelog.Debian.gz 2023-03-30T07:57:18.465 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r-- root/root 692 2023-03-30 03:03 ./usr/share/doc/linux-image-6.3.0-rc3-g6c26fb6d76aa/copyright 2023-03-30T07:57:18.466 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:18.467 INFO:teuthology.task.kernel:searching for kernel 6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:18.467 DEBUG:teuthology.orchestra.run.smithi115:> egrep '(submenu|menuentry.*6.3.0-rc3-g6c26fb6d76aa).*{' /boot/grub/grub.cfg 2023-03-30T07:57:18.475 INFO:teuthology.orchestra.run.smithi115.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-03-30T07:57:18.475 INFO:teuthology.orchestra.run.smithi115.stdout: menuentry 'Ubuntu, with Linux 6.3.0-rc3-g6c26fb6d76aa' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.3.0-rc3-g6c26fb6d76aa-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-03-30T07:57:18.475 INFO:teuthology.orchestra.run.smithi115.stdout: menuentry 'Ubuntu, with Linux 6.3.0-rc3-g6c26fb6d76aa (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.3.0-rc3-g6c26fb6d76aa-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-03-30T07:57:18.476 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-03-30T07:57:18.476 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:18.476 DEBUG:teuthology.orchestra.run.smithi115:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-03-30T07:57:18.520 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi115.front.sepia.ceph.com to complete... 2023-03-30T07:57:19.220 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub' 2023-03-30T07:57:19.230 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-03-30T07:57:19.245 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2023-03-30T07:57:19.492 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:19.504 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:19.899 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-03-30T07:57:19.910 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-03-30T07:57:20.733 INFO:teuthology.orchestra.run.smithi087.stderr:done 2023-03-30T07:57:20.921 DEBUG:teuthology.orchestra.run.smithi087:> dpkg-deb -c /tmp/linux-image.deb 2023-03-30T07:57:20.930 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./ 2023-03-30T07:57:20.931 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./boot/ 2023-03-30T07:57:20.931 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 4289084 2023-03-30 03:03 ./boot/System.map-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:20.945 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 166968 2023-03-30 03:03 ./boot/config-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:20.945 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11175968 2023-03-30 03:03 ./boot/vmlinuz-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:20.967 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./etc/ 2023-03-30T07:57:20.968 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./etc/kernel/ 2023-03-30T07:57:20.968 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./etc/kernel/postinst.d/ 2023-03-30T07:57:20.968 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./etc/kernel/postrm.d/ 2023-03-30T07:57:20.968 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./etc/kernel/preinst.d/ 2023-03-30T07:57:20.968 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./etc/kernel/prerm.d/ 2023-03-30T07:57:20.968 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/ 2023-03-30T07:57:20.968 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/ 2023-03-30T07:57:20.969 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/ 2023-03-30T07:57:20.969 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/ 2023-03-30T07:57:20.969 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/ 2023-03-30T07:57:20.969 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/ 2023-03-30T07:57:20.969 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/ 2023-03-30T07:57:20.969 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 527241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/aesni-intel.ko 2023-03-30T07:57:20.971 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-03-30T07:57:20.972 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-03-30T07:57:20.972 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-03-30T07:57:20.972 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 88505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-03-30T07:57:20.972 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 100081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-03-30T07:57:20.972 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 142185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-03-30T07:57:20.972 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-03-30T07:57:20.972 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-03-30T07:57:20.973 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 78905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-03-30T07:57:20.973 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-03-30T07:57:20.973 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-03-30T07:57:20.973 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/serpent-avx2.ko 2023-03-30T07:57:20.973 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-03-30T07:57:20.973 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-03-30T07:57:20.973 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-03-30T07:57:20.973 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 58273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-03-30T07:57:20.974 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-03-30T07:57:20.974 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-03-30T07:57:20.974 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-03-30T07:57:20.974 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kernel/ 2023-03-30T07:57:20.974 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kernel/cpu/ 2023-03-30T07:57:20.974 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kernel/cpu/mce/ 2023-03-30T07:57:20.974 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-03-30T07:57:20.974 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kernel/cpuid.ko 2023-03-30T07:57:20.975 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kernel/msr.ko 2023-03-30T07:57:20.975 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kvm/ 2023-03-30T07:57:20.975 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 341961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kvm/kvm-amd.ko 2023-03-30T07:57:20.975 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 970945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kvm/kvm-intel.ko 2023-03-30T07:57:20.975 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 2206561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/arch/x86/kvm/kvm.ko 2023-03-30T07:57:20.976 INFO:teuthology.orchestra.run.smithi115.stderr:done 2023-03-30T07:57:20.985 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/ 2023-03-30T07:57:20.985 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/af_alg.ko 2023-03-30T07:57:20.985 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/algif_hash.ko 2023-03-30T07:57:20.985 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/algif_skcipher.ko 2023-03-30T07:57:20.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/ansi_cprng.ko 2023-03-30T07:57:20.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/anubis.ko 2023-03-30T07:57:20.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/arc4.ko 2023-03-30T07:57:20.986 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/asymmetric_keys/ 2023-03-30T07:57:20.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-03-30T07:57:20.986 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/async_tx/ 2023-03-30T07:57:20.986 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/async_tx/async_memcpy.ko 2023-03-30T07:57:20.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/async_tx/async_pq.ko 2023-03-30T07:57:20.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/async_tx/async_raid6_recov.ko 2023-03-30T07:57:20.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/async_tx/async_tx.ko 2023-03-30T07:57:20.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/async_tx/async_xor.ko 2023-03-30T07:57:20.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/async_tx/raid6test.ko 2023-03-30T07:57:20.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/authenc.ko 2023-03-30T07:57:20.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/authencesn.ko 2023-03-30T07:57:20.987 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/blake2b_generic.ko 2023-03-30T07:57:20.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/blowfish_common.ko 2023-03-30T07:57:20.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/blowfish_generic.ko 2023-03-30T07:57:20.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/camellia_generic.ko 2023-03-30T07:57:20.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/cast5_generic.ko 2023-03-30T07:57:20.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/cast6_generic.ko 2023-03-30T07:57:20.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/cast_common.ko 2023-03-30T07:57:20.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/ccm.ko 2023-03-30T07:57:20.988 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/cmac.ko 2023-03-30T07:57:20.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9089 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/crc32_generic.ko 2023-03-30T07:57:20.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/cryptd.ko 2023-03-30T07:57:20.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/crypto_engine.ko 2023-03-30T07:57:20.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/crypto_simd.ko 2023-03-30T07:57:20.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/crypto_user.ko 2023-03-30T07:57:20.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/cts.ko 2023-03-30T07:57:20.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/des_generic.ko 2023-03-30T07:57:20.989 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/dh_generic.ko 2023-03-30T07:57:20.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/echainiv.ko 2023-03-30T07:57:20.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/essiv.ko 2023-03-30T07:57:20.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/fcrypt.ko 2023-03-30T07:57:20.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/khazad.ko 2023-03-30T07:57:20.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/lrw.ko 2023-03-30T07:57:20.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/lz4.ko 2023-03-30T07:57:20.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11089 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/lz4hc.ko 2023-03-30T07:57:20.990 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/md4.ko 2023-03-30T07:57:20.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/michael_mic.ko 2023-03-30T07:57:20.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/pcbc.ko 2023-03-30T07:57:20.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/pcrypt.ko 2023-03-30T07:57:20.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/rmd160.ko 2023-03-30T07:57:20.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/seed.ko 2023-03-30T07:57:20.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/serpent_generic.ko 2023-03-30T07:57:20.991 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 148761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/tcrypt.ko 2023-03-30T07:57:20.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/tea.ko 2023-03-30T07:57:20.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/twofish_common.ko 2023-03-30T07:57:20.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/twofish_generic.ko 2023-03-30T07:57:20.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/vmac.ko 2023-03-30T07:57:20.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/wp512.ko 2023-03-30T07:57:20.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/xcbc.ko 2023-03-30T07:57:20.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/xor.ko 2023-03-30T07:57:20.992 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/xts.ko 2023-03-30T07:57:20.993 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/crypto/xxhash_generic.ko 2023-03-30T07:57:20.993 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ 2023-03-30T07:57:20.993 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/ 2023-03-30T07:57:20.993 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/acpi_extlog.ko 2023-03-30T07:57:20.993 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/acpi_ipmi.ko 2023-03-30T07:57:20.993 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/acpi_pad.ko 2023-03-30T07:57:20.993 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/apei/ 2023-03-30T07:57:20.993 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/apei/einj.ko 2023-03-30T07:57:20.994 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/ec_sys.ko 2023-03-30T07:57:20.994 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/platform_profile.ko 2023-03-30T07:57:20.994 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/sbs.ko 2023-03-30T07:57:20.994 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/sbshc.ko 2023-03-30T07:57:20.994 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 99905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/acpi/video.ko 2023-03-30T07:57:20.994 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/ 2023-03-30T07:57:20.994 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/acard-ahci.ko 2023-03-30T07:57:20.994 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 88185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/ahci.ko 2023-03-30T07:57:20.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/ahci_platform.ko 2023-03-30T07:57:20.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 84753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/libahci.ko 2023-03-30T07:57:20.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/libahci_platform.ko 2023-03-30T07:57:20.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_acpi.ko 2023-03-30T07:57:20.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_ali.ko 2023-03-30T07:57:20.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_amd.ko 2023-03-30T07:57:20.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_artop.ko 2023-03-30T07:57:20.995 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_atiixp.ko 2023-03-30T07:57:20.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_atp867x.ko 2023-03-30T07:57:20.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17089 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_cmd640.ko 2023-03-30T07:57:20.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_cmd64x.ko 2023-03-30T07:57:20.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_cypress.ko 2023-03-30T07:57:20.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_efar.ko 2023-03-30T07:57:20.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_hpt366.ko 2023-03-30T07:57:20.996 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_hpt37x.ko 2023-03-30T07:57:20.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_hpt3x2n.ko 2023-03-30T07:57:20.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_hpt3x3.ko 2023-03-30T07:57:20.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_it8213.ko 2023-03-30T07:57:20.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_it821x.ko 2023-03-30T07:57:20.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_jmicron.ko 2023-03-30T07:57:20.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_legacy.ko 2023-03-30T07:57:20.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_marvell.ko 2023-03-30T07:57:20.997 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_mpiix.ko 2023-03-30T07:57:20.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_netcell.ko 2023-03-30T07:57:20.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_ninja32.ko 2023-03-30T07:57:20.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_ns87410.ko 2023-03-30T07:57:20.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_ns87415.ko 2023-03-30T07:57:20.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_oldpiix.ko 2023-03-30T07:57:20.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_opti.ko 2023-03-30T07:57:20.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_optidma.ko 2023-03-30T07:57:20.998 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_pcmcia.ko 2023-03-30T07:57:20.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_pdc2027x.ko 2023-03-30T07:57:20.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-03-30T07:57:20.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_piccolo.ko 2023-03-30T07:57:20.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_radisys.ko 2023-03-30T07:57:20.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_rdc.ko 2023-03-30T07:57:20.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_rz1000.ko 2023-03-30T07:57:20.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_sch.ko 2023-03-30T07:57:20.999 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_serverworks.ko 2023-03-30T07:57:21.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_sil680.ko 2023-03-30T07:57:21.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19129 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_sl82c105.ko 2023-03-30T07:57:21.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_triflex.ko 2023-03-30T07:57:21.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pata_via.ko 2023-03-30T07:57:21.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/pdc_adma.ko 2023-03-30T07:57:21.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_inic162x.ko 2023-03-30T07:57:21.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 82793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_mv.ko 2023-03-30T07:57:21.000 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_nv.ko 2023-03-30T07:57:21.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_promise.ko 2023-03-30T07:57:21.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_qstor.ko 2023-03-30T07:57:21.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_sil.ko 2023-03-30T07:57:21.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_sil24.ko 2023-03-30T07:57:21.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_sis.ko 2023-03-30T07:57:21.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_svw.ko 2023-03-30T07:57:21.001 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_sx4.ko 2023-03-30T07:57:21.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_uli.ko 2023-03-30T07:57:21.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_via.ko 2023-03-30T07:57:21.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ata/sata_vsc.ko 2023-03-30T07:57:21.002 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/auxdisplay/ 2023-03-30T07:57:21.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/auxdisplay/ks0108.ko 2023-03-30T07:57:21.002 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/bcma/ 2023-03-30T07:57:21.002 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 121249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/bcma/bcma.ko 2023-03-30T07:57:21.002 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/ 2023-03-30T07:57:21.003 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/aoe/ 2023-03-30T07:57:21.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 113145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/aoe/aoe.ko 2023-03-30T07:57:21.003 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/drbd/ 2023-03-30T07:57:21.003 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 963089 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/drbd/drbd.ko 2023-03-30T07:57:21.046 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 172809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/floppy.ko 2023-03-30T07:57:21.046 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/mtip32xx/ 2023-03-30T07:57:21.046 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 93865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-03-30T07:57:21.046 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 113657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/nbd.ko 2023-03-30T07:57:21.046 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/null_blk/ 2023-03-30T07:57:21.047 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 110577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/null_blk/null_blk.ko 2023-03-30T07:57:21.047 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 81753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/pktcdvd.ko 2023-03-30T07:57:21.047 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 253977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/rbd.ko 2023-03-30T07:57:21.047 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/xen-blkback/ 2023-03-30T07:57:21.047 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 97705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-03-30T07:57:21.047 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/zram/ 2023-03-30T07:57:21.047 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/block/zram/zram.ko 2023-03-30T07:57:21.047 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ 2023-03-30T07:57:21.048 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/applicom.ko 2023-03-30T07:57:21.048 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/hangcheck-timer.ko 2023-03-30T07:57:21.048 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/hw_random/ 2023-03-30T07:57:21.048 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/hw_random/amd-rng.ko 2023-03-30T07:57:21.048 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/hw_random/intel-rng.ko 2023-03-30T07:57:21.048 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-03-30T07:57:21.048 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/hw_random/via-rng.ko 2023-03-30T07:57:21.049 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15089 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/hw_random/virtio-rng.ko 2023-03-30T07:57:21.049 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ipmi/ 2023-03-30T07:57:21.049 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-03-30T07:57:21.049 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 147745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-03-30T07:57:21.049 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-03-30T07:57:21.049 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 138561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ipmi/ipmi_si.ko 2023-03-30T07:57:21.049 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-03-30T07:57:21.049 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-03-30T07:57:21.050 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/lp.ko 2023-03-30T07:57:21.050 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/mwave/ 2023-03-30T07:57:21.050 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 83625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/mwave/mwave.ko 2023-03-30T07:57:21.050 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/nvram.ko 2023-03-30T07:57:21.050 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/pcmcia/ 2023-03-30T07:57:21.050 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 102457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-03-30T07:57:21.050 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-03-30T07:57:21.050 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 83689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/pcmcia/synclink_cs.ko 2023-03-30T07:57:21.051 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/ppdev.ko 2023-03-30T07:57:21.051 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tlclk.ko 2023-03-30T07:57:21.051 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/ 2023-03-30T07:57:21.051 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/tpm_atmel.ko 2023-03-30T07:57:21.051 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-03-30T07:57:21.051 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-03-30T07:57:21.051 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-03-30T07:57:21.052 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/tpm_infineon.ko 2023-03-30T07:57:21.052 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/tpm_nsc.ko 2023-03-30T07:57:21.052 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-03-30T07:57:21.052 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/xillybus/ 2023-03-30T07:57:21.052 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/xillybus/xillybus_class.ko 2023-03-30T07:57:21.052 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/xillybus/xillybus_core.ko 2023-03-30T07:57:21.052 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-03-30T07:57:21.052 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/clk/ 2023-03-30T07:57:21.053 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/clk/clk-palmas.ko 2023-03-30T07:57:21.053 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/clk/clk-si5351.ko 2023-03-30T07:57:21.053 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/clk/clk-twl6040.ko 2023-03-30T07:57:21.053 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/clk/clk-wm831x.ko 2023-03-30T07:57:21.053 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/cpufreq/ 2023-03-30T07:57:21.053 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-03-30T07:57:21.053 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/cpufreq/p4-clockmod.ko 2023-03-30T07:57:21.053 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/cpufreq/speedstep-lib.ko 2023-03-30T07:57:21.054 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/ 2023-03-30T07:57:21.054 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/ccp/ 2023-03-30T07:57:21.054 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-03-30T07:57:21.054 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 223113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/ccp/ccp.ko 2023-03-30T07:57:21.054 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/padlock-aes.ko 2023-03-30T07:57:21.054 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/padlock-sha.ko 2023-03-30T07:57:21.054 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/qat/ 2023-03-30T07:57:21.054 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/qat/qat_common/ 2023-03-30T07:57:21.055 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 397793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-03-30T07:57:21.055 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/qat/qat_dh895xcc/ 2023-03-30T07:57:21.055 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-03-30T07:57:21.055 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/virtio/ 2023-03-30T07:57:21.055 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 68121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-03-30T07:57:21.055 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/dca/ 2023-03-30T07:57:21.055 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/dca/dca.ko 2023-03-30T07:57:21.056 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/dma/ 2023-03-30T07:57:21.056 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/dma/dw/ 2023-03-30T07:57:21.056 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/dma/dw/dw_dmac.ko 2023-03-30T07:57:21.056 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/dma/ioat/ 2023-03-30T07:57:21.056 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 122841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/dma/ioat/ioatdma.ko 2023-03-30T07:57:21.056 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/ 2023-03-30T07:57:21.056 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 73825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/amd64_edac.ko 2023-03-30T07:57:21.056 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/e752x_edac.ko 2023-03-30T07:57:21.057 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/edac_mce_amd.ko 2023-03-30T07:57:21.057 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/i3000_edac.ko 2023-03-30T07:57:21.057 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/i3200_edac.ko 2023-03-30T07:57:21.057 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/i5100_edac.ko 2023-03-30T07:57:21.057 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/i5400_edac.ko 2023-03-30T07:57:21.057 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/i7300_edac.ko 2023-03-30T07:57:21.057 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/i7core_edac.ko 2023-03-30T07:57:21.057 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/i82975x_edac.ko 2023-03-30T07:57:21.058 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/ie31200_edac.ko 2023-03-30T07:57:21.058 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 56369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/sb_edac.ko 2023-03-30T07:57:21.058 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/edac/x38_edac.ko 2023-03-30T07:57:21.058 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/ 2023-03-30T07:57:21.058 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/extcon-gpio.ko 2023-03-30T07:57:21.058 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/extcon-max14577.ko 2023-03-30T07:57:21.058 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/extcon-max77693.ko 2023-03-30T07:57:21.059 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/extcon-max8997.ko 2023-03-30T07:57:21.059 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/extcon-palmas.ko 2023-03-30T07:57:21.059 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/extcon-rt8973a.ko 2023-03-30T07:57:21.059 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/extcon/extcon-sm5502.ko 2023-03-30T07:57:21.059 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/firmware/ 2023-03-30T07:57:21.059 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/firmware/dmi-sysfs.ko 2023-03-30T07:57:21.059 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/firmware/efi/ 2023-03-30T07:57:21.059 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/firmware/efi/efi-pstore.ko 2023-03-30T07:57:21.060 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/firmware/iscsi_ibft.ko 2023-03-30T07:57:21.060 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/ 2023-03-30T07:57:21.060 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-adp5520.ko 2023-03-30T07:57:21.060 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-amd8111.ko 2023-03-30T07:57:21.060 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-arizona.ko 2023-03-30T07:57:21.060 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-da9052.ko 2023-03-30T07:57:21.060 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-da9055.ko 2023-03-30T07:57:21.060 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-dln2.ko 2023-03-30T07:57:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 77929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-f7188x.ko 2023-03-30T07:57:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-generic.ko 2023-03-30T07:57:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-ich.ko 2023-03-30T07:57:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-03-30T07:57:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-kempld.ko 2023-03-30T07:57:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-lp3943.ko 2023-03-30T07:57:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-max7300.ko 2023-03-30T07:57:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-max730x.ko 2023-03-30T07:57:21.062 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-max732x.ko 2023-03-30T07:57:21.062 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-03-30T07:57:21.062 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-pca953x.ko 2023-03-30T07:57:21.062 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-pcf857x.ko 2023-03-30T07:57:21.062 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-rdc321x.ko 2023-03-30T07:57:21.062 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-sch.ko 2023-03-30T07:57:21.062 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-sch311x.ko 2023-03-30T07:57:21.062 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-tps65912.ko 2023-03-30T07:57:21.063 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-twl4030.ko 2023-03-30T07:57:21.063 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-twl6040.ko 2023-03-30T07:57:21.063 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-viperboard.ko 2023-03-30T07:57:21.063 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-vx855.ko 2023-03-30T07:57:21.063 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-wm831x.ko 2023-03-30T07:57:21.063 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-wm8350.ko 2023-03-30T07:57:21.063 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/gpio/gpio-wm8994.ko 2023-03-30T07:57:21.064 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/ 2023-03-30T07:57:21.064 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-a4tech.ko 2023-03-30T07:57:21.064 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-apple.ko 2023-03-30T07:57:21.064 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-appleir.ko 2023-03-30T07:57:21.064 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-aureal.ko 2023-03-30T07:57:21.064 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-axff.ko 2023-03-30T07:57:21.064 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-belkin.ko 2023-03-30T07:57:21.064 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-cherry.ko 2023-03-30T07:57:21.065 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-chicony.ko 2023-03-30T07:57:21.065 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 58641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-cp2112.ko 2023-03-30T07:57:21.065 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-cypress.ko 2023-03-30T07:57:21.065 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-dr.ko 2023-03-30T07:57:21.065 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-elecom.ko 2023-03-30T07:57:21.065 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-elo.ko 2023-03-30T07:57:21.065 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-emsff.ko 2023-03-30T07:57:21.065 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-ezkey.ko 2023-03-30T07:57:21.066 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-gaff.ko 2023-03-30T07:57:21.066 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-generic.ko 2023-03-30T07:57:21.066 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-gt683r.ko 2023-03-30T07:57:21.066 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-gyration.ko 2023-03-30T07:57:21.066 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-holtek-kbd.ko 2023-03-30T07:57:21.066 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-holtek-mouse.ko 2023-03-30T07:57:21.066 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-holtekff.ko 2023-03-30T07:57:21.066 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-hyperv.ko 2023-03-30T07:57:21.067 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-icade.ko 2023-03-30T07:57:21.067 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-kensington.ko 2023-03-30T07:57:21.067 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-keytouch.ko 2023-03-30T07:57:21.067 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-kye.ko 2023-03-30T07:57:21.067 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-lcpower.ko 2023-03-30T07:57:21.067 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-led.ko 2023-03-30T07:57:21.067 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-lenovo.ko 2023-03-30T07:57:21.067 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-lg-g15.ko 2023-03-30T07:57:21.068 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-logitech-dj.ko 2023-03-30T07:57:21.068 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 94481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-03-30T07:57:21.068 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 80569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-logitech.ko 2023-03-30T07:57:21.068 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-magicmouse.ko 2023-03-30T07:57:21.068 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-microsoft.ko 2023-03-30T07:57:21.068 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-monterey.ko 2023-03-30T07:57:21.068 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-multitouch.ko 2023-03-30T07:57:21.069 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-ntrig.ko 2023-03-30T07:57:21.069 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-ortek.ko 2023-03-30T07:57:21.069 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-penmount.ko 2023-03-30T07:57:21.069 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-petalynx.ko 2023-03-30T07:57:21.069 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 72497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-picolcd.ko 2023-03-30T07:57:21.069 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-pl.ko 2023-03-30T07:57:21.069 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-plantronics.ko 2023-03-30T07:57:21.069 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-primax.ko 2023-03-30T07:57:21.070 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-rmi.ko 2023-03-30T07:57:21.070 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-arvo.ko 2023-03-30T07:57:21.070 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-common.ko 2023-03-30T07:57:21.070 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-isku.ko 2023-03-30T07:57:21.070 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-kone.ko 2023-03-30T07:57:21.070 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-03-30T07:57:21.070 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-konepure.ko 2023-03-30T07:57:21.070 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-03-30T07:57:21.071 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-lua.ko 2023-03-30T07:57:21.071 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-pyra.ko 2023-03-30T07:57:21.071 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-ryos.ko 2023-03-30T07:57:21.071 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat-savu.ko 2023-03-30T07:57:21.071 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-roccat.ko 2023-03-30T07:57:21.071 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-saitek.ko 2023-03-30T07:57:21.071 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-samsung.ko 2023-03-30T07:57:21.071 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-sensor-hub.ko 2023-03-30T07:57:21.072 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-sjoy.ko 2023-03-30T07:57:21.072 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-sony.ko 2023-03-30T07:57:21.072 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-speedlink.ko 2023-03-30T07:57:21.072 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-steelseries.ko 2023-03-30T07:57:21.072 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-sunplus.ko 2023-03-30T07:57:21.072 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-thrustmaster.ko 2023-03-30T07:57:21.072 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-tivo.ko 2023-03-30T07:57:21.072 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-tmff.ko 2023-03-30T07:57:21.073 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-topseed.ko 2023-03-30T07:57:21.073 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-twinhan.ko 2023-03-30T07:57:21.073 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 71017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-uclogic.ko 2023-03-30T07:57:21.073 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-waltop.ko 2023-03-30T07:57:21.073 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 143097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-wiimote.ko 2023-03-30T07:57:21.073 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-xinmo.ko 2023-03-30T07:57:21.073 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-zpff.ko 2023-03-30T07:57:21.074 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid-zydacron.ko 2023-03-30T07:57:21.074 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 260673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/hid.ko 2023-03-30T07:57:21.074 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/uhid.ko 2023-03-30T07:57:21.074 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/usbhid/ 2023-03-30T07:57:21.074 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 124897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/usbhid/usbhid.ko 2023-03-30T07:57:21.074 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/usbhid/usbkbd.ko 2023-03-30T07:57:21.074 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/usbhid/usbmouse.ko 2023-03-30T07:57:21.074 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 215033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hid/wacom.ko 2023-03-30T07:57:21.075 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hv/ 2023-03-30T07:57:21.075 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hv/hv_balloon.ko 2023-03-30T07:57:21.075 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 89177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hv/hv_utils.ko 2023-03-30T07:57:21.075 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 296049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hv/hv_vmbus.ko 2023-03-30T07:57:21.075 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ 2023-03-30T07:57:21.075 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 66169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/abituguru.ko 2023-03-30T07:57:21.075 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/abituguru3.ko 2023-03-30T07:57:21.075 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/acpi_power_meter.ko 2023-03-30T07:57:21.076 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ad7414.ko 2023-03-30T07:57:21.076 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ad7418.ko 2023-03-30T07:57:21.076 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adc128d818.ko 2023-03-30T07:57:21.076 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adm1025.ko 2023-03-30T07:57:21.076 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 97537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adm1026.ko 2023-03-30T07:57:21.076 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adm1029.ko 2023-03-30T07:57:21.076 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adm1031.ko 2023-03-30T07:57:21.076 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adm9240.ko 2023-03-30T07:57:21.077 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ads7828.ko 2023-03-30T07:57:21.077 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adt7410.ko 2023-03-30T07:57:21.077 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adt7411.ko 2023-03-30T07:57:21.077 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 74009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adt7462.ko 2023-03-30T07:57:21.077 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adt7470.ko 2023-03-30T07:57:21.077 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 64393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adt7475.ko 2023-03-30T07:57:21.077 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/adt7x10.ko 2023-03-30T07:57:21.077 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/amc6821.ko 2023-03-30T07:57:21.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/applesmc.ko 2023-03-30T07:57:21.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/asb100.ko 2023-03-30T07:57:21.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 58113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/asc7621.ko 2023-03-30T07:57:21.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/asus_atk0110.ko 2023-03-30T07:57:21.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/atxp1.ko 2023-03-30T07:57:21.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/coretemp.ko 2023-03-30T07:57:21.078 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/da9052-hwmon.ko 2023-03-30T07:57:21.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/da9055-hwmon.ko 2023-03-30T07:57:21.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-03-30T07:57:21.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 99161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/dme1737.ko 2023-03-30T07:57:21.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ds1621.ko 2023-03-30T07:57:21.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ds620.ko 2023-03-30T07:57:21.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/emc1403.ko 2023-03-30T07:57:21.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/emc2103.ko 2023-03-30T07:57:21.079 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/emc6w201.ko 2023-03-30T07:57:21.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 66481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/f71805f.ko 2023-03-30T07:57:21.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 94153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/f71882fg.ko 2023-03-30T07:57:21.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/f75375s.ko 2023-03-30T07:57:21.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/fam15h_power.ko 2023-03-30T07:57:21.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/fschmd.ko 2023-03-30T07:57:21.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/g760a.ko 2023-03-30T07:57:21.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/g762.ko 2023-03-30T07:57:21.080 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/gl518sm.ko 2023-03-30T07:57:21.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/gl520sm.ko 2023-03-30T07:57:21.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/hih6130.ko 2023-03-30T07:57:21.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/hwmon-vid.ko 2023-03-30T07:57:21.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/i5500_temp.ko 2023-03-30T07:57:21.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/i5k_amb.ko 2023-03-30T07:57:21.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ibmaem.ko 2023-03-30T07:57:21.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ibmpex.ko 2023-03-30T07:57:21.081 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ina209.ko 2023-03-30T07:57:21.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ina2xx.ko 2023-03-30T07:57:21.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 125729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/it87.ko 2023-03-30T07:57:21.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/jc42.ko 2023-03-30T07:57:21.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/k10temp.ko 2023-03-30T07:57:21.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/k8temp.ko 2023-03-30T07:57:21.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lineage-pem.ko 2023-03-30T07:57:21.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm63.ko 2023-03-30T07:57:21.082 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm73.ko 2023-03-30T07:57:21.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm75.ko 2023-03-30T07:57:21.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm77.ko 2023-03-30T07:57:21.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm78.ko 2023-03-30T07:57:21.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm80.ko 2023-03-30T07:57:21.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm83.ko 2023-03-30T07:57:21.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 72337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm85.ko 2023-03-30T07:57:21.083 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm87.ko 2023-03-30T07:57:21.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm90.ko 2023-03-30T07:57:21.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm92.ko 2023-03-30T07:57:21.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 108401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm93.ko 2023-03-30T07:57:21.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm95234.ko 2023-03-30T07:57:21.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm95241.ko 2023-03-30T07:57:21.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/lm95245.ko 2023-03-30T07:57:21.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ltc2945.ko 2023-03-30T07:57:21.084 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ltc4151.ko 2023-03-30T07:57:21.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ltc4215.ko 2023-03-30T07:57:21.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ltc4222.ko 2023-03-30T07:57:21.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ltc4245.ko 2023-03-30T07:57:21.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ltc4260.ko 2023-03-30T07:57:21.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/ltc4261.ko 2023-03-30T07:57:21.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/max16065.ko 2023-03-30T07:57:21.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/max1619.ko 2023-03-30T07:57:21.085 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/max1668.ko 2023-03-30T07:57:21.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/max197.ko 2023-03-30T07:57:21.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/max6639.ko 2023-03-30T07:57:21.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/max6650.ko 2023-03-30T07:57:21.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/max6697.ko 2023-03-30T07:57:21.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/mc13783-adc.ko 2023-03-30T07:57:21.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/mcp3021.ko 2023-03-30T07:57:21.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-03-30T07:57:21.086 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/nct6683.ko 2023-03-30T07:57:21.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 114257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/nct6775-core.ko 2023-03-30T07:57:21.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/nct6775.ko 2023-03-30T07:57:21.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/nct7802.ko 2023-03-30T07:57:21.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 81849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pc87360.ko 2023-03-30T07:57:21.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pc87427.ko 2023-03-30T07:57:21.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pcf8591.ko 2023-03-30T07:57:21.087 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/ 2023-03-30T07:57:21.087 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-03-30T07:57:21.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-03-30T07:57:21.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-03-30T07:57:21.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/max16064.ko 2023-03-30T07:57:21.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/max34440.ko 2023-03-30T07:57:21.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/max8688.ko 2023-03-30T07:57:21.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-03-30T07:57:21.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 71425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-03-30T07:57:21.088 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-03-30T07:57:21.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-03-30T07:57:21.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-03-30T07:57:21.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-03-30T07:57:21.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/powr1220.ko 2023-03-30T07:57:21.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/sch5627.ko 2023-03-30T07:57:21.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/sch5636.ko 2023-03-30T07:57:21.089 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/sch56xx-common.ko 2023-03-30T07:57:21.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/sht15.ko 2023-03-30T07:57:21.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/sht21.ko 2023-03-30T07:57:21.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/shtc1.ko 2023-03-30T07:57:21.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/sis5595.ko 2023-03-30T07:57:21.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/smm665.ko 2023-03-30T07:57:21.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/smsc47b397.ko 2023-03-30T07:57:21.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/smsc47m1.ko 2023-03-30T07:57:21.090 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/smsc47m192.ko 2023-03-30T07:57:21.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/thmc50.ko 2023-03-30T07:57:21.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/tmp102.ko 2023-03-30T07:57:21.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/tmp103.ko 2023-03-30T07:57:21.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/tmp401.ko 2023-03-30T07:57:21.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/tmp421.ko 2023-03-30T07:57:21.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/via-cputemp.ko 2023-03-30T07:57:21.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/via686a.ko 2023-03-30T07:57:21.091 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/vt1211.ko 2023-03-30T07:57:21.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/vt8231.ko 2023-03-30T07:57:21.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83627ehf.ko 2023-03-30T07:57:21.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 78441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83627hf.ko 2023-03-30T07:57:21.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83781d.ko 2023-03-30T07:57:21.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83791d.ko 2023-03-30T07:57:21.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83792d.ko 2023-03-30T07:57:21.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 100953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83793.ko 2023-03-30T07:57:21.092 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 119009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83795.ko 2023-03-30T07:57:21.093 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83l785ts.ko 2023-03-30T07:57:21.093 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/w83l786ng.ko 2023-03-30T07:57:21.093 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-03-30T07:57:21.093 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-03-30T07:57:21.093 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/ 2023-03-30T07:57:21.093 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/algos/ 2023-03-30T07:57:21.093 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-03-30T07:57:21.094 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-03-30T07:57:21.094 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/ 2023-03-30T07:57:21.094 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-03-30T07:57:21.094 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-03-30T07:57:21.094 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-03-30T07:57:21.094 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-03-30T07:57:21.094 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-03-30T07:57:21.094 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-03-30T07:57:21.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-03-30T07:57:21.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 6201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-03-30T07:57:21.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-03-30T07:57:21.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-03-30T07:57:21.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-03-30T07:57:21.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-03-30T07:57:21.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-03-30T07:57:21.095 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-03-30T07:57:21.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-03-30T07:57:21.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-i801.ko 2023-03-30T07:57:21.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-isch.ko 2023-03-30T07:57:21.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-03-30T07:57:21.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-03-30T07:57:21.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-03-30T07:57:21.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-03-30T07:57:21.096 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-03-30T07:57:21.097 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-parport.ko 2023-03-30T07:57:21.097 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-03-30T07:57:21.097 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-03-30T07:57:21.097 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-03-30T07:57:21.097 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-03-30T07:57:21.097 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-03-30T07:57:21.097 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-03-30T07:57:21.098 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-03-30T07:57:21.098 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-03-30T07:57:21.098 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-03-30T07:57:21.098 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-03-30T07:57:21.098 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-via.ko 2023-03-30T07:57:21.098 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-03-30T07:57:21.098 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-03-30T07:57:21.098 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-03-30T07:57:21.099 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/i2c-mux.ko 2023-03-30T07:57:21.099 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/i2c-smbus.ko 2023-03-30T07:57:21.099 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/i2c-stub.ko 2023-03-30T07:57:21.099 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/muxes/ 2023-03-30T07:57:21.099 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-03-30T07:57:21.099 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-03-30T07:57:21.099 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-03-30T07:57:21.099 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ 2023-03-30T07:57:21.100 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/ 2023-03-30T07:57:21.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 264089 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/ib_cm.ko 2023-03-30T07:57:21.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 848881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/ib_core.ko 2023-03-30T07:57:21.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 68233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/ib_umad.ko 2023-03-30T07:57:21.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 321625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-03-30T07:57:21.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 96473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/iw_cm.ko 2023-03-30T07:57:21.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 271681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/rdma_cm.ko 2023-03-30T07:57:21.100 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-03-30T07:57:21.101 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/ 2023-03-30T07:57:21.101 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/cxgb4/ 2023-03-30T07:57:21.101 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 492057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-03-30T07:57:21.101 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/mlx4/ 2023-03-30T07:57:21.101 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 418801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-03-30T07:57:21.101 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/mlx5/ 2023-03-30T07:57:21.101 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 732713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-03-30T07:57:21.102 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/mthca/ 2023-03-30T07:57:21.102 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 296153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-03-30T07:57:21.102 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/ocrdma/ 2023-03-30T07:57:21.102 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 153241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-03-30T07:57:21.102 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/usnic/ 2023-03-30T07:57:21.102 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 168513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-03-30T07:57:21.102 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/ 2023-03-30T07:57:21.102 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/ipoib/ 2023-03-30T07:57:21.103 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 262729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-03-30T07:57:21.103 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/iser/ 2023-03-30T07:57:21.103 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 99785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-03-30T07:57:21.103 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/isert/ 2023-03-30T07:57:21.103 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 110705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-03-30T07:57:21.103 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/srp/ 2023-03-30T07:57:21.103 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 128705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-03-30T07:57:21.103 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/srpt/ 2023-03-30T07:57:21.104 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 130009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-03-30T07:57:21.104 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/ 2023-03-30T07:57:21.104 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/evbug.ko 2023-03-30T07:57:21.104 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/ff-memless.ko 2023-03-30T07:57:21.104 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/gameport/ 2023-03-30T07:57:21.104 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-03-30T07:57:21.104 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/gameport/fm801-gp.ko 2023-03-30T07:57:21.104 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/gameport/gameport.ko 2023-03-30T07:57:21.105 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/gameport/lightning.ko 2023-03-30T07:57:21.105 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/gameport/ns558.ko 2023-03-30T07:57:21.105 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/joydev.ko 2023-03-30T07:57:21.105 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/ 2023-03-30T07:57:21.105 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-03-30T07:57:21.105 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-03-30T07:57:21.105 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-03-30T07:57:21.105 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-03-30T07:57:21.106 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/gpio_keys.ko 2023-03-30T07:57:21.106 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-03-30T07:57:21.106 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/lkkbd.ko 2023-03-30T07:57:21.106 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/lm8323.ko 2023-03-30T07:57:21.106 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/lm8333.ko 2023-03-30T07:57:21.106 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-03-30T07:57:21.106 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-03-30T07:57:21.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-03-30T07:57:21.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-03-30T07:57:21.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/newtonkbd.ko 2023-03-30T07:57:21.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-03-30T07:57:21.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/qt1070.ko 2023-03-30T07:57:21.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/qt2160.ko 2023-03-30T07:57:21.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-03-30T07:57:21.107 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/stowaway.ko 2023-03-30T07:57:21.108 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/sunkbd.ko 2023-03-30T07:57:21.108 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-03-30T07:57:21.108 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-03-30T07:57:21.108 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-03-30T07:57:21.108 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/keyboard/xtkbd.ko 2023-03-30T07:57:21.108 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/matrix-keymap.ko 2023-03-30T07:57:21.108 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/ 2023-03-30T07:57:21.108 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/appletouch.ko 2023-03-30T07:57:21.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/bcm5974.ko 2023-03-30T07:57:21.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 122977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/cyapatp.ko 2023-03-30T07:57:21.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 88929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/elan_i2c.ko 2023-03-30T07:57:21.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/gpio_mouse.ko 2023-03-30T07:57:21.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 334057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/psmouse.ko 2023-03-30T07:57:21.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/sermouse.ko 2023-03-30T07:57:21.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-03-30T07:57:21.109 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/synaptics_usb.ko 2023-03-30T07:57:21.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/mouse/vsxxxaa.ko 2023-03-30T07:57:21.110 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/rmi4/ 2023-03-30T07:57:21.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 107777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/rmi4/rmi_core.ko 2023-03-30T07:57:21.110 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/ 2023-03-30T07:57:21.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/altera_ps2.ko 2023-03-30T07:57:21.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/arc_ps2.ko 2023-03-30T07:57:21.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/ct82c710.ko 2023-03-30T07:57:21.110 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-03-30T07:57:21.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/parkbd.ko 2023-03-30T07:57:21.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/pcips2.ko 2023-03-30T07:57:21.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/ps2mult.ko 2023-03-30T07:57:21.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/serio_raw.ko 2023-03-30T07:57:21.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/serio/serport.ko 2023-03-30T07:57:21.111 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/input/sparse-keymap.ko 2023-03-30T07:57:21.111 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/iommu/ 2023-03-30T07:57:21.112 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/iommu/amd/ 2023-03-30T07:57:21.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/iommu/amd/iommu_v2.ko 2023-03-30T07:57:21.112 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/ 2023-03-30T07:57:21.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-88pm860x.ko 2023-03-30T07:57:21.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-adp5520.ko 2023-03-30T07:57:21.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-bd2802.ko 2023-03-30T07:57:21.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-blinkm.ko 2023-03-30T07:57:21.112 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-da903x.ko 2023-03-30T07:57:21.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-da9052.ko 2023-03-30T07:57:21.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-gpio.ko 2023-03-30T07:57:21.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-lm3530.ko 2023-03-30T07:57:21.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-lm3533.ko 2023-03-30T07:57:21.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-lm355x.ko 2023-03-30T07:57:21.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-lm3642.ko 2023-03-30T07:57:21.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-lp3944.ko 2023-03-30T07:57:21.113 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-lp8788.ko 2023-03-30T07:57:21.114 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-max8997.ko 2023-03-30T07:57:21.114 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-mc13783.ko 2023-03-30T07:57:21.114 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-menf21bmc.ko 2023-03-30T07:57:21.114 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-pca9532.ko 2023-03-30T07:57:21.114 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-pca955x.ko 2023-03-30T07:57:21.114 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-pca963x.ko 2023-03-30T07:57:21.114 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-ss4200.ko 2023-03-30T07:57:21.114 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-tca6507.ko 2023-03-30T07:57:21.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-wm831x-status.ko 2023-03-30T07:57:21.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/leds-wm8350.ko 2023-03-30T07:57:21.115 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ 2023-03-30T07:57:21.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-03-30T07:57:21.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-03-30T07:57:21.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-03-30T07:57:21.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-03-30T07:57:21.115 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-03-30T07:57:21.116 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-03-30T07:57:21.116 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-03-30T07:57:21.116 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-03-30T07:57:21.116 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-03-30T07:57:21.116 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/ 2023-03-30T07:57:21.116 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/bcache/ 2023-03-30T07:57:21.116 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 631593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/bcache/bcache.ko 2023-03-30T07:57:21.116 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-bio-prison.ko 2023-03-30T07:57:21.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 79553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-bufio.ko 2023-03-30T07:57:21.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-cache-smq.ko 2023-03-30T07:57:21.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 153889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-cache.ko 2023-03-30T07:57:21.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 105449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-crypt.ko 2023-03-30T07:57:21.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-delay.ko 2023-03-30T07:57:21.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-era.ko 2023-03-30T07:57:21.117 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-flakey.ko 2023-03-30T07:57:21.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-log-userspace.ko 2023-03-30T07:57:21.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-log.ko 2023-03-30T07:57:21.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-mirror.ko 2023-03-30T07:57:21.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 77297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-multipath.ko 2023-03-30T07:57:21.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-queue-length.ko 2023-03-30T07:57:21.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-raid.ko 2023-03-30T07:57:21.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-region-hash.ko 2023-03-30T07:57:21.118 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-round-robin.ko 2023-03-30T07:57:21.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-service-time.ko 2023-03-30T07:57:21.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 108881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-snapshot.ko 2023-03-30T07:57:21.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-switch.ko 2023-03-30T07:57:21.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 181193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-thin-pool.ko 2023-03-30T07:57:21.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-verity.ko 2023-03-30T07:57:21.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/dm-zero.ko 2023-03-30T07:57:21.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/faulty.ko 2023-03-30T07:57:21.119 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/linear.ko 2023-03-30T07:57:21.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/multipath.ko 2023-03-30T07:57:21.120 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/persistent-data/ 2023-03-30T07:57:21.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 192417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-03-30T07:57:21.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/raid0.ko 2023-03-30T07:57:21.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 111041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/raid1.ko 2023-03-30T07:57:21.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 158385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/raid10.ko 2023-03-30T07:57:21.120 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 391841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/md/raid456.ko 2023-03-30T07:57:21.120 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/ 2023-03-30T07:57:21.121 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/ 2023-03-30T07:57:21.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 174009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/mptbase.ko 2023-03-30T07:57:21.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/mptctl.ko 2023-03-30T07:57:21.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/mptfc.ko 2023-03-30T07:57:21.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/mptlan.ko 2023-03-30T07:57:21.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 122801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/mptsas.ko 2023-03-30T07:57:21.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 75937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/mptscsih.ko 2023-03-30T07:57:21.121 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/message/fusion/mptspi.ko 2023-03-30T07:57:21.122 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/ 2023-03-30T07:57:21.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/88pm800.ko 2023-03-30T07:57:21.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/88pm805.ko 2023-03-30T07:57:21.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/88pm80x.ko 2023-03-30T07:57:21.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/arizona-i2c.ko 2023-03-30T07:57:21.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 121913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/arizona.ko 2023-03-30T07:57:21.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/bcm590xx.ko 2023-03-30T07:57:21.122 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/cros_ec_dev.ko 2023-03-30T07:57:21.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/dln2.ko 2023-03-30T07:57:21.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/janz-cmodio.ko 2023-03-30T07:57:21.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/kempld-core.ko 2023-03-30T07:57:21.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/lm3533-core.ko 2023-03-30T07:57:21.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-03-30T07:57:21.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/lp3943.ko 2023-03-30T07:57:21.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/lpc_ich.ko 2023-03-30T07:57:21.123 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/lpc_sch.ko 2023-03-30T07:57:21.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/max8907.ko 2023-03-30T07:57:21.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/mc13xxx-core.ko 2023-03-30T07:57:21.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-03-30T07:57:21.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/menf21bmc.ko 2023-03-30T07:57:21.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/pcf50633-adc.ko 2023-03-30T07:57:21.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/pcf50633-gpio.ko 2023-03-30T07:57:21.124 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/pcf50633.ko 2023-03-30T07:57:21.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-03-30T07:57:21.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/retu-mfd.ko 2023-03-30T07:57:21.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 76113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/si476x-core.ko 2023-03-30T07:57:21.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/sm501.ko 2023-03-30T07:57:21.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-03-30T07:57:21.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/tps65010.ko 2023-03-30T07:57:21.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/tps6507x.ko 2023-03-30T07:57:21.125 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/viperboard.ko 2023-03-30T07:57:21.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/vx855.ko 2023-03-30T07:57:21.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/wl1273-core.ko 2023-03-30T07:57:21.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/mfd/wm8994.ko 2023-03-30T07:57:21.126 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ 2023-03-30T07:57:21.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-03-30T07:57:21.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ad525x_dpot.ko 2023-03-30T07:57:21.126 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/altera-stapl/ 2023-03-30T07:57:21.126 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-03-30T07:57:21.127 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/apds9802als.ko 2023-03-30T07:57:21.127 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/apds990x.ko 2023-03-30T07:57:21.127 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/bh1770glc.ko 2023-03-30T07:57:21.127 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/c2port/ 2023-03-30T07:57:21.127 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-03-30T07:57:21.127 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/c2port/core.ko 2023-03-30T07:57:21.127 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/cb710/ 2023-03-30T07:57:21.127 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/cb710/cb710.ko 2023-03-30T07:57:21.128 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ds1682.ko 2023-03-30T07:57:21.128 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/dummy-irq.ko 2023-03-30T07:57:21.128 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/echo/ 2023-03-30T07:57:21.128 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/echo/echo.ko 2023-03-30T07:57:21.128 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/eeprom/ 2023-03-30T07:57:21.128 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/eeprom/at24.ko 2023-03-30T07:57:21.128 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/eeprom/eeprom.ko 2023-03-30T07:57:21.128 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-03-30T07:57:21.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/eeprom/max6875.ko 2023-03-30T07:57:21.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/enclosure.ko 2023-03-30T07:57:21.129 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/genwqe/ 2023-03-30T07:57:21.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 151777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-03-30T07:57:21.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/hmc6352.ko 2023-03-30T07:57:21.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/hpilo.ko 2023-03-30T07:57:21.129 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ibmasm/ 2023-03-30T07:57:21.129 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 72177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-03-30T07:57:21.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ics932s401.ko 2023-03-30T07:57:21.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/isl29003.ko 2023-03-30T07:57:21.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/isl29020.ko 2023-03-30T07:57:21.130 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/lis3lv02d/ 2023-03-30T07:57:21.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-03-30T07:57:21.130 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-03-30T07:57:21.130 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/mei/ 2023-03-30T07:57:21.131 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 123577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/mei/mei-me.ko 2023-03-30T07:57:21.131 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 56017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/mei/mei-txe.ko 2023-03-30T07:57:21.131 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 304113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/mei/mei.ko 2023-03-30T07:57:21.131 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30921 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/phantom.ko 2023-03-30T07:57:21.131 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ti-st/ 2023-03-30T07:57:21.131 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 74113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/ti-st/st_drv.ko 2023-03-30T07:57:21.131 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/tifm_7xx1.ko 2023-03-30T07:57:21.131 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/tifm_core.ko 2023-03-30T07:57:21.132 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/tsl2550.ko 2023-03-30T07:57:21.132 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/vmw_balloon.ko 2023-03-30T07:57:21.132 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/vmw_vmci/ 2023-03-30T07:57:21.132 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 180377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-03-30T07:57:21.132 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ 2023-03-30T07:57:21.132 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/bonding/ 2023-03-30T07:57:21.132 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 484865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/bonding/bonding.ko 2023-03-30T07:57:21.132 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dsa/ 2023-03-30T07:57:21.133 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dsa/b53/ 2023-03-30T07:57:21.133 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 98553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dsa/b53/b53_common.ko 2023-03-30T07:57:21.133 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dsa/bcm-sf2.ko 2023-03-30T07:57:21.133 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dsa/mv88e6060.ko 2023-03-30T07:57:21.133 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dsa/mv88e6xxx/ 2023-03-30T07:57:21.133 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 446497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-03-30T07:57:21.133 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/dummy.ko 2023-03-30T07:57:21.133 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/eql.ko 2023-03-30T07:57:21.134 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/ 2023-03-30T07:57:21.134 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/3com/ 2023-03-30T07:57:21.134 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-03-30T07:57:21.134 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-03-30T07:57:21.134 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 130081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-03-30T07:57:21.134 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 68353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-03-30T07:57:21.134 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/8390/ 2023-03-30T07:57:21.134 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/8390/8390.ko 2023-03-30T07:57:21.135 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-03-30T07:57:21.135 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-03-30T07:57:21.135 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 98625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-03-30T07:57:21.135 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/adaptec/ 2023-03-30T07:57:21.135 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-03-30T07:57:21.135 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/agere/ 2023-03-30T07:57:21.135 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 68713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/agere/et131x.ko 2023-03-30T07:57:21.135 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/alteon/ 2023-03-30T07:57:21.136 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-03-30T07:57:21.136 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/altera/ 2023-03-30T07:57:21.136 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-03-30T07:57:21.136 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/amd/ 2023-03-30T07:57:21.136 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-03-30T07:57:21.136 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-03-30T07:57:21.136 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 86849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-03-30T07:57:21.137 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/ 2023-03-30T07:57:21.137 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/alx/ 2023-03-30T07:57:21.137 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 97153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-03-30T07:57:21.137 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-03-30T07:57:21.137 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 104297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-03-30T07:57:21.137 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-03-30T07:57:21.137 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 89745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-03-30T07:57:21.137 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/atlx/ 2023-03-30T07:57:21.138 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 80993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-03-30T07:57:21.138 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 69273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-03-30T07:57:21.138 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/ 2023-03-30T07:57:21.138 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 77881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-03-30T07:57:21.138 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 176761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-03-30T07:57:21.138 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-03-30T07:57:21.138 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1422009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-03-30T07:57:21.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 127561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-03-30T07:57:21.197 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/genet/ 2023-03-30T07:57:21.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 130553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-03-30T07:57:21.197 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 311593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-03-30T07:57:21.197 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/brocade/ 2023-03-30T07:57:21.198 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/brocade/bna/ 2023-03-30T07:57:21.198 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 323097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-03-30T07:57:21.198 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/ 2023-03-30T07:57:21.198 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-03-30T07:57:21.198 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 193001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-03-30T07:57:21.198 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-03-30T07:57:21.198 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 345433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-03-30T07:57:21.199 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-03-30T07:57:21.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1038497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-03-30T07:57:21.199 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-03-30T07:57:21.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 165945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-03-30T07:57:21.199 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-03-30T07:57:21.199 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-03-30T07:57:21.199 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/cisco/ 2023-03-30T07:57:21.199 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/cisco/enic/ 2023-03-30T07:57:21.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 203169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-03-30T07:57:21.200 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/ 2023-03-30T07:57:21.200 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/tulip/ 2023-03-30T07:57:21.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 68953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-03-30T07:57:21.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-03-30T07:57:21.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 140721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-03-30T07:57:21.200 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-03-30T07:57:21.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-03-30T07:57:21.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-03-30T07:57:21.201 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dlink/ 2023-03-30T07:57:21.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-03-30T07:57:21.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-03-30T07:57:21.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/dnet.ko 2023-03-30T07:57:21.201 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/ec_bhf.ko 2023-03-30T07:57:21.201 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/emulex/ 2023-03-30T07:57:21.202 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/emulex/benet/ 2023-03-30T07:57:21.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 280937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-03-30T07:57:21.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/ethoc.ko 2023-03-30T07:57:21.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/fealnx.ko 2023-03-30T07:57:21.202 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/fujitsu/ 2023-03-30T07:57:21.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-03-30T07:57:21.202 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/ 2023-03-30T07:57:21.202 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 89969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/e100.ko 2023-03-30T07:57:21.203 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/e1000/ 2023-03-30T07:57:21.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 295217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-03-30T07:57:21.203 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/e1000e/ 2023-03-30T07:57:21.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 583553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-03-30T07:57:21.203 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/fm10k/ 2023-03-30T07:57:21.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 245881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-03-30T07:57:21.203 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/i40e/ 2023-03-30T07:57:21.203 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 918193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-03-30T07:57:21.204 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/iavf/ 2023-03-30T07:57:21.204 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 302961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-03-30T07:57:21.204 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/igb/ 2023-03-30T07:57:21.204 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 513361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-03-30T07:57:21.204 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/igbvf/ 2023-03-30T07:57:21.204 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 91417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-03-30T07:57:21.204 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/ixgb/ 2023-03-30T07:57:21.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 124121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-03-30T07:57:21.205 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-03-30T07:57:21.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 733809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-03-30T07:57:21.205 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-03-30T07:57:21.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 151361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-03-30T07:57:21.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 86417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/jme.ko 2023-03-30T07:57:21.205 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/marvell/ 2023-03-30T07:57:21.205 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-03-30T07:57:21.206 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 101889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/marvell/skge.ko 2023-03-30T07:57:21.206 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 122185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-03-30T07:57:21.206 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/mellanox/ 2023-03-30T07:57:21.206 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-03-30T07:57:21.206 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 709977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-03-30T07:57:21.206 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 280017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-03-30T07:57:21.206 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-03-30T07:57:21.207 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-03-30T07:57:21.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1034713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-03-30T07:57:21.207 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/micrel/ 2023-03-30T07:57:21.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-03-30T07:57:21.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-03-30T07:57:21.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19129 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-03-30T07:57:21.207 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 95169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-03-30T07:57:21.207 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/myricom/ 2023-03-30T07:57:21.208 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-03-30T07:57:21.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 108305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-03-30T07:57:21.208 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/natsemi/ 2023-03-30T07:57:21.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 72945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-03-30T07:57:21.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-03-30T07:57:21.208 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/neterion/ 2023-03-30T07:57:21.208 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 150401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-03-30T07:57:21.208 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/nvidia/ 2023-03-30T07:57:21.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 136281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-03-30T07:57:21.209 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/packetengines/ 2023-03-30T07:57:21.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-03-30T07:57:21.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-03-30T07:57:21.209 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/qlogic/ 2023-03-30T07:57:21.209 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-03-30T07:57:21.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 227049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-03-30T07:57:21.209 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 86585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-03-30T07:57:21.210 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-03-30T07:57:21.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 671177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-03-30T07:57:21.210 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/rdc/ 2023-03-30T07:57:21.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-03-30T07:57:21.210 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/realtek/ 2023-03-30T07:57:21.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 66881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-03-30T07:57:21.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 83481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-03-30T07:57:21.210 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/realtek/atp.ko 2023-03-30T07:57:21.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 183017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-03-30T07:57:21.211 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/samsung/ 2023-03-30T07:57:21.211 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-03-30T07:57:21.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 103713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-03-30T07:57:21.211 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sfc/ 2023-03-30T07:57:21.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 862513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-03-30T07:57:21.211 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/silan/ 2023-03-30T07:57:21.211 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-03-30T07:57:21.212 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sis/ 2023-03-30T07:57:21.212 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sis/sis190.ko 2023-03-30T07:57:21.212 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 62841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sis/sis900.ko 2023-03-30T07:57:21.212 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/smsc/ 2023-03-30T07:57:21.212 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 61105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-03-30T07:57:21.212 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 66689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-03-30T07:57:21.212 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 72881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-03-30T07:57:21.212 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 67777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-03-30T07:57:21.213 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/stmicro/ 2023-03-30T07:57:21.213 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-03-30T07:57:21.213 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-03-30T07:57:21.213 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-03-30T07:57:21.213 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-03-30T07:57:21.213 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 475081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-03-30T07:57:21.213 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sun/ 2023-03-30T07:57:21.214 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 102945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sun/cassini.ko 2023-03-30T07:57:21.214 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 166097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sun/niu.ko 2023-03-30T07:57:21.214 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sun/sungem.ko 2023-03-30T07:57:21.214 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 83257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-03-30T07:57:21.214 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/tehuti/ 2023-03-30T07:57:21.214 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-03-30T07:57:21.214 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/ti/ 2023-03-30T07:57:21.214 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 86025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/ti/tlan.ko 2023-03-30T07:57:21.215 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/via/ 2023-03-30T07:57:21.215 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 79761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-03-30T07:57:21.215 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 83169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-03-30T07:57:21.215 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/wiznet/ 2023-03-30T07:57:21.215 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 45289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-03-30T07:57:21.215 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-03-30T07:57:21.215 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/xircom/ 2023-03-30T07:57:21.215 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 58025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-03-30T07:57:21.216 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/fddi/ 2023-03-30T07:57:21.216 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/fddi/defxx.ko 2023-03-30T07:57:21.216 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/fddi/skfp/ 2023-03-30T07:57:21.216 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 216481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/fddi/skfp/skfp.ko 2023-03-30T07:57:21.216 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 76673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/geneve.ko 2023-03-30T07:57:21.216 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/hyperv/ 2023-03-30T07:57:21.216 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 234841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-03-30T07:57:21.216 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ieee802154/ 2023-03-30T07:57:21.217 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ieee802154/fakelb.ko 2023-03-30T07:57:21.217 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ifb.ko 2023-03-30T07:57:21.217 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ipvlan/ 2023-03-30T07:57:21.217 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 82705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ipvlan/ipvlan.ko 2023-03-30T07:57:21.217 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/macvlan.ko 2023-03-30T07:57:21.217 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/macvtap.ko 2023-03-30T07:57:21.217 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/mdio/ 2023-03-30T07:57:21.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-03-30T07:57:21.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-03-30T07:57:21.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/mdio/mdio-gpio.ko 2023-03-30T07:57:21.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/mdio.ko 2023-03-30T07:57:21.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/mii.ko 2023-03-30T07:57:21.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/netconsole.ko 2023-03-30T07:57:21.218 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/nlmon.ko 2023-03-30T07:57:21.218 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/pcs/ 2023-03-30T07:57:21.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-03-30T07:57:21.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-03-30T07:57:21.219 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/ 2023-03-30T07:57:21.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/amd.ko 2023-03-30T07:57:21.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-03-30T07:57:21.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/bcm7xxx.ko 2023-03-30T07:57:21.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/bcm87xx.ko 2023-03-30T07:57:21.219 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/broadcom.ko 2023-03-30T07:57:21.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/cicada.ko 2023-03-30T07:57:21.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/davicom.ko 2023-03-30T07:57:21.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/et1011c.ko 2023-03-30T07:57:21.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/icplus.ko 2023-03-30T07:57:21.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/lxt.ko 2023-03-30T07:57:21.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 75673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/marvell.ko 2023-03-30T07:57:21.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 74561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/micrel.ko 2023-03-30T07:57:21.220 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/national.ko 2023-03-30T07:57:21.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 91361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/phylink.ko 2023-03-30T07:57:21.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/qsemi.ko 2023-03-30T07:57:21.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/realtek.ko 2023-03-30T07:57:21.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/smsc.ko 2023-03-30T07:57:21.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/ste10Xp.ko 2023-03-30T07:57:21.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/phy/vitesse.ko 2023-03-30T07:57:21.221 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/plip/ 2023-03-30T07:57:21.221 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/plip/plip.ko 2023-03-30T07:57:21.222 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/ 2023-03-30T07:57:21.222 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/bsd_comp.ko 2023-03-30T07:57:21.222 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/ppp_async.ko 2023-03-30T07:57:21.222 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/ppp_deflate.ko 2023-03-30T07:57:21.222 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/ppp_mppe.ko 2023-03-30T07:57:21.222 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/ppp_synctty.ko 2023-03-30T07:57:21.222 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/pppoe.ko 2023-03-30T07:57:21.223 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/pppox.ko 2023-03-30T07:57:21.223 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/ppp/pptp.ko 2023-03-30T07:57:21.223 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/sb1000.ko 2023-03-30T07:57:21.223 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/slip/ 2023-03-30T07:57:21.223 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/slip/slip.ko 2023-03-30T07:57:21.223 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/sungem_phy.ko 2023-03-30T07:57:21.223 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 63113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/tap.ko 2023-03-30T07:57:21.223 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/team/ 2023-03-30T07:57:21.224 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 104289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/team/team.ko 2023-03-30T07:57:21.224 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/team/team_mode_activebackup.ko 2023-03-30T07:57:21.224 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/team/team_mode_broadcast.ko 2023-03-30T07:57:21.224 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-03-30T07:57:21.224 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/team/team_mode_random.ko 2023-03-30T07:57:21.224 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-03-30T07:57:21.224 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 86649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/veth.ko 2023-03-30T07:57:21.224 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/vmxnet3/ 2023-03-30T07:57:21.225 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 119985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-03-30T07:57:21.225 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/vxlan/ 2023-03-30T07:57:21.225 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 238977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/vxlan/vxlan.ko 2023-03-30T07:57:21.225 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/xen-netback/ 2023-03-30T07:57:21.225 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 143225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/net/xen-netback/xen-netback.ko 2023-03-30T07:57:21.225 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ntb/ 2023-03-30T07:57:21.225 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ntb/ntb.ko 2023-03-30T07:57:21.225 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/nvme/ 2023-03-30T07:57:21.226 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/nvme/host/ 2023-03-30T07:57:21.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 257481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/nvme/host/nvme-core.ko 2023-03-30T07:57:21.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 101281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/nvme/host/nvme.ko 2023-03-30T07:57:21.226 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/parport/ 2023-03-30T07:57:21.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 128697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/parport/parport.ko 2023-03-30T07:57:21.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/parport/parport_cs.ko 2023-03-30T07:57:21.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 83385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/parport/parport_pc.ko 2023-03-30T07:57:21.226 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/parport/parport_serial.ko 2023-03-30T07:57:21.227 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pci/ 2023-03-30T07:57:21.227 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pci/hotplug/ 2023-03-30T07:57:21.227 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-03-30T07:57:21.227 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-03-30T07:57:21.227 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-03-30T07:57:21.227 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pci/pci-stub.ko 2023-03-30T07:57:21.227 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pci/xen-pcifront.ko 2023-03-30T07:57:21.227 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pcmcia/ 2023-03-30T07:57:21.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pcmcia/i82092.ko 2023-03-30T07:57:21.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 143273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pcmcia/pcmcia.ko 2023-03-30T07:57:21.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pcmcia/pcmcia_core.ko 2023-03-30T07:57:21.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-03-30T07:57:21.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pcmcia/pd6729.ko 2023-03-30T07:57:21.228 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 112481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pcmcia/yenta_socket.ko 2023-03-30T07:57:21.228 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/phy/ 2023-03-30T07:57:21.229 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/phy/broadcom/ 2023-03-30T07:57:21.229 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-03-30T07:57:21.229 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/phy/samsung/ 2023-03-30T07:57:21.229 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-03-30T07:57:21.229 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pinctrl/ 2023-03-30T07:57:21.229 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pinctrl/intel/ 2023-03-30T07:57:21.229 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-03-30T07:57:21.229 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/ 2023-03-30T07:57:21.230 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/ 2023-03-30T07:57:21.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-03-30T07:57:21.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/cros_ec.ko 2023-03-30T07:57:21.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-03-30T07:57:21.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-03-30T07:57:21.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-03-30T07:57:21.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-03-30T07:57:21.230 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-03-30T07:57:21.231 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/ 2023-03-30T07:57:21.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 66617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/acer-wmi.ko 2023-03-30T07:57:21.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/acerhdf.ko 2023-03-30T07:57:21.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/apple-gmux.ko 2023-03-30T07:57:21.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/asus-laptop.ko 2023-03-30T07:57:21.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-03-30T07:57:21.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 105913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/asus-wmi.ko 2023-03-30T07:57:21.231 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/classmate-laptop.ko 2023-03-30T07:57:21.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-03-30T07:57:21.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-03-30T07:57:21.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-03-30T07:57:21.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-03-30T07:57:21.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/hdaps.ko 2023-03-30T07:57:21.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/ibm_rtl.ko 2023-03-30T07:57:21.232 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/intel/ 2023-03-30T07:57:21.232 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-03-30T07:57:21.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-03-30T07:57:21.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/intel_ips.ko 2023-03-30T07:57:21.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/msi-wmi.ko 2023-03-30T07:57:21.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/mxm-wmi.ko 2023-03-30T07:57:21.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-03-30T07:57:21.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/samsung-laptop.ko 2023-03-30T07:57:21.233 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/samsung-q10.ko 2023-03-30T07:57:21.234 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/topstar-laptop.ko 2023-03-30T07:57:21.234 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-03-30T07:57:21.234 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/toshiba_haps.ko 2023-03-30T07:57:21.234 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/wmi-bmof.ko 2023-03-30T07:57:21.234 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/platform/x86/wmi.ko 2023-03-30T07:57:21.234 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/ 2023-03-30T07:57:21.234 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/ 2023-03-30T07:57:21.234 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/88pm860x_battery.ko 2023-03-30T07:57:21.235 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/88pm860x_charger.ko 2023-03-30T07:57:21.235 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/bq2415x_charger.ko 2023-03-30T07:57:21.235 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/bq24190_charger.ko 2023-03-30T07:57:21.235 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/bq24735-charger.ko 2023-03-30T07:57:21.235 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-03-30T07:57:21.235 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/da9030_battery.ko 2023-03-30T07:57:21.235 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/da9052-battery.ko 2023-03-30T07:57:21.235 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/ds2760_battery.ko 2023-03-30T07:57:21.236 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/ds2780_battery.ko 2023-03-30T07:57:21.236 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22921 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/ds2781_battery.ko 2023-03-30T07:57:21.236 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/ds2782_battery.ko 2023-03-30T07:57:21.236 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/gpio-charger.ko 2023-03-30T07:57:21.236 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/isp1704_charger.ko 2023-03-30T07:57:21.236 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/lp8727_charger.ko 2023-03-30T07:57:21.236 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/max14577_charger.ko 2023-03-30T07:57:21.236 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/max17040_battery.ko 2023-03-30T07:57:21.237 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/max17042_battery.ko 2023-03-30T07:57:21.237 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/max8903_charger.ko 2023-03-30T07:57:21.237 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/max8925_power.ko 2023-03-30T07:57:21.237 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/pcf50633-charger.ko 2023-03-30T07:57:21.237 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/sbs-battery.ko 2023-03-30T07:57:21.237 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/test_power.ko 2023-03-30T07:57:21.237 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/tps65090-charger.ko 2023-03-30T07:57:21.238 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/wm831x_backup.ko 2023-03-30T07:57:21.238 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/wm831x_power.ko 2023-03-30T07:57:21.238 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/power/supply/wm8350_power.ko 2023-03-30T07:57:21.238 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/powercap/ 2023-03-30T07:57:21.238 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/powercap/intel_rapl_common.ko 2023-03-30T07:57:21.238 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/powercap/intel_rapl_msr.ko 2023-03-30T07:57:21.238 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pps/ 2023-03-30T07:57:21.238 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pps/clients/ 2023-03-30T07:57:21.239 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pps/clients/pps-gpio.ko 2023-03-30T07:57:21.239 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pps/clients/pps-ldisc.ko 2023-03-30T07:57:21.239 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pps/clients/pps_parport.ko 2023-03-30T07:57:21.239 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/pps/pps_core.ko 2023-03-30T07:57:21.239 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ptp/ 2023-03-30T07:57:21.239 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 64265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ptp/ptp.ko 2023-03-30T07:57:21.239 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ptp/ptp_kvm.ko 2023-03-30T07:57:21.239 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/ 2023-03-30T07:57:21.240 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-88pm80x.ko 2023-03-30T07:57:21.240 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-88pm860x.ko 2023-03-30T07:57:21.240 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-bq32k.ko 2023-03-30T07:57:21.240 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-bq4802.ko 2023-03-30T07:57:21.240 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-da9052.ko 2023-03-30T07:57:21.240 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-da9055.ko 2023-03-30T07:57:21.240 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-da9063.ko 2023-03-30T07:57:21.240 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds1286.ko 2023-03-30T07:57:21.241 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 68081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds1307.ko 2023-03-30T07:57:21.241 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds1374.ko 2023-03-30T07:57:21.241 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds1511.ko 2023-03-30T07:57:21.241 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds1553.ko 2023-03-30T07:57:21.241 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds1672.ko 2023-03-30T07:57:21.241 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds1742.ko 2023-03-30T07:57:21.241 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds2404.ko 2023-03-30T07:57:21.242 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-ds3232.ko 2023-03-30T07:57:21.242 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-em3027.ko 2023-03-30T07:57:21.242 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-fm3130.ko 2023-03-30T07:57:21.242 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-isl12022.ko 2023-03-30T07:57:21.242 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-isl1208.ko 2023-03-30T07:57:21.242 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-lp8788.ko 2023-03-30T07:57:21.242 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-m41t80.ko 2023-03-30T07:57:21.242 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-m48t35.ko 2023-03-30T07:57:21.243 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-m48t59.ko 2023-03-30T07:57:21.243 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-m48t86.ko 2023-03-30T07:57:21.243 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-max6900.ko 2023-03-30T07:57:21.243 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-max8907.ko 2023-03-30T07:57:21.243 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-max8925.ko 2023-03-30T07:57:21.243 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-max8997.ko 2023-03-30T07:57:21.243 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-max8998.ko 2023-03-30T07:57:21.243 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-03-30T07:57:21.244 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-msm6242.ko 2023-03-30T07:57:21.244 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-palmas.ko 2023-03-30T07:57:21.244 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-pcf2127.ko 2023-03-30T07:57:21.244 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-pcf50633.ko 2023-03-30T07:57:21.244 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-pcf85063.ko 2023-03-30T07:57:21.244 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-pcf8523.ko 2023-03-30T07:57:21.244 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-pcf8563.ko 2023-03-30T07:57:21.244 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-pcf8583.ko 2023-03-30T07:57:21.245 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-rc5t583.ko 2023-03-30T07:57:21.245 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-rp5c01.ko 2023-03-30T07:57:21.245 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-rs5c372.ko 2023-03-30T07:57:21.245 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-03-30T07:57:21.245 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-rx8025.ko 2023-03-30T07:57:21.245 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-rx8581.ko 2023-03-30T07:57:21.245 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-s35390a.ko 2023-03-30T07:57:21.245 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-03-30T07:57:21.246 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-tps6586x.ko 2023-03-30T07:57:21.246 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-tps65910.ko 2023-03-30T07:57:21.246 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-wm831x.ko 2023-03-30T07:57:21.246 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-wm8350.ko 2023-03-30T07:57:21.246 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/rtc/rtc-x1205.ko 2023-03-30T07:57:21.246 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/ 2023-03-30T07:57:21.246 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 77209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/3w-9xxx.ko 2023-03-30T07:57:21.246 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/3w-sas.ko 2023-03-30T07:57:21.247 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/3w-xxxx.ko 2023-03-30T07:57:21.247 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 134673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/BusLogic.ko 2023-03-30T07:57:21.247 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/a100u2w.ko 2023-03-30T07:57:21.247 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/aacraid/ 2023-03-30T07:57:21.247 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 271161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/aacraid/aacraid.ko 2023-03-30T07:57:21.247 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 100129 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/advansys.ko 2023-03-30T07:57:21.247 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/aic7xxx/ 2023-03-30T07:57:21.247 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 355761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-03-30T07:57:21.248 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 295377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-03-30T07:57:21.248 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/aic94xx/ 2023-03-30T07:57:21.248 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 188825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-03-30T07:57:21.248 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/am53c974.ko 2023-03-30T07:57:21.248 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/arcmsr/ 2023-03-30T07:57:21.248 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 106065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-03-30T07:57:21.248 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37617 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/atp870u.ko 2023-03-30T07:57:21.249 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/be2iscsi/ 2023-03-30T07:57:21.249 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 246913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-03-30T07:57:21.249 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/bfa/ 2023-03-30T07:57:21.249 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1172201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/bfa/bfa.ko 2023-03-30T07:57:21.249 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/bnx2fc/ 2023-03-30T07:57:21.249 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 236737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-03-30T07:57:21.249 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/bnx2i/ 2023-03-30T07:57:21.249 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 114969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-03-30T07:57:21.250 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/ch.ko 2023-03-30T07:57:21.250 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/csiostor/ 2023-03-30T07:57:21.250 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 308401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/csiostor/csiostor.ko 2023-03-30T07:57:21.250 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/cxgbi/ 2023-03-30T07:57:21.250 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-03-30T07:57:21.250 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 75689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-03-30T07:57:21.250 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-03-30T07:57:21.250 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 101017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-03-30T07:57:21.251 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 141417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-03-30T07:57:21.251 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 75105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/dc395x.ko 2023-03-30T07:57:21.251 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/dmx3191d.ko 2023-03-30T07:57:21.251 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/esas2r/ 2023-03-30T07:57:21.251 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 211977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/esas2r/esas2r.ko 2023-03-30T07:57:21.251 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/esp_scsi.ko 2023-03-30T07:57:21.251 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/fcoe/ 2023-03-30T07:57:21.251 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 77713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/fcoe/fcoe.ko 2023-03-30T07:57:21.252 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 154601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-03-30T07:57:21.252 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/fdomain.ko 2023-03-30T07:57:21.252 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/fnic/ 2023-03-30T07:57:21.252 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 262025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/fnic/fnic.ko 2023-03-30T07:57:21.252 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 201305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/hpsa.ko 2023-03-30T07:57:21.252 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/hptiop.ko 2023-03-30T07:57:21.252 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/hv_storvsc.ko 2023-03-30T07:57:21.252 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/imm.ko 2023-03-30T07:57:21.253 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/initio.ko 2023-03-30T07:57:21.253 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 285985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/ipr.ko 2023-03-30T07:57:21.253 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 101449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/ips.ko 2023-03-30T07:57:21.253 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/isci/ 2023-03-30T07:57:21.253 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 316817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/isci/isci.ko 2023-03-30T07:57:21.253 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-03-30T07:57:21.253 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/iscsi_tcp.ko 2023-03-30T07:57:21.253 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/libfc/ 2023-03-30T07:57:21.254 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 307937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/libfc/libfc.ko 2023-03-30T07:57:21.254 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 139737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/libiscsi.ko 2023-03-30T07:57:21.254 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/libiscsi_tcp.ko 2023-03-30T07:57:21.254 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/libsas/ 2023-03-30T07:57:21.254 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 212217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/libsas/libsas.ko 2023-03-30T07:57:21.254 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/lpfc/ 2023-03-30T07:57:21.254 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 2194601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/lpfc/lpfc.ko 2023-03-30T07:57:21.254 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/megaraid/ 2023-03-30T07:57:21.255 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 73113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-03-30T07:57:21.255 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-03-30T07:57:21.255 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 310241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-03-30T07:57:21.255 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 84289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/megaraid.ko 2023-03-30T07:57:21.255 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/mpt3sas/ 2023-03-30T07:57:21.255 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 659793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-03-30T07:57:21.255 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/mvsas/ 2023-03-30T07:57:21.255 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 119425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/mvsas/mvsas.ko 2023-03-30T07:57:21.256 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 77665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/mvumi.ko 2023-03-30T07:57:21.256 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pcmcia/ 2023-03-30T07:57:21.256 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 81113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-03-30T07:57:21.256 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-03-30T07:57:21.256 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-03-30T07:57:21.256 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-03-30T07:57:21.256 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pm8001/ 2023-03-30T07:57:21.257 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 360881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-03-30T07:57:21.257 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 123073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/pmcraid.ko 2023-03-30T07:57:21.257 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/ppa.ko 2023-03-30T07:57:21.257 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/qla1280.ko 2023-03-30T07:57:21.257 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/qla2xxx/ 2023-03-30T07:57:21.257 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1850353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-03-30T07:57:21.257 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 85353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-03-30T07:57:21.257 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/qla4xxx/ 2023-03-30T07:57:21.258 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 558737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-03-30T07:57:21.258 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/qlogicfas408.ko 2023-03-30T07:57:21.258 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/raid_class.ko 2023-03-30T07:57:21.258 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 242441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/scsi_debug.ko 2023-03-30T07:57:21.258 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 171561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/scsi_transport_fc.ko 2023-03-30T07:57:21.258 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 270153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-03-30T07:57:21.258 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 94049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/scsi_transport_sas.ko 2023-03-30T07:57:21.258 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 72321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/scsi_transport_spi.ko 2023-03-30T07:57:21.259 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/scsi_transport_srp.ko 2023-03-30T07:57:21.259 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/ses.ko 2023-03-30T07:57:21.259 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 115409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/st.ko 2023-03-30T07:57:21.259 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/stex.ko 2023-03-30T07:57:21.259 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/sym53c8xx_2/ 2023-03-30T07:57:21.259 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 161697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-03-30T07:57:21.259 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/virtio_scsi.ko 2023-03-30T07:57:21.260 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/vmw_pvscsi.ko 2023-03-30T07:57:21.260 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/wd719x.ko 2023-03-30T07:57:21.260 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/scsi/xen-scsifront.ko 2023-03-30T07:57:21.260 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ssb/ 2023-03-30T07:57:21.260 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 126593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ssb/ssb.ko 2023-03-30T07:57:21.260 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/ 2023-03-30T07:57:21.260 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/iscsi/ 2023-03-30T07:57:21.260 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 730161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-03-30T07:57:21.261 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/loopback/ 2023-03-30T07:57:21.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/loopback/tcm_loop.ko 2023-03-30T07:57:21.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/target_core_file.ko 2023-03-30T07:57:21.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/target_core_iblock.ko 2023-03-30T07:57:21.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 913305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/target_core_mod.ko 2023-03-30T07:57:21.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/target_core_pscsi.ko 2023-03-30T07:57:21.261 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 121793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/target_core_user.ko 2023-03-30T07:57:21.261 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/tcm_fc/ 2023-03-30T07:57:21.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 75905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-03-30T07:57:21.262 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/ 2023-03-30T07:57:21.262 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/ 2023-03-30T07:57:21.262 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/ 2023-03-30T07:57:21.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-03-30T07:57:21.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-03-30T07:57:21.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-03-30T07:57:21.262 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-03-30T07:57:21.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-03-30T07:57:21.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-03-30T07:57:21.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-03-30T07:57:21.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-03-30T07:57:21.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-03-30T07:57:21.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-03-30T07:57:21.263 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-03-30T07:57:21.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-03-30T07:57:21.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/intel_menlow.ko 2023-03-30T07:57:21.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-03-30T07:57:21.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-03-30T07:57:21.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-03-30T07:57:21.264 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-03-30T07:57:21.264 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/ 2023-03-30T07:57:21.264 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/ipwireless/ 2023-03-30T07:57:21.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 77649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-03-30T07:57:21.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/moxa.ko 2023-03-30T07:57:21.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/mxser.ko 2023-03-30T07:57:21.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 104345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/n_gsm.ko 2023-03-30T07:57:21.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/n_hdlc.ko 2023-03-30T07:57:21.265 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 67641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/nozomi.ko 2023-03-30T07:57:21.265 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/ 2023-03-30T07:57:21.266 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/8250/ 2023-03-30T07:57:21.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-03-30T07:57:21.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-03-30T07:57:21.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-03-30T07:57:21.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/altera_uart.ko 2023-03-30T07:57:21.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/arc_uart.ko 2023-03-30T07:57:21.266 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 69473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-03-30T07:57:21.266 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/jsm/ 2023-03-30T07:57:21.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 102521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/jsm/jsm.ko 2023-03-30T07:57:21.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/rp2.ko 2023-03-30T07:57:21.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 51705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/serial/sc16is7xx.ko 2023-03-30T07:57:21.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 99985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/tty/synclink_gt.ko 2023-03-30T07:57:21.267 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ufs/ 2023-03-30T07:57:21.267 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ufs/core/ 2023-03-30T07:57:21.267 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 517745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ufs/core/ufshcd-core.ko 2023-03-30T07:57:21.267 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ufs/host/ 2023-03-30T07:57:21.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-03-30T07:57:21.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-03-30T07:57:21.268 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/ 2023-03-30T07:57:21.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio.ko 2023-03-30T07:57:21.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_aec.ko 2023-03-30T07:57:21.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_cif.ko 2023-03-30T07:57:21.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_dmem_genirq.ko 2023-03-30T07:57:21.268 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_mf624.ko 2023-03-30T07:57:21.269 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_netx.ko 2023-03-30T07:57:21.269 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_pci_generic.ko 2023-03-30T07:57:21.269 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-03-30T07:57:21.269 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/uio/uio_sercos3.ko 2023-03-30T07:57:21.269 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/ 2023-03-30T07:57:21.269 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/c67x00/ 2023-03-30T07:57:21.269 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 72777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/c67x00/c67x00.ko 2023-03-30T07:57:21.270 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/chipidea/ 2023-03-30T07:57:21.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 144113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-03-30T07:57:21.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-03-30T07:57:21.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-03-30T07:57:21.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-03-30T07:57:21.270 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/class/ 2023-03-30T07:57:21.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 85025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/class/cdc-acm.ko 2023-03-30T07:57:21.270 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/class/cdc-wdm.ko 2023-03-30T07:57:21.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/class/usblp.ko 2023-03-30T07:57:21.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 89409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/class/usbtmc.ko 2023-03-30T07:57:21.271 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/common/ 2023-03-30T07:57:21.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/common/ulpi.ko 2023-03-30T07:57:21.271 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/dwc2/ 2023-03-30T07:57:21.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-03-30T07:57:21.271 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/dwc3/ 2023-03-30T07:57:21.271 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-03-30T07:57:21.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-03-30T07:57:21.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 433481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/dwc3/dwc3.ko 2023-03-30T07:57:21.272 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/ 2023-03-30T07:57:21.272 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/ 2023-03-30T07:57:21.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/u_ether.ko 2023-03-30T07:57:21.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/u_serial.ko 2023-03-30T07:57:21.272 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-03-30T07:57:21.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-03-30T07:57:21.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-03-30T07:57:21.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-03-30T07:57:21.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 90865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-03-30T07:57:21.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-03-30T07:57:21.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 117593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-03-30T07:57:21.273 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-03-30T07:57:21.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-03-30T07:57:21.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-03-30T07:57:21.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-03-30T07:57:21.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 83697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-03-30T07:57:21.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-03-30T07:57:21.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 58001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-03-30T07:57:21.274 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 67977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-03-30T07:57:21.274 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/ 2023-03-30T07:57:21.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-03-30T07:57:21.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-03-30T07:57:21.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-03-30T07:57:21.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-03-30T07:57:21.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-03-30T07:57:21.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-03-30T07:57:21.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-03-30T07:57:21.275 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-03-30T07:57:21.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-03-30T07:57:21.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-03-30T07:57:21.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-03-30T07:57:21.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-03-30T07:57:21.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 61665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-03-30T07:57:21.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-03-30T07:57:21.276 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 154681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/libcomposite.ko 2023-03-30T07:57:21.276 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/ 2023-03-30T07:57:21.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-03-30T07:57:21.277 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/bdc/ 2023-03-30T07:57:21.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 157161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-03-30T07:57:21.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-03-30T07:57:21.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-03-30T07:57:21.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 69193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-03-30T07:57:21.277 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-03-30T07:57:21.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 75545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/net2272.ko 2023-03-30T07:57:21.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 74529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/net2280.ko 2023-03-30T07:57:21.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 72745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-03-30T07:57:21.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-03-30T07:57:21.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-03-30T07:57:21.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 79913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-03-30T07:57:21.278 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 139729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-03-30T07:57:21.278 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/ 2023-03-30T07:57:21.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/bcma-hcd.ko 2023-03-30T07:57:21.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 79593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/isp116x-hcd.ko 2023-03-30T07:57:21.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 87185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-03-30T07:57:21.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 78425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-03-30T07:57:21.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/sl811-hcd.ko 2023-03-30T07:57:21.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/sl811_cs.ko 2023-03-30T07:57:21.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/ssb-hcd.ko 2023-03-30T07:57:21.279 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 92241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/u132-hcd.ko 2023-03-30T07:57:21.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-03-30T07:57:21.280 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/image/ 2023-03-30T07:57:21.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/image/mdc800.ko 2023-03-30T07:57:21.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/image/microtek.ko 2023-03-30T07:57:21.280 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/ 2023-03-30T07:57:21.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/adutux.ko 2023-03-30T07:57:21.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/appledisplay.ko 2023-03-30T07:57:21.280 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-03-30T07:57:21.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/cytherm.ko 2023-03-30T07:57:21.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/ehset.ko 2023-03-30T07:57:21.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/emi26.ko 2023-03-30T07:57:21.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/emi62.ko 2023-03-30T07:57:21.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/ezusb.ko 2023-03-30T07:57:21.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 73217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/ftdi-elan.ko 2023-03-30T07:57:21.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/idmouse.ko 2023-03-30T07:57:21.281 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/iowarrior.ko 2023-03-30T07:57:21.282 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/isight_firmware.ko 2023-03-30T07:57:21.282 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/ldusb.ko 2023-03-30T07:57:21.282 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/legousbtower.ko 2023-03-30T07:57:21.282 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/lvstest.ko 2023-03-30T07:57:21.282 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/sisusbvga/ 2023-03-30T07:57:21.282 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 64033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-03-30T07:57:21.282 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/trancevibrator.ko 2023-03-30T07:57:21.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/usb3503.ko 2023-03-30T07:57:21.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/usblcd.ko 2023-03-30T07:57:21.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/usbsevseg.ko 2023-03-30T07:57:21.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/usbtest.ko 2023-03-30T07:57:21.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/uss720.ko 2023-03-30T07:57:21.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/misc/yurex.ko 2023-03-30T07:57:21.283 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/mon/ 2023-03-30T07:57:21.283 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 72321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/mon/usbmon.ko 2023-03-30T07:57:21.284 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/musb/ 2023-03-30T07:57:21.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 294641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/musb/musb_hdrc.ko 2023-03-30T07:57:21.284 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/phy/ 2023-03-30T07:57:21.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/phy/phy-generic.ko 2023-03-30T07:57:21.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-03-30T07:57:21.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/phy/phy-isp1301.ko 2023-03-30T07:57:21.284 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/phy/phy-tahvo.ko 2023-03-30T07:57:21.284 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ 2023-03-30T07:57:21.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/aircable.ko 2023-03-30T07:57:21.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ark3116.ko 2023-03-30T07:57:21.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/belkin_sa.ko 2023-03-30T07:57:21.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ch341.ko 2023-03-30T07:57:21.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 69489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/cp210x.ko 2023-03-30T07:57:21.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/cyberjack.ko 2023-03-30T07:57:21.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/cypress_m8.ko 2023-03-30T07:57:21.285 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/digi_acceleport.ko 2023-03-30T07:57:21.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/empeg.ko 2023-03-30T07:57:21.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/f81232.ko 2023-03-30T07:57:21.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 174409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ftdi_sio.ko 2023-03-30T07:57:21.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/garmin_gps.ko 2023-03-30T07:57:21.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 136441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/io_edgeport.ko 2023-03-30T07:57:21.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 124025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/io_ti.ko 2023-03-30T07:57:21.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 67329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ipaq.ko 2023-03-30T07:57:21.286 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ipw.ko 2023-03-30T07:57:21.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ir-usb.ko 2023-03-30T07:57:21.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-03-30T07:57:21.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 106985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/keyspan.ko 2023-03-30T07:57:21.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/keyspan_pda.ko 2023-03-30T07:57:21.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/kl5kusb105.ko 2023-03-30T07:57:21.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/kobil_sct.ko 2023-03-30T07:57:21.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/mct_u232.ko 2023-03-30T07:57:21.287 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/metro-usb.ko 2023-03-30T07:57:21.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/mos7720.ko 2023-03-30T07:57:21.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 77673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/mos7840.ko 2023-03-30T07:57:21.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/mxuport.ko 2023-03-30T07:57:21.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/navman.ko 2023-03-30T07:57:21.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/omninet.ko 2023-03-30T07:57:21.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/opticon.ko 2023-03-30T07:57:21.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 186601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/option.ko 2023-03-30T07:57:21.288 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/oti6858.ko 2023-03-30T07:57:21.289 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/pl2303.ko 2023-03-30T07:57:21.289 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/qcaux.ko 2023-03-30T07:57:21.289 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/qcserial.ko 2023-03-30T07:57:21.289 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/quatech2.ko 2023-03-30T07:57:21.289 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/safe_serial.ko 2023-03-30T07:57:21.289 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 50865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/sierra.ko 2023-03-30T07:57:21.289 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/spcp8x5.ko 2023-03-30T07:57:21.290 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ssu100.ko 2023-03-30T07:57:21.290 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/symbolserial.ko 2023-03-30T07:57:21.290 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-03-30T07:57:21.290 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-03-30T07:57:21.290 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/usb_debug.ko 2023-03-30T07:57:21.290 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/usb_wwan.ko 2023-03-30T07:57:21.290 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 122417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/usbserial.ko 2023-03-30T07:57:21.290 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/visor.ko 2023-03-30T07:57:21.291 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/whiteheat.ko 2023-03-30T07:57:21.291 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/wishbone-serial.ko 2023-03-30T07:57:21.291 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/serial/xsens_mt.ko 2023-03-30T07:57:21.291 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ 2023-03-30T07:57:21.291 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/uas.ko 2023-03-30T07:57:21.291 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-alauda.ko 2023-03-30T07:57:21.291 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-cypress.ko 2023-03-30T07:57:21.291 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-datafab.ko 2023-03-30T07:57:21.292 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-03-30T07:57:21.292 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-freecom.ko 2023-03-30T07:57:21.292 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-isd200.ko 2023-03-30T07:57:21.292 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-03-30T07:57:21.292 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-karma.ko 2023-03-30T07:57:21.292 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-onetouch.ko 2023-03-30T07:57:21.292 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-realtek.ko 2023-03-30T07:57:21.292 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-sddr09.ko 2023-03-30T07:57:21.293 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-sddr55.ko 2023-03-30T07:57:21.293 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/ums-usbat.ko 2023-03-30T07:57:21.293 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 176113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/storage/usb-storage.ko 2023-03-30T07:57:21.293 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/usbip/ 2023-03-30T07:57:21.293 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/usbip/usbip-core.ko 2023-03-30T07:57:21.293 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 71009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/usbip/usbip-host.ko 2023-03-30T07:57:21.293 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 104905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-03-30T07:57:21.293 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vfio/ 2023-03-30T07:57:21.294 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vfio/pci/ 2023-03-30T07:57:21.294 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 145057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-03-30T07:57:21.294 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vfio/pci/vfio-pci.ko 2023-03-30T07:57:21.294 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 97561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vfio/vfio.ko 2023-03-30T07:57:21.294 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 71321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-03-30T07:57:21.294 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vhost/ 2023-03-30T07:57:21.294 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 98209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vhost/vhost.ko 2023-03-30T07:57:21.295 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vhost/vhost_iotlb.ko 2023-03-30T07:57:21.295 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vhost/vhost_net.ko 2023-03-30T07:57:21.295 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 88633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/vhost/vhost_scsi.ko 2023-03-30T07:57:21.295 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/ 2023-03-30T07:57:21.295 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/ 2023-03-30T07:57:21.295 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-03-30T07:57:21.295 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/aat2870_bl.ko 2023-03-30T07:57:21.295 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/adp5520_bl.ko 2023-03-30T07:57:21.296 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/adp8860_bl.ko 2023-03-30T07:57:21.296 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/adp8870_bl.ko 2023-03-30T07:57:21.296 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/apple_bl.ko 2023-03-30T07:57:21.296 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/as3711_bl.ko 2023-03-30T07:57:21.296 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/bd6107.ko 2023-03-30T07:57:21.296 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/da903x_bl.ko 2023-03-30T07:57:21.296 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/da9052_bl.ko 2023-03-30T07:57:21.296 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/gpio_backlight.ko 2023-03-30T07:57:21.297 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14337 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/kb3886_bl.ko 2023-03-30T07:57:21.297 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/lcd.ko 2023-03-30T07:57:21.297 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/lm3533_bl.ko 2023-03-30T07:57:21.297 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/lm3639_bl.ko 2023-03-30T07:57:21.297 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/lv5207lp.ko 2023-03-30T07:57:21.297 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/max8925_bl.ko 2023-03-30T07:57:21.297 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/pandora_bl.ko 2023-03-30T07:57:21.297 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-03-30T07:57:21.298 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/platform_lcd.ko 2023-03-30T07:57:21.298 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/video/backlight/wm831x_bl.ko 2023-03-30T07:57:21.298 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/ 2023-03-30T07:57:21.298 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/masters/ 2023-03-30T07:57:21.298 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/masters/ds2482.ko 2023-03-30T07:57:21.298 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/masters/ds2490.ko 2023-03-30T07:57:21.298 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/masters/matrox_w1.ko 2023-03-30T07:57:21.298 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/masters/w1-gpio.ko 2023-03-30T07:57:21.299 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/ 2023-03-30T07:57:21.299 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-03-30T07:57:21.299 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-03-30T07:57:21.299 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-03-30T07:57:21.299 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-03-30T07:57:21.299 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-03-30T07:57:21.300 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-03-30T07:57:21.300 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-03-30T07:57:21.300 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-03-30T07:57:21.300 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-03-30T07:57:21.300 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 6889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_smem.ko 2023-03-30T07:57:21.300 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/slaves/w1_therm.ko 2023-03-30T07:57:21.300 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 101081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/w1/wire.ko 2023-03-30T07:57:21.300 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/ 2023-03-30T07:57:21.301 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/acquirewdt.ko 2023-03-30T07:57:21.301 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/advantechwdt.ko 2023-03-30T07:57:21.301 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18129 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/alim1535_wdt.ko 2023-03-30T07:57:21.301 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/alim7101_wdt.ko 2023-03-30T07:57:21.301 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/cpu5wdt.ko 2023-03-30T07:57:21.301 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/da9052_wdt.ko 2023-03-30T07:57:21.301 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/da9055_wdt.ko 2023-03-30T07:57:21.302 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/da9063_wdt.ko 2023-03-30T07:57:21.302 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/dw_wdt.ko 2023-03-30T07:57:21.302 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/eurotechwdt.ko 2023-03-30T07:57:21.302 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/f71808e_wdt.ko 2023-03-30T07:57:21.302 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/hpwdt.ko 2023-03-30T07:57:21.302 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/i6300esb.ko 2023-03-30T07:57:21.302 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-03-30T07:57:21.302 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/iTCO_wdt.ko 2023-03-30T07:57:21.303 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/ib700wdt.ko 2023-03-30T07:57:21.303 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/ibmasr.ko 2023-03-30T07:57:21.303 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-03-30T07:57:21.303 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/it8712f_wdt.ko 2023-03-30T07:57:21.303 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/it87_wdt.ko 2023-03-30T07:57:21.303 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/kempld_wdt.ko 2023-03-30T07:57:21.303 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/machzwd.ko 2023-03-30T07:57:21.303 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/mena21_wdt.ko 2023-03-30T07:57:21.304 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-03-30T07:57:21.304 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/nv_tco.ko 2023-03-30T07:57:21.304 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-03-30T07:57:21.304 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/pc87413_wdt.ko 2023-03-30T07:57:21.304 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/pcwd_pci.ko 2023-03-30T07:57:21.304 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/pcwd_usb.ko 2023-03-30T07:57:21.304 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/retu_wdt.ko 2023-03-30T07:57:21.305 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-03-30T07:57:21.305 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-03-30T07:57:21.305 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-03-30T07:57:21.305 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/sc1200wdt.ko 2023-03-30T07:57:21.305 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/sch311x_wdt.ko 2023-03-30T07:57:21.305 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-03-30T07:57:21.305 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/softdog.ko 2023-03-30T07:57:21.305 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/sp5100_tco.ko 2023-03-30T07:57:21.306 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/twl4030_wdt.ko 2023-03-30T07:57:21.306 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/via_wdt.ko 2023-03-30T07:57:21.306 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-03-30T07:57:21.306 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/w83877f_wdt.ko 2023-03-30T07:57:21.306 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/w83977f_wdt.ko 2023-03-30T07:57:21.306 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/wafer5823wdt.ko 2023-03-30T07:57:21.306 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/wdt_pci.ko 2023-03-30T07:57:21.306 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/wm831x_wdt.ko 2023-03-30T07:57:21.307 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/wm8350_wdt.ko 2023-03-30T07:57:21.307 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/watchdog/xen_wdt.ko 2023-03-30T07:57:21.307 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/ 2023-03-30T07:57:21.307 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xen-evtchn.ko 2023-03-30T07:57:21.307 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xen-gntalloc.ko 2023-03-30T07:57:21.307 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xen-gntdev.ko 2023-03-30T07:57:21.307 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xen-pciback/ 2023-03-30T07:57:21.308 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 176105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-03-30T07:57:21.308 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xen-privcmd.ko 2023-03-30T07:57:21.308 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 71513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xen-scsiback.ko 2023-03-30T07:57:21.308 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xenfs/ 2023-03-30T07:57:21.308 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/drivers/xen/xenfs/xenfs.ko 2023-03-30T07:57:21.308 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ 2023-03-30T07:57:21.308 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/9p/ 2023-03-30T07:57:21.308 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 171305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/9p/9p.ko 2023-03-30T07:57:21.309 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/adfs/ 2023-03-30T07:57:21.309 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/adfs/adfs.ko 2023-03-30T07:57:21.309 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/affs/ 2023-03-30T07:57:21.309 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 162241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/affs/affs.ko 2023-03-30T07:57:21.309 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/afs/ 2023-03-30T07:57:21.309 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 924521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/afs/kafs.ko 2023-03-30T07:57:21.309 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/autofs/ 2023-03-30T07:57:21.309 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 100321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/autofs/autofs4.ko 2023-03-30T07:57:21.310 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/befs/ 2023-03-30T07:57:21.310 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 63977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/befs/befs.ko 2023-03-30T07:57:21.310 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/bfs/ 2023-03-30T07:57:21.310 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/bfs/bfs.ko 2023-03-30T07:57:21.310 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/binfmt_misc.ko 2023-03-30T07:57:21.310 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/btrfs/ 2023-03-30T07:57:21.310 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 3476441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/btrfs/btrfs.ko 2023-03-30T07:57:21.310 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/cachefiles/ 2023-03-30T07:57:21.311 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 299529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/cachefiles/cachefiles.ko 2023-03-30T07:57:21.311 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ceph/ 2023-03-30T07:57:21.311 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1225985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ceph/ceph.ko 2023-03-30T07:57:21.311 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/cifs/ 2023-03-30T07:57:21.311 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 2611009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/cifs/cifs.ko 2023-03-30T07:57:21.311 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/coda/ 2023-03-30T07:57:21.311 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 99153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/coda/coda.ko 2023-03-30T07:57:21.311 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/configfs/ 2023-03-30T07:57:21.312 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 105385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/configfs/configfs.ko 2023-03-30T07:57:21.312 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/cramfs/ 2023-03-30T07:57:21.312 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/cramfs/cramfs.ko 2023-03-30T07:57:21.312 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/dlm/ 2023-03-30T07:57:21.312 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 624153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/dlm/dlm.ko 2023-03-30T07:57:21.312 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/efs/ 2023-03-30T07:57:21.312 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/efs/efs.ko 2023-03-30T07:57:21.312 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/f2fs/ 2023-03-30T07:57:21.313 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1470857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/f2fs/f2fs.ko 2023-03-30T07:57:21.313 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/fat/ 2023-03-30T07:57:21.313 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/fat/msdos.ko 2023-03-30T07:57:21.313 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/freevxfs/ 2023-03-30T07:57:21.313 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 41961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/freevxfs/freevxfs.ko 2023-03-30T07:57:21.313 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/fscache/ 2023-03-30T07:57:21.313 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 218289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/fscache/fscache.ko 2023-03-30T07:57:21.313 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/fuse/ 2023-03-30T07:57:21.314 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/fuse/cuse.ko 2023-03-30T07:57:21.314 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/gfs2/ 2023-03-30T07:57:21.314 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1222017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/gfs2/gfs2.ko 2023-03-30T07:57:21.314 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/hfs/ 2023-03-30T07:57:21.314 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 140857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/hfs/hfs.ko 2023-03-30T07:57:21.314 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/hfsplus/ 2023-03-30T07:57:21.314 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 220953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/hfsplus/hfsplus.ko 2023-03-30T07:57:21.315 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/hpfs/ 2023-03-30T07:57:21.315 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 193145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/hpfs/hpfs.ko 2023-03-30T07:57:21.315 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/isofs/ 2023-03-30T07:57:21.315 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 73961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/isofs/isofs.ko 2023-03-30T07:57:21.315 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/jfs/ 2023-03-30T07:57:21.315 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 418945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/jfs/jfs.ko 2023-03-30T07:57:21.315 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/lockd/ 2023-03-30T07:57:21.315 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 253961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/lockd/lockd.ko 2023-03-30T07:57:21.316 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/minix/ 2023-03-30T07:57:21.316 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 87481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/minix/minix.ko 2023-03-30T07:57:21.316 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/netfs/ 2023-03-30T07:57:21.316 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 128313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/netfs/netfs.ko 2023-03-30T07:57:21.316 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/ 2023-03-30T07:57:21.316 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/blocklayout/ 2023-03-30T07:57:21.316 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 81025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-03-30T07:57:21.316 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/filelayout/ 2023-03-30T07:57:21.317 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 58929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-03-30T07:57:21.317 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/flexfilelayout/ 2023-03-30T07:57:21.317 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 117209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-03-30T07:57:21.317 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1016553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/nfs.ko 2023-03-30T07:57:21.317 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/nfsv2.ko 2023-03-30T07:57:21.317 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 119217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/nfsv3.ko 2023-03-30T07:57:21.317 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 2003113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs/nfsv4.ko 2023-03-30T07:57:21.317 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs_common/ 2023-03-30T07:57:21.318 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs_common/grace.ko 2023-03-30T07:57:21.318 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfs_common/nfs_acl.ko 2023-03-30T07:57:21.318 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfsd/ 2023-03-30T07:57:21.318 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1400457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nfsd/nfsd.ko 2023-03-30T07:57:21.318 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nilfs2/ 2023-03-30T07:57:21.318 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 586417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nilfs2/nilfs2.ko 2023-03-30T07:57:21.318 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/ 2023-03-30T07:57:21.318 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-celtic.ko 2023-03-30T07:57:21.319 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-centeuro.ko 2023-03-30T07:57:21.319 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-croatian.ko 2023-03-30T07:57:21.319 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-cyrillic.ko 2023-03-30T07:57:21.319 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-gaelic.ko 2023-03-30T07:57:21.319 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-greek.ko 2023-03-30T07:57:21.319 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-iceland.ko 2023-03-30T07:57:21.319 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-inuit.ko 2023-03-30T07:57:21.319 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-roman.ko 2023-03-30T07:57:21.320 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-romanian.ko 2023-03-30T07:57:21.320 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/mac-turkish.ko 2023-03-30T07:57:21.320 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_ascii.ko 2023-03-30T07:57:21.320 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp1250.ko 2023-03-30T07:57:21.320 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp1251.ko 2023-03-30T07:57:21.320 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp1255.ko 2023-03-30T07:57:21.320 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp737.ko 2023-03-30T07:57:21.320 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp775.ko 2023-03-30T07:57:21.321 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp850.ko 2023-03-30T07:57:21.321 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp852.ko 2023-03-30T07:57:21.321 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp855.ko 2023-03-30T07:57:21.321 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp857.ko 2023-03-30T07:57:21.321 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp860.ko 2023-03-30T07:57:21.321 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp861.ko 2023-03-30T07:57:21.321 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp862.ko 2023-03-30T07:57:21.322 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp863.ko 2023-03-30T07:57:21.322 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp864.ko 2023-03-30T07:57:21.322 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp865.ko 2023-03-30T07:57:21.322 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp866.ko 2023-03-30T07:57:21.322 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp869.ko 2023-03-30T07:57:21.322 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp874.ko 2023-03-30T07:57:21.322 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 93649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp932.ko 2023-03-30T07:57:21.322 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 142185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp936.ko 2023-03-30T07:57:21.323 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 165321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp949.ko 2023-03-30T07:57:21.323 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 117625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_cp950.ko 2023-03-30T07:57:21.323 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_euc-jp.ko 2023-03-30T07:57:21.323 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-1.ko 2023-03-30T07:57:21.323 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-13.ko 2023-03-30T07:57:21.323 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-14.ko 2023-03-30T07:57:21.323 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-15.ko 2023-03-30T07:57:21.323 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-2.ko 2023-03-30T07:57:21.324 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-3.ko 2023-03-30T07:57:21.324 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-4.ko 2023-03-30T07:57:21.324 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-5.ko 2023-03-30T07:57:21.324 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-6.ko 2023-03-30T07:57:21.324 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-7.ko 2023-03-30T07:57:21.324 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_iso8859-9.ko 2023-03-30T07:57:21.324 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_koi8-r.ko 2023-03-30T07:57:21.324 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_koi8-ru.ko 2023-03-30T07:57:21.325 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_koi8-u.ko 2023-03-30T07:57:21.325 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/nls/nls_utf8.ko 2023-03-30T07:57:21.325 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ntfs/ 2023-03-30T07:57:21.325 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 218585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ntfs/ntfs.ko 2023-03-30T07:57:21.325 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/ 2023-03-30T07:57:21.325 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/cluster/ 2023-03-30T07:57:21.325 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 240737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-03-30T07:57:21.325 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/dlm/ 2023-03-30T07:57:21.326 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 439201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-03-30T07:57:21.326 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/dlmfs/ 2023-03-30T07:57:21.326 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-03-30T07:57:21.326 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 2510441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/ocfs2.ko 2023-03-30T07:57:21.357 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17473 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-03-30T07:57:21.357 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-03-30T07:57:21.358 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-03-30T07:57:21.358 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/omfs/ 2023-03-30T07:57:21.358 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 52145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/omfs/omfs.ko 2023-03-30T07:57:21.358 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/overlayfs/ 2023-03-30T07:57:21.358 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 320649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/overlayfs/overlay.ko 2023-03-30T07:57:21.358 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/pstore/ 2023-03-30T07:57:21.358 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/pstore/ramoops.ko 2023-03-30T07:57:21.359 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/qnx4/ 2023-03-30T07:57:21.359 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/qnx4/qnx4.ko 2023-03-30T07:57:21.359 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/qnx6/ 2023-03-30T07:57:21.359 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/qnx6/qnx6.ko 2023-03-30T07:57:21.359 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/quota/ 2023-03-30T07:57:21.359 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/quota/quota_tree.ko 2023-03-30T07:57:21.359 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/quota/quota_v1.ko 2023-03-30T07:57:21.359 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/quota/quota_v2.ko 2023-03-30T07:57:21.360 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/reiserfs/ 2023-03-30T07:57:21.360 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 527801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/reiserfs/reiserfs.ko 2023-03-30T07:57:21.360 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/romfs/ 2023-03-30T07:57:21.360 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/romfs/romfs.ko 2023-03-30T07:57:21.360 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/smbfs_common/ 2023-03-30T07:57:21.360 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 6361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/smbfs_common/cifs_arc4.ko 2023-03-30T07:57:21.360 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/smbfs_common/cifs_md4.ko 2023-03-30T07:57:21.360 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/squashfs/ 2023-03-30T07:57:21.361 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 131193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/squashfs/squashfs.ko 2023-03-30T07:57:21.361 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/sysv/ 2023-03-30T07:57:21.361 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 88441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/sysv/sysv.ko 2023-03-30T07:57:21.361 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/udf/ 2023-03-30T07:57:21.361 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 247873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/udf/udf.ko 2023-03-30T07:57:21.361 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ufs/ 2023-03-30T07:57:21.361 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 160129 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/ufs/ufs.ko 2023-03-30T07:57:21.362 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/xfs/ 2023-03-30T07:57:21.362 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 3810937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/fs/xfs/xfs.ko 2023-03-30T07:57:21.362 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/kernel/ 2023-03-30T07:57:21.362 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/kernel/locking/ 2023-03-30T07:57:21.362 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/kernel/locking/locktorture.ko 2023-03-30T07:57:21.362 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/kernel/time/ 2023-03-30T07:57:21.362 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/kernel/time/test_udelay.ko 2023-03-30T07:57:21.362 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/kernel/torture.ko 2023-03-30T07:57:21.363 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/ 2023-03-30T07:57:21.363 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 6033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/crc-itu-t.ko 2023-03-30T07:57:21.363 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 5729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/crc7.ko 2023-03-30T07:57:21.363 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 6081 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/crc8.ko 2023-03-30T07:57:21.363 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/crypto/ 2023-03-30T07:57:21.363 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 6305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/crypto/libarc4.ko 2023-03-30T07:57:21.363 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/crypto/libdes.ko 2023-03-30T07:57:21.363 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/interval_tree_test.ko 2023-03-30T07:57:21.364 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/libcrc32c.ko 2023-03-30T07:57:21.364 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/lru_cache.ko 2023-03-30T07:57:21.364 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/lz4/ 2023-03-30T07:57:21.364 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/lz4/lz4_compress.ko 2023-03-30T07:57:21.364 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/lz4/lz4hc_compress.ko 2023-03-30T07:57:21.364 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/math/ 2023-03-30T07:57:21.364 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 5897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/math/cordic.ko 2023-03-30T07:57:21.364 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/memory-notifier-error-inject.ko 2023-03-30T07:57:21.365 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/notifier-error-inject.ko 2023-03-30T07:57:21.365 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/percpu_test.ko 2023-03-30T07:57:21.365 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7865 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/pm-notifier-error-inject.ko 2023-03-30T07:57:21.365 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/raid6/ 2023-03-30T07:57:21.365 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 141873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/raid6/raid6_pq.ko 2023-03-30T07:57:21.365 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/rbtree_test.ko 2023-03-30T07:57:21.365 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/reed_solomon/ 2023-03-30T07:57:21.365 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/reed_solomon/reed_solomon.ko 2023-03-30T07:57:21.366 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/test-kstrtox.ko 2023-03-30T07:57:21.366 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/test-string_helpers.ko 2023-03-30T07:57:21.366 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 4760329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/test_bpf.ko 2023-03-30T07:57:21.366 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 48057 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/test_firmware.ko 2023-03-30T07:57:21.366 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 5873 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/test_module.ko 2023-03-30T07:57:21.366 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21177 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/test_user_copy.ko 2023-03-30T07:57:21.366 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/ts_bm.ko 2023-03-30T07:57:21.366 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/ts_fsm.ko 2023-03-30T07:57:21.367 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/ts_kmp.ko 2023-03-30T07:57:21.367 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/xz/ 2023-03-30T07:57:21.367 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/lib/xz/xz_dec_test.ko 2023-03-30T07:57:21.367 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/mm/ 2023-03-30T07:57:21.367 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/mm/hwpoison-inject.ko 2023-03-30T07:57:21.367 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ 2023-03-30T07:57:21.367 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/ 2023-03-30T07:57:21.368 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/6lowpan.ko 2023-03-30T07:57:21.368 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 6553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/nhc_dest.ko 2023-03-30T07:57:21.368 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 6577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/nhc_fragment.ko 2023-03-30T07:57:21.368 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 6553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/nhc_hop.ko 2023-03-30T07:57:21.368 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 6553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/nhc_ipv6.ko 2023-03-30T07:57:21.368 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 6577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/nhc_mobility.ko 2023-03-30T07:57:21.368 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 6577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/nhc_routing.ko 2023-03-30T07:57:21.368 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/6lowpan/nhc_udp.ko 2023-03-30T07:57:21.369 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/802/ 2023-03-30T07:57:21.369 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/802/garp.ko 2023-03-30T07:57:21.369 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33657 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/802/mrp.ko 2023-03-30T07:57:21.369 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/802/p8022.ko 2023-03-30T07:57:21.369 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/802/psnap.ko 2023-03-30T07:57:21.369 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/802/stp.ko 2023-03-30T07:57:21.369 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/8021q/ 2023-03-30T07:57:21.369 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 80641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/8021q/8021q.ko 2023-03-30T07:57:21.370 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/9p/ 2023-03-30T07:57:21.370 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 191305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/9p/9pnet.ko 2023-03-30T07:57:21.370 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/9p/9pnet_fd.ko 2023-03-30T07:57:21.370 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/9p/9pnet_rdma.ko 2023-03-30T07:57:21.370 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/9p/9pnet_virtio.ko 2023-03-30T07:57:21.370 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/batman-adv/ 2023-03-30T07:57:21.370 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 652281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/batman-adv/batman-adv.ko 2023-03-30T07:57:21.370 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/ 2023-03-30T07:57:21.371 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 63777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/br_netfilter.ko 2023-03-30T07:57:21.371 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 772145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/bridge.ko 2023-03-30T07:57:21.371 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ 2023-03-30T07:57:21.371 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-03-30T07:57:21.371 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_among.ko 2023-03-30T07:57:21.371 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8673 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_arp.ko 2023-03-30T07:57:21.371 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-03-30T07:57:21.371 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-03-30T07:57:21.372 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_ip.ko 2023-03-30T07:57:21.372 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-03-30T07:57:21.372 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_limit.ko 2023-03-30T07:57:21.372 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_log.ko 2023-03-30T07:57:21.372 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_mark.ko 2023-03-30T07:57:21.372 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-03-30T07:57:21.372 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-03-30T07:57:21.372 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-03-30T07:57:21.373 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-03-30T07:57:21.373 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_snat.ko 2023-03-30T07:57:21.373 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_stp.ko 2023-03-30T07:57:21.373 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-03-30T07:57:21.373 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-03-30T07:57:21.373 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-03-30T07:57:21.373 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-03-30T07:57:21.374 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 73961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/ebtables.ko 2023-03-30T07:57:21.374 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-03-30T07:57:21.374 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13449 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-03-30T07:57:21.374 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ceph/ 2023-03-30T07:57:21.374 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1031153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ceph/libceph.ko 2023-03-30T07:57:21.374 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/core/ 2023-03-30T07:57:21.374 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 124297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/core/pktgen.ko 2023-03-30T07:57:21.374 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dccp/ 2023-03-30T07:57:21.375 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 188577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dccp/dccp.ko 2023-03-30T07:57:21.375 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dccp/dccp_diag.ko 2023-03-30T07:57:21.375 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 55633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dccp/dccp_ipv4.ko 2023-03-30T07:57:21.375 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 58905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dccp/dccp_ipv6.ko 2023-03-30T07:57:21.375 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dsa/ 2023-03-30T07:57:21.375 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 272649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dsa/dsa_core.ko 2023-03-30T07:57:21.375 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dsa/tag_brcm.ko 2023-03-30T07:57:21.375 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dsa/tag_dsa.ko 2023-03-30T07:57:21.376 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dsa/tag_none.ko 2023-03-30T07:57:21.376 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/dsa/tag_trailer.ko 2023-03-30T07:57:21.376 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/hsr/ 2023-03-30T07:57:21.376 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 99385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/hsr/hsr.ko 2023-03-30T07:57:21.376 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ieee802154/ 2023-03-30T07:57:21.376 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ieee802154/6lowpan/ 2023-03-30T07:57:21.376 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-03-30T07:57:21.376 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 245489 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ieee802154/ieee802154.ko 2023-03-30T07:57:21.377 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ieee802154/ieee802154_socket.ko 2023-03-30T07:57:21.377 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/ 2023-03-30T07:57:21.377 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/ah4.ko 2023-03-30T07:57:21.377 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/esp4.ko 2023-03-30T07:57:21.377 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44425 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/fou.ko 2023-03-30T07:57:21.377 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/gre.ko 2023-03-30T07:57:21.377 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/inet_diag.ko 2023-03-30T07:57:21.378 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 59737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/ip_gre.ko 2023-03-30T07:57:21.378 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/ip_tunnel.ko 2023-03-30T07:57:21.378 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33737 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/ip_vti.ko 2023-03-30T07:57:21.378 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/ipcomp.ko 2023-03-30T07:57:21.378 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/ipip.ko 2023-03-30T07:57:21.378 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/ 2023-03-30T07:57:21.378 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/arp_tables.ko 2023-03-30T07:57:21.378 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-03-30T07:57:21.379 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-03-30T07:57:21.379 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53921 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/ip_tables.ko 2023-03-30T07:57:21.379 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-03-30T07:57:21.379 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-03-30T07:57:21.379 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-03-30T07:57:21.379 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-03-30T07:57:21.379 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-03-30T07:57:21.379 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-03-30T07:57:21.380 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-03-30T07:57:21.380 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-03-30T07:57:21.380 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-03-30T07:57:21.380 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/iptable_security.ko 2023-03-30T07:57:21.380 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-03-30T07:57:21.380 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-03-30T07:57:21.380 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-03-30T07:57:21.380 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-03-30T07:57:21.381 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-03-30T07:57:21.381 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-03-30T07:57:21.381 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-03-30T07:57:21.381 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-03-30T07:57:21.381 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-03-30T07:57:21.381 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-03-30T07:57:21.381 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-03-30T07:57:21.382 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_bic.ko 2023-03-30T07:57:21.382 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_dctcp.ko 2023-03-30T07:57:21.382 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14689 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_diag.ko 2023-03-30T07:57:21.382 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_highspeed.ko 2023-03-30T07:57:21.382 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_htcp.ko 2023-03-30T07:57:21.382 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_hybla.ko 2023-03-30T07:57:21.382 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10977 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_illinois.ko 2023-03-30T07:57:21.382 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_lp.ko 2023-03-30T07:57:21.383 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_scalable.ko 2023-03-30T07:57:21.383 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_vegas.ko 2023-03-30T07:57:21.383 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_veno.ko 2023-03-30T07:57:21.383 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10529 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_westwood.ko 2023-03-30T07:57:21.383 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tcp_yeah.ko 2023-03-30T07:57:21.383 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21785 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/tunnel4.ko 2023-03-30T07:57:21.383 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15921 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/udp_diag.ko 2023-03-30T07:57:21.383 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/udp_tunnel.ko 2023-03-30T07:57:21.384 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv4/xfrm4_tunnel.ko 2023-03-30T07:57:21.384 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/ 2023-03-30T07:57:21.384 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/ah6.ko 2023-03-30T07:57:21.384 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/esp6.ko 2023-03-30T07:57:21.384 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13993 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/fou6.ko 2023-03-30T07:57:21.384 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 80297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/ip6_gre.ko 2023-03-30T07:57:21.384 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 90857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/ip6_tunnel.ko 2023-03-30T07:57:21.384 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-03-30T07:57:21.385 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/ip6_vti.ko 2023-03-30T07:57:21.385 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/ipcomp6.ko 2023-03-30T07:57:21.385 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/mip6.ko 2023-03-30T07:57:21.385 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ 2023-03-30T07:57:21.385 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-03-30T07:57:21.385 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-03-30T07:57:21.385 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-03-30T07:57:21.385 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-03-30T07:57:21.386 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-03-30T07:57:21.386 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-03-30T07:57:21.386 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-03-30T07:57:21.386 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-03-30T07:57:21.386 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-03-30T07:57:21.386 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-03-30T07:57:21.386 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-03-30T07:57:21.387 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-03-30T07:57:21.387 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-03-30T07:57:21.387 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-03-30T07:57:21.387 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-03-30T07:57:21.387 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-03-30T07:57:21.387 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-03-30T07:57:21.387 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 37929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-03-30T07:57:21.387 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-03-30T07:57:21.388 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-03-30T07:57:21.388 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-03-30T07:57:21.388 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-03-30T07:57:21.388 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-03-30T07:57:21.388 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-03-30T07:57:21.388 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8577 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-03-30T07:57:21.388 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 72545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/sit.ko 2023-03-30T07:57:21.388 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/tunnel6.ko 2023-03-30T07:57:21.389 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22481 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/ipv6/xfrm6_tunnel.ko 2023-03-30T07:57:21.389 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/key/ 2023-03-30T07:57:21.389 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 82505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/key/af_key.ko 2023-03-30T07:57:21.389 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/ 2023-03-30T07:57:21.389 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 120329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/l2tp_core.ko 2023-03-30T07:57:21.389 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19841 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/l2tp_debugfs.ko 2023-03-30T07:57:21.389 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/l2tp_eth.ko 2023-03-30T07:57:21.389 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 34969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/l2tp_ip.ko 2023-03-30T07:57:21.390 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/l2tp_ip6.ko 2023-03-30T07:57:21.390 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/l2tp_netlink.ko 2023-03-30T07:57:21.390 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 53121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/l2tp/l2tp_ppp.ko 2023-03-30T07:57:21.390 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/lapb/ 2023-03-30T07:57:21.390 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 46641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/lapb/lapb.ko 2023-03-30T07:57:21.390 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/llc/ 2023-03-30T07:57:21.390 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/llc/llc.ko 2023-03-30T07:57:21.391 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 266497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/llc/llc2.ko 2023-03-30T07:57:21.391 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/mac802154/ 2023-03-30T07:57:21.391 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 279905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/mac802154/mac802154.ko 2023-03-30T07:57:21.391 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/mpls/ 2023-03-30T07:57:21.391 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/mpls/mpls_gso.ko 2023-03-30T07:57:21.391 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ 2023-03-30T07:57:21.391 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ 2023-03-30T07:57:21.391 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 116641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set.ko 2023-03-30T07:57:21.392 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28017 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-03-30T07:57:21.392 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-03-30T07:57:21.392 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-03-30T07:57:21.392 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 101537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-03-30T07:57:21.392 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 102681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-03-30T07:57:21.392 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 104097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-03-30T07:57:21.392 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 104697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-03-30T07:57:21.393 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 113953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-03-30T07:57:21.393 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 60665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-03-30T07:57:21.393 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 110721 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-03-30T07:57:21.393 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 114241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-03-30T07:57:21.393 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 113889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-03-30T07:57:21.393 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 112713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-03-30T07:57:21.393 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 115777 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-03-30T07:57:21.393 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-03-30T07:57:21.394 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ 2023-03-30T07:57:21.394 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 410137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs.ko 2023-03-30T07:57:21.394 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-03-30T07:57:21.394 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-03-30T07:57:21.394 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-03-30T07:57:21.394 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-03-30T07:57:21.394 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-03-30T07:57:21.394 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-03-30T07:57:21.395 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7257 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-03-30T07:57:21.395 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-03-30T07:57:21.395 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8801 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-03-30T07:57:21.395 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-03-30T07:57:21.395 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13089 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-03-30T07:57:21.395 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-03-30T07:57:21.395 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-03-30T07:57:21.395 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 47601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conncount.ko 2023-03-30T07:57:21.396 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 396769 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack.ko 2023-03-30T07:57:21.396 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15321 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-03-30T07:57:21.396 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9505 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-03-30T07:57:21.396 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-03-30T07:57:21.396 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 117313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_h323.ko 2023-03-30T07:57:21.396 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_irc.ko 2023-03-30T07:57:21.396 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-03-30T07:57:21.396 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 107825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-03-30T07:57:21.397 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-03-30T07:57:21.397 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_sane.ko 2023-03-30T07:57:21.397 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 65305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_sip.ko 2023-03-30T07:57:21.397 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-03-30T07:57:21.397 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-03-30T07:57:21.397 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_dup_netdev.ko 2023-03-30T07:57:21.397 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 86233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_flow_table.ko 2023-03-30T07:57:21.398 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_flow_table_inet.ko 2023-03-30T07:57:21.398 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36705 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_log_syslog.ko 2023-03-30T07:57:21.398 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 91201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_nat.ko 2023-03-30T07:57:21.398 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_nat_amanda.ko 2023-03-30T07:57:21.398 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12129 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_nat_ftp.ko 2023-03-30T07:57:21.398 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_nat_irc.ko 2023-03-30T07:57:21.398 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_nat_sip.ko 2023-03-30T07:57:21.398 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_nat_tftp.ko 2023-03-30T07:57:21.399 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_synproxy_core.ko 2023-03-30T07:57:21.399 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 574417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nf_tables.ko 2023-03-30T07:57:21.399 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 42137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nfnetlink.ko 2023-03-30T07:57:21.399 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nfnetlink_acct.ko 2023-03-30T07:57:21.399 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30185 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-03-30T07:57:21.399 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40225 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nfnetlink_log.ko 2023-03-30T07:57:21.399 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 21793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nfnetlink_osf.ko 2023-03-30T07:57:21.399 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 49001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nfnetlink_queue.ko 2023-03-30T07:57:21.400 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9961 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_chain_nat.ko 2023-03-30T07:57:21.400 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_compat.ko 2023-03-30T07:57:21.400 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 40217 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_ct.ko 2023-03-30T07:57:21.400 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9169 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_dup_netdev.ko 2023-03-30T07:57:21.400 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10161 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_fib.ko 2023-03-30T07:57:21.400 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13385 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_fwd_netdev.ko 2023-03-30T07:57:21.400 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_hash.ko 2023-03-30T07:57:21.400 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_limit.ko 2023-03-30T07:57:21.401 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_log.ko 2023-03-30T07:57:21.401 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_masq.ko 2023-03-30T07:57:21.401 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_nat.ko 2023-03-30T07:57:21.401 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13241 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_numgen.ko 2023-03-30T07:57:21.401 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_osf.ko 2023-03-30T07:57:21.401 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_queue.ko 2023-03-30T07:57:21.401 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_redir.ko 2023-03-30T07:57:21.401 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_reject.ko 2023-03-30T07:57:21.402 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9585 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_reject_inet.ko 2023-03-30T07:57:21.402 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_socket.ko 2023-03-30T07:57:21.402 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_synproxy.ko 2023-03-30T07:57:21.402 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/nft_tproxy.ko 2023-03-30T07:57:21.402 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 98833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/x_tables.ko 2023-03-30T07:57:21.402 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11665 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_AUDIT.ko 2023-03-30T07:57:21.402 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_CHECKSUM.ko 2023-03-30T07:57:21.402 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_CLASSIFY.ko 2023-03-30T07:57:21.403 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-03-30T07:57:21.403 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_CT.ko 2023-03-30T07:57:21.403 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_DSCP.ko 2023-03-30T07:57:21.403 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_HL.ko 2023-03-30T07:57:21.403 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_HMARK.ko 2023-03-30T07:57:21.403 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 38513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_IDLETIMER.ko 2023-03-30T07:57:21.403 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_LED.ko 2023-03-30T07:57:21.403 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_LOG.ko 2023-03-30T07:57:21.404 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_MASQUERADE.ko 2023-03-30T07:57:21.404 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_NETMAP.ko 2023-03-30T07:57:21.404 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_NFLOG.ko 2023-03-30T07:57:21.404 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_NFQUEUE.ko 2023-03-30T07:57:21.404 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_RATEEST.ko 2023-03-30T07:57:21.404 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10377 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_REDIRECT.ko 2023-03-30T07:57:21.404 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_SECMARK.ko 2023-03-30T07:57:21.405 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_TCPMSS.ko 2023-03-30T07:57:21.405 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-03-30T07:57:21.405 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16937 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_TEE.ko 2023-03-30T07:57:21.405 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 16417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_TPROXY.ko 2023-03-30T07:57:21.405 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_TRACE.ko 2023-03-30T07:57:21.405 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13465 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_addrtype.ko 2023-03-30T07:57:21.405 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13457 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_bpf.ko 2023-03-30T07:57:21.405 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15209 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_cgroup.ko 2023-03-30T07:57:21.406 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10713 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_cluster.ko 2023-03-30T07:57:21.406 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7073 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_comment.ko 2023-03-30T07:57:21.406 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_connbytes.ko 2023-03-30T07:57:21.406 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_connlabel.ko 2023-03-30T07:57:21.406 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_connlimit.ko 2023-03-30T07:57:21.406 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_connmark.ko 2023-03-30T07:57:21.406 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_conntrack.ko 2023-03-30T07:57:21.406 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_cpu.ko 2023-03-30T07:57:21.407 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_dccp.ko 2023-03-30T07:57:21.407 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_devgroup.ko 2023-03-30T07:57:21.407 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_dscp.ko 2023-03-30T07:57:21.407 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_ecn.ko 2023-03-30T07:57:21.407 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11041 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_esp.ko 2023-03-30T07:57:21.407 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43025 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_hashlimit.ko 2023-03-30T07:57:21.407 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10889 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_helper.ko 2023-03-30T07:57:21.407 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_hl.ko 2023-03-30T07:57:21.408 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11553 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_ipcomp.ko 2023-03-30T07:57:21.408 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11033 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_iprange.ko 2023-03-30T07:57:21.408 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_ipvs.ko 2023-03-30T07:57:21.408 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_l2tp.ko 2023-03-30T07:57:21.408 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_length.ko 2023-03-30T07:57:21.408 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_limit.ko 2023-03-30T07:57:21.408 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7113 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_mac.ko 2023-03-30T07:57:21.408 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8153 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_mark.ko 2023-03-30T07:57:21.409 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_multiport.ko 2023-03-30T07:57:21.409 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13513 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_nat.ko 2023-03-30T07:57:21.409 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_nfacct.ko 2023-03-30T07:57:21.409 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_osf.ko 2023-03-30T07:57:21.409 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9121 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_owner.ko 2023-03-30T07:57:21.409 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9297 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_physdev.ko 2023-03-30T07:57:21.409 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7137 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_pkttype.ko 2023-03-30T07:57:21.409 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_policy.ko 2023-03-30T07:57:21.410 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9049 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_quota.ko 2023-03-30T07:57:21.410 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_rateest.ko 2023-03-30T07:57:21.410 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7761 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_realm.ko 2023-03-30T07:57:21.410 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36065 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_recent.ko 2023-03-30T07:57:21.410 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12897 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_sctp.ko 2023-03-30T07:57:21.410 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_set.ko 2023-03-30T07:57:21.410 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_socket.ko 2023-03-30T07:57:21.410 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9009 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_state.ko 2023-03-30T07:57:21.411 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_statistic.ko 2023-03-30T07:57:21.411 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8313 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_string.ko 2023-03-30T07:57:21.411 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8129 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_tcpmss.ko 2023-03-30T07:57:21.411 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13305 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_tcpudp.ko 2023-03-30T07:57:21.411 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_time.ko 2023-03-30T07:57:21.411 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8681 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netfilter/xt_u32.ko 2023-03-30T07:57:21.411 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netlink/ 2023-03-30T07:57:21.412 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 13417 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/netlink/netlink_diag.ko 2023-03-30T07:57:21.412 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/nsh/ 2023-03-30T07:57:21.412 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/nsh/nsh.ko 2023-03-30T07:57:21.412 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/openvswitch/ 2023-03-30T07:57:21.412 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 377265 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/openvswitch/openvswitch.ko 2023-03-30T07:57:21.412 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9825 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/openvswitch/vport-geneve.ko 2023-03-30T07:57:21.412 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/openvswitch/vport-gre.ko 2023-03-30T07:57:21.412 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 11361 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/openvswitch/vport-vxlan.ko 2023-03-30T07:57:21.413 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/packet/ 2023-03-30T07:57:21.413 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/packet/af_packet_diag.ko 2023-03-30T07:57:21.413 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/phonet/ 2023-03-30T07:57:21.413 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 109633 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/phonet/phonet.ko 2023-03-30T07:57:21.413 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 54353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/phonet/pn_pep.ko 2023-03-30T07:57:21.413 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/rds/ 2023-03-30T07:57:21.413 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 248545 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/rds/rds.ko 2023-03-30T07:57:21.413 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 164641 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/rds/rds_rdma.ko 2023-03-30T07:57:21.414 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 66441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/rds/rds_tcp.ko 2023-03-30T07:57:21.414 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/rxrpc/ 2023-03-30T07:57:21.414 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 805849 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/rxrpc/rxrpc.ko 2023-03-30T07:57:21.414 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/ 2023-03-30T07:57:21.414 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_csum.ko 2023-03-30T07:57:21.414 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23105 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_gact.ko 2023-03-30T07:57:21.414 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 25249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_ipt.ko 2023-03-30T07:57:21.414 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_mirred.ko 2023-03-30T07:57:21.415 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22929 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_nat.ko 2023-03-30T07:57:21.415 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 39593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_pedit.ko 2023-03-30T07:57:21.415 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 31561 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_police.ko 2023-03-30T07:57:21.415 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_simple.ko 2023-03-30T07:57:21.415 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35921 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_skbedit.ko 2023-03-30T07:57:21.415 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 35625 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/act_vlan.ko 2023-03-30T07:57:21.415 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/cls_basic.ko 2023-03-30T07:57:21.415 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32409 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/cls_bpf.ko 2023-03-30T07:57:21.416 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18729 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/cls_cgroup.ko 2023-03-30T07:57:21.416 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/cls_flow.ko 2023-03-30T07:57:21.416 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29809 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/cls_fw.ko 2023-03-30T07:57:21.416 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 36793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/cls_route.ko 2023-03-30T07:57:21.416 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 57985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/cls_u32.ko 2023-03-30T07:57:21.416 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 6945 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/em_cmp.ko 2023-03-30T07:57:21.416 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 12969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/em_ipset.ko 2023-03-30T07:57:21.416 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/em_meta.ko 2023-03-30T07:57:21.417 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 7393 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/em_nbyte.ko 2023-03-30T07:57:21.417 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10193 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/em_text.ko 2023-03-30T07:57:21.417 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 6753 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/em_u32.ko 2023-03-30T07:57:21.417 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19609 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_choke.ko 2023-03-30T07:57:21.417 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_codel.ko 2023-03-30T07:57:21.417 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 30441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_drr.ko 2023-03-30T07:57:21.417 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 29913 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_fq.ko 2023-03-30T07:57:21.417 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28953 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_fq_codel.ko 2023-03-30T07:57:21.418 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 32145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_gred.ko 2023-03-30T07:57:21.418 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 44345 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_hfsc.ko 2023-03-30T07:57:21.418 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20369 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_hhf.ko 2023-03-30T07:57:21.418 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 63001 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_htb.ko 2023-03-30T07:57:21.418 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15249 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_ingress.ko 2023-03-30T07:57:21.418 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_mqprio.ko 2023-03-30T07:57:21.418 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9353 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_mqprio_lib.ko 2023-03-30T07:57:21.418 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23441 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_multiq.ko 2023-03-30T07:57:21.419 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 33329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_netem.ko 2023-03-30T07:57:21.419 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 23497 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_pie.ko 2023-03-30T07:57:21.419 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9833 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_plug.ko 2023-03-30T07:57:21.419 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22817 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_prio.ko 2023-03-30T07:57:21.419 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 43969 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_qfq.ko 2023-03-30T07:57:21.419 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 28697 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_red.ko 2023-03-30T07:57:21.419 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 24881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_sfb.ko 2023-03-30T07:57:21.420 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 27985 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_sfq.ko 2023-03-30T07:57:21.420 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_tbf.ko 2023-03-30T07:57:21.420 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 26857 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sched/sch_teql.ko 2023-03-30T07:57:21.420 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sctp/ 2023-03-30T07:57:21.420 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 920881 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sctp/sctp.ko 2023-03-30T07:57:21.420 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 18601 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sctp/sctp_diag.ko 2023-03-30T07:57:21.420 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sunrpc/ 2023-03-30T07:57:21.420 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sunrpc/auth_gss/ 2023-03-30T07:57:21.421 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 327521 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-03-30T07:57:21.421 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 61329 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-03-30T07:57:21.421 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 1405649 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sunrpc/sunrpc.ko 2023-03-30T07:57:21.421 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sunrpc/xprtrdma/ 2023-03-30T07:57:21.421 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 681905 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-03-30T07:57:21.421 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/tipc/ 2023-03-30T07:57:21.421 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 9593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/tipc/diag.ko 2023-03-30T07:57:21.421 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 853201 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/tipc/tipc.ko 2023-03-30T07:57:21.422 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/unix/ 2023-03-30T07:57:21.422 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 15233 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/unix/unix_diag.ko 2023-03-30T07:57:21.422 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/vmw_vsock/ 2023-03-30T07:57:21.422 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 76569 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-03-30T07:57:21.422 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 67537 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-03-30T07:57:21.422 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 82401 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/vmw_vsock/vsock.ko 2023-03-30T07:57:21.422 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10273 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/vmw_vsock/vsock_diag.ko 2023-03-30T07:57:21.422 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 17281 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/vmw_vsock/vsock_loopback.ko 2023-03-30T07:57:21.423 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/x25/ 2023-03-30T07:57:21.423 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 124593 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/x25/x25.ko 2023-03-30T07:57:21.423 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/xfrm/ 2023-03-30T07:57:21.423 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 20793 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/xfrm/xfrm_algo.ko 2023-03-30T07:57:21.423 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 19745 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/xfrm/xfrm_ipcomp.ko 2023-03-30T07:57:21.423 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 101145 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/net/xfrm/xfrm_user.ko 2023-03-30T07:57:21.423 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/virt/ 2023-03-30T07:57:21.423 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/virt/lib/ 2023-03-30T07:57:21.424 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 14433 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/kernel/virt/lib/irqbypass.ko 2023-03-30T07:57:21.424 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 635968 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.alias 2023-03-30T07:57:21.424 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 622072 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.alias.bin 2023-03-30T07:57:21.424 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 8260 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.builtin 2023-03-30T07:57:21.424 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 22530 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.builtin.alias.bin 2023-03-30T07:57:21.424 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 10532 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.builtin.bin 2023-03-30T07:57:21.424 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 70097 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.builtin.modinfo 2023-03-30T07:57:21.424 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 146789 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.dep 2023-03-30T07:57:21.425 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 233606 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.dep.bin 2023-03-30T07:57:21.425 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 210 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.devname 2023-03-30T07:57:21.425 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 73038 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.order 2023-03-30T07:57:21.425 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 879 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.softdep 2023-03-30T07:57:21.425 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 251759 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.symbols 2023-03-30T07:57:21.425 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 306289 2023-03-30 03:03 ./lib/modules/6.3.0-rc3-g6c26fb6d76aa/modules.symbols.bin 2023-03-30T07:57:21.425 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./usr/ 2023-03-30T07:57:21.426 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./usr/share/ 2023-03-30T07:57:21.426 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./usr/share/doc/ 2023-03-30T07:57:21.426 INFO:teuthology.orchestra.run.smithi087.stdout:drwxr-xr-x root/root 0 2023-03-30 03:03 ./usr/share/doc/linux-image-6.3.0-rc3-g6c26fb6d76aa/ 2023-03-30T07:57:21.426 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 172 2023-03-30 03:03 ./usr/share/doc/linux-image-6.3.0-rc3-g6c26fb6d76aa/changelog.Debian.gz 2023-03-30T07:57:21.426 INFO:teuthology.orchestra.run.smithi087.stdout:-rw-r--r-- root/root 692 2023-03-30 03:03 ./usr/share/doc/linux-image-6.3.0-rc3-g6c26fb6d76aa/copyright 2023-03-30T07:57:21.427 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:21.427 INFO:teuthology.task.kernel:searching for kernel 6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:21.427 DEBUG:teuthology.orchestra.run.smithi087:> egrep '(submenu|menuentry.*6.3.0-rc3-g6c26fb6d76aa).*{' /boot/grub/grub.cfg 2023-03-30T07:57:21.436 INFO:teuthology.orchestra.run.smithi087.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-03-30T07:57:21.436 INFO:teuthology.orchestra.run.smithi087.stdout: menuentry 'Ubuntu, with Linux 6.3.0-rc3-g6c26fb6d76aa' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.3.0-rc3-g6c26fb6d76aa-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-03-30T07:57:21.436 INFO:teuthology.orchestra.run.smithi087.stdout: menuentry 'Ubuntu, with Linux 6.3.0-rc3-g6c26fb6d76aa (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.3.0-rc3-g6c26fb6d76aa-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-03-30T07:57:21.437 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-03-30T07:57:21.437 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:21.437 DEBUG:teuthology.orchestra.run.smithi087:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-03-30T07:57:21.439 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi087.front.sepia.ceph.com to complete... 2023-03-30T07:57:22.154 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub' 2023-03-30T07:57:22.159 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-03-30T07:57:22.183 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2023-03-30T07:57:22.439 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:22.450 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:57:22.793 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-03-30T07:57:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-03-30T07:57:24.191 INFO:teuthology.orchestra.run.smithi087.stderr:done 2023-03-30T07:57:52.113 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-03-30T07:57:52.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-03-30T07:57:52.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-30T07:57:55.310 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-03-30T07:57:55.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-03-30T07:57:55.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-30T07:58:10.437 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-03-30T07:58:13.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-03-30T07:58:40.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-03-30T07:58:40.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-30T07:58:43.525 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-03-30T07:58:43.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-03-30T07:58:43.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-30T07:58:46.821 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-03-30T07:59:13.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-03-30T07:59:13.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-30T07:59:13.776 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-03-30T07:59:14.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-03-30T07:59:14.473 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.3.0-rc3-g6c26fb6d76aa"... 2023-03-30T07:59:14.474 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2023-03-30T07:59:14.531 INFO:teuthology.orchestra.run.smithi115.stdout:6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:59:14.532 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-rc3-g6c26fb6d76aa vs 6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:59:14.532 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-03-30T07:59:14.532 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-03-30T07:59:15.533 DEBUG:teuthology.parallel:result is None 2023-03-30T07:59:16.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-03-30T07:59:16.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-30T07:59:17.089 DEBUG:teuthology.orchestra.run.smithi087:> true 2023-03-30T07:59:17.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-03-30T07:59:17.743 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.3.0-rc3-g6c26fb6d76aa"... 2023-03-30T07:59:17.743 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2023-03-30T07:59:17.799 INFO:teuthology.orchestra.run.smithi087.stdout:6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:59:17.799 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-rc3-g6c26fb6d76aa vs 6.3.0-rc3-g6c26fb6d76aa 2023-03-30T07:59:17.799 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-03-30T07:59:17.800 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-03-30T07:59:18.800 DEBUG:teuthology.parallel:result is None 2023-03-30T07:59:18.801 INFO:teuthology.run_tasks:Running task internal.base... 2023-03-30T07:59:18.808 INFO:teuthology.task.internal:Creating test directory... 2023-03-30T07:59:18.808 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-30T07:59:18.814 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-30T07:59:18.831 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-03-30T07:59:18.911 INFO:teuthology.run_tasks:Running task internal.archive... 2023-03-30T07:59:19.005 INFO:teuthology.task.internal:Creating archive directory... 2023-03-30T07:59:19.005 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-30T07:59:19.011 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-30T07:59:19.111 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-03-30T07:59:19.118 INFO:teuthology.task.internal:Enabling coredump saving... 2023-03-30T07:59:19.118 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-30T07:59:19.124 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-30T07:59:19.200 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-30T07:59:19.229 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-30T07:59:19.250 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-30T07:59:19.278 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-30T07:59:19.281 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-03-30T07:59:19.288 INFO:teuthology.task.internal:Configuring sudo... 2023-03-30T07:59:19.289 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-30T07:59:19.294 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-30T07:59:19.326 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-03-30T07:59:19.336 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-03-30T07:59:19.336 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-30T07:59:19.372 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-30T07:59:19.388 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-30T07:59:19.442 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-30T07:59:19.501 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T07:59:19.501 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-30T07:59:19.578 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-30T07:59:19.595 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-30T07:59:19.652 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T07:59:19.653 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-30T07:59:19.725 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2023-03-30T07:59:19.731 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2023-03-30T07:59:19.891 INFO:teuthology.run_tasks:Running task internal.timer... 2023-03-30T07:59:19.899 INFO:teuthology.task.internal:Starting timer... 2023-03-30T07:59:19.899 INFO:teuthology.run_tasks:Running task pcp... 2023-03-30T07:59:19.981 INFO:teuthology.run_tasks:Running task selinux... 2023-03-30T07:59:20.025 DEBUG:teuthology.task.selinux:Excluding smithi087: OS 'ubuntu' does not support SELinux 2023-03-30T07:59:20.025 DEBUG:teuthology.task.selinux:Excluding smithi115: OS 'ubuntu' does not support SELinux 2023-03-30T07:59:20.026 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-03-30T07:59:20.026 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-03-30T07:59:20.026 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-03-30T07:59:20.026 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-03-30T07:59:20.035 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-03-30T07:59:20.042 INFO:teuthology.repo_utils:Fetching main from origin 2023-03-30T07:59:20.204 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-03-30T07:59:20.222 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-03-30T07:59:20.224 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi087.front.sepia.ceph.com,smithi115.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-03-30T08:06:20.017 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi115.front.sepia.ceph.com')] 2023-03-30T08:06:20.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-03-30T08:06:20.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-30T08:06:20.124 DEBUG:teuthology.orchestra.run.smithi087:> true 2023-03-30T08:06:20.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-03-30T08:06:20.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-30T08:06:20.447 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-03-30T08:06:20.657 INFO:teuthology.run_tasks:Running task clock... 2023-03-30T08:06:20.668 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-03-30T08:06:20.668 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-30T08:06:20.669 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-30T08:06:20.674 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-30T08:06:20.675 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-30T08:06:20.738 INFO:teuthology.orchestra.run.smithi087.stdout:30 Mar 08:06:20 ntpd[21454]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-03-30T08:06:20.738 INFO:teuthology.orchestra.run.smithi087.stdout:30 Mar 08:06:20 ntpd[21454]: Command line: ntpd -gq 2023-03-30T08:06:20.739 INFO:teuthology.orchestra.run.smithi087.stdout:30 Mar 08:06:20 ntpd[21454]: proto: precision = 0.042 usec (-24) 2023-03-30T08:06:20.739 INFO:teuthology.orchestra.run.smithi087.stdout:30 Mar 08:06:20 ntpd[21454]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-03-30T08:06:20.739 INFO:teuthology.orchestra.run.smithi087.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-03-30T08:06:20.739 INFO:teuthology.orchestra.run.smithi087.stderr:restrict ::: KOD does nothing without LIMITED. 2023-03-30T08:06:20.740 INFO:teuthology.orchestra.run.smithi087.stdout:30 Mar 08:06:20 ntpd[21454]: restrict ::: KOD does nothing without LIMITED. 2023-03-30T08:06:20.740 INFO:teuthology.orchestra.run.smithi087.stdout:30 Mar 08:06:20 ntpd[21454]: Listen and drop on 0 v6wildcard [::]:123 2023-03-30T08:06:20.741 INFO:teuthology.orchestra.run.smithi087.stdout:30 Mar 08:06:20 ntpd[21454]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-03-30T08:06:20.741 INFO:teuthology.orchestra.run.smithi087.stdout:30 Mar 08:06:20 ntpd[21454]: Listen normally on 2 lo 127.0.0.1:123 2023-03-30T08:06:20.741 INFO:teuthology.orchestra.run.smithi087.stdout:30 Mar 08:06:20 ntpd[21454]: Listen normally on 3 enp3s0f1 172.21.15.87:123 2023-03-30T08:06:20.741 INFO:teuthology.orchestra.run.smithi087.stdout:30 Mar 08:06:20 ntpd[21454]: Listen normally on 4 lo [::1]:123 2023-03-30T08:06:20.741 INFO:teuthology.orchestra.run.smithi087.stdout:30 Mar 08:06:20 ntpd[21454]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5f5%5]:123 2023-03-30T08:06:20.741 INFO:teuthology.orchestra.run.smithi087.stdout:30 Mar 08:06:20 ntpd[21454]: Listening on routing socket on fd #22 for interface updates 2023-03-30T08:06:20.763 INFO:teuthology.orchestra.run.smithi115.stdout:30 Mar 08:06:20 ntpd[21449]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-03-30T08:06:20.763 INFO:teuthology.orchestra.run.smithi115.stdout:30 Mar 08:06:20 ntpd[21449]: Command line: ntpd -gq 2023-03-30T08:06:20.765 INFO:teuthology.orchestra.run.smithi115.stdout:30 Mar 08:06:20 ntpd[21449]: proto: precision = 0.063 usec (-24) 2023-03-30T08:06:20.766 INFO:teuthology.orchestra.run.smithi115.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-03-30T08:06:20.767 INFO:teuthology.orchestra.run.smithi115.stdout:30 Mar 08:06:20 ntpd[21449]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-03-30T08:06:20.768 INFO:teuthology.orchestra.run.smithi115.stderr:restrict ::: KOD does nothing without LIMITED. 2023-03-30T08:06:20.769 INFO:teuthology.orchestra.run.smithi115.stdout:30 Mar 08:06:20 ntpd[21449]: restrict ::: KOD does nothing without LIMITED. 2023-03-30T08:06:20.769 INFO:teuthology.orchestra.run.smithi115.stdout:30 Mar 08:06:20 ntpd[21449]: Listen and drop on 0 v6wildcard [::]:123 2023-03-30T08:06:20.770 INFO:teuthology.orchestra.run.smithi115.stdout:30 Mar 08:06:20 ntpd[21449]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-03-30T08:06:20.770 INFO:teuthology.orchestra.run.smithi115.stdout:30 Mar 08:06:20 ntpd[21449]: Listen normally on 2 lo 127.0.0.1:123 2023-03-30T08:06:20.770 INFO:teuthology.orchestra.run.smithi115.stdout:30 Mar 08:06:20 ntpd[21449]: Listen normally on 3 enp3s0f1 172.21.15.115:123 2023-03-30T08:06:20.770 INFO:teuthology.orchestra.run.smithi115.stdout:30 Mar 08:06:20 ntpd[21449]: Listen normally on 4 lo [::1]:123 2023-03-30T08:06:20.770 INFO:teuthology.orchestra.run.smithi115.stdout:30 Mar 08:06:20 ntpd[21449]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce8f%5]:123 2023-03-30T08:06:20.770 INFO:teuthology.orchestra.run.smithi115.stdout:30 Mar 08:06:20 ntpd[21449]: Listening on routing socket on fd #22 for interface updates 2023-03-30T08:06:21.738 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:21 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:21.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:21 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:21.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:21 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:21.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:21 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:21.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:21 ntpd[21454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:21.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:21 ntpd[21454]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:21.764 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:21 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:21.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:21 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:21.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:21 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:21.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:21 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:21.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:21 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:21.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:21 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:21.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:21 ntpd[21449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:21.767 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:21 ntpd[21449]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:21.767 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:21 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:21.767 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:21 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:21.767 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:21 ntpd[21449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:21.767 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:21 ntpd[21449]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:22.738 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:22 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:22 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:22 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:22 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:22 ntpd[21454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:22.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:22 ntpd[21454]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:22.764 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:22 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:22.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:22 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:22.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:22 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:22.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:22 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:22.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:22 ntpd[21449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:22.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:22 ntpd[21449]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:23.738 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:23 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:23.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:23 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:23.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:23 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:23.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:23 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:23.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:23 ntpd[21454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:23.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:23 ntpd[21454]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:23.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:23 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:23.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:23 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:23.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:23 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:23.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:23 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:23.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:23 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:23.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:23 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:23.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:23 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:23.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:23 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:23.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:23 ntpd[21449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:23.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:23 ntpd[21449]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:23.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:23 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:23.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:23 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:23.767 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:23 ntpd[21449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:23.767 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:23 ntpd[21449]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:24.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:24 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:24.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:24 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:24.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:24 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:24.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:24 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:24.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:24 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:24.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:24 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:24.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:24 ntpd[21454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:24.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:24 ntpd[21454]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:24.764 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:24 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:24.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:24 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:24.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:24 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:24.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:24 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:24.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:24 ntpd[21449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:24.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:24 ntpd[21449]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:25.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:25 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:25.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:25 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:25.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:25 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:25.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:25 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:25.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:25 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:25.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:25 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:25.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:25 ntpd[21454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:25.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:25 ntpd[21454]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:25.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:25 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:25.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:25 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:25.741 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:25 ntpd[21454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:25.741 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:25 ntpd[21454]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:25 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:25 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:25 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:25 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:25 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:25.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:25 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:25 ntpd[21449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:25 ntpd[21449]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:25 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:25 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:25 ntpd[21449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:25.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:25 ntpd[21449]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:26.738 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:26 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:26.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:26 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:26.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:26 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:26.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:26 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:26.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:26 ntpd[21454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:26.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:26 ntpd[21454]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:26.764 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:26 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:26.764 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:26 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:26.764 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:26 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:26.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:26 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:26.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:26 ntpd[21449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:26.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:26 ntpd[21449]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:27.739 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:27 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:27.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:27 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:27.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:27 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:27.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:27 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:27.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:27 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:27.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:27 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:27.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:27 ntpd[21454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:27.740 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:27 ntpd[21454]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:27.741 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:27 ntpd[21454]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:27.741 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:27 ntpd[21454]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:27.741 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:27 ntpd[21454]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:27.741 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:27 ntpd[21454]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:27.741 INFO:teuthology.orchestra.run.smithi087.stdout:30 Mar 08:06:27 ntpd[21454]: ntpd: time slew +0.000081 s 2023-03-30T08:06:27.741 INFO:teuthology.orchestra.run.smithi087.stdout:ntpd: time slew +0.000081s 2023-03-30T08:06:27.742 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:27 ntpd[21454]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-03-30T08:06:27.742 INFO:teuthology.orchestra.run.smithi087.stderr:30 Mar 08:06:27 ntpd[21454]: can't open /var/log/ntpstats/loopstats.20230330: Permission denied 2023-03-30T08:06:27.764 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:27 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:27.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:27 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:27.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:27 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:27.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:27 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:27.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:27 ntpd[21449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-03-30T08:06:27.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:27 ntpd[21449]: can't open /var/log/ntpstats/rawstats.20230330: Permission denied 2023-03-30T08:06:27.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:27 ntpd[21449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-03-30T08:06:27.765 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:27 ntpd[21449]: can't open /var/log/ntpstats/peerstats.20230330: Permission denied 2023-03-30T08:06:27.766 INFO:teuthology.orchestra.run.smithi115.stdout:30 Mar 08:06:27 ntpd[21449]: ntpd: time slew -0.000701 s 2023-03-30T08:06:27.766 INFO:teuthology.orchestra.run.smithi115.stdout:ntpd: time slew -0.000701s 2023-03-30T08:06:27.766 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:27 ntpd[21449]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-03-30T08:06:27.767 INFO:teuthology.orchestra.run.smithi115.stderr:30 Mar 08:06:27 ntpd[21449]: can't open /var/log/ntpstats/loopstats.20230330: Permission denied 2023-03-30T08:06:27.865 INFO:teuthology.orchestra.run.smithi087.stdout: remote refid st t when poll reach delay offset jitter 2023-03-30T08:06:27.866 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================== 2023-03-30T08:06:27.866 INFO:teuthology.orchestra.run.smithi087.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-03-30T08:06:27.866 INFO:teuthology.orchestra.run.smithi087.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-03-30T08:06:27.866 INFO:teuthology.orchestra.run.smithi087.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-03-30T08:06:27.866 INFO:teuthology.orchestra.run.smithi087.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-03-30T08:06:27.901 INFO:teuthology.orchestra.run.smithi115.stdout: remote refid st t when poll reach delay offset jitter 2023-03-30T08:06:27.902 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================== 2023-03-30T08:06:27.902 INFO:teuthology.orchestra.run.smithi115.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-03-30T08:06:27.902 INFO:teuthology.orchestra.run.smithi115.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-03-30T08:06:27.902 INFO:teuthology.orchestra.run.smithi115.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-03-30T08:06:27.902 INFO:teuthology.orchestra.run.smithi115.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-03-30T08:06:27.903 INFO:teuthology.run_tasks:Running task install... 2023-03-30T08:06:27.914 DEBUG:teuthology.task.install:project ceph 2023-03-30T08:06:27.915 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f03d69a8741c605ae6711afe2c9991ac46095f7d'}} 2023-03-30T08:06:27.915 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f03d69a8741c605ae6711afe2c9991ac46095f7d'} 2023-03-30T08:06:27.915 INFO:teuthology.task.install:Using flavor: default 2023-03-30T08:06:27.921 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-03-30T08:06:27.922 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-03-30T08:06:27.922 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-key list | grep Ceph 2023-03-30T08:06:27.923 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-key list | grep Ceph 2023-03-30T08:06:28.118 INFO:teuthology.orchestra.run.smithi087.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-03-30T08:06:28.126 INFO:teuthology.orchestra.run.smithi115.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-03-30T08:06:28.251 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-03-30T08:06:28.251 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph.com (release key) 2023-03-30T08:06:28.252 INFO:teuthology.orchestra.run.smithi115.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-03-30T08:06:28.252 INFO:teuthology.orchestra.run.smithi115.stdout:uid [ unknown] Ceph.com (release key) 2023-03-30T08:06:28.253 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-03-30T08:06:28.253 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-03-30T08:06:28.254 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=f03d69a8741c605ae6711afe2c9991ac46095f7d 2023-03-30T08:06:28.284 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-03-30T08:06:28.284 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-03-30T08:06:28.284 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=f03d69a8741c605ae6711afe2c9991ac46095f7d 2023-03-30T08:06:28.432 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default/ 2023-03-30T08:06:28.433 INFO:teuthology.task.install.deb:Package version is 18.0.0-3066-gf03d69a8-1focal 2023-03-30T08:06:28.446 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default/ 2023-03-30T08:06:28.447 INFO:teuthology.task.install.deb:Package version is 18.0.0-3066-gf03d69a8-1focal 2023-03-30T08:06:28.558 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:06:28.559 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-03-30T08:06:28.562 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:06:28.562 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-03-30T08:06:28.588 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2023-03-30T08:06:28.592 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get update 2023-03-30T08:06:28.853 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-03-30T08:06:28.854 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-03-30T08:06:28.854 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-03-30T08:06:28.868 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-03-30T08:06:28.875 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-03-30T08:06:28.912 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal InRelease 2023-03-30T08:06:28.915 INFO:teuthology.orchestra.run.smithi115.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal InRelease 2023-03-30T08:06:28.934 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-03-30T08:06:28.938 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-03-30T08:06:28.959 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal Release.gpg 2023-03-30T08:06:28.960 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2023-03-30T08:06:28.962 INFO:teuthology.orchestra.run.smithi115.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal Release.gpg 2023-03-30T08:06:28.980 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main i386 Packages [3,421 B] 2023-03-30T08:06:28.984 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-03-30T08:06:29.021 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-03-30T08:06:29.023 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main i386 Packages [3,421 B] 2023-03-30T08:06:29.043 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-03-30T08:06:29.127 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-03-30T08:06:30.092 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 28.4 kB in 1s (24.0 kB/s) 2023-03-30T08:06:30.108 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 28.4 kB in 1s (23.5 kB/s) 2023-03-30T08:06:31.232 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2023-03-30T08:06:31.236 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2023-03-30T08:06:31.271 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3066-gf03d69a8-1focal cephadm=18.0.0-3066-gf03d69a8-1focal ceph-mds=18.0.0-3066-gf03d69a8-1focal ceph-mgr=18.0.0-3066-gf03d69a8-1focal ceph-common=18.0.0-3066-gf03d69a8-1focal ceph-fuse=18.0.0-3066-gf03d69a8-1focal ceph-test=18.0.0-3066-gf03d69a8-1focal ceph-volume=18.0.0-3066-gf03d69a8-1focal radosgw=18.0.0-3066-gf03d69a8-1focal python3-rados=18.0.0-3066-gf03d69a8-1focal python3-rgw=18.0.0-3066-gf03d69a8-1focal python3-cephfs=18.0.0-3066-gf03d69a8-1focal python3-rbd=18.0.0-3066-gf03d69a8-1focal libcephfs2=18.0.0-3066-gf03d69a8-1focal libcephfs-dev=18.0.0-3066-gf03d69a8-1focal librados2=18.0.0-3066-gf03d69a8-1focal librbd1=18.0.0-3066-gf03d69a8-1focal rbd-fuse=18.0.0-3066-gf03d69a8-1focal python3-cephfs=18.0.0-3066-gf03d69a8-1focal cephfs-shell=18.0.0-3066-gf03d69a8-1focal cephfs-top=18.0.0-3066-gf03d69a8-1focal cephfs-mirror=18.0.0-3066-gf03d69a8-1focal 2023-03-30T08:06:31.273 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3066-gf03d69a8-1focal cephadm=18.0.0-3066-gf03d69a8-1focal ceph-mds=18.0.0-3066-gf03d69a8-1focal ceph-mgr=18.0.0-3066-gf03d69a8-1focal ceph-common=18.0.0-3066-gf03d69a8-1focal ceph-fuse=18.0.0-3066-gf03d69a8-1focal ceph-test=18.0.0-3066-gf03d69a8-1focal ceph-volume=18.0.0-3066-gf03d69a8-1focal radosgw=18.0.0-3066-gf03d69a8-1focal python3-rados=18.0.0-3066-gf03d69a8-1focal python3-rgw=18.0.0-3066-gf03d69a8-1focal python3-cephfs=18.0.0-3066-gf03d69a8-1focal python3-rbd=18.0.0-3066-gf03d69a8-1focal libcephfs2=18.0.0-3066-gf03d69a8-1focal libcephfs-dev=18.0.0-3066-gf03d69a8-1focal librados2=18.0.0-3066-gf03d69a8-1focal librbd1=18.0.0-3066-gf03d69a8-1focal rbd-fuse=18.0.0-3066-gf03d69a8-1focal python3-cephfs=18.0.0-3066-gf03d69a8-1focal cephfs-shell=18.0.0-3066-gf03d69a8-1focal cephfs-top=18.0.0-3066-gf03d69a8-1focal cephfs-mirror=18.0.0-3066-gf03d69a8-1focal 2023-03-30T08:06:31.379 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2023-03-30T08:06:31.387 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2023-03-30T08:06:31.547 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2023-03-30T08:06:31.547 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2023-03-30T08:06:31.575 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2023-03-30T08:06:31.575 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2023-03-30T08:06:31.704 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages were automatically installed and are no longer required: 2023-03-30T08:06:31.705 INFO:teuthology.orchestra.run.smithi115.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-03-30T08:06:31.705 INFO:teuthology.orchestra.run.smithi115.stdout:Use 'sudo apt autoremove' to remove them. 2023-03-30T08:06:31.705 INFO:teuthology.orchestra.run.smithi115.stdout:The following additional packages will be installed: 2023-03-30T08:06:31.705 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-03-30T08:06:31.706 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-03-30T08:06:31.706 INFO:teuthology.orchestra.run.smithi115.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-03-30T08:06:31.706 INFO:teuthology.orchestra.run.smithi115.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-03-30T08:06:31.706 INFO:teuthology.orchestra.run.smithi115.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-03-30T08:06:31.706 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-03-30T08:06:31.707 INFO:teuthology.orchestra.run.smithi115.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-03-30T08:06:31.707 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-03-30T08:06:31.707 INFO:teuthology.orchestra.run.smithi115.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-03-30T08:06:31.707 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-03-30T08:06:31.707 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-03-30T08:06:31.707 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-03-30T08:06:31.707 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-03-30T08:06:31.708 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-03-30T08:06:31.708 INFO:teuthology.orchestra.run.smithi115.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-03-30T08:06:31.708 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-03-30T08:06:31.708 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-03-30T08:06:31.708 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-03-30T08:06:31.708 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-03-30T08:06:31.708 INFO:teuthology.orchestra.run.smithi115.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-03-30T08:06:31.709 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-03-30T08:06:31.709 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-03-30T08:06:31.709 INFO:teuthology.orchestra.run.smithi115.stdout: qttranslations5-l10n socat xmlstarlet 2023-03-30T08:06:31.709 INFO:teuthology.orchestra.run.smithi115.stdout:Suggested packages: 2023-03-30T08:06:31.709 INFO:teuthology.orchestra.run.smithi115.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-03-30T08:06:31.710 INFO:teuthology.orchestra.run.smithi115.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-03-30T08:06:31.710 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-03-30T08:06:31.710 INFO:teuthology.orchestra.run.smithi115.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-03-30T08:06:31.710 INFO:teuthology.orchestra.run.smithi115.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-03-30T08:06:31.710 INFO:teuthology.orchestra.run.smithi115.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-03-30T08:06:31.710 INFO:teuthology.orchestra.run.smithi115.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-03-30T08:06:31.710 INFO:teuthology.orchestra.run.smithi115.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-03-30T08:06:31.711 INFO:teuthology.orchestra.run.smithi115.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-03-30T08:06:31.711 INFO:teuthology.orchestra.run.smithi115.stdout:Recommended packages: 2023-03-30T08:06:31.711 INFO:teuthology.orchestra.run.smithi115.stdout: btrfs-tools 2023-03-30T08:06:31.736 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2023-03-30T08:06:31.736 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-03-30T08:06:31.737 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2023-03-30T08:06:31.737 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2023-03-30T08:06:31.737 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-03-30T08:06:31.738 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-03-30T08:06:31.738 INFO:teuthology.orchestra.run.smithi087.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-03-30T08:06:31.738 INFO:teuthology.orchestra.run.smithi087.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-03-30T08:06:31.738 INFO:teuthology.orchestra.run.smithi087.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-03-30T08:06:31.738 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-03-30T08:06:31.738 INFO:teuthology.orchestra.run.smithi087.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-03-30T08:06:31.739 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-03-30T08:06:31.739 INFO:teuthology.orchestra.run.smithi087.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-03-30T08:06:31.739 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-03-30T08:06:31.739 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-03-30T08:06:31.739 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-03-30T08:06:31.739 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-03-30T08:06:31.739 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-03-30T08:06:31.739 INFO:teuthology.orchestra.run.smithi087.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-03-30T08:06:31.740 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-03-30T08:06:31.740 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-03-30T08:06:31.740 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-03-30T08:06:31.740 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-03-30T08:06:31.740 INFO:teuthology.orchestra.run.smithi087.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-03-30T08:06:31.740 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-03-30T08:06:31.740 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-03-30T08:06:31.740 INFO:teuthology.orchestra.run.smithi087.stdout: qttranslations5-l10n socat xmlstarlet 2023-03-30T08:06:31.741 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2023-03-30T08:06:31.741 INFO:teuthology.orchestra.run.smithi087.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-03-30T08:06:31.741 INFO:teuthology.orchestra.run.smithi087.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-03-30T08:06:31.741 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-03-30T08:06:31.741 INFO:teuthology.orchestra.run.smithi087.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-03-30T08:06:31.742 INFO:teuthology.orchestra.run.smithi087.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-03-30T08:06:31.742 INFO:teuthology.orchestra.run.smithi087.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-03-30T08:06:31.742 INFO:teuthology.orchestra.run.smithi087.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-03-30T08:06:31.742 INFO:teuthology.orchestra.run.smithi087.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-03-30T08:06:31.742 INFO:teuthology.orchestra.run.smithi087.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-03-30T08:06:31.742 INFO:teuthology.orchestra.run.smithi087.stdout:Recommended packages: 2023-03-30T08:06:31.742 INFO:teuthology.orchestra.run.smithi087.stdout: btrfs-tools 2023-03-30T08:06:31.904 INFO:teuthology.orchestra.run.smithi115.stdout:The following NEW packages will be installed: 2023-03-30T08:06:31.905 INFO:teuthology.orchestra.run.smithi115.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-03-30T08:06:31.905 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-03-30T08:06:31.905 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-03-30T08:06:31.905 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-03-30T08:06:31.905 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-03-30T08:06:31.906 INFO:teuthology.orchestra.run.smithi115.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-03-30T08:06:31.906 INFO:teuthology.orchestra.run.smithi115.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-03-30T08:06:31.906 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-03-30T08:06:31.907 INFO:teuthology.orchestra.run.smithi115.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-03-30T08:06:31.907 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-03-30T08:06:31.907 INFO:teuthology.orchestra.run.smithi115.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-03-30T08:06:31.907 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-03-30T08:06:31.907 INFO:teuthology.orchestra.run.smithi115.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-03-30T08:06:31.907 INFO:teuthology.orchestra.run.smithi115.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-03-30T08:06:31.907 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-03-30T08:06:31.908 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-03-30T08:06:31.908 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-03-30T08:06:31.908 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-03-30T08:06:31.908 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-03-30T08:06:31.908 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-03-30T08:06:31.908 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-03-30T08:06:31.908 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-03-30T08:06:31.908 INFO:teuthology.orchestra.run.smithi115.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-03-30T08:06:31.909 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-03-30T08:06:31.909 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-03-30T08:06:31.909 INFO:teuthology.orchestra.run.smithi115.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-03-30T08:06:31.909 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages will be upgraded: 2023-03-30T08:06:31.909 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 librbd1 2023-03-30T08:06:31.934 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2023-03-30T08:06:31.934 INFO:teuthology.orchestra.run.smithi087.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-03-30T08:06:31.935 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-03-30T08:06:31.935 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-03-30T08:06:31.935 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-03-30T08:06:31.935 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-03-30T08:06:31.936 INFO:teuthology.orchestra.run.smithi087.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-03-30T08:06:31.936 INFO:teuthology.orchestra.run.smithi087.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-03-30T08:06:31.936 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-03-30T08:06:31.937 INFO:teuthology.orchestra.run.smithi087.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-03-30T08:06:31.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-03-30T08:06:31.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-03-30T08:06:31.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-03-30T08:06:31.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-03-30T08:06:31.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-03-30T08:06:31.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-03-30T08:06:31.937 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-03-30T08:06:31.938 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-03-30T08:06:31.938 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-03-30T08:06:31.938 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-03-30T08:06:31.938 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-03-30T08:06:31.938 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-03-30T08:06:31.938 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-03-30T08:06:31.938 INFO:teuthology.orchestra.run.smithi087.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-03-30T08:06:31.938 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-03-30T08:06:31.939 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-03-30T08:06:31.939 INFO:teuthology.orchestra.run.smithi087.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-03-30T08:06:31.939 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2023-03-30T08:06:31.939 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 librbd1 2023-03-30T08:06:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:2 upgraded, 116 newly installed, 0 to remove and 158 not upgraded. 2023-03-30T08:06:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:Need to get 201 MB of archives. 2023-03-30T08:06:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:After this operation, 1,004 MB of additional disk space will be used. 2023-03-30T08:06:31.994 INFO:teuthology.orchestra.run.smithi115.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-03-30T08:06:32.013 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-03-30T08:06:32.020 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-03-30T08:06:32.046 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-03-30T08:06:32.076 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-03-30T08:06:32.079 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-03-30T08:06:32.082 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-3066-gf03d69a8-1focal [3,427 kB] 2023-03-30T08:06:32.093 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-03-30T08:06:32.109 INFO:teuthology.orchestra.run.smithi087.stdout:2 upgraded, 116 newly installed, 0 to remove and 158 not upgraded. 2023-03-30T08:06:32.110 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 201 MB of archives. 2023-03-30T08:06:32.110 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 1,004 MB of additional disk space will be used. 2023-03-30T08:06:32.110 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-3066-gf03d69a8-1focal [3,427 kB] 2023-03-30T08:06:32.137 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-03-30T08:06:32.140 INFO:teuthology.orchestra.run.smithi115.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-03-30T08:06:32.148 INFO:teuthology.orchestra.run.smithi115.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-03-30T08:06:32.149 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-03-30T08:06:32.150 INFO:teuthology.orchestra.run.smithi115.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-03-30T08:06:32.186 INFO:teuthology.orchestra.run.smithi115.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-03-30T08:06:32.234 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-03-30T08:06:32.263 INFO:teuthology.orchestra.run.smithi115.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-03-30T08:06:32.267 INFO:teuthology.orchestra.run.smithi115.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-03-30T08:06:32.268 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-03-30T08:06:32.304 INFO:teuthology.orchestra.run.smithi115.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-03-30T08:06:32.305 INFO:teuthology.orchestra.run.smithi115.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-03-30T08:06:32.311 INFO:teuthology.orchestra.run.smithi115.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-03-30T08:06:32.313 INFO:teuthology.orchestra.run.smithi115.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-03-30T08:06:32.314 INFO:teuthology.orchestra.run.smithi115.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-03-30T08:06:32.314 INFO:teuthology.orchestra.run.smithi115.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-03-30T08:06:32.317 INFO:teuthology.orchestra.run.smithi115.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-03-30T08:06:32.317 INFO:teuthology.orchestra.run.smithi115.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-03-30T08:06:32.353 INFO:teuthology.orchestra.run.smithi115.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-03-30T08:06:32.392 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-03-30T08:06:32.420 INFO:teuthology.orchestra.run.smithi115.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-03-30T08:06:32.424 INFO:teuthology.orchestra.run.smithi115.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-03-30T08:06:32.439 INFO:teuthology.orchestra.run.smithi115.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-03-30T08:06:32.452 INFO:teuthology.orchestra.run.smithi115.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-03-30T08:06:32.453 INFO:teuthology.orchestra.run.smithi115.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-03-30T08:06:32.479 INFO:teuthology.orchestra.run.smithi115.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-03-30T08:06:32.479 INFO:teuthology.orchestra.run.smithi115.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-03-30T08:06:32.481 INFO:teuthology.orchestra.run.smithi115.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-03-30T08:06:32.482 INFO:teuthology.orchestra.run.smithi115.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-03-30T08:06:32.484 INFO:teuthology.orchestra.run.smithi115.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-03-30T08:06:32.521 INFO:teuthology.orchestra.run.smithi115.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-3066-gf03d69a8-1focal [3,983 kB] 2023-03-30T08:06:32.523 INFO:teuthology.orchestra.run.smithi115.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-03-30T08:06:32.531 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-03-30T08:06:32.548 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-03-30T08:06:32.550 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-3066-gf03d69a8-1focal [3,983 kB] 2023-03-30T08:06:32.610 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-03-30T08:06:32.617 INFO:teuthology.orchestra.run.smithi115.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-03-30T08:06:32.620 INFO:teuthology.orchestra.run.smithi115.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-03-30T08:06:32.630 INFO:teuthology.orchestra.run.smithi115.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-03-30T08:06:32.638 INFO:teuthology.orchestra.run.smithi115.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-03-30T08:06:32.640 INFO:teuthology.orchestra.run.smithi115.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-03-30T08:06:32.641 INFO:teuthology.orchestra.run.smithi115.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-03-30T08:06:32.642 INFO:teuthology.orchestra.run.smithi115.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-03-30T08:06:32.648 INFO:teuthology.orchestra.run.smithi115.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-03-30T08:06:32.653 INFO:teuthology.orchestra.run.smithi115.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-03-30T08:06:32.655 INFO:teuthology.orchestra.run.smithi115.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-03-30T08:06:32.691 INFO:teuthology.orchestra.run.smithi115.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-03-30T08:06:32.733 INFO:teuthology.orchestra.run.smithi115.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-03-30T08:06:32.761 INFO:teuthology.orchestra.run.smithi115.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-3066-gf03d69a8-1focal [724 kB] 2023-03-30T08:06:32.808 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-3066-gf03d69a8-1focal [724 kB] 2023-03-30T08:06:32.810 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-03-30T08:06:32.813 INFO:teuthology.orchestra.run.smithi115.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-3066-gf03d69a8-1focal [375 kB] 2023-03-30T08:06:32.820 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-03-30T08:06:32.842 INFO:teuthology.orchestra.run.smithi115.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-3066-gf03d69a8-1focal [22.4 kB] 2023-03-30T08:06:32.843 INFO:teuthology.orchestra.run.smithi115.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-3066-gf03d69a8-1focal [184 kB] 2023-03-30T08:06:32.848 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-03-30T08:06:32.849 INFO:teuthology.orchestra.run.smithi115.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-3066-gf03d69a8-1focal [47.7 kB] 2023-03-30T08:06:32.850 INFO:teuthology.orchestra.run.smithi115.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-3066-gf03d69a8-1focal [354 kB] 2023-03-30T08:06:32.856 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-03-30T08:06:32.864 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-3066-gf03d69a8-1focal [375 kB] 2023-03-30T08:06:32.879 INFO:teuthology.orchestra.run.smithi115.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-3066-gf03d69a8-1focal [6,553 kB] 2023-03-30T08:06:32.895 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-3066-gf03d69a8-1focal [22.4 kB] 2023-03-30T08:06:32.897 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-3066-gf03d69a8-1focal [184 kB] 2023-03-30T08:06:32.903 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-3066-gf03d69a8-1focal [47.7 kB] 2023-03-30T08:06:32.904 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-3066-gf03d69a8-1focal [354 kB] 2023-03-30T08:06:32.935 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-3066-gf03d69a8-1focal [6,553 kB] 2023-03-30T08:06:32.937 INFO:teuthology.orchestra.run.smithi115.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-03-30T08:06:32.958 INFO:teuthology.orchestra.run.smithi115.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-03-30T08:06:32.960 INFO:teuthology.orchestra.run.smithi115.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-03-30T08:06:32.975 INFO:teuthology.orchestra.run.smithi115.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-03-30T08:06:32.976 INFO:teuthology.orchestra.run.smithi115.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-03-30T08:06:32.976 INFO:teuthology.orchestra.run.smithi115.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-03-30T08:06:32.976 INFO:teuthology.orchestra.run.smithi115.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-03-30T08:06:32.977 INFO:teuthology.orchestra.run.smithi115.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-03-30T08:06:32.977 INFO:teuthology.orchestra.run.smithi115.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-03-30T08:06:33.014 INFO:teuthology.orchestra.run.smithi115.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-03-30T08:06:33.025 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-03-30T08:06:33.081 INFO:teuthology.orchestra.run.smithi115.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-03-30T08:06:33.083 INFO:teuthology.orchestra.run.smithi115.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-03-30T08:06:33.088 INFO:teuthology.orchestra.run.smithi115.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-03-30T08:06:33.122 INFO:teuthology.orchestra.run.smithi115.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-03-30T08:06:33.129 INFO:teuthology.orchestra.run.smithi115.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-03-30T08:06:33.135 INFO:teuthology.orchestra.run.smithi115.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-03-30T08:06:33.138 INFO:teuthology.orchestra.run.smithi115.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-03-30T08:06:33.147 INFO:teuthology.orchestra.run.smithi115.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-03-30T08:06:33.152 INFO:teuthology.orchestra.run.smithi115.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-03-30T08:06:33.153 INFO:teuthology.orchestra.run.smithi115.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-03-30T08:06:33.216 INFO:teuthology.orchestra.run.smithi115.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-03-30T08:06:33.289 INFO:teuthology.orchestra.run.smithi115.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-3066-gf03d69a8-1focal [104 kB] 2023-03-30T08:06:33.291 INFO:teuthology.orchestra.run.smithi115.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-3066-gf03d69a8-1focal [466 kB] 2023-03-30T08:06:33.315 INFO:teuthology.orchestra.run.smithi115.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-03-30T08:06:33.328 INFO:teuthology.orchestra.run.smithi115.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-03-30T08:06:33.333 INFO:teuthology.orchestra.run.smithi115.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-3066-gf03d69a8-1focal [25.0 MB] 2023-03-30T08:06:33.374 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-3066-gf03d69a8-1focal [104 kB] 2023-03-30T08:06:33.375 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-3066-gf03d69a8-1focal [466 kB] 2023-03-30T08:06:33.386 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-03-30T08:06:33.406 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-03-30T08:06:33.413 INFO:teuthology.orchestra.run.smithi115.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-03-30T08:06:33.415 INFO:teuthology.orchestra.run.smithi115.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-03-30T08:06:33.415 INFO:teuthology.orchestra.run.smithi115.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-03-30T08:06:33.415 INFO:teuthology.orchestra.run.smithi115.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-03-30T08:06:33.416 INFO:teuthology.orchestra.run.smithi115.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-03-30T08:06:33.418 INFO:teuthology.orchestra.run.smithi115.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-03-30T08:06:33.423 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-3066-gf03d69a8-1focal [25.0 MB] 2023-03-30T08:06:33.432 INFO:teuthology.orchestra.run.smithi115.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-03-30T08:06:33.432 INFO:teuthology.orchestra.run.smithi115.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-03-30T08:06:33.468 INFO:teuthology.orchestra.run.smithi115.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-03-30T08:06:33.504 INFO:teuthology.orchestra.run.smithi115.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-03-30T08:06:33.547 INFO:teuthology.orchestra.run.smithi115.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-03-30T08:06:33.557 INFO:teuthology.orchestra.run.smithi115.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-03-30T08:06:33.560 INFO:teuthology.orchestra.run.smithi115.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-03-30T08:06:33.574 INFO:teuthology.orchestra.run.smithi115.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-03-30T08:06:33.576 INFO:teuthology.orchestra.run.smithi115.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-03-30T08:06:33.583 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-03-30T08:06:33.592 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-03-30T08:06:33.626 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-03-30T08:06:33.632 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-03-30T08:06:33.635 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-03-30T08:06:33.637 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-03-30T08:06:33.647 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-03-30T08:06:33.648 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-03-30T08:06:33.814 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-03-30T08:06:34.135 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-03-30T08:06:34.159 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-03-30T08:06:34.232 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-03-30T08:06:34.294 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-03-30T08:06:34.304 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-03-30T08:06:34.424 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-03-30T08:06:34.424 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-03-30T08:06:34.428 INFO:teuthology.orchestra.run.smithi087.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-03-30T08:06:34.432 INFO:teuthology.orchestra.run.smithi087.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-03-30T08:06:34.443 INFO:teuthology.orchestra.run.smithi087.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-03-30T08:06:34.631 INFO:teuthology.orchestra.run.smithi087.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-03-30T08:06:34.930 INFO:teuthology.orchestra.run.smithi115.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-3066-gf03d69a8-1focal [11.0 MB] 2023-03-30T08:06:35.069 INFO:teuthology.orchestra.run.smithi087.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-03-30T08:06:35.081 INFO:teuthology.orchestra.run.smithi087.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-03-30T08:06:35.098 INFO:teuthology.orchestra.run.smithi087.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-3066-gf03d69a8-1focal [11.0 MB] 2023-03-30T08:06:35.126 INFO:teuthology.orchestra.run.smithi087.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-03-30T08:06:35.171 INFO:teuthology.orchestra.run.smithi087.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-03-30T08:06:35.180 INFO:teuthology.orchestra.run.smithi087.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-03-30T08:06:35.185 INFO:teuthology.orchestra.run.smithi087.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-03-30T08:06:35.189 INFO:teuthology.orchestra.run.smithi087.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-03-30T08:06:35.215 INFO:teuthology.orchestra.run.smithi087.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-03-30T08:06:35.237 INFO:teuthology.orchestra.run.smithi087.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-03-30T08:06:35.247 INFO:teuthology.orchestra.run.smithi087.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-03-30T08:06:35.414 INFO:teuthology.orchestra.run.smithi087.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-03-30T08:06:35.604 INFO:teuthology.orchestra.run.smithi087.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-03-30T08:06:35.616 INFO:teuthology.orchestra.run.smithi115.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-3066-gf03d69a8-1focal [222 kB] 2023-03-30T08:06:35.652 INFO:teuthology.orchestra.run.smithi115.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3066-gf03d69a8-1focal [133 kB] 2023-03-30T08:06:35.657 INFO:teuthology.orchestra.run.smithi115.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-3066-gf03d69a8-1focal [1,550 kB] 2023-03-30T08:06:35.742 INFO:teuthology.orchestra.run.smithi115.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-3066-gf03d69a8-1focal [9,386 kB] 2023-03-30T08:06:35.845 INFO:teuthology.orchestra.run.smithi087.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-3066-gf03d69a8-1focal [222 kB] 2023-03-30T08:06:35.848 INFO:teuthology.orchestra.run.smithi087.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3066-gf03d69a8-1focal [133 kB] 2023-03-30T08:06:35.851 INFO:teuthology.orchestra.run.smithi087.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-3066-gf03d69a8-1focal [1,550 kB] 2023-03-30T08:06:35.975 INFO:teuthology.orchestra.run.smithi087.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-3066-gf03d69a8-1focal [9,386 kB] 2023-03-30T08:06:36.338 INFO:teuthology.orchestra.run.smithi115.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-3066-gf03d69a8-1focal [31.3 MB] 2023-03-30T08:06:36.380 INFO:teuthology.orchestra.run.smithi087.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-03-30T08:06:36.452 INFO:teuthology.orchestra.run.smithi087.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-03-30T08:06:36.454 INFO:teuthology.orchestra.run.smithi087.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-03-30T08:06:36.497 INFO:teuthology.orchestra.run.smithi087.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-03-30T08:06:36.497 INFO:teuthology.orchestra.run.smithi087.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-03-30T08:06:36.498 INFO:teuthology.orchestra.run.smithi087.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-03-30T08:06:36.499 INFO:teuthology.orchestra.run.smithi087.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-03-30T08:06:36.500 INFO:teuthology.orchestra.run.smithi087.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-03-30T08:06:36.501 INFO:teuthology.orchestra.run.smithi087.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-03-30T08:06:36.593 INFO:teuthology.orchestra.run.smithi087.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-3066-gf03d69a8-1focal [31.3 MB] 2023-03-30T08:06:36.666 INFO:teuthology.orchestra.run.smithi087.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-03-30T08:06:36.989 INFO:teuthology.orchestra.run.smithi087.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-03-30T08:06:37.003 INFO:teuthology.orchestra.run.smithi087.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-03-30T08:06:37.031 INFO:teuthology.orchestra.run.smithi087.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-03-30T08:06:37.191 INFO:teuthology.orchestra.run.smithi087.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-03-30T08:06:37.236 INFO:teuthology.orchestra.run.smithi087.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-03-30T08:06:37.264 INFO:teuthology.orchestra.run.smithi087.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-03-30T08:06:37.273 INFO:teuthology.orchestra.run.smithi087.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-03-30T08:06:37.316 INFO:teuthology.orchestra.run.smithi087.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-03-30T08:06:37.347 INFO:teuthology.orchestra.run.smithi087.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-03-30T08:06:37.349 INFO:teuthology.orchestra.run.smithi087.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-03-30T08:06:37.633 INFO:teuthology.orchestra.run.smithi087.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-03-30T08:06:38.104 INFO:teuthology.orchestra.run.smithi087.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-03-30T08:06:38.160 INFO:teuthology.orchestra.run.smithi087.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-03-30T08:06:38.287 INFO:teuthology.orchestra.run.smithi115.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-3066-gf03d69a8-1focal [3,812 B] 2023-03-30T08:06:38.287 INFO:teuthology.orchestra.run.smithi115.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-3066-gf03d69a8-1focal [833 kB] 2023-03-30T08:06:38.309 INFO:teuthology.orchestra.run.smithi115.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-3066-gf03d69a8-1focal [2,286 kB] 2023-03-30T08:06:38.438 INFO:teuthology.orchestra.run.smithi115.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-3066-gf03d69a8-1focal [97.1 kB] 2023-03-30T08:06:38.441 INFO:teuthology.orchestra.run.smithi115.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-3066-gf03d69a8-1focal [118 kB] 2023-03-30T08:06:38.445 INFO:teuthology.orchestra.run.smithi115.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-3066-gf03d69a8-1focal [1,760 kB] 2023-03-30T08:06:38.510 INFO:teuthology.orchestra.run.smithi087.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-03-30T08:06:38.512 INFO:teuthology.orchestra.run.smithi087.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-03-30T08:06:38.513 INFO:teuthology.orchestra.run.smithi087.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-03-30T08:06:38.513 INFO:teuthology.orchestra.run.smithi087.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-03-30T08:06:38.514 INFO:teuthology.orchestra.run.smithi087.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-03-30T08:06:38.516 INFO:teuthology.orchestra.run.smithi087.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-03-30T08:06:38.556 INFO:teuthology.orchestra.run.smithi115.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3066-gf03d69a8-1focal [7,898 kB] 2023-03-30T08:06:38.557 INFO:teuthology.orchestra.run.smithi087.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-03-30T08:06:38.558 INFO:teuthology.orchestra.run.smithi087.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-03-30T08:06:38.725 INFO:teuthology.orchestra.run.smithi087.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-03-30T08:06:38.897 INFO:teuthology.orchestra.run.smithi087.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-03-30T08:06:38.899 INFO:teuthology.orchestra.run.smithi087.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-3066-gf03d69a8-1focal [3,812 B] 2023-03-30T08:06:38.899 INFO:teuthology.orchestra.run.smithi087.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-3066-gf03d69a8-1focal [833 kB] 2023-03-30T08:06:38.954 INFO:teuthology.orchestra.run.smithi087.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-3066-gf03d69a8-1focal [2,286 kB] 2023-03-30T08:06:38.994 INFO:teuthology.orchestra.run.smithi115.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-3066-gf03d69a8-1focal [3,932 B] 2023-03-30T08:06:38.994 INFO:teuthology.orchestra.run.smithi115.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-3066-gf03d69a8-1focal [43.8 MB] 2023-03-30T08:06:39.114 INFO:teuthology.orchestra.run.smithi087.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-03-30T08:06:39.129 INFO:teuthology.orchestra.run.smithi087.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-3066-gf03d69a8-1focal [97.1 kB] 2023-03-30T08:06:39.149 INFO:teuthology.orchestra.run.smithi087.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-3066-gf03d69a8-1focal [118 kB] 2023-03-30T08:06:39.162 INFO:teuthology.orchestra.run.smithi087.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-03-30T08:06:39.163 INFO:teuthology.orchestra.run.smithi087.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-3066-gf03d69a8-1focal [1,760 kB] 2023-03-30T08:06:39.175 INFO:teuthology.orchestra.run.smithi087.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-03-30T08:06:39.239 INFO:teuthology.orchestra.run.smithi087.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-03-30T08:06:39.253 INFO:teuthology.orchestra.run.smithi087.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-03-30T08:06:39.300 INFO:teuthology.orchestra.run.smithi087.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3066-gf03d69a8-1focal [7,898 kB] 2023-03-30T08:06:39.916 INFO:teuthology.orchestra.run.smithi087.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-3066-gf03d69a8-1focal [3,932 B] 2023-03-30T08:06:39.916 INFO:teuthology.orchestra.run.smithi087.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-3066-gf03d69a8-1focal [43.8 MB] 2023-03-30T08:06:41.478 INFO:teuthology.orchestra.run.smithi115.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-3066-gf03d69a8-1focal [225 kB] 2023-03-30T08:06:41.480 INFO:teuthology.orchestra.run.smithi115.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-3066-gf03d69a8-1focal [253 kB] 2023-03-30T08:06:41.499 INFO:teuthology.orchestra.run.smithi115.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-3066-gf03d69a8-1focal [23.3 kB] 2023-03-30T08:06:41.500 INFO:teuthology.orchestra.run.smithi115.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-3066-gf03d69a8-1focal [13.0 kB] 2023-03-30T08:06:41.502 INFO:teuthology.orchestra.run.smithi115.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-3066-gf03d69a8-1focal [27.4 kB] 2023-03-30T08:06:41.503 INFO:teuthology.orchestra.run.smithi115.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-3066-gf03d69a8-1focal [13.4 MB] 2023-03-30T08:06:42.269 INFO:teuthology.orchestra.run.smithi115.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-3066-gf03d69a8-1focal [97.2 kB] 2023-03-30T08:06:42.722 INFO:teuthology.orchestra.run.smithi087.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-3066-gf03d69a8-1focal [225 kB] 2023-03-30T08:06:42.724 INFO:teuthology.orchestra.run.smithi087.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-3066-gf03d69a8-1focal [253 kB] 2023-03-30T08:06:42.727 INFO:teuthology.orchestra.run.smithi087.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-3066-gf03d69a8-1focal [23.3 kB] 2023-03-30T08:06:42.727 INFO:teuthology.orchestra.run.smithi087.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-3066-gf03d69a8-1focal [13.0 kB] 2023-03-30T08:06:42.727 INFO:teuthology.orchestra.run.smithi087.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-3066-gf03d69a8-1focal [27.4 kB] 2023-03-30T08:06:42.728 INFO:teuthology.orchestra.run.smithi087.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-3066-gf03d69a8-1focal [13.4 MB] 2023-03-30T08:06:43.150 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 201 MB in 10s (19.4 MB/s) 2023-03-30T08:06:43.225 INFO:teuthology.orchestra.run.smithi087.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230317.095222/f03d69a8741c605ae6711afe2c9991ac46095f7d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-3066-gf03d69a8-1focal [97.2 kB] 2023-03-30T08:06:43.326 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyperclip. 2023-03-30T08:06:43.395 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107765 files and directories currently installed.) 2023-03-30T08:06:43.398 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-03-30T08:06:43.439 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-03-30T08:06:43.758 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-wcwidth. 2023-03-30T08:06:43.776 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-03-30T08:06:43.816 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-03-30T08:06:44.111 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 201 MB in 11s (17.8 MB/s) 2023-03-30T08:06:44.152 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cmd2. 2023-03-30T08:06:44.171 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-03-30T08:06:44.202 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-03-30T08:06:44.265 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyperclip. 2023-03-30T08:06:44.334 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107765 files and directories currently installed.) 2023-03-30T08:06:44.337 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-03-30T08:06:44.386 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-03-30T08:06:44.589 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-03-30T08:06:44.606 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-03-30T08:06:44.689 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-03-30T08:06:44.714 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-wcwidth. 2023-03-30T08:06:44.732 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-03-30T08:06:44.772 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-03-30T08:06:45.076 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-03-30T08:06:45.094 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-03-30T08:06:45.109 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cmd2. 2023-03-30T08:06:45.126 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-03-30T08:06:45.134 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-03-30T08:06:45.167 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-03-30T08:06:45.504 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-03-30T08:06:45.519 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-03-30T08:06:45.521 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-03-30T08:06:45.531 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-03-30T08:06:45.562 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-03-30T08:06:45.620 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-03-30T08:06:45.965 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-03-30T08:06:45.982 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-03-30T08:06:46.023 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-03-30T08:06:46.049 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-03-30T08:06:46.068 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-03-30T08:06:46.125 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-30T08:06:46.385 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-03-30T08:06:46.401 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-03-30T08:06:46.443 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-03-30T08:06:46.660 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-03-30T08:06:46.678 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-03-30T08:06:46.718 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-30T08:06:46.872 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-03-30T08:06:46.890 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-03-30T08:06:46.948 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-30T08:06:47.138 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-03-30T08:06:47.156 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-03-30T08:06:47.363 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-30T08:06:47.500 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-03-30T08:06:47.516 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-03-30T08:06:47.558 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-30T08:06:47.775 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-03-30T08:06:47.792 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-03-30T08:06:47.833 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-03-30T08:06:48.161 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-03-30T08:06:48.178 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-03-30T08:06:48.212 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../010-librbd1_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:48.219 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-30T08:06:48.336 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librbd1 (18.0.0-3066-gf03d69a8-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-03-30T08:06:48.606 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-03-30T08:06:48.623 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-03-30T08:06:48.664 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-03-30T08:06:49.036 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../011-librados2_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:49.067 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../010-librbd1_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:49.163 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librados2 (18.0.0-3066-gf03d69a8-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-03-30T08:06:49.193 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librbd1 (18.0.0-3066-gf03d69a8-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-03-30T08:06:49.928 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../011-librados2_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:49.976 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libcephfs2. 2023-03-30T08:06:49.995 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:50.034 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libcephfs2 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:50.052 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librados2 (18.0.0-3066-gf03d69a8-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-03-30T08:06:50.412 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rados. 2023-03-30T08:06:50.428 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../013-python3-rados_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:50.470 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rados (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:50.808 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs2. 2023-03-30T08:06:50.814 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-03-30T08:06:50.825 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:50.832 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:06:50.866 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs2 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:50.881 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-ceph-argparse (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:51.150 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cephfs. 2023-03-30T08:06:51.168 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:51.193 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rados. 2023-03-30T08:06:51.205 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../013-python3-rados_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:51.208 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cephfs (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:51.235 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rados (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:51.537 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-ceph-common. 2023-03-30T08:06:51.555 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:06:51.572 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-03-30T08:06:51.584 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:06:51.595 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-ceph-common (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:51.631 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-argparse (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:51.908 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cephfs. 2023-03-30T08:06:51.926 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:51.965 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-prettytable. 2023-03-30T08:06:51.966 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cephfs (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:51.983 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-03-30T08:06:52.024 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-03-30T08:06:52.295 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-common. 2023-03-30T08:06:52.311 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rbd. 2023-03-30T08:06:52.312 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:06:52.328 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:52.345 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-common (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:52.369 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rbd (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:52.682 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-prettytable. 2023-03-30T08:06:52.700 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-03-30T08:06:52.740 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-03-30T08:06:52.747 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-03-30T08:06:52.764 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-03-30T08:06:52.805 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-03-30T08:06:53.010 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rbd. 2023-03-30T08:06:53.027 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:53.068 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rbd (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:53.184 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-03-30T08:06:53.195 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-03-30T08:06:53.234 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-03-30T08:06:53.429 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-03-30T08:06:53.446 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-03-30T08:06:53.487 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-03-30T08:06:53.612 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-03-30T08:06:53.629 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-03-30T08:06:53.670 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-03-30T08:06:53.824 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-03-30T08:06:53.842 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-03-30T08:06:53.873 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-03-30T08:06:54.031 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librgw2. 2023-03-30T08:06:54.048 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../022-librgw2_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:54.097 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librgw2 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:54.218 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-03-30T08:06:54.252 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-03-30T08:06:54.276 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-03-30T08:06:54.620 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librgw2. 2023-03-30T08:06:54.639 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../022-librgw2_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:54.670 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librgw2 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:54.983 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rgw. 2023-03-30T08:06:55.000 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:55.041 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rgw (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:55.420 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liboath0. 2023-03-30T08:06:55.436 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-03-30T08:06:55.469 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-03-30T08:06:55.572 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rgw. 2023-03-30T08:06:55.590 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:55.630 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rgw (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:55.780 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libradosstriper1. 2023-03-30T08:06:55.796 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:55.838 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libradosstriper1 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:56.008 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liboath0. 2023-03-30T08:06:56.026 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-03-30T08:06:56.066 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-03-30T08:06:56.316 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-common. 2023-03-30T08:06:56.332 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../026-ceph-common_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:56.374 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-common (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:56.411 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libradosstriper1. 2023-03-30T08:06:56.429 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:56.469 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libradosstriper1 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:56.947 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-common. 2023-03-30T08:06:56.963 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../026-ceph-common_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:57.005 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-common (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:58.896 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-base. 2023-03-30T08:06:58.913 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../027-ceph-base_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:58.974 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-base (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:06:59.487 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-base. 2023-03-30T08:06:59.503 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../027-ceph-base_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:06:59.561 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-base (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:00.417 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cherrypy3. 2023-03-30T08:07:00.435 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-03-30T08:07:00.475 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-03-30T08:07:00.861 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-natsort. 2023-03-30T08:07:00.878 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-03-30T08:07:00.919 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-03-30T08:07:01.032 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cherrypy3. 2023-03-30T08:07:01.048 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-03-30T08:07:01.089 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-03-30T08:07:01.265 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-logutils. 2023-03-30T08:07:01.283 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-03-30T08:07:01.322 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-03-30T08:07:01.444 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-natsort. 2023-03-30T08:07:01.462 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-03-30T08:07:01.502 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-03-30T08:07:01.634 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-markupsafe. 2023-03-30T08:07:01.651 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-03-30T08:07:01.692 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-03-30T08:07:01.855 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-logutils. 2023-03-30T08:07:01.872 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-03-30T08:07:01.913 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-03-30T08:07:02.013 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-mako. 2023-03-30T08:07:02.029 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-03-30T08:07:02.070 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-03-30T08:07:02.259 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-markupsafe. 2023-03-30T08:07:02.276 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-03-30T08:07:02.317 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-03-30T08:07:02.429 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-simplegeneric. 2023-03-30T08:07:02.446 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-03-30T08:07:02.487 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-03-30T08:07:02.641 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-mako. 2023-03-30T08:07:02.659 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-03-30T08:07:02.698 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-03-30T08:07:03.441 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-singledispatch. 2023-03-30T08:07:03.459 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-03-30T08:07:03.498 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-03-30T08:07:03.652 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplegeneric. 2023-03-30T08:07:03.670 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-03-30T08:07:03.710 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-03-30T08:07:03.852 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-webob. 2023-03-30T08:07:03.869 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-03-30T08:07:03.910 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-03-30T08:07:04.047 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-singledispatch. 2023-03-30T08:07:04.064 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-03-30T08:07:04.104 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-03-30T08:07:04.271 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-soupsieve. 2023-03-30T08:07:04.288 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-03-30T08:07:04.329 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-03-30T08:07:04.433 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webob. 2023-03-30T08:07:04.449 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-03-30T08:07:04.491 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-03-30T08:07:04.607 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-bs4. 2023-03-30T08:07:04.624 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-03-30T08:07:04.665 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-03-30T08:07:04.860 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-soupsieve. 2023-03-30T08:07:04.877 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-03-30T08:07:04.918 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-03-30T08:07:05.035 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-waitress. 2023-03-30T08:07:05.053 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-03-30T08:07:05.099 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-03-30T08:07:05.255 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-bs4. 2023-03-30T08:07:05.271 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-03-30T08:07:05.313 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-03-30T08:07:05.455 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-tempita. 2023-03-30T08:07:05.473 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-03-30T08:07:05.513 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-03-30T08:07:05.691 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-waitress. 2023-03-30T08:07:05.708 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-03-30T08:07:05.755 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-03-30T08:07:05.858 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-paste. 2023-03-30T08:07:05.875 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-03-30T08:07:05.916 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-03-30T08:07:06.136 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-tempita. 2023-03-30T08:07:06.153 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-03-30T08:07:06.193 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-03-30T08:07:06.236 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-03-30T08:07:06.252 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-03-30T08:07:06.294 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-03-30T08:07:06.521 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-paste. 2023-03-30T08:07:06.539 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-03-30T08:07:06.579 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-03-30T08:07:06.613 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pastedeploy. 2023-03-30T08:07:06.632 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-03-30T08:07:06.671 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-03-30T08:07:06.933 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-03-30T08:07:06.950 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-03-30T08:07:06.991 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-03-30T08:07:07.016 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-webtest. 2023-03-30T08:07:07.033 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-03-30T08:07:07.066 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-03-30T08:07:07.294 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastedeploy. 2023-03-30T08:07:07.311 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-03-30T08:07:07.344 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pecan. 2023-03-30T08:07:07.351 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-03-30T08:07:07.360 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-03-30T08:07:07.402 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-03-30T08:07:07.671 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webtest. 2023-03-30T08:07:07.687 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-03-30T08:07:07.729 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-03-30T08:07:07.807 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-werkzeug. 2023-03-30T08:07:07.819 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-03-30T08:07:07.857 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-03-30T08:07:08.067 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pecan. 2023-03-30T08:07:08.083 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-03-30T08:07:08.124 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-03-30T08:07:08.168 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-03-30T08:07:08.186 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:08.243 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:08.521 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-werkzeug. 2023-03-30T08:07:08.538 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-03-30T08:07:08.579 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-03-30T08:07:08.673 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-03-30T08:07:08.690 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:08.731 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:08.932 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-03-30T08:07:08.950 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:08.990 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:09.059 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cryptography. 2023-03-30T08:07:09.077 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-03-30T08:07:09.117 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-03-30T08:07:09.419 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-03-30T08:07:09.431 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:09.469 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:09.504 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-openssl. 2023-03-30T08:07:09.521 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-03-30T08:07:09.562 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-03-30T08:07:09.814 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cryptography. 2023-03-30T08:07:09.831 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-03-30T08:07:09.871 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-03-30T08:07:09.949 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr. 2023-03-30T08:07:09.966 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:10.006 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:10.209 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-openssl. 2023-03-30T08:07:10.226 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-03-30T08:07:10.258 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-03-30T08:07:10.552 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mon. 2023-03-30T08:07:10.569 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:10.609 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mon (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:10.628 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr. 2023-03-30T08:07:10.647 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:10.686 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:11.131 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mon. 2023-03-30T08:07:11.148 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:11.181 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mon (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:11.838 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-osd. 2023-03-30T08:07:11.856 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:11.896 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-osd (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:12.468 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-osd. 2023-03-30T08:07:12.486 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:12.526 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-osd (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:14.574 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph. 2023-03-30T08:07:14.592 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../053-ceph_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:14.632 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:14.976 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-fuse. 2023-03-30T08:07:14.993 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:15.034 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-fuse (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:15.279 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph. 2023-03-30T08:07:15.296 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../053-ceph_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:15.337 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:15.471 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mds. 2023-03-30T08:07:15.488 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:15.529 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mds (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:15.690 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-fuse. 2023-03-30T08:07:15.707 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:15.747 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-fuse (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:16.082 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package cephadm. 2023-03-30T08:07:16.100 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../056-cephadm_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:16.140 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking cephadm (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:16.142 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mds. 2023-03-30T08:07:16.159 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:16.192 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mds (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:16.468 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-asyncssh. 2023-03-30T08:07:16.484 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-03-30T08:07:16.525 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-03-30T08:07:16.745 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephadm. 2023-03-30T08:07:16.763 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../056-cephadm_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:16.803 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephadm (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:16.920 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jinja2. 2023-03-30T08:07:16.939 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-03-30T08:07:16.978 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-03-30T08:07:17.139 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-asyncssh. 2023-03-30T08:07:17.156 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-03-30T08:07:17.189 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-03-30T08:07:17.348 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-03-30T08:07:17.366 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:17.406 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:17.600 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jinja2. 2023-03-30T08:07:17.618 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-03-30T08:07:17.658 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-03-30T08:07:17.776 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-bcrypt. 2023-03-30T08:07:17.794 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-03-30T08:07:17.834 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-03-30T08:07:18.003 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-03-30T08:07:18.021 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:18.060 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:18.422 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-bcrypt. 2023-03-30T08:07:18.433 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-03-30T08:07:18.471 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-03-30T08:07:18.478 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jwt. 2023-03-30T08:07:18.495 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-03-30T08:07:18.536 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-03-30T08:07:18.807 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jwt. 2023-03-30T08:07:18.819 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-03-30T08:07:18.866 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-03-30T08:07:18.889 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-repoze.lru. 2023-03-30T08:07:18.906 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-03-30T08:07:18.947 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-03-30T08:07:19.202 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-repoze.lru. 2023-03-30T08:07:19.208 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libjs-underscore. 2023-03-30T08:07:19.213 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-03-30T08:07:19.226 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-03-30T08:07:19.251 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-03-30T08:07:19.266 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-03-30T08:07:19.513 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjs-underscore. 2023-03-30T08:07:19.531 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-03-30T08:07:19.543 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-03-30T08:07:19.554 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-03-30T08:07:19.570 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-03-30T08:07:19.593 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-03-30T08:07:19.849 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-03-30T08:07:19.866 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-03-30T08:07:19.906 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-03-30T08:07:19.963 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-routes. 2023-03-30T08:07:19.980 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-03-30T08:07:20.021 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-03-30T08:07:20.193 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-routes. 2023-03-30T08:07:20.210 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-03-30T08:07:20.250 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-03-30T08:07:20.399 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-03-30T08:07:20.416 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:20.482 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:20.595 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-03-30T08:07:20.612 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:20.653 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:20.985 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-decorator. 2023-03-30T08:07:21.003 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-03-30T08:07:21.043 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-03-30T08:07:21.232 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-decorator. 2023-03-30T08:07:21.249 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-03-30T08:07:21.289 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-03-30T08:07:21.379 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-03-30T08:07:21.397 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-03-30T08:07:21.437 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-03-30T08:07:21.609 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-03-30T08:07:21.626 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-03-30T08:07:21.667 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-03-30T08:07:21.774 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-scipy. 2023-03-30T08:07:21.791 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-03-30T08:07:21.831 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-03-30T08:07:22.003 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-scipy. 2023-03-30T08:07:22.020 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-03-30T08:07:22.061 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-03-30T08:07:23.173 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-03-30T08:07:23.193 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-03-30T08:07:23.231 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-03-30T08:07:23.377 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-03-30T08:07:23.389 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-03-30T08:07:23.427 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-03-30T08:07:23.834 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-joblib. 2023-03-30T08:07:23.852 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-03-30T08:07:23.892 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-03-30T08:07:23.972 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-joblib. 2023-03-30T08:07:23.989 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-03-30T08:07:24.022 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-03-30T08:07:24.288 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-sklearn. 2023-03-30T08:07:24.306 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-03-30T08:07:24.345 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-03-30T08:07:24.450 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn. 2023-03-30T08:07:24.468 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-03-30T08:07:24.508 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-03-30T08:07:25.079 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-03-30T08:07:25.096 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:25.145 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:25.233 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-03-30T08:07:25.251 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:25.291 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:26.356 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cachetools. 2023-03-30T08:07:26.374 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-03-30T08:07:26.414 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-03-30T08:07:26.494 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cachetools. 2023-03-30T08:07:26.511 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-03-30T08:07:26.552 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-03-30T08:07:26.751 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyasn1. 2023-03-30T08:07:26.769 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-03-30T08:07:26.808 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-03-30T08:07:26.879 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1. 2023-03-30T08:07:26.891 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-03-30T08:07:26.929 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-03-30T08:07:27.187 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-03-30T08:07:27.204 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-03-30T08:07:27.244 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-03-30T08:07:27.316 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-03-30T08:07:27.332 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-03-30T08:07:27.373 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-03-30T08:07:27.606 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rsa. 2023-03-30T08:07:27.624 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-03-30T08:07:27.664 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rsa (4.0-3) ... 2023-03-30T08:07:27.718 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rsa. 2023-03-30T08:07:27.736 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-03-30T08:07:27.776 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rsa (4.0-3) ... 2023-03-30T08:07:28.000 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-google-auth. 2023-03-30T08:07:28.019 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-03-30T08:07:28.058 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-03-30T08:07:28.112 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-google-auth. 2023-03-30T08:07:28.130 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-03-30T08:07:28.170 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-03-30T08:07:28.411 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-blinker. 2023-03-30T08:07:28.428 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-03-30T08:07:28.469 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-03-30T08:07:28.531 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-blinker. 2023-03-30T08:07:28.543 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-03-30T08:07:28.581 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-03-30T08:07:28.822 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-oauthlib. 2023-03-30T08:07:28.839 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-03-30T08:07:28.880 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-03-30T08:07:28.909 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-oauthlib. 2023-03-30T08:07:28.921 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-03-30T08:07:28.958 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-03-30T08:07:29.336 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-03-30T08:07:29.353 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-03-30T08:07:29.394 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-03-30T08:07:29.664 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-03-30T08:07:29.683 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-03-30T08:07:29.722 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-03-30T08:07:29.747 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-websocket. 2023-03-30T08:07:29.765 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-03-30T08:07:29.805 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-03-30T08:07:30.059 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-websocket. 2023-03-30T08:07:30.077 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-03-30T08:07:30.117 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-03-30T08:07:30.142 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-kubernetes. 2023-03-30T08:07:30.160 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-03-30T08:07:30.200 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-03-30T08:07:30.471 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-kubernetes. 2023-03-30T08:07:30.488 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-03-30T08:07:30.528 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-03-30T08:07:30.824 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-03-30T08:07:30.842 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:30.882 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:31.185 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-03-30T08:07:31.204 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:31.210 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libonig5:amd64. 2023-03-30T08:07:31.228 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-03-30T08:07:31.243 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:31.268 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-03-30T08:07:31.596 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libonig5:amd64. 2023-03-30T08:07:31.613 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-03-30T08:07:31.629 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libjq1:amd64. 2023-03-30T08:07:31.648 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-03-30T08:07:31.654 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-03-30T08:07:31.689 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-03-30T08:07:31.982 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package jq. 2023-03-30T08:07:32.000 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-03-30T08:07:32.007 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjq1:amd64. 2023-03-30T08:07:32.019 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-03-30T08:07:32.040 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-03-30T08:07:32.056 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-03-30T08:07:32.318 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package socat. 2023-03-30T08:07:32.336 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-03-30T08:07:32.351 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package jq. 2023-03-30T08:07:32.363 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-03-30T08:07:32.376 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking socat (1.7.3.3-2) ... 2023-03-30T08:07:32.400 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-03-30T08:07:32.670 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package socat. 2023-03-30T08:07:32.682 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-03-30T08:07:32.705 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package xmlstarlet. 2023-03-30T08:07:32.719 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking socat (1.7.3.3-2) ... 2023-03-30T08:07:32.721 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-03-30T08:07:32.762 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-03-30T08:07:33.040 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package xmlstarlet. 2023-03-30T08:07:33.059 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-03-30T08:07:33.098 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-03-30T08:07:33.151 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-test. 2023-03-30T08:07:33.168 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../090-ceph-test_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:33.208 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-test (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:33.502 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-test. 2023-03-30T08:07:33.520 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../090-ceph-test_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:33.560 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-test (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:36.821 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-volume. 2023-03-30T08:07:36.840 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:36.878 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-volume (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:37.276 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package cephfs-mirror. 2023-03-30T08:07:37.281 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-volume. 2023-03-30T08:07:37.293 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:37.298 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:37.333 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking cephfs-mirror (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:37.338 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-volume (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:37.669 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-colorama. 2023-03-30T08:07:37.680 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-03-30T08:07:37.693 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephfs-mirror. 2023-03-30T08:07:37.710 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-03-30T08:07:37.711 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:37.760 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephfs-mirror (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:37.980 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package cephfs-shell. 2023-03-30T08:07:37.997 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:38.038 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking cephfs-shell (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:38.121 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-colorama. 2023-03-30T08:07:38.138 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-03-30T08:07:38.178 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-03-30T08:07:38.333 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package cephfs-top. 2023-03-30T08:07:38.350 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:38.391 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking cephfs-top (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:38.464 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephfs-shell. 2023-03-30T08:07:38.483 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:38.522 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephfs-shell (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:38.652 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package fonts-mathjax. 2023-03-30T08:07:38.670 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-03-30T08:07:38.709 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-03-30T08:07:38.808 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephfs-top. 2023-03-30T08:07:38.826 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-3066-gf03d69a8-1focal_all.deb ... 2023-03-30T08:07:38.866 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephfs-top (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:39.144 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package fonts-mathjax. 2023-03-30T08:07:39.163 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-03-30T08:07:39.202 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-03-30T08:07:39.222 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libcephfs-dev. 2023-03-30T08:07:39.240 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:39.280 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libcephfs-dev (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:39.683 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package nvme-cli. 2023-03-30T08:07:39.701 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-03-30T08:07:39.771 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-03-30T08:07:39.772 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs-dev. 2023-03-30T08:07:39.791 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:39.830 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs-dev (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:40.096 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-03-30T08:07:40.115 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-03-30T08:07:40.154 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-03-30T08:07:40.225 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package nvme-cli. 2023-03-30T08:07:40.243 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-03-30T08:07:40.313 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-03-30T08:07:40.591 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libjs-mathjax. 2023-03-30T08:07:40.609 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-03-30T08:07:40.648 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-03-30T08:07:40.662 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-03-30T08:07:40.680 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-03-30T08:07:40.720 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-03-30T08:07:41.098 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjs-mathjax. 2023-03-30T08:07:41.116 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-03-30T08:07:41.156 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-03-30T08:07:42.514 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python-natsort-doc. 2023-03-30T08:07:42.534 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-03-30T08:07:42.572 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-03-30T08:07:42.950 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-atomicwrites. 2023-03-30T08:07:42.968 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-03-30T08:07:43.008 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-03-30T08:07:43.186 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-natsort-doc. 2023-03-30T08:07:43.206 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-03-30T08:07:43.244 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-03-30T08:07:43.336 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-attr. 2023-03-30T08:07:43.355 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-03-30T08:07:43.394 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-03-30T08:07:43.630 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-atomicwrites. 2023-03-30T08:07:43.643 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-03-30T08:07:43.680 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-03-30T08:07:43.781 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-webencodings. 2023-03-30T08:07:43.799 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-03-30T08:07:43.838 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-03-30T08:07:43.999 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-attr. 2023-03-30T08:07:44.012 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-03-30T08:07:44.049 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-03-30T08:07:44.175 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-html5lib. 2023-03-30T08:07:44.193 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-03-30T08:07:44.232 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-03-30T08:07:44.410 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webencodings. 2023-03-30T08:07:44.429 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-03-30T08:07:44.476 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-03-30T08:07:44.595 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-03-30T08:07:44.613 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-03-30T08:07:44.652 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-03-30T08:07:44.796 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-html5lib. 2023-03-30T08:07:44.815 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-03-30T08:07:44.854 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-03-30T08:07:45.122 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-packaging. 2023-03-30T08:07:45.141 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-03-30T08:07:45.180 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-packaging (20.3-1) ... 2023-03-30T08:07:45.207 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-03-30T08:07:45.225 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-03-30T08:07:45.265 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-03-30T08:07:45.508 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pastescript. 2023-03-30T08:07:45.527 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-03-30T08:07:45.566 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-03-30T08:07:45.777 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-packaging. 2023-03-30T08:07:45.796 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-03-30T08:07:45.834 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-packaging (20.3-1) ... 2023-03-30T08:07:45.920 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pluggy. 2023-03-30T08:07:45.939 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-03-30T08:07:45.978 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-03-30T08:07:46.154 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastescript. 2023-03-30T08:07:46.172 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-03-30T08:07:46.211 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-03-30T08:07:46.331 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-psutil. 2023-03-30T08:07:46.350 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-03-30T08:07:46.389 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-03-30T08:07:46.540 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pluggy. 2023-03-30T08:07:46.552 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-03-30T08:07:46.589 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-03-30T08:07:46.766 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-py. 2023-03-30T08:07:46.779 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-03-30T08:07:46.816 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-03-30T08:07:46.942 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-psutil. 2023-03-30T08:07:46.955 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-03-30T08:07:47.000 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-03-30T08:07:47.204 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyinotify. 2023-03-30T08:07:47.221 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-03-30T08:07:47.261 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-03-30T08:07:47.338 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-py. 2023-03-30T08:07:47.356 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-03-30T08:07:47.395 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-03-30T08:07:47.591 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pytest. 2023-03-30T08:07:47.609 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-03-30T08:07:47.648 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-03-30T08:07:47.758 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyinotify. 2023-03-30T08:07:47.775 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-03-30T08:07:47.817 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-03-30T08:07:48.011 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-simplejson. 2023-03-30T08:07:48.029 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-03-30T08:07:48.068 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-03-30T08:07:48.126 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pytest. 2023-03-30T08:07:48.139 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-03-30T08:07:48.176 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-03-30T08:07:48.380 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-03-30T08:07:48.398 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-03-30T08:07:48.438 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-03-30T08:07:48.529 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplejson. 2023-03-30T08:07:48.548 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-03-30T08:07:48.587 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-03-30T08:07:48.923 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-03-30T08:07:48.941 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-03-30T08:07:48.981 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-03-30T08:07:49.450 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package radosgw. 2023-03-30T08:07:49.468 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../116-radosgw_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:49.508 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking radosgw (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:49.710 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package radosgw. 2023-03-30T08:07:49.728 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../116-radosgw_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:49.767 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking radosgw (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:50.903 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package rbd-fuse. 2023-03-30T08:07:50.921 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:50.952 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking rbd-fuse (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:51.221 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package rbd-fuse. 2023-03-30T08:07:51.240 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-3066-gf03d69a8-1focal_amd64.deb ... 2023-03-30T08:07:51.278 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking rbd-fuse (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:51.321 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-attr (19.3.0-2) ... 2023-03-30T08:07:51.640 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-attr (19.3.0-2) ... 2023-03-30T08:07:51.658 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-03-30T08:07:51.784 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-03-30T08:07:51.910 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-03-30T08:07:51.992 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-03-30T08:07:52.120 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up cephadm (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:52.134 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-03-30T08:07:52.260 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-03-30T08:07:52.478 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephadm (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:52.817 INFO:teuthology.orchestra.run.smithi115.stdout:Adding system user cephadm....done 2023-03-30T08:07:53.001 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-03-30T08:07:53.127 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-03-30T08:07:53.182 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user cephadm....done 2023-03-30T08:07:53.367 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-03-30T08:07:53.493 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-03-30T08:07:53.530 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-03-30T08:07:53.866 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-03-30T08:07:53.903 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-03-30T08:07:54.147 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-03-30T08:07:54.238 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-03-30T08:07:54.273 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-03-30T08:07:54.364 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-03-30T08:07:54.490 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-03-30T08:07:54.642 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-03-30T08:07:54.874 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-03-30T08:07:55.111 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-03-30T08:07:55.386 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-03-30T08:07:55.445 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-03-30T08:07:55.729 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-03-30T08:07:55.780 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-03-30T08:07:56.055 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-03-30T08:07:56.115 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-03-30T08:07:56.389 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-03-30T08:07:56.450 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-03-30T08:07:56.715 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-03-30T08:07:56.792 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-ceph-argparse (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:57.058 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-argparse (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:07:57.135 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-03-30T08:07:57.252 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-03-30T08:07:57.400 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-03-30T08:07:57.526 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-03-30T08:07:57.587 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-03-30T08:07:57.860 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-03-30T08:07:57.921 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-03-30T08:07:58.187 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-03-30T08:07:58.257 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-03-30T08:07:58.382 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-03-30T08:07:58.522 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-03-30T08:07:58.648 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-03-30T08:07:58.809 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-03-30T08:07:59.082 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-03-30T08:07:59.143 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-03-30T08:07:59.425 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-03-30T08:07:59.469 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-03-30T08:07:59.759 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-03-30T08:07:59.871 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-03-30T08:08:00.205 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-03-30T08:08:00.485 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-03-30T08:08:00.606 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-03-30T08:08:00.819 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-03-30T08:08:00.948 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-packaging (20.3-1) ... 2023-03-30T08:08:01.217 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-03-30T08:08:01.308 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-03-30T08:08:01.436 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-03-30T08:08:01.563 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-03-30T08:08:01.568 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-packaging (20.3-1) ... 2023-03-30T08:08:01.906 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-03-30T08:08:01.919 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-03-30T08:08:02.046 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-03-30T08:08:02.163 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-03-30T08:08:02.360 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-03-30T08:08:02.498 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-03-30T08:08:02.703 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-03-30T08:08:02.958 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-03-30T08:08:03.137 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-03-30T08:08:03.309 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-03-30T08:08:03.564 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up socat (1.7.3.3-2) ... 2023-03-30T08:08:03.689 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-ceph-common (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:03.735 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-03-30T08:08:04.083 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-30T08:08:04.178 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up socat (1.7.3.3-2) ... 2023-03-30T08:08:04.242 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-03-30T08:08:04.304 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-common (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:04.661 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-03-30T08:08:04.682 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-30T08:08:04.787 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-03-30T08:08:04.824 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-03-30T08:08:04.913 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-03-30T08:08:05.234 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-03-30T08:08:05.248 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-03-30T08:08:05.360 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-03-30T08:08:05.486 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-03-30T08:08:05.615 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-30T08:08:05.741 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-03-30T08:08:05.837 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-03-30T08:08:05.868 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-03-30T08:08:06.200 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-30T08:08:06.248 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-03-30T08:08:06.326 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-03-30T08:08:06.452 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-03-30T08:08:06.599 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-03-30T08:08:06.838 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-03-30T08:08:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-03-30T08:08:07.119 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-03-30T08:08:07.155 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-03-30T08:08:07.453 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-03-30T08:08:07.533 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-03-30T08:08:07.657 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-03-30T08:08:07.796 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-03-30T08:08:08.000 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-03-30T08:08:08.155 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-03-30T08:08:08.345 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-03-30T08:08:08.618 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-03-30T08:08:08.696 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-03-30T08:08:08.918 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-03-30T08:08:09.044 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-03-30T08:08:09.096 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-03-30T08:08:09.408 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-03-30T08:08:09.420 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-03-30T08:08:09.533 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-03-30T08:08:09.838 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-03-30T08:08:09.909 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-03-30T08:08:09.964 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-03-30T08:08:10.090 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-03-30T08:08:10.344 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-03-30T08:08:10.470 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-03-30T08:08:10.475 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-03-30T08:08:10.596 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-03-30T08:08:10.810 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-03-30T08:08:10.980 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-03-30T08:08:11.314 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-03-30T08:08:12.540 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-03-30T08:08:12.657 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-03-30T08:08:13.045 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-03-30T08:08:13.101 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-03-30T08:08:13.163 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-03-30T08:08:13.460 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-03-30T08:08:13.581 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-03-30T08:08:13.795 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-30T08:08:13.921 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-03-30T08:08:13.932 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-03-30T08:08:14.258 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-03-30T08:08:14.322 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-03-30T08:08:14.384 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-03-30T08:08:14.707 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-03-30T08:08:14.769 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-03-30T08:08:15.138 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-03-30T08:08:15.150 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-03-30T08:08:15.527 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-03-30T08:08:15.599 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-03-30T08:08:15.976 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-03-30T08:08:16.735 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-03-30T08:08:16.861 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-03-30T08:08:16.987 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-03-30T08:08:17.138 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rsa (4.0-3) ... 2023-03-30T08:08:17.173 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-03-30T08:08:17.308 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-03-30T08:08:17.437 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-03-30T08:08:17.464 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-03-30T08:08:17.563 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rsa (4.0-3) ... 2023-03-30T08:08:17.590 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-03-30T08:08:17.906 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-03-30T08:08:17.936 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-03-30T08:08:18.031 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-03-30T08:08:18.279 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-03-30T08:08:18.391 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-03-30T08:08:18.647 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-03-30T08:08:18.734 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-03-30T08:08:19.082 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librados2 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:19.103 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-03-30T08:08:19.313 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-03-30T08:08:19.439 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librgw2 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:19.556 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librados2 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:19.565 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:19.793 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-03-30T08:08:19.919 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librgw2 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:19.966 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libcephfs2 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:20.036 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:20.093 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-routes (2.4.1-2) ... 2023-03-30T08:08:20.162 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs2 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:20.305 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-routes (2.4.1-2) ... 2023-03-30T08:08:20.444 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libradosstriper1 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:20.570 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-03-30T08:08:20.648 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libradosstriper1 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:20.775 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-03-30T08:08:20.913 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librbd1 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:21.039 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-modules-core (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:21.126 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librbd1 (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:21.165 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-fuse (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:21.252 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-modules-core (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:21.378 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-fuse (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:21.415 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-03-30T08:08:21.415 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-03-30T08:08:21.629 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-03-30T08:08:21.630 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-03-30T08:08:22.209 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libcephfs-dev (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:22.334 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rados (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:22.421 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs-dev (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:22.460 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up cephfs-top (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:22.547 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rados (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:22.586 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-03-30T08:08:22.690 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephfs-top (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:22.816 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-03-30T08:08:23.723 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rbd (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:23.849 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up rbd-fuse (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:23.937 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rbd (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:23.984 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rgw (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:24.063 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up rbd-fuse (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:24.110 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cephfs (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:24.189 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rgw (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:24.236 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up cephfs-shell (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:24.314 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cephfs (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:24.370 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-common (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:24.441 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephfs-shell (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:24.567 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-common (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:24.941 INFO:teuthology.orchestra.run.smithi115.stdout:Adding group ceph....done 2023-03-30T08:08:25.153 INFO:teuthology.orchestra.run.smithi087.stdout:Adding group ceph....done 2023-03-30T08:08:25.374 INFO:teuthology.orchestra.run.smithi115.stdout:Adding system user ceph....done 2023-03-30T08:08:25.585 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user ceph....done 2023-03-30T08:08:25.585 INFO:teuthology.orchestra.run.smithi115.stdout:Setting system user ceph properties....done 2023-03-30T08:08:25.611 INFO:teuthology.orchestra.run.smithi115.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-03-30T08:08:25.788 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-03-30T08:08:25.823 INFO:teuthology.orchestra.run.smithi087.stdout:Setting system user ceph properties....done 2023-03-30T08:08:25.857 INFO:teuthology.orchestra.run.smithi087.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-03-30T08:08:26.035 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-03-30T08:08:26.303 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-03-30T08:08:26.524 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-03-30T08:08:27.113 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up cephfs-mirror (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:27.248 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-test (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:27.319 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephfs-mirror (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:27.374 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up radosgw (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:27.462 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-test (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:27.588 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up radosgw (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:27.679 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-03-30T08:08:27.680 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-03-30T08:08:27.894 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-03-30T08:08:27.895 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-03-30T08:08:28.834 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-base (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:29.073 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-base (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:29.299 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-03-30T08:08:29.543 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-03-30T08:08:30.145 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mds (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:30.358 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mds (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:30.400 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-03-30T08:08:30.401 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-03-30T08:08:30.617 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-03-30T08:08:30.618 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-03-30T08:08:31.196 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:31.418 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:31.465 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-03-30T08:08:31.465 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-03-30T08:08:31.680 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-03-30T08:08:31.680 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-03-30T08:08:32.264 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-osd (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:32.444 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-osd (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:33.058 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-03-30T08:08:33.059 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-03-30T08:08:33.228 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-03-30T08:08:33.229 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-03-30T08:08:33.857 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:34.008 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:34.012 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:34.138 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:34.160 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mon (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:34.281 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mon (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:34.410 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-03-30T08:08:34.411 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-03-30T08:08:34.546 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-03-30T08:08:34.546 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-03-30T08:08:35.261 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-cephadm (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:35.332 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-cephadm (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:35.412 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:35.483 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:35.538 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-dashboard (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:35.609 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-dashboard (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:35.698 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-volume (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:35.819 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-volume (18.0.0-3066-gf03d69a8-1focal) ... 2023-03-30T08:08:35.825 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-03-30T08:08:35.947 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-03-30T08:08:35.984 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-03-30T08:08:36.106 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-03-30T08:08:36.419 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-03-30T08:08:36.532 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-03-30T08:08:41.038 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-03-30T08:08:41.302 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-03-30T08:08:41.762 INFO:teuthology.orchestra.run.smithi115.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-03-30T08:08:41.768 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-03-30T08:08:41.882 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2023-03-30T08:08:42.054 INFO:teuthology.orchestra.run.smithi087.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-03-30T08:08:42.059 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-03-30T08:08:42.074 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2023-03-30T08:08:42.074 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2023-03-30T08:08:42.170 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2023-03-30T08:08:42.252 INFO:teuthology.orchestra.run.smithi115.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-03-30T08:08:42.252 INFO:teuthology.orchestra.run.smithi115.stdout:flex is already the newest version (2.6.4-6.2). 2023-03-30T08:08:42.252 INFO:teuthology.orchestra.run.smithi115.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-03-30T08:08:42.252 INFO:teuthology.orchestra.run.smithi115.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-03-30T08:08:42.252 INFO:teuthology.orchestra.run.smithi115.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-03-30T08:08:42.253 INFO:teuthology.orchestra.run.smithi115.stdout:util-linux is already the newest version (2.34-0.1ubuntu9.3). 2023-03-30T08:08:42.253 INFO:teuthology.orchestra.run.smithi115.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-03-30T08:08:42.253 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages were automatically installed and are no longer required: 2023-03-30T08:08:42.254 INFO:teuthology.orchestra.run.smithi115.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-03-30T08:08:42.254 INFO:teuthology.orchestra.run.smithi115.stdout:Use 'sudo apt autoremove' to remove them. 2023-03-30T08:08:42.254 INFO:teuthology.orchestra.run.smithi115.stdout:The following additional packages will be installed: 2023-03-30T08:08:42.254 INFO:teuthology.orchestra.run.smithi115.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-03-30T08:08:42.254 INFO:teuthology.orchestra.run.smithi115.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 modemmanager 2023-03-30T08:08:42.254 INFO:teuthology.orchestra.run.smithi115.stdout: network-manager-pptp postgresql-12 postgresql-client-12 2023-03-30T08:08:42.254 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-03-30T08:08:42.255 INFO:teuthology.orchestra.run.smithi115.stdout: wpasupplicant 2023-03-30T08:08:42.255 INFO:teuthology.orchestra.run.smithi115.stdout:Suggested packages: 2023-03-30T08:08:42.255 INFO:teuthology.orchestra.run.smithi115.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-03-30T08:08:42.255 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-doc-12 libjson-perl comgt wvdial wpagui libengine-pkcs11-openssl 2023-03-30T08:08:42.342 INFO:teuthology.orchestra.run.smithi115.stdout:The following NEW packages will be installed: 2023-03-30T08:08:42.343 INFO:teuthology.orchestra.run.smithi115.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-03-30T08:08:42.343 INFO:teuthology.orchestra.run.smithi115.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-03-30T08:08:42.343 INFO:teuthology.orchestra.run.smithi115.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-03-30T08:08:42.344 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-03-30T08:08:42.344 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-03-30T08:08:42.344 INFO:teuthology.orchestra.run.smithi115.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-03-30T08:08:42.345 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages will be upgraded: 2023-03-30T08:08:42.345 INFO:teuthology.orchestra.run.smithi115.stdout: libssl1.1 2023-03-30T08:08:42.361 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2023-03-30T08:08:42.362 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2023-03-30T08:08:42.534 INFO:teuthology.orchestra.run.smithi087.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-03-30T08:08:42.534 INFO:teuthology.orchestra.run.smithi087.stdout:flex is already the newest version (2.6.4-6.2). 2023-03-30T08:08:42.534 INFO:teuthology.orchestra.run.smithi087.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-03-30T08:08:42.534 INFO:teuthology.orchestra.run.smithi087.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-03-30T08:08:42.534 INFO:teuthology.orchestra.run.smithi087.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-03-30T08:08:42.535 INFO:teuthology.orchestra.run.smithi087.stdout:util-linux is already the newest version (2.34-0.1ubuntu9.3). 2023-03-30T08:08:42.535 INFO:teuthology.orchestra.run.smithi087.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-03-30T08:08:42.535 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2023-03-30T08:08:42.536 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-03-30T08:08:42.536 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2023-03-30T08:08:42.536 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2023-03-30T08:08:42.536 INFO:teuthology.orchestra.run.smithi087.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-03-30T08:08:42.536 INFO:teuthology.orchestra.run.smithi087.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 modemmanager 2023-03-30T08:08:42.536 INFO:teuthology.orchestra.run.smithi087.stdout: network-manager-pptp postgresql-12 postgresql-client-12 2023-03-30T08:08:42.537 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-03-30T08:08:42.537 INFO:teuthology.orchestra.run.smithi087.stdout: wpasupplicant 2023-03-30T08:08:42.537 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2023-03-30T08:08:42.537 INFO:teuthology.orchestra.run.smithi087.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-03-30T08:08:42.537 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-doc-12 libjson-perl comgt wvdial wpagui libengine-pkcs11-openssl 2023-03-30T08:08:42.558 INFO:teuthology.orchestra.run.smithi115.stdout:1 upgraded, 31 newly installed, 0 to remove and 157 not upgraded. 2023-03-30T08:08:42.558 INFO:teuthology.orchestra.run.smithi115.stdout:Need to get 24.0 MB of archives. 2023-03-30T08:08:42.559 INFO:teuthology.orchestra.run.smithi115.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-03-30T08:08:42.559 INFO:teuthology.orchestra.run.smithi115.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.17 [1,322 kB] 2023-03-30T08:08:42.621 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2023-03-30T08:08:42.621 INFO:teuthology.orchestra.run.smithi087.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-03-30T08:08:42.622 INFO:teuthology.orchestra.run.smithi087.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-03-30T08:08:42.622 INFO:teuthology.orchestra.run.smithi087.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-03-30T08:08:42.622 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-03-30T08:08:42.623 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-03-30T08:08:42.623 INFO:teuthology.orchestra.run.smithi087.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-03-30T08:08:42.623 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2023-03-30T08:08:42.624 INFO:teuthology.orchestra.run.smithi087.stdout: libssl1.1 2023-03-30T08:08:42.686 INFO:teuthology.orchestra.run.smithi087.stdout:1 upgraded, 31 newly installed, 0 to remove and 157 not upgraded. 2023-03-30T08:08:42.686 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 24.0 MB of archives. 2023-03-30T08:08:42.686 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-03-30T08:08:42.686 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.17 [1,322 kB] 2023-03-30T08:08:42.821 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-03-30T08:08:42.823 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-03-30T08:08:42.827 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-03-30T08:08:42.829 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-03-30T08:08:42.829 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-03-30T08:08:42.830 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-03-30T08:08:42.832 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-03-30T08:08:42.834 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-03-30T08:08:42.834 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-03-30T08:08:42.838 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-03-30T08:08:42.873 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-03-30T08:08:42.979 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.14-0ubuntu0.20.04.1 [116 kB] 2023-03-30T08:08:42.984 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-03-30T08:08:43.009 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-03-30T08:08:43.009 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.17 [1,585 kB] 2023-03-30T08:08:43.035 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-03-30T08:08:43.035 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-03-30T08:08:43.045 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-03-30T08:08:43.058 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-03-30T08:08:43.077 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-03-30T08:08:43.081 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-03-30T08:08:43.116 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-03-30T08:08:43.160 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-03-30T08:08:43.171 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.14-0ubuntu0.20.04.1 [1,053 kB] 2023-03-30T08:08:43.214 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-03-30T08:08:43.216 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-03-30T08:08:43.222 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-03-30T08:08:43.225 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-03-30T08:08:43.226 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-03-30T08:08:43.228 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-03-30T08:08:43.231 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-03-30T08:08:43.237 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-03-30T08:08:43.237 INFO:teuthology.orchestra.run.smithi115.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-03-30T08:08:43.251 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-03-30T08:08:43.255 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.14-0ubuntu0.20.04.1 [13.5 MB] 2023-03-30T08:08:43.296 INFO:teuthology.orchestra.run.smithi115.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-03-30T08:08:43.397 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-03-30T08:08:43.397 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-03-30T08:08:43.398 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-03-30T08:08:43.398 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-03-30T08:08:43.398 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-03-30T08:08:43.461 INFO:teuthology.orchestra.run.smithi115.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-03-30T08:08:43.906 INFO:teuthology.orchestra.run.smithi087.stdout:Preconfiguring packages ... 2023-03-30T08:08:43.963 INFO:teuthology.orchestra.run.smithi115.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.14-0ubuntu0.20.04.1 [116 kB] 2023-03-30T08:08:43.981 INFO:teuthology.orchestra.run.smithi115.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-03-30T08:08:44.104 INFO:teuthology.orchestra.run.smithi115.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-03-30T08:08:44.104 INFO:teuthology.orchestra.run.smithi115.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.17 [1,585 kB] 2023-03-30T08:08:44.127 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 24.0 MB in 1s (31.2 MB/s) 2023-03-30T08:08:44.224 INFO:teuthology.orchestra.run.smithi115.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-03-30T08:08:44.224 INFO:teuthology.orchestra.run.smithi115.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-03-30T08:08:44.258 INFO:teuthology.orchestra.run.smithi115.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-03-30T08:08:44.293 INFO:teuthology.orchestra.run.smithi115.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-03-30T08:08:44.338 INFO:teuthology.orchestra.run.smithi115.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-03-30T08:08:44.347 INFO:teuthology.orchestra.run.smithi115.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-03-30T08:08:44.455 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-03-30T08:08:44.459 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.17_amd64.deb ... 2023-03-30T08:08:44.512 INFO:teuthology.orchestra.run.smithi115.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-03-30T08:08:44.642 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.17) over (1.1.1f-1ubuntu2.16) ... 2023-03-30T08:08:44.703 INFO:teuthology.orchestra.run.smithi115.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-03-30T08:08:44.752 INFO:teuthology.orchestra.run.smithi115.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.14-0ubuntu0.20.04.1 [1,053 kB] 2023-03-30T08:08:45.132 INFO:teuthology.orchestra.run.smithi115.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-03-30T08:08:45.147 INFO:teuthology.orchestra.run.smithi115.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.14-0ubuntu0.20.04.1 [13.5 MB] 2023-03-30T08:08:45.166 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-03-30T08:08:45.185 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-03-30T08:08:45.224 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-03-30T08:08:45.580 INFO:teuthology.orchestra.run.smithi115.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-03-30T08:08:45.580 INFO:teuthology.orchestra.run.smithi115.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-03-30T08:08:45.581 INFO:teuthology.orchestra.run.smithi115.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-03-30T08:08:45.581 INFO:teuthology.orchestra.run.smithi115.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-03-30T08:08:45.581 INFO:teuthology.orchestra.run.smithi115.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-03-30T08:08:45.593 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package dump. 2023-03-30T08:08:45.612 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-03-30T08:08:45.651 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking dump (0.4b46-6) ... 2023-03-30T08:08:46.107 INFO:teuthology.orchestra.run.smithi115.stdout:Preconfiguring packages ... 2023-03-30T08:08:46.175 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package indent. 2023-03-30T08:08:46.193 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-03-30T08:08:46.233 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking indent (2.2.12-1) ... 2023-03-30T08:08:46.326 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 24.0 MB in 3s (7,428 kB/s) 2023-03-30T08:08:46.561 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-03-30T08:08:46.579 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-03-30T08:08:46.619 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-03-30T08:08:46.683 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-03-30T08:08:46.688 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.17_amd64.deb ... 2023-03-30T08:08:46.862 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.17) over (1.1.1f-1ubuntu2.16) ... 2023-03-30T08:08:46.965 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-03-30T08:08:46.984 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-03-30T08:08:47.024 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-03-30T08:08:47.318 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-03-30T08:08:47.338 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-03-30T08:08:47.376 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-03-30T08:08:47.416 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-03-30T08:08:47.436 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-03-30T08:08:47.474 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-03-30T08:08:47.755 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-03-30T08:08:47.773 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-03-30T08:08:47.812 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-03-30T08:08:47.848 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package dump. 2023-03-30T08:08:47.867 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-03-30T08:08:47.906 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking dump (0.4b46-6) ... 2023-03-30T08:08:48.115 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libmbim-proxy. 2023-03-30T08:08:48.134 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-03-30T08:08:48.182 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-03-30T08:08:48.260 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package indent. 2023-03-30T08:08:48.279 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-03-30T08:08:48.318 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking indent (2.2.12-1) ... 2023-03-30T08:08:48.535 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-03-30T08:08:48.554 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-03-30T08:08:48.593 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-03-30T08:08:48.646 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-03-30T08:08:48.665 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-03-30T08:08:48.704 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-03-30T08:08:48.980 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libndp0:amd64. 2023-03-30T08:08:48.999 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-03-30T08:08:49.038 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-03-30T08:08:49.065 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-03-30T08:08:49.078 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-03-30T08:08:49.115 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-03-30T08:08:49.391 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libnm0:amd64. 2023-03-30T08:08:49.401 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-03-30T08:08:49.409 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-03-30T08:08:49.414 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-03-30T08:08:49.449 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-03-30T08:08:49.451 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-03-30T08:08:49.815 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-03-30T08:08:49.828 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-03-30T08:08:49.852 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libpq5:amd64. 2023-03-30T08:08:49.865 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-03-30T08:08:49.872 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../12-libpq5_12.14-0ubuntu0.20.04.1_amd64.deb ... 2023-03-30T08:08:49.910 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libpq5:amd64 (12.14-0ubuntu0.20.04.1) ... 2023-03-30T08:08:50.159 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libmbim-proxy. 2023-03-30T08:08:50.178 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-03-30T08:08:50.217 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-03-30T08:08:50.304 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-03-30T08:08:50.323 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-03-30T08:08:50.362 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-03-30T08:08:50.724 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libqmi-proxy. 2023-03-30T08:08:50.743 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-03-30T08:08:50.782 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-03-30T08:08:51.030 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-03-30T08:08:51.049 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-03-30T08:08:51.096 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-03-30T08:08:51.169 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-03-30T08:08:51.187 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.17_amd64.deb ... 2023-03-30T08:08:51.227 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.17) ... 2023-03-30T08:08:51.491 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libndp0:amd64. 2023-03-30T08:08:51.510 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-03-30T08:08:51.549 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-03-30T08:08:51.747 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-03-30T08:08:51.764 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-03-30T08:08:51.805 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-03-30T08:08:51.887 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libnm0:amd64. 2023-03-30T08:08:51.905 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-03-30T08:08:51.945 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-03-30T08:08:52.192 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package modemmanager. 2023-03-30T08:08:52.211 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-03-30T08:08:52.268 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-03-30T08:08:52.348 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libpq5:amd64. 2023-03-30T08:08:52.367 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../12-libpq5_12.14-0ubuntu0.20.04.1_amd64.deb ... 2023-03-30T08:08:52.406 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libpq5:amd64 (12.14-0ubuntu0.20.04.1) ... 2023-03-30T08:08:52.792 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-03-30T08:08:52.808 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-03-30T08:08:52.850 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-03-30T08:08:52.922 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package wpasupplicant. 2023-03-30T08:08:52.940 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-03-30T08:08:52.980 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-03-30T08:08:53.219 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqmi-proxy. 2023-03-30T08:08:53.237 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-03-30T08:08:53.277 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-03-30T08:08:53.538 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-03-30T08:08:53.557 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.17_amd64.deb ... 2023-03-30T08:08:53.577 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package network-manager. 2023-03-30T08:08:53.596 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-03-30T08:08:53.604 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.17) ... 2023-03-30T08:08:53.674 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-03-30T08:08:54.133 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-03-30T08:08:54.153 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-03-30T08:08:54.191 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-03-30T08:08:54.460 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ppp. 2023-03-30T08:08:54.478 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-03-30T08:08:54.578 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package modemmanager. 2023-03-30T08:08:54.597 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-03-30T08:08:54.655 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-03-30T08:08:54.935 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-03-30T08:08:55.284 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package wpasupplicant. 2023-03-30T08:08:55.302 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-03-30T08:08:55.322 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package pptp-linux. 2023-03-30T08:08:55.340 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-03-30T08:08:55.341 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-03-30T08:08:55.380 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-03-30T08:08:55.761 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package network-manager-pptp. 2023-03-30T08:08:55.779 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-03-30T08:08:55.848 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-03-30T08:08:55.922 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package network-manager. 2023-03-30T08:08:55.941 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-03-30T08:08:56.231 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-03-30T08:08:56.433 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-client-common. 2023-03-30T08:08:56.451 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-03-30T08:08:56.491 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-03-30T08:08:56.828 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-client-12. 2023-03-30T08:08:56.846 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../24-postgresql-client-12_12.14-0ubuntu0.20.04.1_amd64.deb ... 2023-03-30T08:08:56.886 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-client-12 (12.14-0ubuntu0.20.04.1) ... 2023-03-30T08:08:57.065 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ppp. 2023-03-30T08:08:57.084 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-03-30T08:08:57.516 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-common. 2023-03-30T08:08:57.536 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-03-30T08:08:57.542 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-03-30T08:08:57.606 INFO:teuthology.orchestra.run.smithi087.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-03-30T08:08:57.636 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-03-30T08:08:57.895 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package pptp-linux. 2023-03-30T08:08:57.914 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-03-30T08:08:57.953 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-03-30T08:08:58.123 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-12. 2023-03-30T08:08:58.142 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../26-postgresql-12_12.14-0ubuntu0.20.04.1_amd64.deb ... 2023-03-30T08:08:58.187 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-12 (12.14-0ubuntu0.20.04.1) ... 2023-03-30T08:08:58.448 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package network-manager-pptp. 2023-03-30T08:08:58.462 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-03-30T08:08:58.536 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-03-30T08:08:58.859 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-client-common. 2023-03-30T08:08:58.877 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-03-30T08:08:58.917 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-03-30T08:08:59.255 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-client-12. 2023-03-30T08:08:59.274 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../24-postgresql-client-12_12.14-0ubuntu0.20.04.1_amd64.deb ... 2023-03-30T08:08:59.315 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-client-12 (12.14-0ubuntu0.20.04.1) ... 2023-03-30T08:08:59.718 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql. 2023-03-30T08:08:59.737 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-03-30T08:08:59.776 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-03-30T08:08:59.928 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-common. 2023-03-30T08:08:59.947 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-03-30T08:09:00.019 INFO:teuthology.orchestra.run.smithi115.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-03-30T08:09:00.045 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-client. 2023-03-30T08:09:00.048 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-03-30T08:09:00.064 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-03-30T08:09:00.103 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-03-30T08:09:00.380 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package postgresql-contrib. 2023-03-30T08:09:00.399 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-03-30T08:09:00.439 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-03-30T08:09:00.576 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-12. 2023-03-30T08:09:00.595 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../26-postgresql-12_12.14-0ubuntu0.20.04.1_amd64.deb ... 2023-03-30T08:09:00.640 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-12 (12.14-0ubuntu0.20.04.1) ... 2023-03-30T08:09:00.699 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-03-30T08:09:00.718 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-03-30T08:09:00.757 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-03-30T08:09:01.169 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package usb-modeswitch. 2023-03-30T08:09:01.187 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-03-30T08:09:01.243 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-03-30T08:09:01.567 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-03-30T08:09:01.774 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.17) ... 2023-03-30T08:09:02.126 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libpq5:amd64 (12.14-0ubuntu0.20.04.1) ... 2023-03-30T08:09:02.153 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql. 2023-03-30T08:09:02.173 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-03-30T08:09:02.211 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-03-30T08:09:02.252 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-03-30T08:09:02.378 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-03-30T08:09:02.489 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-client. 2023-03-30T08:09:02.503 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-03-30T08:09:02.507 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-03-30T08:09:02.547 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-03-30T08:09:02.824 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-contrib. 2023-03-30T08:09:02.844 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-03-30T08:09:02.882 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-03-30T08:09:02.975 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-03-30T08:09:02.976 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-03-30T08:09:03.143 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-03-30T08:09:03.161 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-03-30T08:09:03.201 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-03-30T08:09:03.638 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package usb-modeswitch. 2023-03-30T08:09:03.657 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-03-30T08:09:03.715 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-03-30T08:09:03.790 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-client-12 (12.14-0ubuntu0.20.04.1) ... 2023-03-30T08:09:04.052 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-03-30T08:09:04.260 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.17) ... 2023-03-30T08:09:04.636 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libpq5:amd64 (12.14-0ubuntu0.20.04.1) ... 2023-03-30T08:09:04.762 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-03-30T08:09:04.888 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-03-30T08:09:05.014 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-03-30T08:09:05.440 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-03-30T08:09:05.441 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-03-30T08:09:05.599 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-03-30T08:09:05.712 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-03-30T08:09:05.838 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-03-30T08:09:06.333 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-client-12 (12.14-0ubuntu0.20.04.1) ... 2023-03-30T08:09:07.420 INFO:teuthology.orchestra.run.smithi087.stdout:Adding user postgres to group ssl-cert 2023-03-30T08:09:07.769 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:07.769 INFO:teuthology.orchestra.run.smithi087.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-03-30T08:09:08.159 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-03-30T08:09:08.211 INFO:teuthology.orchestra.run.smithi087.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-03-30T08:09:08.211 INFO:teuthology.orchestra.run.smithi087.stdout:Removing obsolete dictionary files: 2023-03-30T08:09:08.263 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-03-30T08:09:08.398 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-03-30T08:09:08.724 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-03-30T08:09:09.594 INFO:teuthology.orchestra.run.smithi115.stdout:Adding user postgres to group ssl-cert 2023-03-30T08:09:09.936 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:09.936 INFO:teuthology.orchestra.run.smithi115.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-03-30T08:09:10.015 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.17) ... 2023-03-30T08:09:10.141 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-03-30T08:09:10.266 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-03-30T08:09:10.361 INFO:teuthology.orchestra.run.smithi115.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-03-30T08:09:10.361 INFO:teuthology.orchestra.run.smithi115.stdout:Removing obsolete dictionary files: 2023-03-30T08:09:10.401 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-03-30T08:09:10.527 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-03-30T08:09:10.867 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-03-30T08:09:11.686 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-03-30T08:09:12.075 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up dump (0.4b46-6) ... 2023-03-30T08:09:12.182 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-03-30T08:09:12.249 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.17) ... 2023-03-30T08:09:12.251 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-03-30T08:09:12.375 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-03-30T08:09:12.377 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-03-30T08:09:12.501 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-03-30T08:09:12.503 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up indent (2.2.12-1) ... 2023-03-30T08:09:12.627 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-03-30T08:09:12.629 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-03-30T08:09:12.753 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-03-30T08:09:12.805 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-03-30T08:09:12.931 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-12 (12.14-0ubuntu0.20.04.1) ... 2023-03-30T08:09:13.408 INFO:teuthology.orchestra.run.smithi087.stdout:Creating new PostgreSQL cluster 12/main ... 2023-03-30T08:09:13.437 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-03-30T08:09:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:The files belonging to this database system will be owned by user "postgres". 2023-03-30T08:09:13.501 INFO:teuthology.orchestra.run.smithi087.stdout:This user must also own the server process. 2023-03-30T08:09:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:13.501 INFO:teuthology.orchestra.run.smithi087.stdout:The database cluster will be initialized with locale "en_US". 2023-03-30T08:09:13.501 INFO:teuthology.orchestra.run.smithi087.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-03-30T08:09:13.501 INFO:teuthology.orchestra.run.smithi087.stdout:The default text search configuration will be set to "english". 2023-03-30T08:09:13.501 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:13.501 INFO:teuthology.orchestra.run.smithi087.stdout:Data page checksums are disabled. 2023-03-30T08:09:13.502 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:13.502 INFO:teuthology.orchestra.run.smithi087.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-03-30T08:09:13.504 INFO:teuthology.orchestra.run.smithi087.stdout:creating subdirectories ... ok 2023-03-30T08:09:13.504 INFO:teuthology.orchestra.run.smithi087.stdout:selecting dynamic shared memory implementation ... posix 2023-03-30T08:09:13.535 INFO:teuthology.orchestra.run.smithi087.stdout:selecting default max_connections ... 100 2023-03-30T08:09:13.575 INFO:teuthology.orchestra.run.smithi087.stdout:selecting default shared_buffers ... 128MB 2023-03-30T08:09:13.596 INFO:teuthology.orchestra.run.smithi087.stdout:selecting default time zone ... Etc/UTC 2023-03-30T08:09:13.597 INFO:teuthology.orchestra.run.smithi087.stdout:creating configuration files ... ok 2023-03-30T08:09:13.783 INFO:teuthology.orchestra.run.smithi087.stdout:running bootstrap script ... ok 2023-03-30T08:09:13.901 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-03-30T08:09:14.316 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up dump (0.4b46-6) ... 2023-03-30T08:09:14.422 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-03-30T08:09:14.434 INFO:teuthology.orchestra.run.smithi087.stdout:performing post-bootstrap initialization ... ok 2023-03-30T08:09:14.493 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-03-30T08:09:14.619 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-03-30T08:09:14.745 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up indent (2.2.12-1) ... 2023-03-30T08:09:14.871 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-03-30T08:09:15.011 INFO:teuthology.orchestra.run.smithi087.stdout:syncing data to disk ... ok 2023-03-30T08:09:15.012 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:15.012 INFO:teuthology.orchestra.run.smithi087.stdout:Success. You can now start the database server using: 2023-03-30T08:09:15.012 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:15.012 INFO:teuthology.orchestra.run.smithi087.stdout: pg_ctlcluster 12 main start 2023-03-30T08:09:15.012 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:15.055 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-03-30T08:09:15.181 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-12 (12.14-0ubuntu0.20.04.1) ... 2023-03-30T08:09:15.504 INFO:teuthology.orchestra.run.smithi087.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-03-30T08:09:15.505 INFO:teuthology.orchestra.run.smithi087.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-03-30T08:09:15.633 INFO:teuthology.orchestra.run.smithi115.stdout:Creating new PostgreSQL cluster 12/main ... 2023-03-30T08:09:15.660 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-03-30T08:09:15.670 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-03-30T08:09:15.721 INFO:teuthology.orchestra.run.smithi115.stdout:The files belonging to this database system will be owned by user "postgres". 2023-03-30T08:09:15.721 INFO:teuthology.orchestra.run.smithi115.stdout:This user must also own the server process. 2023-03-30T08:09:15.721 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:15.721 INFO:teuthology.orchestra.run.smithi115.stdout:The database cluster will be initialized with locale "en_US". 2023-03-30T08:09:15.721 INFO:teuthology.orchestra.run.smithi115.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-03-30T08:09:15.721 INFO:teuthology.orchestra.run.smithi115.stdout:The default text search configuration will be set to "english". 2023-03-30T08:09:15.722 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:15.722 INFO:teuthology.orchestra.run.smithi115.stdout:Data page checksums are disabled. 2023-03-30T08:09:15.722 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:15.722 INFO:teuthology.orchestra.run.smithi115.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-03-30T08:09:15.724 INFO:teuthology.orchestra.run.smithi115.stdout:creating subdirectories ... ok 2023-03-30T08:09:15.724 INFO:teuthology.orchestra.run.smithi115.stdout:selecting dynamic shared memory implementation ... posix 2023-03-30T08:09:15.756 INFO:teuthology.orchestra.run.smithi115.stdout:selecting default max_connections ... 100 2023-03-30T08:09:15.798 INFO:teuthology.orchestra.run.smithi115.stdout:selecting default shared_buffers ... 128MB 2023-03-30T08:09:15.819 INFO:teuthology.orchestra.run.smithi115.stdout:selecting default time zone ... Etc/UTC 2023-03-30T08:09:15.820 INFO:teuthology.orchestra.run.smithi115.stdout:creating configuration files ... ok 2023-03-30T08:09:16.006 INFO:teuthology.orchestra.run.smithi115.stdout:running bootstrap script ... ok 2023-03-30T08:09:16.775 INFO:teuthology.orchestra.run.smithi115.stdout:performing post-bootstrap initialization ... ok 2023-03-30T08:09:17.313 INFO:teuthology.orchestra.run.smithi115.stdout:syncing data to disk ... ok 2023-03-30T08:09:17.313 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:17.313 INFO:teuthology.orchestra.run.smithi115.stdout:Success. You can now start the database server using: 2023-03-30T08:09:17.313 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:17.314 INFO:teuthology.orchestra.run.smithi115.stdout: pg_ctlcluster 12 main start 2023-03-30T08:09:17.314 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:17.843 INFO:teuthology.orchestra.run.smithi115.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-03-30T08:09:17.843 INFO:teuthology.orchestra.run.smithi115.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-03-30T08:09:18.023 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-03-30T08:09:19.423 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-03-30T08:09:19.548 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-03-30T08:09:19.716 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-03-30T08:09:19.843 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-03-30T08:09:20.921 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:20.922 INFO:teuthology.orchestra.run.smithi087.stdout:The following network interfaces were found in /etc/network/interfaces 2023-03-30T08:09:20.922 INFO:teuthology.orchestra.run.smithi087.stdout:which means they are currently configured by ifupdown: 2023-03-30T08:09:20.922 INFO:teuthology.orchestra.run.smithi087.stdout:- enp3s0f1 2023-03-30T08:09:20.922 INFO:teuthology.orchestra.run.smithi087.stdout:If you want to manage those interfaces with NetworkManager instead 2023-03-30T08:09:20.922 INFO:teuthology.orchestra.run.smithi087.stdout:remove their configuration from /etc/network/interfaces. 2023-03-30T08:09:20.922 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:21.134 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-03-30T08:09:21.654 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-03-30T08:09:22.115 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-03-30T08:09:22.239 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-03-30T08:09:22.407 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-03-30T08:09:22.533 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-03-30T08:09:22.543 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-03-30T08:09:23.445 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-03-30T08:09:23.563 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-03-30T08:09:23.663 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:23.664 INFO:teuthology.orchestra.run.smithi115.stdout:The following network interfaces were found in /etc/network/interfaces 2023-03-30T08:09:23.664 INFO:teuthology.orchestra.run.smithi115.stdout:which means they are currently configured by ifupdown: 2023-03-30T08:09:23.664 INFO:teuthology.orchestra.run.smithi115.stdout:- enp3s0f1 2023-03-30T08:09:23.664 INFO:teuthology.orchestra.run.smithi115.stdout:If you want to manage those interfaces with NetworkManager instead 2023-03-30T08:09:23.664 INFO:teuthology.orchestra.run.smithi115.stdout:remove their configuration from /etc/network/interfaces. 2023-03-30T08:09:23.664 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:23.723 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-03-30T08:09:23.849 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-03-30T08:09:23.877 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-03-30T08:09:23.975 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-03-30T08:09:24.134 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-03-30T08:09:24.260 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-03-30T08:09:24.401 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-03-30T08:09:24.572 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-03-30T08:09:24.572 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-03-30T08:09:25.331 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-03-30T08:09:25.471 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-03-30T08:09:25.864 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-03-30T08:09:26.033 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-03-30T08:09:26.227 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-03-30T08:09:26.353 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-03-30T08:09:26.493 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-03-30T08:09:26.513 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-03-30T08:09:26.639 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-03-30T08:09:26.773 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-03-30T08:09:26.940 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-03-30T08:09:27.208 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-03-30T08:09:27.521 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-03-30T08:09:27.521 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-03-30T08:09:28.419 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-03-30T08:09:28.771 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-03-30T08:09:28.931 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-03-30T08:09:29.398 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-03-30T08:09:36.521 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-03-30T08:09:36.630 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-03-30T08:09:38.045 INFO:teuthology.orchestra.run.smithi087.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-03-30T08:09:38.050 DEBUG:teuthology.parallel:result is None 2023-03-30T08:09:39.551 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-03-30T08:09:39.660 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-03-30T08:09:40.776 INFO:teuthology.orchestra.run.smithi115.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-03-30T08:09:40.782 DEBUG:teuthology.parallel:result is None 2023-03-30T08:09:40.783 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=f03d69a8741c605ae6711afe2c9991ac46095f7d 2023-03-30T08:09:40.928 DEBUG:teuthology.orchestra.run.smithi087:> dpkg-query -W -f '${Version}' ceph 2023-03-30T08:09:40.963 INFO:teuthology.orchestra.run.smithi087.stdout:18.0.0-3066-gf03d69a8-1focal 2023-03-30T08:09:40.964 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3066-gf03d69a8-1focal 2023-03-30T08:09:40.964 INFO:teuthology.task.install:The correct ceph version 18.0.0-3066-gf03d69a8-1focal is installed. 2023-03-30T08:09:40.965 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=f03d69a8741c605ae6711afe2c9991ac46095f7d 2023-03-30T08:09:41.106 DEBUG:teuthology.orchestra.run.smithi115:> dpkg-query -W -f '${Version}' ceph 2023-03-30T08:09:41.140 INFO:teuthology.orchestra.run.smithi115.stdout:18.0.0-3066-gf03d69a8-1focal 2023-03-30T08:09:41.141 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3066-gf03d69a8-1focal 2023-03-30T08:09:41.141 INFO:teuthology.task.install:The correct ceph version 18.0.0-3066-gf03d69a8-1focal is installed. 2023-03-30T08:09:41.142 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-03-30T08:09:41.142 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:09:41.142 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-30T08:09:41.172 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:09:41.173 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-30T08:09:41.213 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-03-30T08:09:41.213 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:09:41.214 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2023-03-30T08:09:41.247 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-30T08:09:41.317 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:09:41.318 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2023-03-30T08:09:41.347 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-30T08:09:41.425 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-03-30T08:09:41.425 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:09:41.426 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-30T08:09:41.455 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-30T08:09:41.526 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:09:41.527 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-30T08:09:41.557 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-30T08:09:41.627 INFO:teuthology.run_tasks:Running task ceph... 2023-03-30T08:09:41.700 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-03-30T08:09:41.701 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2023-03-30T08:09:41.707 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /var/log/ceph 2023-03-30T08:09:41.736 INFO:tasks.ceph:Disabling ceph logrotate... 2023-03-30T08:09:41.736 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2023-03-30T08:09:41.783 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/logrotate.d/ceph 2023-03-30T08:09:41.812 INFO:tasks.ceph:Creating extra log directories... 2023-03-30T08:09:41.812 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-03-30T08:09:41.855 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-03-30T08:09:41.892 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-03-30T08:09:41.893 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-03-30T08:09:41.893 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-03-30T08:09:41.893 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:09:41.893 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-03-30T08:09:41.942 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-03-30T08:09:42.056 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:09:42.057 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-03-30T08:09:42.071 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-03-30T08:09:42.188 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-03-30T08:09:42.189 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-03-30T08:09:42.189 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7225993', 'branch': 'wip-vshankar-testing-20230317.095222', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7225993', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '6c26fb6d76aa35f265ac42f88c0a40a9c564d650'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230317.095222'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f03d69a8741c605ae6711afe2c9991ac46095f7d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f03d69a8741c605ae6711afe2c9991ac46095f7d'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230317.095222', 'sha1': 'f03d69a8741c605ae6711afe2c9991ac46095f7d'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 30, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'f03d69a8741c605ae6711afe2c9991ac46095f7d', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230317.095222', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_f03d69a8741c605ae6711afe2c9991ac46095f7d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'f03d69a8741c605ae6711afe2c9991ac46095f7d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi087.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0=', 'smithi115.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '6c26fb6d76aa35f265ac42f88c0a40a9c564d650'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f03d69a8741c605ae6711afe2c9991ac46095f7d'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e3729161eecf8e6d09a4069acbb883cdcd5e9f50', 'timestamp': '2023-03-30_04:16:29', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.803'} 2023-03-30T08:09:42.190 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-03-30T08:09:42.196 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-03-30T08:09:42.211 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2023-03-30T08:09:42.259 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/run/ceph 2023-03-30T08:09:42.289 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:09:42.290 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2023-03-30T08:09:42.341 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-30T08:09:42.341 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2023-03-30T08:09:42.399 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-30T08:09:42.400 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-30T08:09:42.400 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 496 Links: 1 2023-03-30T08:09:42.400 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-30T08:09:42.400 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2023-03-30 08:04:30.006739370 +0000 2023-03-30T08:09:42.400 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2023-03-30 08:04:29.550749886 +0000 2023-03-30T08:09:42.400 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2023-03-30 08:04:29.550749886 +0000 2023-03-30T08:09:42.401 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2023-03-30T08:09:42.401 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-30T08:09:42.472 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2023-03-30T08:09:42.472 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2023-03-30T08:09:42.473 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.00054599 s, 938 kB/s 2023-03-30T08:09:42.474 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-30T08:09:42.543 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2023-03-30T08:09:42.607 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-30T08:09:42.608 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-30T08:09:42.608 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 502 Links: 1 2023-03-30T08:09:42.608 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-30T08:09:42.608 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2023-03-30 08:04:30.286732913 +0000 2023-03-30T08:09:42.608 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2023-03-30 08:04:30.282733005 +0000 2023-03-30T08:09:42.608 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2023-03-30 08:04:30.282733005 +0000 2023-03-30T08:09:42.608 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2023-03-30T08:09:42.609 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-30T08:09:42.681 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2023-03-30T08:09:42.682 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2023-03-30T08:09:42.682 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000636611 s, 804 kB/s 2023-03-30T08:09:42.683 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-30T08:09:42.748 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2023-03-30T08:09:42.811 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-30T08:09:42.812 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-30T08:09:42.812 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 509 Links: 1 2023-03-30T08:09:42.812 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-30T08:09:42.812 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2023-03-30 08:04:30.994716586 +0000 2023-03-30T08:09:42.813 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2023-03-30 08:04:30.990716677 +0000 2023-03-30T08:09:42.813 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2023-03-30 08:04:30.990716677 +0000 2023-03-30T08:09:42.813 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2023-03-30T08:09:42.813 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-30T08:09:42.883 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2023-03-30T08:09:42.883 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2023-03-30T08:09:42.883 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000720281 s, 711 kB/s 2023-03-30T08:09:42.885 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-30T08:09:42.948 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2023-03-30T08:09:43.006 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-30T08:09:43.006 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-30T08:09:43.006 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 516 Links: 1 2023-03-30T08:09:43.006 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-30T08:09:43.007 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2023-03-30 08:04:32.178689281 +0000 2023-03-30T08:09:43.007 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2023-03-30 08:04:31.738699429 +0000 2023-03-30T08:09:43.007 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2023-03-30 08:04:31.738699429 +0000 2023-03-30T08:09:43.007 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2023-03-30T08:09:43.008 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-30T08:09:43.082 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2023-03-30T08:09:43.082 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2023-03-30T08:09:43.083 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000637726 s, 803 kB/s 2023-03-30T08:09:43.084 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-30T08:09:43.147 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-30T08:09:43.147 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:09:43.148 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2023-03-30T08:09:43.162 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-30T08:09:43.163 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2023-03-30T08:09:43.220 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-30T08:09:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-30T08:09:43.221 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 493 Links: 1 2023-03-30T08:09:43.221 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-30T08:09:43.221 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-03-30 08:04:31.794519975 +0000 2023-03-30T08:09:43.221 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-03-30 08:04:31.334530582 +0000 2023-03-30T08:09:43.221 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-03-30 08:04:31.334530582 +0000 2023-03-30T08:09:43.222 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2023-03-30T08:09:43.222 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-30T08:09:43.289 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-03-30T08:09:43.289 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-03-30T08:09:43.290 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000665155 s, 770 kB/s 2023-03-30T08:09:43.291 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-30T08:09:43.356 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2023-03-30T08:09:43.415 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-30T08:09:43.415 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-30T08:09:43.415 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 500 Links: 1 2023-03-30T08:09:43.415 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-30T08:09:43.415 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-03-30 08:04:32.534502910 +0000 2023-03-30T08:09:43.416 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-03-30 08:04:32.058513887 +0000 2023-03-30T08:09:43.416 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-03-30 08:04:32.058513887 +0000 2023-03-30T08:09:43.416 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2023-03-30T08:09:43.416 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-30T08:09:43.483 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-03-30T08:09:43.483 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-03-30T08:09:43.483 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000654423 s, 782 kB/s 2023-03-30T08:09:43.485 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-30T08:09:43.547 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2023-03-30T08:09:43.603 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-30T08:09:43.603 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-30T08:09:43.603 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 506 Links: 1 2023-03-30T08:09:43.603 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-30T08:09:43.603 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-03-30 08:04:33.258486214 +0000 2023-03-30T08:09:43.604 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-03-30 08:04:32.806496636 +0000 2023-03-30T08:09:43.604 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-03-30 08:04:32.806496636 +0000 2023-03-30T08:09:43.604 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2023-03-30T08:09:43.604 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-30T08:09:43.675 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-03-30T08:09:43.675 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-03-30T08:09:43.675 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000668762 s, 766 kB/s 2023-03-30T08:09:43.677 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-30T08:09:43.743 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2023-03-30T08:09:43.809 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-30T08:09:43.809 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-30T08:09:43.809 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 512 Links: 1 2023-03-30T08:09:43.809 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-30T08:09:43.809 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-03-30 08:04:33.970469794 +0000 2023-03-30T08:09:43.810 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-03-30 08:04:33.534479847 +0000 2023-03-30T08:09:43.810 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-03-30 08:04:33.534479847 +0000 2023-03-30T08:09:43.810 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2023-03-30T08:09:43.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-30T08:09:43.879 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-03-30T08:09:43.879 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-03-30T08:09:43.879 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000545235 s, 939 kB/s 2023-03-30T08:09:43.881 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-30T08:09:43.944 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-30T08:09:43.944 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-03-30T08:09:43.944 INFO:tasks.ceph:Generating config... 2023-03-30T08:09:43.946 INFO:tasks.ceph:[client] client mount timeout = 600 2023-03-30T08:09:43.946 INFO:tasks.ceph:[client] debug client = 20 2023-03-30T08:09:43.946 INFO:tasks.ceph:[client] debug ms = 1 2023-03-30T08:09:43.946 INFO:tasks.ceph:[client] pid file = 2023-03-30T08:09:43.947 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-03-30T08:09:43.947 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-03-30T08:09:43.947 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-03-30T08:09:43.947 INFO:tasks.ceph:[mds] debug mds = 20 2023-03-30T08:09:43.947 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-03-30T08:09:43.948 INFO:tasks.ceph:[mds] debug ms = 1 2023-03-30T08:09:43.948 INFO:tasks.ceph:[mds] mds debug frag = True 2023-03-30T08:09:43.948 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-03-30T08:09:43.948 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-03-30T08:09:43.948 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-03-30T08:09:43.949 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-03-30T08:09:43.949 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-03-30T08:09:43.949 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-03-30T08:09:43.949 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-03-30T08:09:43.949 INFO:tasks.ceph:[mgr] debug ms = 1 2023-03-30T08:09:43.950 INFO:tasks.ceph:[mon] debug mon = 20 2023-03-30T08:09:43.950 INFO:tasks.ceph:[mon] debug ms = 1 2023-03-30T08:09:43.950 INFO:tasks.ceph:[mon] debug paxos = 20 2023-03-30T08:09:43.950 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-03-30T08:09:43.950 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-03-30T08:09:43.950 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-03-30T08:09:43.951 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-03-30T08:09:43.951 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-03-30T08:09:43.951 INFO:tasks.ceph:[osd] debug ms = 1 2023-03-30T08:09:43.951 INFO:tasks.ceph:[osd] debug osd = 20 2023-03-30T08:09:43.951 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-03-30T08:09:43.952 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-03-30T08:09:43.952 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-03-30T08:09:43.952 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-03-30T08:09:43.952 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-03-30T08:09:43.952 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-03-30T08:09:43.953 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-03-30T08:09:43.953 INFO:tasks.ceph:Setting up mon.a... 2023-03-30T08:09:43.953 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-03-30T08:09:44.018 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.keyring 2023-03-30T08:09:44.033 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-03-30T08:09:44.102 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-30T08:09:44.128 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.87'), ('mon.b', '172.21.15.115'), ('mon.c', '[v2:172.21.15.115:3301,v1:172.21.15.115:6790]')] 2023-03-30T08:09:44.129 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.87,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-03-30T08:09:44.130 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:09:44.130 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-03-30T08:09:44.185 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.87 --add b 172.21.15.115 --addv c '[v2:172.21.15.115:3301,v1:172.21.15.115:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-03-30T08:09:44.290 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-03-30T08:09:44.290 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: generated fsid 936aee23-1888-4f7e-bc67-7a45e372f20a 2023-03-30T08:09:44.290 INFO:teuthology.orchestra.run.smithi087.stdout:setting min_mon_release = pacific 2023-03-30T08:09:44.290 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 0 2023-03-30T08:09:44.291 INFO:teuthology.orchestra.run.smithi087.stdout:fsid 936aee23-1888-4f7e-bc67-7a45e372f20a 2023-03-30T08:09:44.291 INFO:teuthology.orchestra.run.smithi087.stdout:last_changed 2023-03-30T08:09:44.290819+0000 2023-03-30T08:09:44.291 INFO:teuthology.orchestra.run.smithi087.stdout:created 2023-03-30T08:09:44.290819+0000 2023-03-30T08:09:44.291 INFO:teuthology.orchestra.run.smithi087.stdout:min_mon_release 16 (pacific) 2023-03-30T08:09:44.291 INFO:teuthology.orchestra.run.smithi087.stdout:election_strategy: 1 2023-03-30T08:09:44.291 INFO:teuthology.orchestra.run.smithi087.stdout:0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2023-03-30T08:09:44.291 INFO:teuthology.orchestra.run.smithi087.stdout:1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2023-03-30T08:09:44.292 INFO:teuthology.orchestra.run.smithi087.stdout:2: [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] mon.c 2023-03-30T08:09:44.292 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-03-30T08:09:44.293 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-03-30T08:09:44.303 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 936aee23-1888-4f7e-bc67-7a45e372f20a... 2023-03-30T08:09:44.304 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-03-30T08:09:44.355 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-03-30T08:09:44.419 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2023-03-30T08:09:44.419 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2023-03-30T08:09:44.420 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-03-30T08:09:44.420 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2023-03-30T08:09:44.420 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.420 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2023-03-30T08:09:44.420 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.420 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2023-03-30T08:09:44.420 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.421 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2023-03-30T08:09:44.421 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2023-03-30T08:09:44.421 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.421 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2023-03-30T08:09:44.421 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2023-03-30T08:09:44.421 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.421 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2023-03-30T08:09:44.422 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2023-03-30T08:09:44.422 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.422 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2023-03-30T08:09:44.422 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2023-03-30T08:09:44.422 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.422 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2023-03-30T08:09:44.422 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.423 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2023-03-30T08:09:44.423 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2023-03-30T08:09:44.423 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2023-03-30T08:09:44.423 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2023-03-30T08:09:44.423 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2023-03-30T08:09:44.423 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2023-03-30T08:09:44.423 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2023-03-30T08:09:44.424 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-03-30T08:09:44.424 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2023-03-30T08:09:44.424 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2023-03-30T08:09:44.424 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.424 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-03-30T08:09:44.424 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.424 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2023-03-30T08:09:44.424 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.425 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2023-03-30T08:09:44.425 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.425 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2023-03-30T08:09:44.425 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2023-03-30T08:09:44.425 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2023-03-30T08:09:44.425 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.87,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]" 2023-03-30T08:09:44.425 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on skipped message = False 2023-03-30T08:09:44.426 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 936aee23-1888-4f7e-bc67-7a45e372f20a 2023-03-30T08:09:44.426 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.426 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2023-03-30T08:09:44.426 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2023-03-30T08:09:44.426 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.426 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2023-03-30T08:09:44.426 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2023-03-30T08:09:44.427 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.427 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2023-03-30T08:09:44.427 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2023-03-30T08:09:44.427 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.427 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2023-03-30T08:09:44.427 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2023-03-30T08:09:44.427 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2023-03-30T08:09:44.427 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.428 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2023-03-30T08:09:44.428 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2023-03-30T08:09:44.428 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.428 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2023-03-30T08:09:44.428 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.428 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2023-03-30T08:09:44.428 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.428 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2023-03-30T08:09:44.429 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.429 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2023-03-30T08:09:44.429 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2023-03-30T08:09:44.429 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.429 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2023-03-30T08:09:44.429 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2023-03-30T08:09:44.429 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2023-03-30T08:09:44.430 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2023-03-30T08:09:44.430 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 20 2023-03-30T08:09:44.430 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 20 2023-03-30T08:09:44.430 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2023-03-30T08:09:44.430 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2023-03-30T08:09:44.430 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 10 2023-03-30T08:09:44.430 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2023-03-30T08:09:44.430 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2023-03-30T08:09:44.431 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2023-03-30T08:09:44.431 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2023-03-30T08:09:44.431 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2023-03-30T08:09:44.431 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2023-03-30T08:09:44.431 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.431 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2023-03-30T08:09:44.431 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2023-03-30T08:09:44.432 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2023-03-30T08:09:44.432 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2023-03-30T08:09:44.432 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2023-03-30T08:09:44.432 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2023-03-30T08:09:44.432 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2023-03-30T08:09:44.432 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2023-03-30T08:09:44.432 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.433 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2023-03-30T08:09:44.433 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2023-03-30T08:09:44.433 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2023-03-30T08:09:44.433 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2023-03-30T08:09:44.433 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2023-03-30T08:09:44.433 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2023-03-30T08:09:44.433 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2023-03-30T08:09:44.434 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2023-03-30T08:09:44.434 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2023-03-30T08:09:44.434 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2023-03-30T08:09:44.434 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2023-03-30T08:09:44.434 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.434 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-03-30T08:09:44.434 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2023-03-30T08:09:44.435 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2023-03-30T08:09:44.435 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.435 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2023-03-30T08:09:44.435 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-03-30T08:09:44.435 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-03-30T08:09:44.435 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.435 INFO:teuthology.orchestra.run.smithi087.stdout: # 1m isn't quite enough 2023-03-30T08:09:44.435 INFO:teuthology.orchestra.run.smithi087.stdout: mon_down_mkfs_grace = 2m 2023-03-30T08:09:44.436 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.436 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_filestore_osds = false 2023-03-30T08:09:44.436 INFO:teuthology.orchestra.run.smithi087.stdout: mon op complaint time = 120 2023-03-30T08:09:44.436 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:09:44.436 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2023-03-30T08:09:44.436 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2023-03-30T08:09:44.436 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2023-03-30T08:09:44.436 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2023-03-30T08:09:44.437 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-03-30T08:09:44.437 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-03-30T08:09:44.437 INFO:teuthology.orchestra.run.smithi087.stdout: client mount timeout = 600 2023-03-30T08:09:44.437 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2023-03-30T08:09:44.437 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2023-03-30T08:09:44.437 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = "" 2023-03-30T08:09:44.437 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2023-03-30T08:09:44.437 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2023-03-30T08:09:44.438 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2023-03-30T08:09:44.438 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2023-03-30T08:09:44.438 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2023-03-30T08:09:44.438 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2023-03-30T08:09:44.438 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2023-03-30T08:09:44.438 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2023-03-30T08:09:44.438 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d] 2023-03-30T08:09:44.439 INFO:teuthology.orchestra.run.smithi087.stdout:[mds] 2023-03-30T08:09:44.439 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds = 20 2023-03-30T08:09:44.439 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds balancer = 20 2023-03-30T08:09:44.439 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2023-03-30T08:09:44.439 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug frag = True 2023-03-30T08:09:44.439 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug scatterstat = True 2023-03-30T08:09:44.439 INFO:teuthology.orchestra.run.smithi087.stdout: mds op complaint time = 180 2023-03-30T08:09:44.439 INFO:teuthology.orchestra.run.smithi087.stdout: mds verify scatter = True 2023-03-30T08:09:44.440 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2023-03-30T08:09:44.440 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2023-03-30T08:09:44.440 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2023-03-30T08:09:44.440 INFO:teuthology.orchestra.run.smithi115.stdout:[global] 2023-03-30T08:09:44.441 INFO:teuthology.orchestra.run.smithi115.stdout: chdir = "" 2023-03-30T08:09:44.441 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-03-30T08:09:44.441 INFO:teuthology.orchestra.run.smithi115.stdout: auth supported = cephx 2023-03-30T08:09:44.441 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.441 INFO:teuthology.orchestra.run.smithi115.stdout: filestore xattr use omap = true 2023-03-30T08:09:44.441 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.441 INFO:teuthology.orchestra.run.smithi115.stdout: mon clock drift allowed = 1.000 2023-03-30T08:09:44.442 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.442 INFO:teuthology.orchestra.run.smithi115.stdout: osd crush chooseleaf type = 0 2023-03-30T08:09:44.442 INFO:teuthology.orchestra.run.smithi115.stdout: auth debug = true 2023-03-30T08:09:44.442 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.442 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on old message = true 2023-03-30T08:09:44.442 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on bug = true 2023-03-30T08:09:44.442 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.442 INFO:teuthology.orchestra.run.smithi115.stdout: mon max pg per osd = 10000 # >= luminous 2023-03-30T08:09:44.443 INFO:teuthology.orchestra.run.smithi115.stdout: mon pg warn max object skew = 0 2023-03-30T08:09:44.443 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.443 INFO:teuthology.orchestra.run.smithi115.stdout: # disable pg_autoscaler by default for new pools 2023-03-30T08:09:44.443 INFO:teuthology.orchestra.run.smithi115.stdout: osd_pool_default_pg_autoscale_mode = off 2023-03-30T08:09:44.443 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.443 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default size = 2 2023-03-30T08:09:44.443 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.443 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow primary affinity = true 2023-03-30T08:09:44.444 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow pg remap = true 2023-03-30T08:09:44.444 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on legacy crush tunables = false 2023-03-30T08:09:44.444 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on crush straw calc version zero = false 2023-03-30T08:09:44.444 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on no sortbitwise = false 2023-03-30T08:09:44.444 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on osd down out interval zero = false 2023-03-30T08:09:44.444 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on too few osds = false 2023-03-30T08:09:44.444 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-03-30T08:09:44.444 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_no_redundancy = false 2023-03-30T08:09:44.445 INFO:teuthology.orchestra.run.smithi115.stdout: mon_allow_pool_size_one = true 2023-03-30T08:09:44.445 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.445 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-03-30T08:09:44.445 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.445 INFO:teuthology.orchestra.run.smithi115.stdout: osd default data pool replay window = 5 2023-03-30T08:09:44.445 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.445 INFO:teuthology.orchestra.run.smithi115.stdout: mon allow pool delete = true 2023-03-30T08:09:44.446 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.446 INFO:teuthology.orchestra.run.smithi115.stdout: mon cluster log file level = debug 2023-03-30T08:09:44.446 INFO:teuthology.orchestra.run.smithi115.stdout: debug asserts on shutdown = true 2023-03-30T08:09:44.446 INFO:teuthology.orchestra.run.smithi115.stdout: mon health detail to clog = false 2023-03-30T08:09:44.446 INFO:teuthology.orchestra.run.smithi115.stdout: mon host = "172.21.15.87,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]" 2023-03-30T08:09:44.446 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on skipped message = False 2023-03-30T08:09:44.446 INFO:teuthology.orchestra.run.smithi115.stdout: fsid = 936aee23-1888-4f7e-bc67-7a45e372f20a 2023-03-30T08:09:44.446 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.447 INFO:teuthology.orchestra.run.smithi115.stdout:[osd] 2023-03-30T08:09:44.447 INFO:teuthology.orchestra.run.smithi115.stdout: osd journal size = 100 2023-03-30T08:09:44.447 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.447 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub load threshold = 5.0 2023-03-30T08:09:44.447 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub max interval = 600 2023-03-30T08:09:44.447 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.447 INFO:teuthology.orchestra.run.smithi115.stdout: osd recover clone overlap = true 2023-03-30T08:09:44.447 INFO:teuthology.orchestra.run.smithi115.stdout: osd recovery max chunk = 1048576 2023-03-30T08:09:44.448 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.448 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug shutdown = true 2023-03-30T08:09:44.448 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug op order = true 2023-03-30T08:09:44.448 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug verify stray on activate = true 2023-03-30T08:09:44.448 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.448 INFO:teuthology.orchestra.run.smithi115.stdout: osd open classes on start = true 2023-03-30T08:09:44.448 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug pg log writeout = true 2023-03-30T08:09:44.448 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.449 INFO:teuthology.orchestra.run.smithi115.stdout: osd deep scrub update digest min age = 30 2023-03-30T08:09:44.449 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.449 INFO:teuthology.orchestra.run.smithi115.stdout: osd map max advance = 10 2023-03-30T08:09:44.449 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.449 INFO:teuthology.orchestra.run.smithi115.stdout: journal zero on create = true 2023-03-30T08:09:44.449 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.449 INFO:teuthology.orchestra.run.smithi115.stdout: filestore ondisk finisher threads = 3 2023-03-30T08:09:44.450 INFO:teuthology.orchestra.run.smithi115.stdout: filestore apply finisher threads = 3 2023-03-30T08:09:44.450 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.450 INFO:teuthology.orchestra.run.smithi115.stdout: bdev debug aio = true 2023-03-30T08:09:44.450 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug misdirected ops = true 2023-03-30T08:09:44.450 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore block size = 96636764160 2023-03-30T08:09:44.450 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore fsck on mount = True 2023-03-30T08:09:44.450 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluefs = 20 2023-03-30T08:09:44.450 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluestore = 20 2023-03-30T08:09:44.451 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-03-30T08:09:44.451 INFO:teuthology.orchestra.run.smithi115.stdout: debug osd = 20 2023-03-30T08:09:44.451 INFO:teuthology.orchestra.run.smithi115.stdout: debug rocksdb = 10 2023-03-30T08:09:44.451 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd backfillfull_ratio = 0.85 2023-03-30T08:09:44.451 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd full ratio = 0.9 2023-03-30T08:09:44.451 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd nearfull ratio = 0.8 2023-03-30T08:09:44.451 INFO:teuthology.orchestra.run.smithi115.stdout: osd failsafe full ratio = 0.95 2023-03-30T08:09:44.451 INFO:teuthology.orchestra.run.smithi115.stdout: osd objectstore = bluestore 2023-03-30T08:09:44.452 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2023-03-30T08:09:44.452 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.452 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr] 2023-03-30T08:09:44.452 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-03-30T08:09:44.452 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgr = 20 2023-03-30T08:09:44.452 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2023-03-30T08:09:44.452 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2023-03-30T08:09:44.452 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2023-03-30T08:09:44.453 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2023-03-30T08:09:44.453 INFO:teuthology.orchestra.run.smithi115.stdout: mgr/telemetry/nag = false 2023-03-30T08:09:44.453 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.453 INFO:teuthology.orchestra.run.smithi115.stdout:[mon] 2023-03-30T08:09:44.453 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-03-30T08:09:44.453 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2023-03-30T08:09:44.453 INFO:teuthology.orchestra.run.smithi115.stdout: debug paxos = 20 2023-03-30T08:09:44.453 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2023-03-30T08:09:44.454 INFO:teuthology.orchestra.run.smithi115.stdout: mon data avail warn = 5 2023-03-30T08:09:44.454 INFO:teuthology.orchestra.run.smithi115.stdout: mon mgr mkfs grace = 240 2023-03-30T08:09:44.454 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2023-03-30T08:09:44.454 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd reporter subtree level = osd 2023-03-30T08:09:44.454 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd prime pg temp = true 2023-03-30T08:09:44.454 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2023-03-30T08:09:44.454 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.454 INFO:teuthology.orchestra.run.smithi115.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-03-30T08:09:44.455 INFO:teuthology.orchestra.run.smithi115.stdout: auth mon ticket ttl = 660 # 11m 2023-03-30T08:09:44.455 INFO:teuthology.orchestra.run.smithi115.stdout: auth service ticket ttl = 240 # 4m 2023-03-30T08:09:44.455 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.455 INFO:teuthology.orchestra.run.smithi115.stdout: # don't complain about insecure global_id in the test suite 2023-03-30T08:09:44.455 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-03-30T08:09:44.455 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-03-30T08:09:44.455 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.455 INFO:teuthology.orchestra.run.smithi115.stdout: # 1m isn't quite enough 2023-03-30T08:09:44.456 INFO:teuthology.orchestra.run.smithi115.stdout: mon_down_mkfs_grace = 2m 2023-03-30T08:09:44.456 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.456 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_filestore_osds = false 2023-03-30T08:09:44.456 INFO:teuthology.orchestra.run.smithi115.stdout: mon op complaint time = 120 2023-03-30T08:09:44.456 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-03-30T08:09:44.456 INFO:teuthology.orchestra.run.smithi115.stdout:[client] 2023-03-30T08:09:44.456 INFO:teuthology.orchestra.run.smithi115.stdout: rgw cache enabled = true 2023-03-30T08:09:44.456 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable ops log = true 2023-03-30T08:09:44.457 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable usage log = true 2023-03-30T08:09:44.457 INFO:teuthology.orchestra.run.smithi115.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-03-30T08:09:44.457 INFO:teuthology.orchestra.run.smithi115.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-03-30T08:09:44.457 INFO:teuthology.orchestra.run.smithi115.stdout: client mount timeout = 600 2023-03-30T08:09:44.457 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2023-03-30T08:09:44.457 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-03-30T08:09:44.457 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = "" 2023-03-30T08:09:44.457 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2023-03-30T08:09:44.458 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2023-03-30T08:09:44.458 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.a] 2023-03-30T08:09:44.458 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.b] 2023-03-30T08:09:44.458 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.c] 2023-03-30T08:09:44.458 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2023-03-30T08:09:44.458 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2023-03-30T08:09:44.458 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2023-03-30T08:09:44.458 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2023-03-30T08:09:44.459 INFO:teuthology.orchestra.run.smithi115.stdout:[mds] 2023-03-30T08:09:44.459 INFO:teuthology.orchestra.run.smithi115.stdout: debug mds = 20 2023-03-30T08:09:44.459 INFO:teuthology.orchestra.run.smithi115.stdout: debug mds balancer = 20 2023-03-30T08:09:44.459 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-03-30T08:09:44.459 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug frag = True 2023-03-30T08:09:44.459 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug scatterstat = True 2023-03-30T08:09:44.459 INFO:teuthology.orchestra.run.smithi115.stdout: mds op complaint time = 180 2023-03-30T08:09:44.459 INFO:teuthology.orchestra.run.smithi115.stdout: mds verify scatter = True 2023-03-30T08:09:44.460 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2023-03-30T08:09:44.460 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2023-03-30T08:09:44.460 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2023-03-30T08:09:44.461 INFO:tasks.ceph:Creating admin key on mon.a... 2023-03-30T08:09:44.461 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-03-30T08:09:44.541 INFO:tasks.ceph:Copying monmap to all nodes... 2023-03-30T08:09:44.541 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:09:44.542 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-03-30T08:09:44.553 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:09:44.554 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-03-30T08:09:44.614 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2023-03-30T08:09:44.614 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:09:44.614 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2023-03-30T08:09:44.614 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-30T08:09:44.707 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:09:44.707 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-03-30T08:09:44.768 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi115.front.sepia.ceph.com 2023-03-30T08:09:44.769 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:09:44.769 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.keyring 2023-03-30T08:09:44.769 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-30T08:09:44.825 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:09:44.825 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-03-30T08:09:44.882 INFO:tasks.ceph:Setting up mon nodes... 2023-03-30T08:09:44.882 INFO:tasks.ceph:Setting up mgr nodes... 2023-03-30T08:09:44.882 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-03-30T08:09:44.972 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-03-30T08:09:44.978 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-03-30T08:09:45.073 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-03-30T08:09:45.099 INFO:tasks.ceph:Setting up mds nodes... 2023-03-30T08:09:45.099 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-03-30T08:09:45.192 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-03-30T08:09:45.197 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-03-30T08:09:45.226 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-03-30T08:09:45.357 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-03-30T08:09:45.363 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-03-30T08:09:45.390 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-03-30T08:09:45.478 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-03-30T08:09:45.484 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-03-30T08:09:45.510 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-03-30T08:09:45.638 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-03-30T08:09:45.644 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-03-30T08:09:45.672 INFO:tasks.ceph_client:Setting up client nodes... 2023-03-30T08:09:45.673 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-03-30T08:09:45.745 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-03-30T08:09:45.769 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-03-30T08:09:45.830 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-03-30T08:09:45.856 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-03-30T08:09:45.925 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-03-30T08:09:45.950 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-03-30T08:09:46.015 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-03-30T08:09:46.040 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-03-30T08:09:46.040 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-03-30T08:09:46.041 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-03-30T08:09:46.070 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-30T08:09:46.070 INFO:tasks.ceph:role: osd.0 2023-03-30T08:09:46.070 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2023-03-30T08:09:46.071 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-03-30T08:09:46.654 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-03-30T08:09:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-30T08:09:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-30T08:09:46.654 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2023-03-30T08:09:46.655 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-30T08:09:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2023-03-30T08:09:46.655 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-30T08:09:46.655 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-30T08:09:46.655 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-30T08:09:46.655 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-30T08:09:46.658 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2023-03-30T08:09:46.659 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-03-30T08:09:46.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-03-30T08:09:46.803 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2023-03-30T08:09:46.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T08:09:46.805 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-03-30T08:09:46.877 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-30T08:09:46.877 INFO:tasks.ceph:role: osd.1 2023-03-30T08:09:46.877 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com 2023-03-30T08:09:46.878 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-03-30T08:09:47.405 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-03-30T08:09:47.405 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-30T08:09:47.406 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-30T08:09:47.406 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2023-03-30T08:09:47.406 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-30T08:09:47.406 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2023-03-30T08:09:47.406 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-30T08:09:47.406 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-30T08:09:47.406 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-30T08:09:47.406 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-30T08:09:47.411 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2023-03-30T08:09:47.411 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-03-30T08:09:47.449 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-03-30T08:09:47.512 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2023-03-30T08:09:47.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T08:09:47.513 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-03-30T08:09:47.584 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-30T08:09:47.585 INFO:tasks.ceph:role: osd.2 2023-03-30T08:09:47.585 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com 2023-03-30T08:09:47.585 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-03-30T08:09:48.139 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-03-30T08:09:48.139 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-30T08:09:48.139 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-30T08:09:48.140 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2023-03-30T08:09:48.140 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-30T08:09:48.140 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2023-03-30T08:09:48.140 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-30T08:09:48.140 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-30T08:09:48.140 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-30T08:09:48.140 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-30T08:09:48.144 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2023-03-30T08:09:48.144 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-03-30T08:09:48.230 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-03-30T08:09:48.249 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2023-03-30T08:09:48.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T08:09:48.250 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-03-30T08:09:48.324 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-30T08:09:48.325 INFO:tasks.ceph:role: osd.3 2023-03-30T08:09:48.325 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com 2023-03-30T08:09:48.325 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-03-30T08:09:48.911 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-03-30T08:09:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-30T08:09:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-30T08:09:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2023-03-30T08:09:48.912 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-30T08:09:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2023-03-30T08:09:48.912 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-30T08:09:48.912 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-30T08:09:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-30T08:09:48.912 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-30T08:09:48.915 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2023-03-30T08:09:48.916 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-03-30T08:09:49.053 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-03-30T08:09:49.070 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2023-03-30T08:09:49.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T08:09:49.071 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-30T08:09:49.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:49.227+0000 7f54caa8f700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-03-30T08:09:49.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:49.235+0000 7f54caa8f700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-03-30T08:09:49.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:49.235+0000 7f54caa8f700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-30T08:09:49.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:49.235+0000 7f54caa8f700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-30T08:09:49.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:49.235+0000 7f54caa8f700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-30T08:09:49.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:49.243+0000 7f54caa8f700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-03-30T08:09:52.568 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-03-30T08:09:52.599 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-30T08:09:52.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:52.714+0000 7effe4b67700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-03-30T08:09:52.719 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:52.718+0000 7effe4b67700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-03-30T08:09:52.720 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:52.718+0000 7effe4b67700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-30T08:09:52.720 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:52.718+0000 7effe4b67700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-30T08:09:52.720 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:52.718+0000 7effe4b67700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-30T08:09:52.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:52.718+0000 7effe4b67700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-03-30T08:09:55.787 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-03-30T08:09:55.817 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-30T08:09:55.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:55.938+0000 7f734963d700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-03-30T08:09:55.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:55.938+0000 7f734963d700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-03-30T08:09:55.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:55.938+0000 7f734963d700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-30T08:09:55.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:55.938+0000 7f734963d700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-30T08:09:55.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:55.938+0000 7f734963d700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-30T08:09:55.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:55.938+0000 7f734963d700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-03-30T08:09:58.975 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-03-30T08:09:59.005 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-30T08:09:59.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:59.118+0000 7f07edda9700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-03-30T08:09:59.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:59.122+0000 7f07edda9700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-03-30T08:09:59.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:59.122+0000 7f07edda9700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-30T08:09:59.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:59.122+0000 7f07edda9700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-30T08:09:59.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:59.122+0000 7f07edda9700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-30T08:09:59.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:09:59.122+0000 7f07edda9700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-03-30T08:10:02.175 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-03-30T08:10:02.205 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-03-30T08:10:02.238 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-30T08:10:02.238 INFO:tasks.ceph:role: osd.4 2023-03-30T08:10:02.238 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com 2023-03-30T08:10:02.239 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-03-30T08:10:02.819 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-03-30T08:10:02.819 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-30T08:10:02.819 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-30T08:10:02.820 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 2023-03-30T08:10:02.820 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-30T08:10:02.820 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-03-30T08:10:02.820 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-30T08:10:02.820 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-30T08:10:02.820 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-30T08:10:02.820 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-30T08:10:02.823 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-03-30T08:10:02.824 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-03-30T08:10:02.940 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-03-30T08:10:02.958 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2023-03-30T08:10:02.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T08:10:02.959 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-03-30T08:10:03.032 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-30T08:10:03.033 INFO:tasks.ceph:role: osd.5 2023-03-30T08:10:03.033 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com 2023-03-30T08:10:03.033 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-03-30T08:10:03.552 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-03-30T08:10:03.552 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-30T08:10:03.552 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-30T08:10:03.552 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 2023-03-30T08:10:03.552 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-30T08:10:03.553 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-03-30T08:10:03.553 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-30T08:10:03.553 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-30T08:10:03.553 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-30T08:10:03.553 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-30T08:10:03.557 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-03-30T08:10:03.557 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-03-30T08:10:03.594 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-03-30T08:10:03.659 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2023-03-30T08:10:03.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T08:10:03.661 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-03-30T08:10:03.735 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-30T08:10:03.735 INFO:tasks.ceph:role: osd.6 2023-03-30T08:10:03.735 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com 2023-03-30T08:10:03.736 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-03-30T08:10:04.298 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-03-30T08:10:04.298 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-30T08:10:04.298 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-30T08:10:04.298 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 2023-03-30T08:10:04.298 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-30T08:10:04.299 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-03-30T08:10:04.299 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-30T08:10:04.299 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-30T08:10:04.299 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-30T08:10:04.299 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-30T08:10:04.302 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-03-30T08:10:04.302 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-03-30T08:10:04.397 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-03-30T08:10:04.418 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2023-03-30T08:10:04.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T08:10:04.420 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-03-30T08:10:04.496 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-30T08:10:04.496 INFO:tasks.ceph:role: osd.7 2023-03-30T08:10:04.496 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com 2023-03-30T08:10:04.497 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-03-30T08:10:05.125 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-03-30T08:10:05.125 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-30T08:10:05.126 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-30T08:10:05.126 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 2023-03-30T08:10:05.126 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-30T08:10:05.126 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-03-30T08:10:05.126 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-30T08:10:05.126 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-30T08:10:05.126 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-30T08:10:05.127 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-30T08:10:05.129 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-03-30T08:10:05.130 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-03-30T08:10:05.243 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-03-30T08:10:05.260 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2023-03-30T08:10:05.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T08:10:05.262 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-30T08:10:05.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:05.474+0000 7f7e5d720700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-03-30T08:10:05.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:05.478+0000 7f7e5d720700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-03-30T08:10:05.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:05.478+0000 7f7e5d720700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-30T08:10:05.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:05.478+0000 7f7e5d720700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-30T08:10:05.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:05.478+0000 7f7e5d720700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-30T08:10:05.494 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:05.486+0000 7f7e5d720700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-03-30T08:10:08.805 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-03-30T08:10:08.841 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-30T08:10:08.959 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:08.955+0000 7f90eae91700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-03-30T08:10:08.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:08.955+0000 7f90eae91700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-03-30T08:10:08.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:08.955+0000 7f90eae91700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-30T08:10:08.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:08.955+0000 7f90eae91700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-30T08:10:08.960 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:08.955+0000 7f90eae91700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-30T08:10:08.963 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:08.959+0000 7f90eae91700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-03-30T08:10:12.010 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-03-30T08:10:12.039 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-30T08:10:12.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:12.155+0000 7f19c5ac5700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-03-30T08:10:12.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:12.159+0000 7f19c5ac5700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-03-30T08:10:12.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:12.159+0000 7f19c5ac5700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-30T08:10:12.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:12.159+0000 7f19c5ac5700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-30T08:10:12.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:12.159+0000 7f19c5ac5700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-30T08:10:12.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:12.159+0000 7f19c5ac5700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-03-30T08:10:12.191 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:10:12.197 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:10:15.214 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-03-30T08:10:15.245 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-30T08:10:15.361 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:15.355+0000 7f33fa7fb700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-03-30T08:10:15.362 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:15.355+0000 7f33fa7fb700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-03-30T08:10:15.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:15.359+0000 7f33fa7fb700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-30T08:10:15.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:15.359+0000 7f33fa7fb700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-30T08:10:15.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:15.359+0000 7f33fa7fb700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-30T08:10:15.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:15.359+0000 7f33fa7fb700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-03-30T08:10:18.403 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-03-30T08:10:18.432 INFO:tasks.ceph:Reading keys from all nodes... 2023-03-30T08:10:18.432 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:10:18.433 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-03-30T08:10:18.461 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:10:18.462 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-03-30T08:10:18.536 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:10:18.536 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-03-30T08:10:18.608 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:10:18.608 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-03-30T08:10:18.678 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:10:18.678 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-03-30T08:10:18.747 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:10:18.748 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-03-30T08:10:18.820 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:10:18.820 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-03-30T08:10:18.892 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:10:18.893 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-03-30T08:10:18.923 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:10:18.923 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-03-30T08:10:18.995 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:10:18.995 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-03-30T08:10:19.067 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:10:19.067 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-03-30T08:10:19.138 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:10:19.139 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-03-30T08:10:19.210 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:10:19.211 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-03-30T08:10:19.283 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:10:19.283 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-03-30T08:10:19.359 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:10:19.360 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-03-30T08:10:19.376 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:10:19.376 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-03-30T08:10:19.433 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:10:19.434 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-03-30T08:10:19.449 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:10:19.449 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-03-30T08:10:19.506 INFO:tasks.ceph:Adding keys to all mons... 2023-03-30T08:10:19.507 DEBUG:teuthology.orchestra.run.smithi087:> sudo tee -a /etc/ceph/ceph.keyring 2023-03-30T08:10:19.512 DEBUG:teuthology.orchestra.run.smithi115:> sudo tee -a /etc/ceph/ceph.keyring 2023-03-30T08:10:19.556 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.y] 2023-03-30T08:10:19.556 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDIQyVkxu/5ORAAZ9z8upF22mTFxeHf8EuesQ== 2023-03-30T08:10:19.556 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2023-03-30T08:10:19.556 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDJQyVk0WR9CxAAj/HIs03b3UXC15TDyV0CaA== 2023-03-30T08:10:19.557 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2023-03-30T08:10:19.557 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDJQyVkh+ZaFRAApqwS1KDVviRnfcCyWNbXfw== 2023-03-30T08:10:19.557 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.0] 2023-03-30T08:10:19.557 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDNQyVk3t/KDRAAh/doqkDA3saU0oO544Mk5g== 2023-03-30T08:10:19.557 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.1] 2023-03-30T08:10:19.557 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDQQyVkgFHVKhAAoI+x0IEyJRJpYzmumBSS3w== 2023-03-30T08:10:19.557 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.2] 2023-03-30T08:10:19.558 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDTQyVk/FcBOBAArHHqtrurl0tNY2NGAXYJkQ== 2023-03-30T08:10:19.558 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.3] 2023-03-30T08:10:19.558 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDXQyVkZjZVBxAAy0yM9R+WaLryuRU5lQkJDQ== 2023-03-30T08:10:19.558 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.x] 2023-03-30T08:10:19.558 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDJQyVkddVHBBAAutK10mLMZo/MHWelsabqLQ== 2023-03-30T08:10:19.558 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2023-03-30T08:10:19.558 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDJQyVkR7dkHBAAumpXy9u42c6ZvzCalEM3sg== 2023-03-30T08:10:19.558 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.d] 2023-03-30T08:10:19.559 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDJQyVku/n0JRAAR0LtRbpx7xhVdVUy0Ec/Rw== 2023-03-30T08:10:19.559 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.4] 2023-03-30T08:10:19.559 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDdQyVkLNSyHBAARL8uqcpJ5VbML5RcJ+AyeQ== 2023-03-30T08:10:19.559 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.5] 2023-03-30T08:10:19.559 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDgQyVk4uUhORAA3HcnlsCRhwvSczD5OK4OHA== 2023-03-30T08:10:19.559 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.6] 2023-03-30T08:10:19.559 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDkQyVkTNebCRAAQYG63wHseBzO1wkAnKNu7w== 2023-03-30T08:10:19.560 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.7] 2023-03-30T08:10:19.560 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDnQyVkPfeGFRAAcTAO00ne03UYnUkareUf+w== 2023-03-30T08:10:19.560 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2023-03-30T08:10:19.560 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDJQyVkPcl4LBAA1G96+FCw7jee5PlqiYhJvA== 2023-03-30T08:10:19.560 INFO:teuthology.orchestra.run.smithi087.stdout:[client.2] 2023-03-30T08:10:19.560 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDJQyVkpL2MMRAA8UBOCuP918a/KC992r1juw== 2023-03-30T08:10:19.560 INFO:teuthology.orchestra.run.smithi087.stdout:[client.1] 2023-03-30T08:10:19.560 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDJQyVkBMQKNxAAWgehKxymjV6O8weU+9S5Eg== 2023-03-30T08:10:19.561 INFO:teuthology.orchestra.run.smithi087.stdout:[client.3] 2023-03-30T08:10:19.561 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDKQyVke/jMABAAEjw6oKtbehX4O1cQtW3Aew== 2023-03-30T08:10:19.577 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.y] 2023-03-30T08:10:19.578 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDIQyVkxu/5ORAAZ9z8upF22mTFxeHf8EuesQ== 2023-03-30T08:10:19.578 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2023-03-30T08:10:19.578 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDJQyVk0WR9CxAAj/HIs03b3UXC15TDyV0CaA== 2023-03-30T08:10:19.578 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2023-03-30T08:10:19.578 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDJQyVkh+ZaFRAApqwS1KDVviRnfcCyWNbXfw== 2023-03-30T08:10:19.578 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.0] 2023-03-30T08:10:19.578 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDNQyVk3t/KDRAAh/doqkDA3saU0oO544Mk5g== 2023-03-30T08:10:19.578 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.1] 2023-03-30T08:10:19.579 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDQQyVkgFHVKhAAoI+x0IEyJRJpYzmumBSS3w== 2023-03-30T08:10:19.579 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.2] 2023-03-30T08:10:19.579 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDTQyVk/FcBOBAArHHqtrurl0tNY2NGAXYJkQ== 2023-03-30T08:10:19.579 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.3] 2023-03-30T08:10:19.579 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDXQyVkZjZVBxAAy0yM9R+WaLryuRU5lQkJDQ== 2023-03-30T08:10:19.579 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.x] 2023-03-30T08:10:19.579 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDJQyVkddVHBBAAutK10mLMZo/MHWelsabqLQ== 2023-03-30T08:10:19.580 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2023-03-30T08:10:19.580 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDJQyVkR7dkHBAAumpXy9u42c6ZvzCalEM3sg== 2023-03-30T08:10:19.580 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2023-03-30T08:10:19.580 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDJQyVku/n0JRAAR0LtRbpx7xhVdVUy0Ec/Rw== 2023-03-30T08:10:19.580 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.4] 2023-03-30T08:10:19.580 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDdQyVkLNSyHBAARL8uqcpJ5VbML5RcJ+AyeQ== 2023-03-30T08:10:19.580 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.5] 2023-03-30T08:10:19.580 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDgQyVk4uUhORAA3HcnlsCRhwvSczD5OK4OHA== 2023-03-30T08:10:19.581 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.6] 2023-03-30T08:10:19.581 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDkQyVkTNebCRAAQYG63wHseBzO1wkAnKNu7w== 2023-03-30T08:10:19.581 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.7] 2023-03-30T08:10:19.581 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDnQyVkPfeGFRAAcTAO00ne03UYnUkareUf+w== 2023-03-30T08:10:19.581 INFO:teuthology.orchestra.run.smithi115.stdout:[client.0] 2023-03-30T08:10:19.581 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDJQyVkPcl4LBAA1G96+FCw7jee5PlqiYhJvA== 2023-03-30T08:10:19.581 INFO:teuthology.orchestra.run.smithi115.stdout:[client.2] 2023-03-30T08:10:19.581 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDJQyVkpL2MMRAA8UBOCuP918a/KC992r1juw== 2023-03-30T08:10:19.582 INFO:teuthology.orchestra.run.smithi115.stdout:[client.1] 2023-03-30T08:10:19.582 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDJQyVkBMQKNxAAWgehKxymjV6O8weU+9S5Eg== 2023-03-30T08:10:19.582 INFO:teuthology.orchestra.run.smithi115.stdout:[client.3] 2023-03-30T08:10:19.582 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDKQyVke/jMABAAEjw6oKtbehX4O1cQtW3Aew== 2023-03-30T08:10:19.583 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-30T08:10:19.607 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-30T08:10:19.709 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-30T08:10:19.715 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-30T08:10:19.794 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-30T08:10:19.800 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-30T08:10:19.878 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:19.883 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:19.958 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:19.963 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:20.036 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:20.042 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:20.117 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:20.122 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:20.203 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-30T08:10:20.209 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-30T08:10:20.284 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-30T08:10:20.289 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-30T08:10:20.367 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-30T08:10:20.372 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-30T08:10:20.447 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:20.452 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:20.523 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:20.529 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:20.606 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:20.611 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:20.685 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:20.690 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-30T08:10:20.764 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-30T08:10:20.769 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-30T08:10:20.846 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-30T08:10:20.852 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-30T08:10:20.928 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-30T08:10:20.934 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-30T08:10:21.014 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-30T08:10:21.019 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-30T08:10:21.098 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-03-30T08:10:21.098 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-03-30T08:10:21.129 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-30T08:10:21.266 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-03-30T08:10:21.297 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-03-30T08:10:21.328 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-30T08:10:21.474 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-03-30T08:10:21.503 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-03-30T08:10:21.575 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-30T08:10:21.715 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-03-30T08:10:21.745 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-03-30T08:10:21.750 DEBUG:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-03-30T08:10:21.800 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-03-30T08:10:21.801 INFO:tasks.ceph.mon.a:Restarting daemon 2023-03-30T08:10:21.801 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-03-30T08:10:21.807 INFO:tasks.ceph.mon.a:Started 2023-03-30T08:10:21.808 INFO:tasks.ceph.mon.b:Restarting daemon 2023-03-30T08:10:21.808 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-03-30T08:10:21.851 INFO:tasks.ceph.mon.b:Started 2023-03-30T08:10:21.851 INFO:tasks.ceph.mon.c:Restarting daemon 2023-03-30T08:10:21.852 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-03-30T08:10:21.857 INFO:tasks.ceph.mon.c:Started 2023-03-30T08:10:21.857 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-03-30T08:10:21.858 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-03-30T08:10:21.858 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-03-30T08:10:21.863 INFO:tasks.ceph.mgr.y:Started 2023-03-30T08:10:21.864 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-03-30T08:10:21.864 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-03-30T08:10:21.867 INFO:tasks.ceph.mgr.x:Started 2023-03-30T08:10:21.868 INFO:tasks.ceph:Setting crush tunables to default 2023-03-30T08:10:21.868 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd crush tunables default 2023-03-30T08:10:22.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.014+0000 7f46d7fff700 1 Processor -- start 2023-03-30T08:10:22.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.014+0000 7f46d7fff700 1 -- start start 2023-03-30T08:10:22.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d7fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 0x7f46d80d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:22.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46d80d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:22.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d7fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d8160ef0 con 0x7f46d80d27e0 2023-03-30T08:10:22.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d7fff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d80cd6a0 con 0x7f46d80b8380 2023-03-30T08:10:22.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d7fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d80cd3a0 con 0x7f46d806a3e0 2023-03-30T08:10:22.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d6ffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 0x7f46d80d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:22.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d77fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46d80d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:22.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d6ffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 0x7f46d80d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56288/0 (socket says 172.21.15.87:56288) 2023-03-30T08:10:22.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 learned_addr learned my addr 172.21.15.87:0/2235315750 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d77fe700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46d80d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-03-30T08:10:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d77fe700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46d80d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d77fe700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46d80d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 msgr2=0x7f46d80d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-30T08:10:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 msgr2=0x7f46d80d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d77fe700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46d80d0880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-30T08:10:22.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 0x7f46d80d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:22.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.018+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 0x7f46d80d2200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-30T08:10:22.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.222+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 0x7f46d80d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:22.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.222+0000 7f46d77fe700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46d80d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:22.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.222+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 msgr2=0x7f46d80d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-03-30T08:10:22.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.222+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 msgr2=0x7f46d80d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:22.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.222+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 0x7f46d80d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:22.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.222+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 0x7f46d80d2200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-30T08:10:22.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.222+0000 7f46d77fe700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46d80d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-30T08:10:22.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.222+0000 7f46d77fe700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46d80d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:22.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.222+0000 7f46d77fe700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46d80d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:22.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.222+0000 7f46d77fe700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46d80d0880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-30T08:10:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.626+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 0x7f46d80d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.626+0000 7f46d77fe700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46d80d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.626+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 msgr2=0x7f46d80d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-30T08:10:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.626+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 msgr2=0x7f46d80d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:22.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.626+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 0x7f46d80d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.626+0000 7f46d77fe700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46d80d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-03-30T08:10:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.626+0000 7f46d77fe700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46d80d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.626+0000 7f46d77fe700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46d80d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:22.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.626+0000 7f46d77fe700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46d80d0880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-03-30T08:10:22.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:22.626+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 0x7f46d80d2200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-03-30T08:10:23.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:23.430+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 0x7f46d80d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:23.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:23.430+0000 7f46d77fe700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46d80d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:23.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:23.430+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 msgr2=0x7f46d80d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-03-30T08:10:23.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:23.430+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 msgr2=0x7f46d80d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:23.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:23.430+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 0x7f46d80d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:23.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:23.430+0000 7f46d77fe700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46d80d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-30T08:10:23.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:23.430+0000 7f46d77fe700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46d80d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:23.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:23.430+0000 7f46d77fe700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46d80d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:23.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:23.430+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 0x7f46d80d2200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-03-30T08:10:23.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:23.430+0000 7f46d77fe700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46d80d0880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-03-30T08:10:25.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.018+0000 7f46d4ff9700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46d80d0880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-30T08:10:25.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.018+0000 7f46d4ff9700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46d80d0880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:25.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.018+0000 7f46d4ff9700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 msgr2=0x7f46d80d2200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-30T08:10:25.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.018+0000 7f46d4ff9700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46d80b8380 0x7f46d80d2200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:25.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.018+0000 7f46d4ff9700 1 -- 172.21.15.87:0/2235315750 >> v1:172.21.15.115:6789/0 conn(0x7f46d80d27e0 legacy=0x7f46d8069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:25.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.018+0000 7f46d4ff9700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 0x7f46c4005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:25.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.018+0000 7f46d4ff9700 1 -- 172.21.15.87:0/2235315750 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d80cef00 con 0x7f46c40061f0 2023-03-30T08:10:25.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.018+0000 7f46d4ff9700 1 -- 172.21.15.87:0/2235315750 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d80cd6a0 con 0x7f46c4003740 2023-03-30T08:10:25.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.018+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 0x7f46c4005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:25.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.018+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-03-30T08:10:25.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.018+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:25.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.018+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 0x7f46c4005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:25.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.018+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 0x7f46c4005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-30T08:10:25.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.222+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 0x7f46c4005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:25.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.222+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-03-30T08:10:25.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.222+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:25.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.222+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 0x7f46c4005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:25.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.222+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 0x7f46c4005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-30T08:10:25.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.626+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 0x7f46c4005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:25.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.626+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-03-30T08:10:25.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.626+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:25.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.626+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 0x7f46c4005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:25.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:25.626+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 0x7f46c4005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-03-30T08:10:26.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:26.430+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 0x7f46c4005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:26.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:26.430+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-03-30T08:10:26.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:26.430+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:26.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:26.430+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 0x7f46c4005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:26.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:26.430+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 0x7f46c4005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-03-30T08:10:28.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.018+0000 7f46d4ff9700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-30T08:10:28.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.018+0000 7f46d4ff9700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c4003740 0x7f46c4005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:28.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.018+0000 7f46d4ff9700 1 -- 172.21.15.87:0/2235315750 >> v1:172.21.15.87:6789/0 conn(0x7f46c40061f0 legacy=0x7f46c40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:28.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.018+0000 7f46d4ff9700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46c400a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:28.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.018+0000 7f46d77fe700 1 -- 172.21.15.87:0/2235315750 reap_dead start 2023-03-30T08:10:28.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.018+0000 7f46d4ff9700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 0x7f46c4005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:28.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.018+0000 7f46d4ff9700 1 -- 172.21.15.87:0/2235315750 --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c400af70 con 0x7f46c400aae0 2023-03-30T08:10:28.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.018+0000 7f46d4ff9700 1 -- 172.21.15.87:0/2235315750 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d80cd6a0 con 0x7f46c400a590 2023-03-30T08:10:28.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.018+0000 7f46d4ff9700 1 -- 172.21.15.87:0/2235315750 --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d80cd3a0 con 0x7f46d806a3e0 2023-03-30T08:10:28.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.018+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 0x7f46c4005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:28.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.018+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46c400a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:28.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.018+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-30T08:10:28.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.018+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:28.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.018+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 0x7f46c4005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:28.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.018+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 0x7f46c4005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-30T08:10:28.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.022+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46c400a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-03-30T08:10:28.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.022+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46c400a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:28.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.022+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46c400a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:28.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.022+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46c400a050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-30T08:10:28.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.226+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 0x7f46c4005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:28.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.226+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46c400a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:28.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.226+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-30T08:10:28.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.226+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:28.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.226+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 0x7f46c4005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:28.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.226+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46c400a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-03-30T08:10:28.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.226+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46c400a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:28.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.226+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46c400a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:28.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.226+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46c400a050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-30T08:10:28.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.226+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 0x7f46c4005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-30T08:10:28.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.630+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 0x7f46c4005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:28.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.630+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46c400a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:28.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.630+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-03-30T08:10:28.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.630+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:28.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.630+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 0x7f46c4005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:28.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.630+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 0x7f46c4005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-03-30T08:10:28.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.630+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46c400a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-30T08:10:28.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.630+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46c400a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:28.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.630+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46c400a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:28.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:28.630+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46c400a050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-03-30T08:10:29.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:29.434+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 0x7f46c4005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:29.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:29.434+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46c400a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:29.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:29.434+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-03-30T08:10:29.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:29.434+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:29.434+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 0x7f46c4005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:29.434+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 0x7f46c4005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-03-30T08:10:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:29.434+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46c400a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-30T08:10:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:29.434+0000 7f46d6ffd700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46c400a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:29.434+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46c400a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:29.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:29.434+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46c400a050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-03-30T08:10:31.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.017+0000 7f46d4ff9700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 msgr2=0x7f46c400a050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-30T08:10:31.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.017+0000 7f46d4ff9700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.115:3300/0 conn(0x7f46d806a3e0 0x7f46c400a050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:31.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.017+0000 7f46d4ff9700 1 -- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 msgr2=0x7f46c4005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-30T08:10:31.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.017+0000 7f46d4ff9700 1 --2- 172.21.15.87:0/2235315750 >> v2:172.21.15.87:3300/0 conn(0x7f46c400a590 0x7f46c4005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:31.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.017+0000 7f46d4ff9700 1 -- 172.21.15.87:0/2235315750 >> v1:172.21.15.115:6789/0 conn(0x7f46c400aae0 legacy=0x7f46c400f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:31.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.017+0000 7f46d4ff9700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 0x7f46c4013c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:31.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.017+0000 7f46d4ff9700 1 -- 172.21.15.87:0/2235315750 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c4006750 con 0x7f46c4006a60 2023-03-30T08:10:31.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.017+0000 7f46d4ff9700 1 -- 172.21.15.87:0/2235315750 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d80cd6a0 con 0x7f46c40096f0 2023-03-30T08:10:31.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.021+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 0x7f46c4013c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:31.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.021+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 msgr2=0x7f46c4013c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-03-30T08:10:31.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.021+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 msgr2=0x7f46c4013c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:31.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.021+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 0x7f46c4013c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:31.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.021+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 0x7f46c4013c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-30T08:10:31.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.225+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 0x7f46c4013c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:31.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.225+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 msgr2=0x7f46c4013c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-03-30T08:10:31.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.225+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 msgr2=0x7f46c4013c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:31.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.225+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 0x7f46c4013c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:31.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.225+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 0x7f46c4013c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-03-30T08:10:31.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.629+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 0x7f46c4013c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:31.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.629+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 msgr2=0x7f46c4013c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-03-30T08:10:31.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.629+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 msgr2=0x7f46c4013c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-30T08:10:31.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.629+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 0x7f46c4013c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-30T08:10:31.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:31.629+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 0x7f46c4013c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-03-30T08:10:32.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.213+0000 7f46d5ffb700 1 -- 172.21.15.87:0/2235315750 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553139001 0 0) 0x7f46c4006750 con 0x7f46c4006a60 2023-03-30T08:10:32.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.213+0000 7f46d5ffb700 1 -- 172.21.15.87:0/2235315750 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46c00035d0 con 0x7f46c4006a60 2023-03-30T08:10:32.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d5ffb700 1 -- 172.21.15.87:0/2235315750 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1568411982 0 0) 0x7f46c00035d0 con 0x7f46c4006a60 2023-03-30T08:10:32.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d5ffb700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 msgr2=0x7f46c4013c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-30T08:10:32.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d5ffb700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c40096f0 0x7f46c4013c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:32.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d5ffb700 1 -- 172.21.15.87:0/2235315750 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c4015190 con 0x7f46c4006a60 2023-03-30T08:10:32.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d5ffb700 1 -- 172.21.15.87:0/2235315750 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f46c8009700 con 0x7f46c4006a60 2023-03-30T08:10:32.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d5ffb700 1 -- 172.21.15.87:0/2235315750 >> v1:172.21.15.87:6789/0 conn(0x7f46c4006a60 legacy=0x7f46c4008e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:32.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d77fe700 1 -- 172.21.15.87:0/2235315750 reap_dead start 2023-03-30T08:10:32.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d5ffb700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c0003a50 0x7f46c0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:32.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d5ffb700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c0004870 0x7f46c0004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:32.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d5ffb700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46c0005270 0x7f46c000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:32.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d5ffb700 1 -- 172.21.15.87:0/2235315750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d80cd6a0 con 0x7f46c0005270 2023-03-30T08:10:32.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d5ffb700 1 -- 172.21.15.87:0/2235315750 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c000c180 con 0x7f46c0004870 2023-03-30T08:10:32.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d5ffb700 1 -- 172.21.15.87:0/2235315750 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c000c340 con 0x7f46c0003a50 2023-03-30T08:10:32.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c0004870 0x7f46c0004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:32.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d6ffd700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c0003a50 0x7f46c0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:32.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d77fe700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46c0005270 0x7f46c000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:32.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c0003a50 msgr2=0x7f46c0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:32.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c0003a50 0x7f46c0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:32.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46c0005270 msgr2=0x7f46c000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:32.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46c0005270 0x7f46c000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:32.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.217+0000 7f46d67fc700 1 -- 172.21.15.87:0/2235315750 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c00035d0 con 0x7f46c0004870 2023-03-30T08:10:32.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.221+0000 7f46d77fe700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46c0005270 0x7f46c000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:10:32.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.221+0000 7f46d67fc700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c0004870 0x7f46c0004ce0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009dc0 tx=0x7f46c00058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdfc470aa34a4c50 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:32.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.221+0000 7f46d5ffb700 1 -- 172.21.15.87:0/2235315750 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc005110 con 0x7f46c0004870 2023-03-30T08:10:32.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.221+0000 7f46d5ffb700 1 -- 172.21.15.87:0/2235315750 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc005270 con 0x7f46c0004870 2023-03-30T08:10:32.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.221+0000 7f46d5ffb700 1 -- 172.21.15.87:0/2235315750 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0176d0 con 0x7f46c0004870 2023-03-30T08:10:32.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.221+0000 7f46d7fff700 1 -- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c0004870 msgr2=0x7f46c0004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:32.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.221+0000 7f46d7fff700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c0004870 0x7f46c0004ce0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009dc0 tx=0x7f46c00058a0 comp rx=0 tx=0).stop 2023-03-30T08:10:32.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.221+0000 7f46d7fff700 1 -- 172.21.15.87:0/2235315750 shutdown_connections 2023-03-30T08:10:32.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.221+0000 7f46d7fff700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46c0005270 0x7f46c000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:32.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.221+0000 7f46d7fff700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c0004870 0x7f46c0004ce0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:32.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.221+0000 7f46d7fff700 1 --2- 172.21.15.87:0/2235315750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c0003a50 0x7f46c0003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:32.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.221+0000 7f46d7fff700 1 -- 172.21.15.87:0/2235315750 >> 172.21.15.87:0/2235315750 conn(0x7f46d80b53f0 msgr2=0x7f46d80cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:32.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.225+0000 7f46d7fff700 1 -- 172.21.15.87:0/2235315750 shutdown_connections 2023-03-30T08:10:32.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.225+0000 7f46d7fff700 1 -- 172.21.15.87:0/2235315750 wait complete. 2023-03-30T08:10:32.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.225+0000 7f46d7fff700 1 Processor -- start 2023-03-30T08:10:32.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d7fff700 1 -- start start 2023-03-30T08:10:32.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d7fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46c0003a50 0x7f46d80c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:32.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c0004870 0x7f46d80c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:32.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c0005270 0x7f46d81f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:32.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d7fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d814bee0 con 0x7f46c0003a50 2023-03-30T08:10:32.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d7fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d80c8e60 con 0x7f46c0005270 2023-03-30T08:10:32.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d7fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d80c9130 con 0x7f46c0004870 2023-03-30T08:10:32.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d6ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46c0003a50 0x7f46d80c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:32.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c0005270 0x7f46d81f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:32.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d67fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c0004870 0x7f46d80c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:32.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d77fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c0005270 0x7f46d81f50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:54280/0 (socket says 172.21.15.87:54280) 2023-03-30T08:10:32.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d6ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46c0003a50 0x7f46d80c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41344/0 (socket says 172.21.15.87:41344) 2023-03-30T08:10:32.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d77fe700 1 -- 172.21.15.87:0/3596622099 learned_addr learned my addr 172.21.15.87:0/3596622099 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:32.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d77fe700 1 -- 172.21.15.87:0/3596622099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c0004870 msgr2=0x7f46d80c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:32.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d77fe700 1 --2- 172.21.15.87:0/3596622099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c0004870 0x7f46d80c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:32.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d77fe700 1 -- 172.21.15.87:0/3596622099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46c0003a50 msgr2=0x7f46d80c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:32.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d77fe700 1 --2- 172.21.15.87:0/3596622099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46c0003a50 0x7f46d80c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:32.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d77fe700 1 -- 172.21.15.87:0/3596622099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d80cf480 con 0x7f46c0005270 2023-03-30T08:10:32.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d77fe700 1 --2- 172.21.15.87:0/3596622099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c0005270 0x7f46d81f50f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f46d80b1930 tx=0x7f46d0012740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:32.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46bf7fe700 1 -- 172.21.15.87:0/3596622099 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0003e60 con 0x7f46c0005270 2023-03-30T08:10:32.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46bf7fe700 1 -- 172.21.15.87:0/3596622099 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d000c040 con 0x7f46c0005270 2023-03-30T08:10:32.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46d7fff700 1 -- 172.21.15.87:0/3596622099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d80cf1a0 con 0x7f46c0005270 2023-03-30T08:10:32.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.229+0000 7f46bf7fe700 1 -- 172.21.15.87:0/3596622099 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0018450 con 0x7f46c0005270 2023-03-30T08:10:32.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.233+0000 7f46d7fff700 1 -- 172.21.15.87:0/3596622099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d80b8750 con 0x7f46c0005270 2023-03-30T08:10:32.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.233+0000 7f46bf7fe700 1 -- 172.21.15.87:0/3596622099 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f46d0005d40 con 0x7f46c0005270 2023-03-30T08:10:32.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.233+0000 7f46bf7fe700 1 -- 172.21.15.87:0/3596622099 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f46d0006470 con 0x7f46c0005270 2023-03-30T08:10:32.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.233+0000 7f46d7fff700 1 -- 172.21.15.87:0/3596622099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d8072cf0 con 0x7f46c0005270 2023-03-30T08:10:32.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.237+0000 7f46bf7fe700 1 -- 172.21.15.87:0/3596622099 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f46d001d030 con 0x7f46c0005270 2023-03-30T08:10:32.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.309+0000 7f46d7fff700 1 -- 172.21.15.87:0/3596622099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f46d80733a0 con 0x7f46c0005270 2023-03-30T08:10:32.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.321+0000 7f46bf7fe700 1 -- 172.21.15.87:0/3596622099 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f46d0006630 con 0x7f46c0005270 2023-03-30T08:10:32.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.321+0000 7f46d7fff700 1 -- 172.21.15.87:0/3596622099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c0005270 msgr2=0x7f46d81f50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:32.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.321+0000 7f46d7fff700 1 --2- 172.21.15.87:0/3596622099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c0005270 0x7f46d81f50f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f46d80b1930 tx=0x7f46d0012740 comp rx=0 tx=0).stop 2023-03-30T08:10:32.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.321+0000 7f46d7fff700 1 -- 172.21.15.87:0/3596622099 shutdown_connections 2023-03-30T08:10:32.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.321+0000 7f46d7fff700 1 --2- 172.21.15.87:0/3596622099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46c0005270 0x7f46d81f50f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:32.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.321+0000 7f46d7fff700 1 --2- 172.21.15.87:0/3596622099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f46c0004870 0x7f46d80c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:32.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.321+0000 7f46d7fff700 1 --2- 172.21.15.87:0/3596622099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f46c0003a50 0x7f46d80c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:32.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.321+0000 7f46d7fff700 1 -- 172.21.15.87:0/3596622099 >> 172.21.15.87:0/3596622099 conn(0x7f46d80b53f0 msgr2=0x7f46d80d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:32.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.321+0000 7f46d7fff700 1 -- 172.21.15.87:0/3596622099 shutdown_connections 2023-03-30T08:10:32.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:32.321+0000 7f46d7fff700 1 -- 172.21.15.87:0/3596622099 wait complete. 2023-03-30T08:10:32.327 INFO:teuthology.orchestra.run.smithi087.stderr:adjusted tunables profile to default 2023-03-30T08:10:32.346 INFO:tasks.ceph:check_enable_crimson: False 2023-03-30T08:10:32.347 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-03-30T08:10:32.347 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:10:32.347 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-03-30T08:10:32.372 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:10:32.373 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-03-30T08:10:32.439 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:10:32.439 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-03-30T08:10:32.468 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:32.465+0000 7f4b7275a2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-30T08:10:32.495 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:10:32.496 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-03-30T08:10:32.496 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:32.491+0000 7f7d1c3662c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-30T08:10:32.567 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:10:32.567 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-03-30T08:10:32.597 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:10:32.597 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-03-30T08:10:32.666 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:10:32.666 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-03-30T08:10:32.739 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:10:32.739 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-03-30T08:10:32.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new a2fe6d6c-96ab-4206-a397-c72fefa24d00 0 2023-03-30T08:10:33.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.995+0000 7fdc38bdc700 1 Processor -- start 2023-03-30T08:10:33.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.995+0000 7fdc38bdc700 1 -- start start 2023-03-30T08:10:33.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.995+0000 7fdc38bdc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdc34163dc0 0x7fdc340c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.995+0000 7fdc38bdc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdc340aea30 0x7fdc3406a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.995+0000 7fdc38bdc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc34069f00 con 0x7fdc34164190 2023-03-30T08:10:33.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.995+0000 7fdc38bdc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc3406d810 con 0x7fdc34163dc0 2023-03-30T08:10:33.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.995+0000 7fdc38bdc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc340cc1d0 con 0x7fdc340aea30 2023-03-30T08:10:33.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.995+0000 7fdc33fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdc340aea30 0x7fdc3406a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.995+0000 7fdc2bfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fdc34164190 0x7fdc340c9b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36242/0 (socket says 172.21.15.115:36242) 2023-03-30T08:10:33.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.995+0000 7fdc2bfff700 1 -- 172.21.15.115:0/3512893779 learned_addr learned my addr 172.21.15.115:0/3512893779 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-03-30T08:10:33.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc337fe700 1 --2- 172.21.15.115:0/3512893779 >> v2:172.21.15.87:3300/0 conn(0x7fdc34163dc0 0x7fdc340c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc33fff700 1 -- 172.21.15.115:0/3512893779 >> v2:172.21.15.87:3300/0 conn(0x7fdc34163dc0 msgr2=0x7fdc340c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:33.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc33fff700 1 --2- 172.21.15.115:0/3512893779 >> v2:172.21.15.87:3300/0 conn(0x7fdc34163dc0 0x7fdc340c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc33fff700 1 -- 172.21.15.115:0/3512893779 >> v1:172.21.15.115:6789/0 conn(0x7fdc34164190 legacy=0x7fdc340c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc33fff700 1 -- 172.21.15.115:0/3512893779 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3406cf70 con 0x7fdc340aea30 2023-03-30T08:10:33.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc337fe700 1 --2- 172.21.15.115:0/3512893779 >> v2:172.21.15.87:3300/0 conn(0x7fdc34163dc0 0x7fdc340c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:10:33.004 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc33fff700 1 --2- 172.21.15.115:0/3512893779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc340aea30 0x7fdc3406a390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdc340cb9a0 tx=0x7fdc2c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d3cea117f63f362 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:33.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc32ffd700 1 -- 172.21.15.115:0/3512893779 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c00e070 con 0x7fdc340aea30 2023-03-30T08:10:33.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc32ffd700 1 -- 172.21.15.115:0/3512893779 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c00bbd0 con 0x7fdc340aea30 2023-03-30T08:10:33.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc32ffd700 1 -- 172.21.15.115:0/3512893779 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c012430 con 0x7fdc340aea30 2023-03-30T08:10:33.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc38bdc700 1 -- 172.21.15.115:0/3512893779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc340aea30 msgr2=0x7fdc3406a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc38bdc700 1 --2- 172.21.15.115:0/3512893779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc340aea30 0x7fdc3406a390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdc340cb9a0 tx=0x7fdc2c00b330 comp rx=0 tx=0).stop 2023-03-30T08:10:33.005 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc38bdc700 1 -- 172.21.15.115:0/3512893779 shutdown_connections 2023-03-30T08:10:33.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc38bdc700 1 --2- 172.21.15.115:0/3512893779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc340aea30 0x7fdc3406a390 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc38bdc700 1 --2- 172.21.15.115:0/3512893779 >> v2:172.21.15.87:3300/0 conn(0x7fdc34163dc0 0x7fdc340c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc38bdc700 1 -- 172.21.15.115:0/3512893779 >> 172.21.15.115:0/3512893779 conn(0x7fdc340cf410 msgr2=0x7fdc340cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:33.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc38bdc700 1 -- 172.21.15.115:0/3512893779 shutdown_connections 2023-03-30T08:10:33.006 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:32.999+0000 7fdc38bdc700 1 -- 172.21.15.115:0/3512893779 wait complete. 2023-03-30T08:10:33.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc38bdc700 1 Processor -- start 2023-03-30T08:10:33.007 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc38bdc700 1 -- start start 2023-03-30T08:10:33.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc38bdc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc340aea30 0x7fdc340c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.008 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc38bdc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc34163dc0 0x7fdc3415bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc38bdc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc34164190 0x7fdc341554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc38bdc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3415c530 con 0x7fdc34164190 2023-03-30T08:10:33.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc38bdc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34155a30 con 0x7fdc34163dc0 2023-03-30T08:10:33.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc38bdc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340ca1f0 con 0x7fdc340aea30 2023-03-30T08:10:33.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc337fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc340aea30 0x7fdc340c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.009 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc337fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc340aea30 0x7fdc340c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:47876/0 (socket says 172.21.15.115:47876) 2023-03-30T08:10:33.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc337fe700 1 -- 172.21.15.115:0/1349774423 learned_addr learned my addr 172.21.15.115:0/1349774423 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-03-30T08:10:33.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc2bfff700 1 --2- 172.21.15.115:0/1349774423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc34163dc0 0x7fdc3415bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.010 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc33fff700 1 --2- 172.21.15.115:0/1349774423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc34164190 0x7fdc341554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc337fe700 1 -- 172.21.15.115:0/1349774423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc34163dc0 msgr2=0x7fdc3415bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc337fe700 1 --2- 172.21.15.115:0/1349774423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc34163dc0 0x7fdc3415bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc337fe700 1 -- 172.21.15.115:0/1349774423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc34164190 msgr2=0x7fdc341554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.011 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc337fe700 1 --2- 172.21.15.115:0/1349774423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc34164190 0x7fdc341554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc337fe700 1 -- 172.21.15.115:0/1349774423 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c009a70 con 0x7fdc340aea30 2023-03-30T08:10:33.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc33fff700 1 --2- 172.21.15.115:0/1349774423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc34164190 0x7fdc341554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:10:33.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc337fe700 1 --2- 172.21.15.115:0/1349774423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc340aea30 0x7fdc340c9b30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400c770 tx=0x7fdc2400ca80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:33.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc30ff9700 1 -- 172.21.15.115:0/1349774423 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24011800 con 0x7fdc340aea30 2023-03-30T08:10:33.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc30ff9700 1 -- 172.21.15.115:0/1349774423 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc24011960 con 0x7fdc340aea30 2023-03-30T08:10:33.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc38bdc700 1 -- 172.21.15.115:0/1349774423 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3406d530 con 0x7fdc340aea30 2023-03-30T08:10:33.012 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc30ff9700 1 -- 172.21.15.115:0/1349774423 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24011d10 con 0x7fdc340aea30 2023-03-30T08:10:33.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc38bdc700 1 -- 172.21.15.115:0/1349774423 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3406d250 con 0x7fdc340aea30 2023-03-30T08:10:33.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.003+0000 7fdc30ff9700 1 -- 172.21.15.115:0/1349774423 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdc2401a450 con 0x7fdc340aea30 2023-03-30T08:10:33.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.007+0000 7fdc30ff9700 1 -- 172.21.15.115:0/1349774423 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdc240186f0 con 0x7fdc340aea30 2023-03-30T08:10:33.013 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.007+0000 7fdc38bdc700 1 -- 172.21.15.115:0/1349774423 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc3406cc40 con 0x7fdc340aea30 2023-03-30T08:10:33.015 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.011+0000 7fdc30ff9700 1 -- 172.21.15.115:0/1349774423 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fdc24039b10 con 0x7fdc340aea30 2023-03-30T08:10:33.088 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.083+0000 7fdc38bdc700 1 -- 172.21.15.115:0/1349774423 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a2fe6d6c-96ab-4206-a397-c72fefa24d00", "id": 0} v 0) v1 -- 0x7fdc340733a0 con 0x7fdc340aea30 2023-03-30T08:10:33.098 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.091+0000 7fdc30ff9700 1 -- 172.21.15.115:0/1349774423 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a2fe6d6c-96ab-4206-a397-c72fefa24d00", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdc24028030 con 0x7fdc340aea30 2023-03-30T08:10:33.098 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-03-30T08:10:33.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.095+0000 7fdc38bdc700 1 -- 172.21.15.115:0/1349774423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc340aea30 msgr2=0x7fdc340c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.099 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.095+0000 7fdc38bdc700 1 --2- 172.21.15.115:0/1349774423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc340aea30 0x7fdc340c9b30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400c770 tx=0x7fdc2400ca80 comp rx=0 tx=0).stop 2023-03-30T08:10:33.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.095+0000 7fdc38bdc700 1 -- 172.21.15.115:0/1349774423 shutdown_connections 2023-03-30T08:10:33.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.095+0000 7fdc38bdc700 1 --2- 172.21.15.115:0/1349774423 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc34164190 0x7fdc341554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.095+0000 7fdc38bdc700 1 --2- 172.21.15.115:0/1349774423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc34163dc0 0x7fdc3415bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.095+0000 7fdc38bdc700 1 --2- 172.21.15.115:0/1349774423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc340aea30 0x7fdc340c9b30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.100 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.095+0000 7fdc38bdc700 1 -- 172.21.15.115:0/1349774423 >> 172.21.15.115:0/1349774423 conn(0x7fdc340cf410 msgr2=0x7fdc340cdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:33.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.095+0000 7fdc38bdc700 1 -- 172.21.15.115:0/1349774423 shutdown_connections 2023-03-30T08:10:33.101 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.095+0000 7fdc38bdc700 1 -- 172.21.15.115:0/1349774423 wait complete. 2023-03-30T08:10:33.119 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new dbdda5bb-e5db-4a9f-a7e6-05d15a90f745 1 2023-03-30T08:10:33.158 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:33.153+0000 7f4b7275a2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-30T08:10:33.185 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:33.179+0000 7f7d1c3662c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-30T08:10:33.237 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:33.233+0000 7f4b7275a2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-30T08:10:33.259 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:33.255+0000 7f7d1c3662c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-30T08:10:33.262 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.259+0000 7f1f129e8700 1 Processor -- start 2023-03-30T08:10:33.263 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.259+0000 7f1f129e8700 1 -- start start 2023-03-30T08:10:33.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.259+0000 7f1f129e8700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1f0c15a5e0 0x7f1f0c0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.265 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.259+0000 7f1f129e8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1f0c0afbf0 0x7f1f0c0b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.259+0000 7f1f129e8700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f0c0ce9d0 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.259+0000 7f1f129e8700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f0c09a350 con 0x7f1f0c15a5e0 2023-03-30T08:10:33.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.259+0000 7f1f129e8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f0c15a9b0 con 0x7f1f0c0afbf0 2023-03-30T08:10:33.266 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.259+0000 7f1f111e5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1f0c0afbf0 0x7f1f0c0b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.259+0000 7f1f111e5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1f0c0afbf0 0x7f1f0c0b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56820/0 (socket says 172.21.15.115:56820) 2023-03-30T08:10:33.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.259+0000 7f1f111e5700 1 -- 172.21.15.115:0/1038618515 learned_addr learned my addr 172.21.15.115:0/1038618515 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-03-30T08:10:33.267 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.259+0000 7f1f119e6700 1 --2- 172.21.15.115:0/1038618515 >> v2:172.21.15.87:3300/0 conn(0x7f1f0c15a5e0 0x7f1f0c0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f109e4700 1 -- 172.21.15.115:0/1038618515 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071395682 0 0) 0x7f1f0c0ce9d0 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f109e4700 1 -- 172.21.15.115:0/1038618515 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ef80035d0 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.268 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f111e5700 1 -- 172.21.15.115:0/1038618515 >> v2:172.21.15.87:3300/0 conn(0x7f1f0c15a5e0 msgr2=0x7f1f0c0b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:33.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f111e5700 1 --2- 172.21.15.115:0/1038618515 >> v2:172.21.15.87:3300/0 conn(0x7f1f0c15a5e0 0x7f1f0c0b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f111e5700 1 -- 172.21.15.115:0/1038618515 >> v1:172.21.15.87:6789/0 conn(0x7f1f0c0b1c20 legacy=0x7f1f0c1630f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f111e5700 1 -- 172.21.15.115:0/1038618515 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0c0cec20 con 0x7f1f0c0afbf0 2023-03-30T08:10:33.269 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f111e5700 1 --2- 172.21.15.115:0/1038618515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f0c0afbf0 0x7f1f0c0b16e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009910 tx=0x7f1efc009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68ccd5881c7c050e server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:33.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f109e4700 1 -- 172.21.15.115:0/1038618515 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc011830 con 0x7f1f0c0afbf0 2023-03-30T08:10:33.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f109e4700 1 -- 172.21.15.115:0/1038618515 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc011990 con 0x7f1f0c0afbf0 2023-03-30T08:10:33.270 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f109e4700 1 -- 172.21.15.115:0/1038618515 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc011d40 con 0x7f1f0c0afbf0 2023-03-30T08:10:33.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f129e8700 1 -- 172.21.15.115:0/1038618515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f0c0afbf0 msgr2=0x7f1f0c0b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f129e8700 1 --2- 172.21.15.115:0/1038618515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f0c0afbf0 0x7f1f0c0b16e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009910 tx=0x7f1efc009c20 comp rx=0 tx=0).stop 2023-03-30T08:10:33.271 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f129e8700 1 -- 172.21.15.115:0/1038618515 shutdown_connections 2023-03-30T08:10:33.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f129e8700 1 --2- 172.21.15.115:0/1038618515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f0c0afbf0 0x7f1f0c0b16e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f129e8700 1 --2- 172.21.15.115:0/1038618515 >> v2:172.21.15.87:3300/0 conn(0x7f1f0c15a5e0 0x7f1f0c0b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f129e8700 1 -- 172.21.15.115:0/1038618515 >> 172.21.15.115:0/1038618515 conn(0x7f1f0c099dc0 msgr2=0x7f1f0c0d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:33.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f129e8700 1 -- 172.21.15.115:0/1038618515 shutdown_connections 2023-03-30T08:10:33.272 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.263+0000 7f1f129e8700 1 -- 172.21.15.115:0/1038618515 wait complete. 2023-03-30T08:10:33.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f129e8700 1 Processor -- start 2023-03-30T08:10:33.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f129e8700 1 -- start start 2023-03-30T08:10:33.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f129e8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f0c0afbf0 0x7f1f0c153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.274 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f129e8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1f0c0b1c20 0x7f1f0c0c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f129e8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f0c15a5e0 0x7f1f0c0ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f129e8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c0c6400 con 0x7f1f0c15a5e0 2023-03-30T08:10:33.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f129e8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c0c9820 con 0x7f1f0c0afbf0 2023-03-30T08:10:33.275 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f129e8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c0c9b00 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f111e5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1f0c0b1c20 0x7f1f0c0c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f119e6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f0c0afbf0 0x7f1f0c153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f111e5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1f0c0b1c20 0x7f1f0c0c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:47884/0 (socket says 172.21.15.115:47884) 2023-03-30T08:10:33.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f111e5700 1 -- 172.21.15.115:0/2476244738 learned_addr learned my addr 172.21.15.115:0/2476244738 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-03-30T08:10:33.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f121e7700 1 --2- 172.21.15.115:0/2476244738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f0c15a5e0 0x7f1f0c0ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f111e5700 1 -- 172.21.15.115:0/2476244738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f0c0afbf0 msgr2=0x7f1f0c153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f111e5700 1 --2- 172.21.15.115:0/2476244738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f0c0afbf0 0x7f1f0c153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.276 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f111e5700 1 -- 172.21.15.115:0/2476244738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f0c15a5e0 msgr2=0x7f1f0c0ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f111e5700 1 --2- 172.21.15.115:0/2476244738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f0c15a5e0 0x7f1f0c0ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f111e5700 1 -- 172.21.15.115:0/2476244738 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc009570 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f121e7700 1 --2- 172.21.15.115:0/2476244738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f0c15a5e0 0x7f1f0c0ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:10:33.277 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.267+0000 7f1f119e6700 1 --2- 172.21.15.115:0/2476244738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f0c0afbf0 0x7f1f0c153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:10:33.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.271+0000 7f1f111e5700 1 --2- 172.21.15.115:0/2476244738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1f0c0b1c20 0x7f1f0c0c8680 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009c60 tx=0x7f1efc004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:33.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.271+0000 7f1f027fc700 1 -- 172.21.15.115:0/2476244738 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc004510 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.271+0000 7f1f027fc700 1 -- 172.21.15.115:0/2476244738 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc0036c0 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.278 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.271+0000 7f1f129e8700 1 -- 172.21.15.115:0/2476244738 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f0c0b0c80 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.271+0000 7f1f027fc700 1 -- 172.21.15.115:0/2476244738 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc003a70 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.271+0000 7f1f129e8700 1 -- 172.21.15.115:0/2476244738 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0c0cef00 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.271+0000 7f1f027fc700 1 -- 172.21.15.115:0/2476244738 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1efc025460 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.271+0000 7f1f027fc700 1 -- 172.21.15.115:0/2476244738 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f1efc01a7d0 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.279 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.271+0000 7f1f129e8700 1 -- 172.21.15.115:0/2476244738 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f0c0cf1e0 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.280 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.275+0000 7f1f027fc700 1 -- 172.21.15.115:0/2476244738 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f1efc02a020 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.356 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.351+0000 7f1f129e8700 1 -- 172.21.15.115:0/2476244738 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dbdda5bb-e5db-4a9f-a7e6-05d15a90f745", "id": 1} v 0) v1 -- 0x7f1f0c072cf0 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.363+0000 7f1f027fc700 1 -- 172.21.15.115:0/2476244738 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dbdda5bb-e5db-4a9f-a7e6-05d15a90f745", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1efc020070 con 0x7f1f0c0b1c20 2023-03-30T08:10:33.368 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-03-30T08:10:33.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.363+0000 7f1f129e8700 1 -- 172.21.15.115:0/2476244738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1f0c0b1c20 msgr2=0x7f1f0c0c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.363+0000 7f1f129e8700 1 --2- 172.21.15.115:0/2476244738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1f0c0b1c20 0x7f1f0c0c8680 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009c60 tx=0x7f1efc004770 comp rx=0 tx=0).stop 2023-03-30T08:10:33.370 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.363+0000 7f1f129e8700 1 -- 172.21.15.115:0/2476244738 shutdown_connections 2023-03-30T08:10:33.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.363+0000 7f1f129e8700 1 --2- 172.21.15.115:0/2476244738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1f0c15a5e0 0x7f1f0c0ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.363+0000 7f1f129e8700 1 --2- 172.21.15.115:0/2476244738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1f0c0b1c20 0x7f1f0c0c8680 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.363+0000 7f1f129e8700 1 --2- 172.21.15.115:0/2476244738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f0c0afbf0 0x7f1f0c153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.363+0000 7f1f129e8700 1 -- 172.21.15.115:0/2476244738 >> 172.21.15.115:0/2476244738 conn(0x7f1f0c099dc0 msgr2=0x7f1f0c159810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:33.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.363+0000 7f1f129e8700 1 -- 172.21.15.115:0/2476244738 shutdown_connections 2023-03-30T08:10:33.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.363+0000 7f1f129e8700 1 -- 172.21.15.115:0/2476244738 wait complete. 2023-03-30T08:10:33.387 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6 2 2023-03-30T08:10:33.403 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:33.401+0000 7f4b7275a2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-30T08:10:33.430 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:33.423+0000 7f7d1c3662c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-30T08:10:33.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.523+0000 7f829b59e700 1 Processor -- start 2023-03-30T08:10:33.530 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f829b59e700 1 -- start start 2023-03-30T08:10:33.531 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f829b59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f829c0cf9c0 0x7f829c06d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f829b59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f829c071290 0x7f829c1601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f829b59e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c0717d0 con 0x7f829c15c5d0 2023-03-30T08:10:33.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f829b59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c0ccc70 con 0x7f829c071290 2023-03-30T08:10:33.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f829b59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c0cfe80 con 0x7f829c0cf9c0 2023-03-30T08:10:33.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f8293fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f829c0cf9c0 0x7f829c06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.533 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f8293fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f829c0cf9c0 0x7f829c06d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56844/0 (socket says 172.21.15.115:56844) 2023-03-30T08:10:33.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f8293fff700 1 -- 172.21.15.115:0/905031074 learned_addr learned my addr 172.21.15.115:0/905031074 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-03-30T08:10:33.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f8293fff700 1 -- 172.21.15.115:0/905031074 >> v2:172.21.15.87:3300/0 conn(0x7f829c071290 msgr2=0x7f829c1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:33.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f8293fff700 1 --2- 172.21.15.115:0/905031074 >> v2:172.21.15.87:3300/0 conn(0x7f829c071290 0x7f829c1601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f8293fff700 1 -- 172.21.15.115:0/905031074 >> v1:172.21.15.115:6789/0 conn(0x7f829c15c5d0 legacy=0x7f829c070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f8293fff700 1 -- 172.21.15.115:0/905031074 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c071a20 con 0x7f829c0cf9c0 2023-03-30T08:10:33.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f8293fff700 1 --2- 172.21.15.115:0/905031074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f829c0cf9c0 0x7f829c06d660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f829c0b1c90 tx=0x7f8284009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=584be70c5d2d9048 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:33.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f8299d9b700 1 -- 172.21.15.115:0/905031074 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400b8a0 con 0x7f829c0cf9c0 2023-03-30T08:10:33.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f8299d9b700 1 -- 172.21.15.115:0/905031074 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828400ba00 con 0x7f829c0cf9c0 2023-03-30T08:10:33.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.527+0000 7f8299d9b700 1 -- 172.21.15.115:0/905031074 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400bd90 con 0x7f829c0cf9c0 2023-03-30T08:10:33.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.531+0000 7f829b59e700 1 -- 172.21.15.115:0/905031074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f829c0cf9c0 msgr2=0x7f829c06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.531+0000 7f829b59e700 1 --2- 172.21.15.115:0/905031074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f829c0cf9c0 0x7f829c06d660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f829c0b1c90 tx=0x7f8284009bf0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.531+0000 7f829b59e700 1 -- 172.21.15.115:0/905031074 shutdown_connections 2023-03-30T08:10:33.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.531+0000 7f829b59e700 1 --2- 172.21.15.115:0/905031074 >> v2:172.21.15.87:3300/0 conn(0x7f829c071290 0x7f829c1601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.536 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.531+0000 7f829b59e700 1 --2- 172.21.15.115:0/905031074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f829c0cf9c0 0x7f829c06d660 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.531+0000 7f829b59e700 1 -- 172.21.15.115:0/905031074 >> 172.21.15.115:0/905031074 conn(0x7f829c0cc7b0 msgr2=0x7f829c0cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:33.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.531+0000 7f829b59e700 1 -- 172.21.15.115:0/905031074 shutdown_connections 2023-03-30T08:10:33.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.531+0000 7f829b59e700 1 -- 172.21.15.115:0/905031074 wait complete. 2023-03-30T08:10:33.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.531+0000 7f829b59e700 1 Processor -- start 2023-03-30T08:10:33.537 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.531+0000 7f829b59e700 1 -- start start 2023-03-30T08:10:33.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829b59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f829c071290 0x7f829c1520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829b59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f829c0cf9c0 0x7f829c0c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829c15c5d0 0x7f829c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.539 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0ae3a0 con 0x7f829c15c5d0 2023-03-30T08:10:33.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829b59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0ae680 con 0x7f829c071290 2023-03-30T08:10:33.540 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829b59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0c5170 con 0x7f829c0cf9c0 2023-03-30T08:10:33.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f829c071290 0x7f829c1520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f829c071290 0x7f829c1520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56858/0 (socket says 172.21.15.115:56858) 2023-03-30T08:10:33.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829a59c700 1 -- 172.21.15.115:0/3147865412 learned_addr learned my addr 172.21.15.115:0/3147865412 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-03-30T08:10:33.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f8293fff700 1 --2- 172.21.15.115:0/3147865412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f829c0cf9c0 0x7f829c0c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.541 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829ad9d700 1 --2- 172.21.15.115:0/3147865412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829c15c5d0 0x7f829c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829a59c700 1 -- 172.21.15.115:0/3147865412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f829c0cf9c0 msgr2=0x7f829c0c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829a59c700 1 --2- 172.21.15.115:0/3147865412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f829c0cf9c0 0x7f829c0c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829a59c700 1 -- 172.21.15.115:0/3147865412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829c15c5d0 msgr2=0x7f829c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829a59c700 1 --2- 172.21.15.115:0/3147865412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829c15c5d0 0x7f829c0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829a59c700 1 -- 172.21.15.115:0/3147865412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8284009570 con 0x7f829c071290 2023-03-30T08:10:33.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829a59c700 1 --2- 172.21.15.115:0/3147865412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f829c071290 0x7f829c1520e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f828c00c500 tx=0x7f828c00c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:33.542 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f8292ffd700 1 -- 172.21.15.115:0/3147865412 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0052d0 con 0x7f829c071290 2023-03-30T08:10:33.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f8292ffd700 1 -- 172.21.15.115:0/3147865412 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c005430 con 0x7f829c071290 2023-03-30T08:10:33.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829b59e700 1 -- 172.21.15.115:0/3147865412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c15c9a0 con 0x7f829c071290 2023-03-30T08:10:33.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f8292ffd700 1 -- 172.21.15.115:0/3147865412 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0055a0 con 0x7f829c071290 2023-03-30T08:10:33.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f829b59e700 1 -- 172.21.15.115:0/3147865412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c071d00 con 0x7f829c071290 2023-03-30T08:10:33.543 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f8292ffd700 1 -- 172.21.15.115:0/3147865412 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f828c003be0 con 0x7f829c071290 2023-03-30T08:10:33.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.535+0000 7f8292ffd700 1 -- 172.21.15.115:0/3147865412 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f828c011d10 con 0x7f829c071290 2023-03-30T08:10:33.544 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.539+0000 7f829b59e700 1 -- 172.21.15.115:0/3147865412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829c0ceb70 con 0x7f829c071290 2023-03-30T08:10:33.547 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.543+0000 7f8292ffd700 1 -- 172.21.15.115:0/3147865412 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f828c017070 con 0x7f829c071290 2023-03-30T08:10:33.624 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.619+0000 7f829b59e700 1 -- 172.21.15.115:0/3147865412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6", "id": 2} v 0) v1 -- 0x7f829c072cf0 con 0x7f829c071290 2023-03-30T08:10:33.636 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.631+0000 7f8292ffd700 1 -- 172.21.15.115:0/3147865412 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f828c011590 con 0x7f829c071290 2023-03-30T08:10:33.636 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-03-30T08:10:33.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.631+0000 7f829b59e700 1 -- 172.21.15.115:0/3147865412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f829c071290 msgr2=0x7f829c1520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.631+0000 7f829b59e700 1 --2- 172.21.15.115:0/3147865412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f829c071290 0x7f829c1520e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f828c00c500 tx=0x7f828c00c810 comp rx=0 tx=0).stop 2023-03-30T08:10:33.637 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.631+0000 7f829b59e700 1 -- 172.21.15.115:0/3147865412 shutdown_connections 2023-03-30T08:10:33.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.631+0000 7f829b59e700 1 --2- 172.21.15.115:0/3147865412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829c15c5d0 0x7f829c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.631+0000 7f829b59e700 1 --2- 172.21.15.115:0/3147865412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f829c0cf9c0 0x7f829c0c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.631+0000 7f829b59e700 1 --2- 172.21.15.115:0/3147865412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f829c071290 0x7f829c1520e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.631+0000 7f829b59e700 1 -- 172.21.15.115:0/3147865412 >> 172.21.15.115:0/3147865412 conn(0x7f829c0cc7b0 msgr2=0x7f829c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:33.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.631+0000 7f829b59e700 1 -- 172.21.15.115:0/3147865412 shutdown_connections 2023-03-30T08:10:33.638 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.631+0000 7f829b59e700 1 -- 172.21.15.115:0/3147865412 wait complete. 2023-03-30T08:10:33.648 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:33.645+0000 7f4b7275a2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-30T08:10:33.658 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 63d8c669-4920-4af1-a5a3-d770d0127a1a 3 2023-03-30T08:10:33.686 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:33.679+0000 7f7d1c3662c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-30T08:10:33.717 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:33.713+0000 7f4b7275a2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-30T08:10:33.756 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:33.751+0000 7f7d1c3662c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-30T08:10:33.833 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.827+0000 7f81afc62700 1 Processor -- start 2023-03-30T08:10:33.834 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.827+0000 7f81afc62700 1 -- start start 2023-03-30T08:10:33.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81afc62700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a80b3f30 0x7f81a80b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81afc62700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f81a80af350 0x7f81a806c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81afc62700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a806b670 con 0x7f81a806a6e0 2023-03-30T08:10:33.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81afc62700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a806b0b0 con 0x7f81a80af350 2023-03-30T08:10:33.836 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81afc62700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a806b390 con 0x7f81a80b3f30 2023-03-30T08:10:33.837 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81ad1fd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f81a806a6e0 0x7f81a80aec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36248/0 (socket says 172.21.15.115:36248) 2023-03-30T08:10:33.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81ad1fd700 1 -- 172.21.15.115:0/631498508 learned_addr learned my addr 172.21.15.115:0/631498508 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-03-30T08:10:33.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81ad9fe700 1 --2- 172.21.15.115:0/631498508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a80b3f30 0x7f81a80b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81ae1ff700 1 --2- 172.21.15.115:0/631498508 >> v2:172.21.15.87:3300/0 conn(0x7f81a80af350 0x7f81a806c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.838 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81ac9fc700 1 -- 172.21.15.115:0/631498508 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330774361 0 0) 0x7f81a806b670 con 0x7f81a806a6e0 2023-03-30T08:10:33.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81ac9fc700 1 -- 172.21.15.115:0/631498508 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81940035d0 con 0x7f81a806a6e0 2023-03-30T08:10:33.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81ad9fe700 1 -- 172.21.15.115:0/631498508 >> v2:172.21.15.87:3300/0 conn(0x7f81a80af350 msgr2=0x7f81a806c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:33.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81ad9fe700 1 --2- 172.21.15.115:0/631498508 >> v2:172.21.15.87:3300/0 conn(0x7f81a80af350 0x7f81a806c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81ad9fe700 1 -- 172.21.15.115:0/631498508 >> v1:172.21.15.115:6789/0 conn(0x7f81a806a6e0 legacy=0x7f81a80aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.840 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81ad9fe700 1 -- 172.21.15.115:0/631498508 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a80aded0 con 0x7f81a80b3f30 2023-03-30T08:10:33.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.831+0000 7f81ad9fe700 1 --2- 172.21.15.115:0/631498508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a80b3f30 0x7f81a80b0c10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009850 tx=0x7f81a4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=601e3713beec90f9 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:33.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.835+0000 7f81ac9fc700 1 -- 172.21.15.115:0/631498508 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4011830 con 0x7f81a80b3f30 2023-03-30T08:10:33.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.835+0000 7f81ac9fc700 1 -- 172.21.15.115:0/631498508 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a4011990 con 0x7f81a80b3f30 2023-03-30T08:10:33.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.835+0000 7f81ac9fc700 1 -- 172.21.15.115:0/631498508 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4011d40 con 0x7f81a80b3f30 2023-03-30T08:10:33.842 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.835+0000 7f81afc62700 1 -- 172.21.15.115:0/631498508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a80b3f30 msgr2=0x7f81a80b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.835+0000 7f81afc62700 1 --2- 172.21.15.115:0/631498508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a80b3f30 0x7f81a80b0c10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009850 tx=0x7f81a4009b60 comp rx=0 tx=0).stop 2023-03-30T08:10:33.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.835+0000 7f81afc62700 1 -- 172.21.15.115:0/631498508 shutdown_connections 2023-03-30T08:10:33.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.835+0000 7f81afc62700 1 --2- 172.21.15.115:0/631498508 >> v2:172.21.15.87:3300/0 conn(0x7f81a80af350 0x7f81a806c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.835+0000 7f81afc62700 1 --2- 172.21.15.115:0/631498508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a80b3f30 0x7f81a80b0c10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.835+0000 7f81afc62700 1 -- 172.21.15.115:0/631498508 >> 172.21.15.115:0/631498508 conn(0x7f81a80cf410 msgr2=0x7f81a80cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:33.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.835+0000 7f81afc62700 1 -- 172.21.15.115:0/631498508 shutdown_connections 2023-03-30T08:10:33.844 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.835+0000 7f81afc62700 1 -- 172.21.15.115:0/631498508 wait complete. 2023-03-30T08:10:33.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81afc62700 1 Processor -- start 2023-03-30T08:10:33.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81afc62700 1 -- start start 2023-03-30T08:10:33.845 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81afc62700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81a806a6e0 0x7f81a81561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81afc62700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81a80af350 0x7f81a80c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81afc62700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a80b3f30 0x7f81a81f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81afc62700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a815c160 con 0x7f81a80af350 2023-03-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81afc62700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a815c580 con 0x7f81a806a6e0 2023-03-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81afc62700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a815b4e0 con 0x7f81a80b3f30 2023-03-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81ae1ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a80b3f30 0x7f81a81f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81ae1ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a80b3f30 0x7f81a81f60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:47906/0 (socket says 172.21.15.115:47906) 2023-03-30T08:10:33.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81ae1ff700 1 -- 172.21.15.115:0/100866346 learned_addr learned my addr 172.21.15.115:0/100866346 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-03-30T08:10:33.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81ad9fe700 1 --2- 172.21.15.115:0/100866346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81a806a6e0 0x7f81a81561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81ae1ff700 1 -- 172.21.15.115:0/100866346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81a806a6e0 msgr2=0x7f81a81561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81ad1fd700 1 --2- 172.21.15.115:0/100866346 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81a80af350 0x7f81a80c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:33.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81ae1ff700 1 --2- 172.21.15.115:0/100866346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81a806a6e0 0x7f81a81561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81ae1ff700 1 -- 172.21.15.115:0/100866346 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81a80af350 msgr2=0x7f81a80c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81ae1ff700 1 --2- 172.21.15.115:0/100866346 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81a80af350 0x7f81a80c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.848 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81ae1ff700 1 -- 172.21.15.115:0/100866346 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a40094b0 con 0x7f81a80b3f30 2023-03-30T08:10:33.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81ad9fe700 1 --2- 172.21.15.115:0/100866346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81a806a6e0 0x7f81a81561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:10:33.849 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81ad1fd700 1 --2- 172.21.15.115:0/100866346 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81a80af350 0x7f81a80c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:10:33.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81ae1ff700 1 --2- 172.21.15.115:0/100866346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a80b3f30 0x7f81a81f60b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f81a000efc0 tx=0x7f81a000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:33.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f819e7fc700 1 -- 172.21.15.115:0/100866346 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0009ba0 con 0x7f81a80b3f30 2023-03-30T08:10:33.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f819e7fc700 1 -- 172.21.15.115:0/100866346 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a000f040 con 0x7f81a80b3f30 2023-03-30T08:10:33.851 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.839+0000 7f81afc62700 1 -- 172.21.15.115:0/100866346 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a80b4300 con 0x7f81a80b3f30 2023-03-30T08:10:33.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.843+0000 7f819e7fc700 1 -- 172.21.15.115:0/100866346 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0014480 con 0x7f81a80b3f30 2023-03-30T08:10:33.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.843+0000 7f81afc62700 1 -- 172.21.15.115:0/100866346 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a80ae1b0 con 0x7f81a80b3f30 2023-03-30T08:10:33.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.843+0000 7f819e7fc700 1 -- 172.21.15.115:0/100866346 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f81a00148e0 con 0x7f81a80b3f30 2023-03-30T08:10:33.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.843+0000 7f819e7fc700 1 -- 172.21.15.115:0/100866346 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f81a0013870 con 0x7f81a80b3f30 2023-03-30T08:10:33.852 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.843+0000 7f81afc62700 1 -- 172.21.15.115:0/100866346 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a806ab30 con 0x7f81a80b3f30 2023-03-30T08:10:33.853 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.847+0000 7f819e7fc700 1 -- 172.21.15.115:0/100866346 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f81a0018020 con 0x7f81a80b3f30 2023-03-30T08:10:33.939 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:33.937+0000 7f4b7275a2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-30T08:10:33.977 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.971+0000 7f81afc62700 1 -- 172.21.15.115:0/100866346 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "63d8c669-4920-4af1-a5a3-d770d0127a1a", "id": 3} v 0) v1 -- 0x7f81a815c2a0 con 0x7f81a80b3f30 2023-03-30T08:10:33.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.983+0000 7f819e7fc700 1 -- 172.21.15.115:0/100866346 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "63d8c669-4920-4af1-a5a3-d770d0127a1a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f81a815c2a0 con 0x7f81a80b3f30 2023-03-30T08:10:33.989 INFO:teuthology.orchestra.run.smithi115.stdout:3 2023-03-30T08:10:33.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.983+0000 7f81afc62700 1 -- 172.21.15.115:0/100866346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a80b3f30 msgr2=0x7f81a81f60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:33.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.983+0000 7f81afc62700 1 --2- 172.21.15.115:0/100866346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a80b3f30 0x7f81a81f60b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f81a000efc0 tx=0x7f81a000c3a0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.987+0000 7f81afc62700 1 -- 172.21.15.115:0/100866346 shutdown_connections 2023-03-30T08:10:33.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.987+0000 7f81afc62700 1 --2- 172.21.15.115:0/100866346 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f81a80b3f30 0x7f81a81f60b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.987+0000 7f81afc62700 1 --2- 172.21.15.115:0/100866346 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81a80af350 0x7f81a80c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.987+0000 7f81afc62700 1 --2- 172.21.15.115:0/100866346 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81a806a6e0 0x7f81a81561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:33.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.987+0000 7f81afc62700 1 -- 172.21.15.115:0/100866346 >> 172.21.15.115:0/100866346 conn(0x7f81a80cf410 msgr2=0x7f81a81575e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:33.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.987+0000 7f81afc62700 1 -- 172.21.15.115:0/100866346 shutdown_connections 2023-03-30T08:10:33.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:33.987+0000 7f81afc62700 1 -- 172.21.15.115:0/100866346 wait complete. 2023-03-30T08:10:34.007 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 03113f49-ad8c-4918-8126-7aa02cc000c4 4 2023-03-30T08:10:34.014 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:34.011+0000 7f7d1c3662c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-30T08:10:34.017 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:34.013+0000 7f4b7275a2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-30T08:10:34.094 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:34.087+0000 7f7d1c3662c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-30T08:10:34.104 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:34.101+0000 7f4b7275a2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-30T08:10:34.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc694f10700 1 Processor -- start 2023-03-30T08:10:34.150 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc694f10700 1 -- start start 2023-03-30T08:10:34.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc694f10700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc6900ad640 0x7fc6900abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.151 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc694f10700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69006a0e0 con 0x7fc6901600d0 2023-03-30T08:10:34.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc694f10700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900c9db0 con 0x7fc6900ac520 2023-03-30T08:10:34.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc694f10700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6900ca090 con 0x7fc6900ad640 2023-03-30T08:10:34.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc6900ac520 0x7fc6901604a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36262/0 (socket says 172.21.15.115:36262) 2023-03-30T08:10:34.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68ffff700 1 -- 172.21.15.115:0/2069544994 learned_addr learned my addr 172.21.15.115:0/2069544994 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-03-30T08:10:34.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68effd700 1 --2- 172.21.15.115:0/2069544994 >> v2:172.21.15.87:3300/0 conn(0x7fc6900ad640 0x7fc6900abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68e7fc700 1 -- 172.21.15.115:0/2069544994 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454075822 0 0) 0x7fc6900c9db0 con 0x7fc6900ac520 2023-03-30T08:10:34.153 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68e7fc700 1 -- 172.21.15.115:0/2069544994 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6700035d0 con 0x7fc6900ac520 2023-03-30T08:10:34.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68e7fc700 1 -- 172.21.15.115:0/2069544994 <== mon.1 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1527769444 0 0) 0x7fc6700035d0 con 0x7fc6900ac520 2023-03-30T08:10:34.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68e7fc700 1 -- 172.21.15.115:0/2069544994 >> v2:172.21.15.87:3300/0 conn(0x7fc6900ad640 msgr2=0x7fc6900abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:34.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68e7fc700 1 --2- 172.21.15.115:0/2069544994 >> v2:172.21.15.87:3300/0 conn(0x7fc6900ad640 0x7fc6900abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68e7fc700 1 -- 172.21.15.115:0/2069544994 >> v1:172.21.15.87:6789/0 conn(0x7fc6901600d0 legacy=0x7fc69006a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68e7fc700 1 -- 172.21.15.115:0/2069544994 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc690069d70 con 0x7fc6900ac520 2023-03-30T08:10:34.155 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68e7fc700 1 -- 172.21.15.115:0/2069544994 <== mon.1 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7fc688001670 con 0x7fc6900ac520 2023-03-30T08:10:34.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68e7fc700 1 -- 172.21.15.115:0/2069544994 >> v1:172.21.15.115:6789/0 conn(0x7fc6900ac520 legacy=0x7fc6901604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68e7fc700 1 --2- 172.21.15.115:0/2069544994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc670003a20 0x7fc670003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68e7fc700 1 --2- 172.21.15.115:0/2069544994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc670004870 0x7fc670004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68e7fc700 1 --2- 172.21.15.115:0/2069544994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc670005220 0x7fc67000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68e7fc700 1 -- 172.21.15.115:0/2069544994 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900ca090 con 0x7fc670003a20 2023-03-30T08:10:34.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68e7fc700 1 -- 172.21.15.115:0/2069544994 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67000c080 con 0x7fc670005220 2023-03-30T08:10:34.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68e7fc700 1 -- 172.21.15.115:0/2069544994 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67000c240 con 0x7fc670004870 2023-03-30T08:10:34.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68ffff700 1 --2- 172.21.15.115:0/2069544994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc670005220 0x7fc67000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68effd700 1 --2- 172.21.15.115:0/2069544994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc670004870 0x7fc670004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.147+0000 7fc68f7fe700 1 --2- 172.21.15.115:0/2069544994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc670003a20 0x7fc670003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc68ffff700 1 -- 172.21.15.115:0/2069544994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc670004870 msgr2=0x7fc670004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:34.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc68ffff700 1 --2- 172.21.15.115:0/2069544994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc670004870 0x7fc670004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc68ffff700 1 -- 172.21.15.115:0/2069544994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc670003a20 msgr2=0x7fc670003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:34.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc68ffff700 1 --2- 172.21.15.115:0/2069544994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc670003a20 0x7fc670003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.157 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc68ffff700 1 -- 172.21.15.115:0/2069544994 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6700035d0 con 0x7fc670005220 2023-03-30T08:10:34.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc68f7fe700 1 --2- 172.21.15.115:0/2069544994 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc670003a20 0x7fc670003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:10:34.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc68ffff700 1 -- 172.21.15.115:0/2069544994 reap_dead start 2023-03-30T08:10:34.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc68ffff700 1 --2- 172.21.15.115:0/2069544994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc670005220 0x7fc67000ba30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc68800c320 tx=0x7fc6700058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f24f7f61b92dc304 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:34.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc68e7fc700 1 -- 172.21.15.115:0/2069544994 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688007c30 con 0x7fc670005220 2023-03-30T08:10:34.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc68e7fc700 1 -- 172.21.15.115:0/2069544994 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68800ce80 con 0x7fc670005220 2023-03-30T08:10:34.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc68e7fc700 1 -- 172.21.15.115:0/2069544994 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688005bc0 con 0x7fc670005220 2023-03-30T08:10:34.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc694f10700 1 -- 172.21.15.115:0/2069544994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc670005220 msgr2=0x7fc67000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc694f10700 1 --2- 172.21.15.115:0/2069544994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc670005220 0x7fc67000ba30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc68800c320 tx=0x7fc6700058a0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.160 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc694f10700 1 -- 172.21.15.115:0/2069544994 shutdown_connections 2023-03-30T08:10:34.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc694f10700 1 --2- 172.21.15.115:0/2069544994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc670005220 0x7fc67000ba30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc694f10700 1 -- 172.21.15.115:0/2069544994 >> 172.21.15.115:0/2069544994 conn(0x7fc6900cf410 msgr2=0x7fc6900cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:34.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc694f10700 1 -- 172.21.15.115:0/2069544994 shutdown_connections 2023-03-30T08:10:34.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc694f10700 1 -- 172.21.15.115:0/2069544994 wait complete. 2023-03-30T08:10:34.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc694f10700 1 Processor -- start 2023-03-30T08:10:34.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.151+0000 7fc694f10700 1 -- start start 2023-03-30T08:10:34.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc694f10700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc670005220 0x7fc6901f1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.161 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc694f10700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc69014c930 0x7fc6901f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc694f10700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6901f1cf0 0x7fc69015e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc694f10700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69014ce80 con 0x7fc670005220 2023-03-30T08:10:34.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc694f10700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900b07e0 con 0x7fc69014c930 2023-03-30T08:10:34.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc694f10700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900c87b0 con 0x7fc6901f1cf0 2023-03-30T08:10:34.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc68effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc69014c930 0x7fc6901f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc68effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc69014c930 0x7fc6901f17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56888/0 (socket says 172.21.15.115:56888) 2023-03-30T08:10:34.162 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc68effd700 1 -- 172.21.15.115:0/1501629780 learned_addr learned my addr 172.21.15.115:0/1501629780 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-03-30T08:10:34.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc68ffff700 1 --2- 172.21.15.115:0/1501629780 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6901f1cf0 0x7fc69015e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc68effd700 1 -- 172.21.15.115:0/1501629780 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6901f1cf0 msgr2=0x7fc69015e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc68f7fe700 1 --2- 172.21.15.115:0/1501629780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc670005220 0x7fc6901f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc68effd700 1 --2- 172.21.15.115:0/1501629780 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6901f1cf0 0x7fc69015e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc68effd700 1 -- 172.21.15.115:0/1501629780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc670005220 msgr2=0x7fc6901f1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc68effd700 1 --2- 172.21.15.115:0/1501629780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc670005220 0x7fc6901f1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc68effd700 1 -- 172.21.15.115:0/1501629780 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6900ac980 con 0x7fc69014c930 2023-03-30T08:10:34.163 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc68f7fe700 1 --2- 172.21.15.115:0/1501629780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc670005220 0x7fc6901f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:10:34.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc68effd700 1 --2- 172.21.15.115:0/1501629780 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc69014c930 0x7fc6901f17b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc6780108f0 tx=0x7fc678010cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:34.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc687fff700 1 -- 172.21.15.115:0/1501629780 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678010e90 con 0x7fc69014c930 2023-03-30T08:10:34.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc687fff700 1 -- 172.21.15.115:0/1501629780 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67800e8d0 con 0x7fc69014c930 2023-03-30T08:10:34.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc694f10700 1 -- 172.21.15.115:0/1501629780 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6900ca370 con 0x7fc69014c930 2023-03-30T08:10:34.164 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc687fff700 1 -- 172.21.15.115:0/1501629780 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67800ec40 con 0x7fc69014c930 2023-03-30T08:10:34.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc694f10700 1 -- 172.21.15.115:0/1501629780 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6900addc0 con 0x7fc69014c930 2023-03-30T08:10:34.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc687fff700 1 -- 172.21.15.115:0/1501629780 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc678005d40 con 0x7fc69014c930 2023-03-30T08:10:34.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.155+0000 7fc687fff700 1 -- 172.21.15.115:0/1501629780 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc678006840 con 0x7fc69014c930 2023-03-30T08:10:34.165 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.159+0000 7fc694f10700 1 -- 172.21.15.115:0/1501629780 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6901f20f0 con 0x7fc69014c930 2023-03-30T08:10:34.166 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.159+0000 7fc687fff700 1 -- 172.21.15.115:0/1501629780 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fc678024060 con 0x7fc69014c930 2023-03-30T08:10:34.179 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:34.175+0000 7f7d1c3662c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-30T08:10:34.244 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.239+0000 7fc694f10700 1 -- 172.21.15.115:0/1501629780 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "03113f49-ad8c-4918-8126-7aa02cc000c4", "id": 4} v 0) v1 -- 0x7fc6900733a0 con 0x7fc69014c930 2023-03-30T08:10:34.254 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.251+0000 7fc687fff700 1 -- 172.21.15.115:0/1501629780 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "03113f49-ad8c-4918-8126-7aa02cc000c4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc67801a070 con 0x7fc69014c930 2023-03-30T08:10:34.255 INFO:teuthology.orchestra.run.smithi115.stdout:4 2023-03-30T08:10:34.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.251+0000 7fc694f10700 1 -- 172.21.15.115:0/1501629780 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc69014c930 msgr2=0x7fc6901f17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.251+0000 7fc694f10700 1 --2- 172.21.15.115:0/1501629780 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc69014c930 0x7fc6901f17b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc6780108f0 tx=0x7fc678010cb0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.251+0000 7fc694f10700 1 -- 172.21.15.115:0/1501629780 shutdown_connections 2023-03-30T08:10:34.256 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.251+0000 7fc694f10700 1 --2- 172.21.15.115:0/1501629780 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6901f1cf0 0x7fc69015e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.251+0000 7fc694f10700 1 --2- 172.21.15.115:0/1501629780 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc69014c930 0x7fc6901f17b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.251+0000 7fc694f10700 1 --2- 172.21.15.115:0/1501629780 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc670005220 0x7fc6901f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.251+0000 7fc694f10700 1 -- 172.21.15.115:0/1501629780 >> 172.21.15.115:0/1501629780 conn(0x7fc6900cf410 msgr2=0x7fc6900cc330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:34.257 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.251+0000 7fc694f10700 1 -- 172.21.15.115:0/1501629780 shutdown_connections 2023-03-30T08:10:34.258 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.251+0000 7fc694f10700 1 -- 172.21.15.115:0/1501629780 wait complete. 2023-03-30T08:10:34.276 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new bec65318-4382-41ca-9166-283b1a2eed45 5 2023-03-30T08:10:34.468 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.462+0000 7f0b767a8700 1 Processor -- start 2023-03-30T08:10:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.462+0000 7f0b767a8700 1 -- start start 2023-03-30T08:10:34.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b767a8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b700d27e0 0x7f0b700d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b767a8700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0b7006a3e0 0x7f0b700d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.471 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b767a8700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b70160ef0 con 0x7f0b700b8380 2023-03-30T08:10:34.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b767a8700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b700cd6a0 con 0x7f0b7006a3e0 2023-03-30T08:10:34.472 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b767a8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b700cd3a0 con 0x7f0b700d27e0 2023-03-30T08:10:34.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b74fa5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b700d27e0 0x7f0b700d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b74fa5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b700d27e0 0x7f0b700d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:47940/0 (socket says 172.21.15.115:47940) 2023-03-30T08:10:34.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b74fa5700 1 -- 172.21.15.115:0/3170761855 learned_addr learned my addr 172.21.15.115:0/3170761855 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-03-30T08:10:34.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b75fa7700 1 --2- 172.21.15.115:0/3170761855 >> v2:172.21.15.87:3300/0 conn(0x7f0b7006a3e0 0x7f0b700d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b74fa5700 1 -- 172.21.15.115:0/3170761855 >> v2:172.21.15.87:3300/0 conn(0x7f0b7006a3e0 msgr2=0x7f0b700d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:34.473 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b74fa5700 1 --2- 172.21.15.115:0/3170761855 >> v2:172.21.15.87:3300/0 conn(0x7f0b7006a3e0 0x7f0b700d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b74fa5700 1 -- 172.21.15.115:0/3170761855 >> v1:172.21.15.87:6789/0 conn(0x7f0b700b8380 legacy=0x7f0b70069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b74fa5700 1 -- 172.21.15.115:0/3170761855 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b700cef00 con 0x7f0b700d27e0 2023-03-30T08:10:34.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b75fa7700 1 --2- 172.21.15.115:0/3170761855 >> v2:172.21.15.87:3300/0 conn(0x7f0b7006a3e0 0x7f0b700d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:10:34.474 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b74fa5700 1 --2- 172.21.15.115:0/3170761855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b700d27e0 0x7f0b700d2200 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009910 tx=0x7f0b60009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94068cc8a3f1aed6 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:34.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b67fff700 1 -- 172.21.15.115:0/3170761855 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000ba60 con 0x7f0b700d27e0 2023-03-30T08:10:34.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b67fff700 1 -- 172.21.15.115:0/3170761855 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6000bbc0 con 0x7f0b700d27e0 2023-03-30T08:10:34.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.466+0000 7f0b67fff700 1 -- 172.21.15.115:0/3170761855 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60009e60 con 0x7f0b700d27e0 2023-03-30T08:10:34.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.470+0000 7f0b767a8700 1 -- 172.21.15.115:0/3170761855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b700d27e0 msgr2=0x7f0b700d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.475 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.470+0000 7f0b767a8700 1 --2- 172.21.15.115:0/3170761855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b700d27e0 0x7f0b700d2200 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009910 tx=0x7f0b60009c20 comp rx=0 tx=0).stop 2023-03-30T08:10:34.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.470+0000 7f0b767a8700 1 -- 172.21.15.115:0/3170761855 shutdown_connections 2023-03-30T08:10:34.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.470+0000 7f0b767a8700 1 --2- 172.21.15.115:0/3170761855 >> v2:172.21.15.87:3300/0 conn(0x7f0b7006a3e0 0x7f0b700d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.470+0000 7f0b767a8700 1 --2- 172.21.15.115:0/3170761855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b700d27e0 0x7f0b700d2200 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.470+0000 7f0b767a8700 1 -- 172.21.15.115:0/3170761855 >> 172.21.15.115:0/3170761855 conn(0x7f0b700b53f0 msgr2=0x7f0b700cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:34.476 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.470+0000 7f0b767a8700 1 -- 172.21.15.115:0/3170761855 shutdown_connections 2023-03-30T08:10:34.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.470+0000 7f0b767a8700 1 -- 172.21.15.115:0/3170761855 wait complete. 2023-03-30T08:10:34.477 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.470+0000 7f0b767a8700 1 Processor -- start 2023-03-30T08:10:34.478 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.470+0000 7f0b767a8700 1 -- start start 2023-03-30T08:10:34.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b767a8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b7006a3e0 0x7f0b700c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.479 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b767a8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b700b8380 0x7f0b700c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b767a8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b700c8dc0 0x7f0b70150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.480 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b767a8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b701574f0 con 0x7f0b700c8dc0 2023-03-30T08:10:34.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b767a8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7015cae0 con 0x7f0b700b8380 2023-03-30T08:10:34.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b767a8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b700c9560 con 0x7f0b7006a3e0 2023-03-30T08:10:34.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b74fa5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b700b8380 0x7f0b700c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b74fa5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b700b8380 0x7f0b700c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56902/0 (socket says 172.21.15.115:56902) 2023-03-30T08:10:34.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b74fa5700 1 -- 172.21.15.115:0/1682836175 learned_addr learned my addr 172.21.15.115:0/1682836175 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-03-30T08:10:34.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b757a6700 1 --2- 172.21.15.115:0/1682836175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b7006a3e0 0x7f0b700c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.481 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b75fa7700 1 --2- 172.21.15.115:0/1682836175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b700c8dc0 0x7f0b70150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b74fa5700 1 -- 172.21.15.115:0/1682836175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b7006a3e0 msgr2=0x7f0b700c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.482 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b74fa5700 1 --2- 172.21.15.115:0/1682836175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b7006a3e0 0x7f0b700c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b74fa5700 1 -- 172.21.15.115:0/1682836175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b700c8dc0 msgr2=0x7f0b70150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b74fa5700 1 --2- 172.21.15.115:0/1682836175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b700c8dc0 0x7f0b70150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b74fa5700 1 -- 172.21.15.115:0/1682836175 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60009570 con 0x7f0b700b8380 2023-03-30T08:10:34.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b75fa7700 1 --2- 172.21.15.115:0/1682836175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b700c8dc0 0x7f0b70150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:10:34.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b74fa5700 1 --2- 172.21.15.115:0/1682836175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b700b8380 0x7f0b700c8880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0b60014040 tx=0x7f0b60004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:34.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b65ffb700 1 -- 172.21.15.115:0/1682836175 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60004500 con 0x7f0b700b8380 2023-03-30T08:10:34.483 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b65ffb700 1 -- 172.21.15.115:0/1682836175 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b600036c0 con 0x7f0b700b8380 2023-03-30T08:10:34.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b767a8700 1 -- 172.21.15.115:0/1682836175 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b700cf480 con 0x7f0b700b8380 2023-03-30T08:10:34.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b65ffb700 1 -- 172.21.15.115:0/1682836175 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60003a70 con 0x7f0b700b8380 2023-03-30T08:10:34.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.474+0000 7f0b767a8700 1 -- 172.21.15.115:0/1682836175 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b700cf1a0 con 0x7f0b700b8380 2023-03-30T08:10:34.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.478+0000 7f0b65ffb700 1 -- 172.21.15.115:0/1682836175 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0b60012530 con 0x7f0b700b8380 2023-03-30T08:10:34.484 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.478+0000 7f0b65ffb700 1 -- 172.21.15.115:0/1682836175 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f0b60012d60 con 0x7f0b700b8380 2023-03-30T08:10:34.485 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.478+0000 7f0b767a8700 1 -- 172.21.15.115:0/1682836175 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b700b8750 con 0x7f0b700b8380 2023-03-30T08:10:34.488 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.482+0000 7f0b65ffb700 1 -- 172.21.15.115:0/1682836175 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f0b60020070 con 0x7f0b700b8380 2023-03-30T08:10:34.565 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.558+0000 7f0b767a8700 1 -- 172.21.15.115:0/1682836175 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bec65318-4382-41ca-9166-283b1a2eed45", "id": 5} v 0) v1 -- 0x7f0b70072cf0 con 0x7f0b700b8380 2023-03-30T08:10:34.575 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.570+0000 7f0b65ffb700 1 -- 172.21.15.115:0/1682836175 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bec65318-4382-41ca-9166-283b1a2eed45", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0b60015020 con 0x7f0b700b8380 2023-03-30T08:10:34.576 INFO:teuthology.orchestra.run.smithi115.stdout:5 2023-03-30T08:10:34.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.570+0000 7f0b767a8700 1 -- 172.21.15.115:0/1682836175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b700b8380 msgr2=0x7f0b700c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.570+0000 7f0b767a8700 1 --2- 172.21.15.115:0/1682836175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b700b8380 0x7f0b700c8880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0b60014040 tx=0x7f0b60004770 comp rx=0 tx=0).stop 2023-03-30T08:10:34.577 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.570+0000 7f0b767a8700 1 -- 172.21.15.115:0/1682836175 shutdown_connections 2023-03-30T08:10:34.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.570+0000 7f0b767a8700 1 --2- 172.21.15.115:0/1682836175 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b700c8dc0 0x7f0b70150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.570+0000 7f0b767a8700 1 --2- 172.21.15.115:0/1682836175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b700b8380 0x7f0b700c8880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.570+0000 7f0b767a8700 1 --2- 172.21.15.115:0/1682836175 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b7006a3e0 0x7f0b700c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.570+0000 7f0b767a8700 1 -- 172.21.15.115:0/1682836175 >> 172.21.15.115:0/1682836175 conn(0x7f0b700b53f0 msgr2=0x7f0b700b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:34.578 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.570+0000 7f0b767a8700 1 -- 172.21.15.115:0/1682836175 shutdown_connections 2023-03-30T08:10:34.579 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.570+0000 7f0b767a8700 1 -- 172.21.15.115:0/1682836175 wait complete. 2023-03-30T08:10:34.583 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:34.581+0000 7f4b7275a2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-30T08:10:34.595 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 15e69056-187e-42c4-9812-7afef76b243f 6 2023-03-30T08:10:34.651 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:34.646+0000 7f7d1c3662c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-30T08:10:34.748 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:34.745+0000 7f4b7275a2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-30T08:10:34.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.746+0000 7f4e3ab01700 1 Processor -- start 2023-03-30T08:10:34.751 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.746+0000 7f4e3ab01700 1 -- start start 2023-03-30T08:10:34.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.746+0000 7f4e3ab01700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4e340b4e90 0x7f4e340d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.746+0000 7f4e3ab01700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4e340cd7e0 0x7f4e340d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.746+0000 7f4e3ab01700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e340cd350 con 0x7f4e340b8460 2023-03-30T08:10:34.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.746+0000 7f4e3ab01700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e34160f50 con 0x7f4e340b4e90 2023-03-30T08:10:34.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.746+0000 7f4e3ab01700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3406c320 con 0x7f4e340cd7e0 2023-03-30T08:10:34.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.746+0000 7f4e3889d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4e340b8460 0x7f4e340b4780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:36264/0 (socket says 172.21.15.115:36264) 2023-03-30T08:10:34.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.746+0000 7f4e3889d700 1 -- 172.21.15.115:0/2664853151 learned_addr learned my addr 172.21.15.115:0/2664853151 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-03-30T08:10:34.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.746+0000 7f4e3909e700 1 --2- 172.21.15.115:0/2664853151 >> v2:172.21.15.115:3300/0 conn(0x7f4e340cd7e0 0x7f4e340d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e33fff700 1 --2- 172.21.15.115:0/2664853151 >> v2:172.21.15.87:3300/0 conn(0x7f4e340b4e90 0x7f4e340d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e337fe700 1 -- 172.21.15.115:0/2664853151 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629153753 0 0) 0x7f4e340cd350 con 0x7f4e340b8460 2023-03-30T08:10:34.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e337fe700 1 -- 172.21.15.115:0/2664853151 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e240035d0 con 0x7f4e340b8460 2023-03-30T08:10:34.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e337fe700 1 -- 172.21.15.115:0/2664853151 <== mon.1 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1411720862 0 0) 0x7f4e240035d0 con 0x7f4e340b8460 2023-03-30T08:10:34.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e33fff700 1 -- 172.21.15.115:0/2664853151 >> v2:172.21.15.115:3300/0 conn(0x7f4e340cd7e0 msgr2=0x7f4e340d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:34.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e33fff700 1 --2- 172.21.15.115:0/2664853151 >> v2:172.21.15.115:3300/0 conn(0x7f4e340cd7e0 0x7f4e340d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e33fff700 1 -- 172.21.15.115:0/2664853151 >> v1:172.21.15.115:6789/0 conn(0x7f4e340b8460 legacy=0x7f4e340b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.756 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e33fff700 1 -- 172.21.15.115:0/2664853151 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e340b8830 con 0x7f4e340b4e90 2023-03-30T08:10:34.757 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e33fff700 1 --2- 172.21.15.115:0/2664853151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e340b4e90 0x7f4e340d08d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4e3415ca30 tx=0x7f4e20009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3735f414117f85b6 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:34.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e337fe700 1 -- 172.21.15.115:0/2664853151 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28001670 con 0x7f4e340b4e90 2023-03-30T08:10:34.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e337fe700 1 -- 172.21.15.115:0/2664853151 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e20004030 con 0x7f4e340b4e90 2023-03-30T08:10:34.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e337fe700 1 -- 172.21.15.115:0/2664853151 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e200043c0 con 0x7f4e340b4e90 2023-03-30T08:10:34.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e3ab01700 1 -- 172.21.15.115:0/2664853151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e340b4e90 msgr2=0x7f4e340d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e3ab01700 1 --2- 172.21.15.115:0/2664853151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e340b4e90 0x7f4e340d08d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4e3415ca30 tx=0x7f4e20009b30 comp rx=0 tx=0).stop 2023-03-30T08:10:34.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e3ab01700 1 -- 172.21.15.115:0/2664853151 shutdown_connections 2023-03-30T08:10:34.758 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e3ab01700 1 --2- 172.21.15.115:0/2664853151 >> v2:172.21.15.115:3300/0 conn(0x7f4e340cd7e0 0x7f4e340d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e3ab01700 1 --2- 172.21.15.115:0/2664853151 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e340b4e90 0x7f4e340d08d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e3ab01700 1 -- 172.21.15.115:0/2664853151 >> 172.21.15.115:0/2664853151 conn(0x7f4e340cf780 msgr2=0x7f4e340cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:34.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e3ab01700 1 -- 172.21.15.115:0/2664853151 shutdown_connections 2023-03-30T08:10:34.759 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.750+0000 7f4e3ab01700 1 -- 172.21.15.115:0/2664853151 wait complete. 2023-03-30T08:10:34.760 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.754+0000 7f4e3ab01700 1 Processor -- start 2023-03-30T08:10:34.761 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.754+0000 7f4e3ab01700 1 -- start start 2023-03-30T08:10:34.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.754+0000 7f4e3ab01700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e340b4e90 0x7f4e341552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e3ab01700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e340b8460 0x7f4e340c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e3ab01700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e340cd7e0 0x7f4e340c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:34.762 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e3ab01700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e34155800 con 0x7f4e340b4e90 2023-03-30T08:10:34.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e3ab01700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e340c7800 con 0x7f4e340cd7e0 2023-03-30T08:10:34.763 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e3ab01700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e340c6bf0 con 0x7f4e340b8460 2023-03-30T08:10:34.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e33fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e340b8460 0x7f4e340c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.764 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e33fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e340b8460 0x7f4e340c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:47970/0 (socket says 172.21.15.115:47970) 2023-03-30T08:10:34.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e33fff700 1 -- 172.21.15.115:0/2593626199 learned_addr learned my addr 172.21.15.115:0/2593626199 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-03-30T08:10:34.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e3909e700 1 --2- 172.21.15.115:0/2593626199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e340cd7e0 0x7f4e340c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e3889d700 1 --2- 172.21.15.115:0/2593626199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e340b4e90 0x7f4e341552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:34.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e33fff700 1 -- 172.21.15.115:0/2593626199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e340cd7e0 msgr2=0x7f4e340c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e33fff700 1 --2- 172.21.15.115:0/2593626199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e340cd7e0 0x7f4e340c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.765 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e33fff700 1 -- 172.21.15.115:0/2593626199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e340b4e90 msgr2=0x7f4e341552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e33fff700 1 --2- 172.21.15.115:0/2593626199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e340b4e90 0x7f4e341552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e33fff700 1 -- 172.21.15.115:0/2593626199 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e200094b0 con 0x7f4e340b8460 2023-03-30T08:10:34.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e33fff700 1 --2- 172.21.15.115:0/2593626199 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e340b8460 0x7f4e340c7c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4e200090b0 tx=0x7f4e20004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:34.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e317fa700 1 -- 172.21.15.115:0/2593626199 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20003df0 con 0x7f4e340b8460 2023-03-30T08:10:34.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e317fa700 1 -- 172.21.15.115:0/2593626199 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2001f070 con 0x7f4e340b8460 2023-03-30T08:10:34.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e3ab01700 1 -- 172.21.15.115:0/2593626199 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e341609b0 con 0x7f4e340b8460 2023-03-30T08:10:34.766 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e317fa700 1 -- 172.21.15.115:0/2593626199 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20011870 con 0x7f4e340b8460 2023-03-30T08:10:34.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e3ab01700 1 -- 172.21.15.115:0/2593626199 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e340ceeb0 con 0x7f4e340b8460 2023-03-30T08:10:34.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e317fa700 1 -- 172.21.15.115:0/2593626199 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4e20011cd0 con 0x7f4e340b8460 2023-03-30T08:10:34.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e317fa700 1 -- 172.21.15.115:0/2593626199 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4e20021070 con 0x7f4e340b8460 2023-03-30T08:10:34.767 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.758+0000 7f4e3ab01700 1 -- 172.21.15.115:0/2593626199 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e34160c70 con 0x7f4e340b8460 2023-03-30T08:10:34.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.762+0000 7f4e317fa700 1 -- 172.21.15.115:0/2593626199 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f4e2002b020 con 0x7f4e340b8460 2023-03-30T08:10:34.826 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:34.822+0000 7f7d1c3662c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-30T08:10:34.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.842+0000 7f4e3ab01700 1 -- 172.21.15.115:0/2593626199 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "15e69056-187e-42c4-9812-7afef76b243f", "id": 6} v 0) v1 -- 0x7f4e34073ee0 con 0x7f4e340b8460 2023-03-30T08:10:34.857 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.850+0000 7f4e317fa700 1 -- 172.21.15.115:0/2593626199 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15e69056-187e-42c4-9812-7afef76b243f", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4e20026550 con 0x7f4e340b8460 2023-03-30T08:10:34.857 INFO:teuthology.orchestra.run.smithi115.stdout:6 2023-03-30T08:10:34.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.854+0000 7f4e3ab01700 1 -- 172.21.15.115:0/2593626199 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e340b8460 msgr2=0x7f4e340c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:34.858 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.854+0000 7f4e3ab01700 1 --2- 172.21.15.115:0/2593626199 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e340b8460 0x7f4e340c7c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4e200090b0 tx=0x7f4e20004770 comp rx=0 tx=0).stop 2023-03-30T08:10:34.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.854+0000 7f4e3ab01700 1 -- 172.21.15.115:0/2593626199 shutdown_connections 2023-03-30T08:10:34.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.854+0000 7f4e3ab01700 1 --2- 172.21.15.115:0/2593626199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4e340cd7e0 0x7f4e340c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.859 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.854+0000 7f4e3ab01700 1 --2- 172.21.15.115:0/2593626199 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4e340b8460 0x7f4e340c7c90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.854+0000 7f4e3ab01700 1 --2- 172.21.15.115:0/2593626199 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4e340b4e90 0x7f4e341552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:34.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.854+0000 7f4e3ab01700 1 -- 172.21.15.115:0/2593626199 >> 172.21.15.115:0/2593626199 conn(0x7f4e340cf780 msgr2=0x7f4e340d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:34.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.854+0000 7f4e3ab01700 1 -- 172.21.15.115:0/2593626199 shutdown_connections 2023-03-30T08:10:34.860 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:34.854+0000 7f4e3ab01700 1 -- 172.21.15.115:0/2593626199 wait complete. 2023-03-30T08:10:34.879 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new e0ab3933-1c98-42e1-862d-59633365c20e 7 2023-03-30T08:10:35.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.022+0000 7fa2a2d51700 1 Processor -- start 2023-03-30T08:10:35.028 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.022+0000 7fa2a2d51700 1 -- start start 2023-03-30T08:10:35.030 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2d51700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa29c0d27e0 0x7fa29c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:35.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2d51700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa29c06a3e0 0x7fa29c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:35.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2d51700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c160ef0 con 0x7fa29c0b8380 2023-03-30T08:10:35.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2d51700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c0cd6a0 con 0x7fa29c0d27e0 2023-03-30T08:10:35.031 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2d51700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c0cd3a0 con 0x7fa29c06a3e0 2023-03-30T08:10:35.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2550700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa29c06a3e0 0x7fa29c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:35.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2550700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa29c06a3e0 0x7fa29c0d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56936/0 (socket says 172.21.15.115:56936) 2023-03-30T08:10:35.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2550700 1 -- 172.21.15.115:0/1138622235 learned_addr learned my addr 172.21.15.115:0/1138622235 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-03-30T08:10:35.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a154e700 1 --2- 172.21.15.115:0/1138622235 >> v2:172.21.15.87:3300/0 conn(0x7fa29c0d27e0 0x7fa29c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:35.032 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2550700 1 -- 172.21.15.115:0/1138622235 >> v2:172.21.15.87:3300/0 conn(0x7fa29c0d27e0 msgr2=0x7fa29c0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:35.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2550700 1 --2- 172.21.15.115:0/1138622235 >> v2:172.21.15.87:3300/0 conn(0x7fa29c0d27e0 0x7fa29c0d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2550700 1 -- 172.21.15.115:0/1138622235 >> v1:172.21.15.87:6789/0 conn(0x7fa29c0b8380 legacy=0x7fa29c069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:35.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2550700 1 -- 172.21.15.115:0/1138622235 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0cef00 con 0x7fa29c06a3e0 2023-03-30T08:10:35.033 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2550700 1 --2- 172.21.15.115:0/1138622235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c06a3e0 0x7fa29c0d0880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa294009e50 tx=0x7fa29400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fee1da213fec09c4 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:35.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a0d4d700 1 -- 172.21.15.115:0/1138622235 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29400e070 con 0x7fa29c06a3e0 2023-03-30T08:10:35.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a0d4d700 1 -- 172.21.15.115:0/1138622235 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa294003a40 con 0x7fa29c06a3e0 2023-03-30T08:10:35.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a0d4d700 1 -- 172.21.15.115:0/1138622235 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294003df0 con 0x7fa29c06a3e0 2023-03-30T08:10:35.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2d51700 1 -- 172.21.15.115:0/1138622235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c06a3e0 msgr2=0x7fa29c0d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:35.034 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2d51700 1 --2- 172.21.15.115:0/1138622235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c06a3e0 0x7fa29c0d0880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa294009e50 tx=0x7fa29400b330 comp rx=0 tx=0).stop 2023-03-30T08:10:35.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2d51700 1 -- 172.21.15.115:0/1138622235 shutdown_connections 2023-03-30T08:10:35.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2d51700 1 --2- 172.21.15.115:0/1138622235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c06a3e0 0x7fa29c0d0880 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2d51700 1 --2- 172.21.15.115:0/1138622235 >> v2:172.21.15.87:3300/0 conn(0x7fa29c0d27e0 0x7fa29c0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2d51700 1 -- 172.21.15.115:0/1138622235 >> 172.21.15.115:0/1138622235 conn(0x7fa29c0b53f0 msgr2=0x7fa29c0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:35.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2d51700 1 -- 172.21.15.115:0/1138622235 shutdown_connections 2023-03-30T08:10:35.035 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.026+0000 7fa2a2d51700 1 -- 172.21.15.115:0/1138622235 wait complete. 2023-03-30T08:10:35.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.030+0000 7fa2a2d51700 1 Processor -- start 2023-03-30T08:10:35.036 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.030+0000 7fa2a2d51700 1 -- start start 2023-03-30T08:10:35.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.030+0000 7fa2a2d51700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa29c06a3e0 0x7fa29c1f28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:35.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.030+0000 7fa2a2d51700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c0b8380 0x7fa29c14d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:35.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.030+0000 7fa2a2d51700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa29c1f54d0 0x7fa29c0d0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:35.037 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.030+0000 7fa2a2d51700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c1f24b0 con 0x7fa29c06a3e0 2023-03-30T08:10:35.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.030+0000 7fa2a2d51700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c1f1ee0 con 0x7fa29c0b8380 2023-03-30T08:10:35.038 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.030+0000 7fa2a2d51700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c1f2e10 con 0x7fa29c1f54d0 2023-03-30T08:10:35.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.030+0000 7fa2a154e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c0b8380 0x7fa29c14d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:35.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.030+0000 7fa2a2550700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa29c1f54d0 0x7fa29c0d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:35.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.030+0000 7fa2a154e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c0b8380 0x7fa29c14d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56940/0 (socket says 172.21.15.115:56940) 2023-03-30T08:10:35.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.030+0000 7fa2a154e700 1 -- 172.21.15.115:0/3729277418 learned_addr learned my addr 172.21.15.115:0/3729277418 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-03-30T08:10:35.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.030+0000 7fa2a154e700 1 -- 172.21.15.115:0/3729277418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa29c1f54d0 msgr2=0x7fa29c0d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:35.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.030+0000 7fa2a154e700 1 --2- 172.21.15.115:0/3729277418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa29c1f54d0 0x7fa29c0d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.039 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.030+0000 7fa2a1d4f700 1 --2- 172.21.15.115:0/3729277418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa29c06a3e0 0x7fa29c1f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:35.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.034+0000 7fa2a154e700 1 -- 172.21.15.115:0/3729277418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa29c06a3e0 msgr2=0x7fa29c1f28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:35.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.034+0000 7fa2a154e700 1 --2- 172.21.15.115:0/3729277418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa29c06a3e0 0x7fa29c1f28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.034+0000 7fa2a154e700 1 -- 172.21.15.115:0/3729277418 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294009b30 con 0x7fa29c0b8380 2023-03-30T08:10:35.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.034+0000 7fa2a1d4f700 1 --2- 172.21.15.115:0/3729277418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa29c06a3e0 0x7fa29c1f28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:10:35.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.034+0000 7fa2a154e700 1 --2- 172.21.15.115:0/3729277418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c0b8380 0x7fa29c14d060 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00d7d0 tx=0x7fa28c00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:35.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.034+0000 7fa2927fc700 1 -- 172.21.15.115:0/3729277418 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c004240 con 0x7fa29c0b8380 2023-03-30T08:10:35.040 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.034+0000 7fa2927fc700 1 -- 172.21.15.115:0/3729277418 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c0043a0 con 0x7fa29c0b8380 2023-03-30T08:10:35.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.034+0000 7fa2927fc700 1 -- 172.21.15.115:0/3729277418 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0036c0 con 0x7fa29c0b8380 2023-03-30T08:10:35.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.034+0000 7fa2a2d51700 1 -- 172.21.15.115:0/3729277418 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c0cf480 con 0x7fa29c0b8380 2023-03-30T08:10:35.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.034+0000 7fa2a2d51700 1 -- 172.21.15.115:0/3729277418 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c0cf1a0 con 0x7fa29c0b8380 2023-03-30T08:10:35.041 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.034+0000 7fa2927fc700 1 -- 172.21.15.115:0/3729277418 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa28c003b20 con 0x7fa29c0b8380 2023-03-30T08:10:35.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.034+0000 7fa2927fc700 1 -- 172.21.15.115:0/3729277418 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa28c003dd0 con 0x7fa29c0b8380 2023-03-30T08:10:35.042 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.034+0000 7fa2a2d51700 1 -- 172.21.15.115:0/3729277418 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c0b8750 con 0x7fa29c0b8380 2023-03-30T08:10:35.043 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.038+0000 7fa2927fc700 1 -- 172.21.15.115:0/3729277418 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fa28c012e10 con 0x7fa29c0b8380 2023-03-30T08:10:35.122 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.114+0000 7fa2a2d51700 1 -- 172.21.15.115:0/3729277418 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e0ab3933-1c98-42e1-862d-59633365c20e", "id": 7} v 0) v1 -- 0x7fa29c072cf0 con 0x7fa29c0b8380 2023-03-30T08:10:35.126 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:35.121+0000 7f4b7275a2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-30T08:10:35.133 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.126+0000 7fa2927fc700 1 -- 172.21.15.115:0/3729277418 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e0ab3933-1c98-42e1-862d-59633365c20e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa28c012420 con 0x7fa29c0b8380 2023-03-30T08:10:35.133 INFO:teuthology.orchestra.run.smithi115.stdout:7 2023-03-30T08:10:35.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.130+0000 7fa2a2d51700 1 -- 172.21.15.115:0/3729277418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c0b8380 msgr2=0x7fa29c14d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:35.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.130+0000 7fa2a2d51700 1 --2- 172.21.15.115:0/3729277418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c0b8380 0x7fa29c14d060 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00d7d0 tx=0x7fa28c00db90 comp rx=0 tx=0).stop 2023-03-30T08:10:35.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.130+0000 7fa2a2d51700 1 -- 172.21.15.115:0/3729277418 shutdown_connections 2023-03-30T08:10:35.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.130+0000 7fa2a2d51700 1 --2- 172.21.15.115:0/3729277418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa29c1f54d0 0x7fa29c0d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.130+0000 7fa2a2d51700 1 --2- 172.21.15.115:0/3729277418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29c0b8380 0x7fa29c14d060 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.130+0000 7fa2a2d51700 1 --2- 172.21.15.115:0/3729277418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa29c06a3e0 0x7fa29c1f28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.130+0000 7fa2a2d51700 1 -- 172.21.15.115:0/3729277418 >> 172.21.15.115:0/3729277418 conn(0x7fa29c0b53f0 msgr2=0x7fa29c15c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:35.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.130+0000 7fa2a2d51700 1 -- 172.21.15.115:0/3729277418 shutdown_connections 2023-03-30T08:10:35.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-03-30T08:10:35.130+0000 7fa2a2d51700 1 -- 172.21.15.115:0/3729277418 wait complete. 2023-03-30T08:10:35.154 INFO:tasks.ceph.osd.0:Restarting daemon 2023-03-30T08:10:35.154 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-03-30T08:10:35.159 INFO:tasks.ceph.osd.0:Started 2023-03-30T08:10:35.160 INFO:tasks.ceph.osd.1:Restarting daemon 2023-03-30T08:10:35.160 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-03-30T08:10:35.164 INFO:tasks.ceph.osd.1:Started 2023-03-30T08:10:35.164 INFO:tasks.ceph.osd.2:Restarting daemon 2023-03-30T08:10:35.164 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-03-30T08:10:35.168 INFO:tasks.ceph.osd.2:Started 2023-03-30T08:10:35.168 INFO:tasks.ceph.osd.3:Restarting daemon 2023-03-30T08:10:35.168 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-03-30T08:10:35.173 INFO:tasks.ceph.osd.3:Started 2023-03-30T08:10:35.173 INFO:tasks.ceph.osd.4:Restarting daemon 2023-03-30T08:10:35.173 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-03-30T08:10:35.179 INFO:tasks.ceph.osd.4:Started 2023-03-30T08:10:35.179 INFO:tasks.ceph.osd.5:Restarting daemon 2023-03-30T08:10:35.179 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-03-30T08:10:35.183 INFO:tasks.ceph.osd.5:Started 2023-03-30T08:10:35.183 INFO:tasks.ceph.osd.6:Restarting daemon 2023-03-30T08:10:35.183 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-03-30T08:10:35.187 INFO:tasks.ceph.osd.6:Started 2023-03-30T08:10:35.187 INFO:tasks.ceph.osd.7:Restarting daemon 2023-03-30T08:10:35.187 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-03-30T08:10:35.192 INFO:tasks.ceph.osd.7:Started 2023-03-30T08:10:35.193 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:10:35.214 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:35.206+0000 7f7d1c3662c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-30T08:10:35.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.353+0000 7f41d70dc700 1 Processor -- start 2023-03-30T08:10:35.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.353+0000 7f41d70dc700 1 -- start start 2023-03-30T08:10:35.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d70dc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41d00b8380 0x7f41d00d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:35.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d70dc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f41d00d27e0 0x7f41d0069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:35.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d70dc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f41d01609f0 0x7f41d006a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:35.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d70dc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d0160ef0 con 0x7f41d01609f0 2023-03-30T08:10:35.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d70dc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d00cd6a0 con 0x7f41d00d27e0 2023-03-30T08:10:35.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d70dc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00cd3a0 con 0x7f41d00b8380 2023-03-30T08:10:35.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d68db700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f41d01609f0 0x7f41d006a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:35.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d68db700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f41d01609f0 0x7f41d006a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41380/0 (socket says 172.21.15.87:41380) 2023-03-30T08:10:35.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d68db700 1 -- 172.21.15.87:0/1407260402 learned_addr learned my addr 172.21.15.87:0/1407260402 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:35.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d58d9700 1 --2- 172.21.15.87:0/1407260402 >> v2:172.21.15.115:3300/0 conn(0x7f41d00d27e0 0x7f41d0069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:35.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d60da700 1 --2- 172.21.15.87:0/1407260402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41d00b8380 0x7f41d00d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:35.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d68db700 1 -- 172.21.15.87:0/1407260402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41d00b8380 msgr2=0x7f41d00d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:35.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d68db700 1 --2- 172.21.15.87:0/1407260402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41d00b8380 0x7f41d00d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d68db700 1 -- 172.21.15.87:0/1407260402 >> v2:172.21.15.115:3300/0 conn(0x7f41d00d27e0 msgr2=0x7f41d0069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:35.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d68db700 1 --2- 172.21.15.87:0/1407260402 >> v2:172.21.15.115:3300/0 conn(0x7f41d00d27e0 0x7f41d0069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d68db700 1 -- 172.21.15.87:0/1407260402 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d00cef00 con 0x7f41d01609f0 2023-03-30T08:10:35.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d68db700 1 --2- 172.21.15.87:0/1407260402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d01609f0 0x7f41d006a210 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f41d006add0 tx=0x7f41c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc29fc39e04df61 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:35.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d50d8700 1 -- 172.21.15.87:0/1407260402 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c800e070 con 0x7f41d01609f0 2023-03-30T08:10:35.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d50d8700 1 -- 172.21.15.87:0/1407260402 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c800b910 con 0x7f41d01609f0 2023-03-30T08:10:35.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.357+0000 7f41d50d8700 1 -- 172.21.15.87:0/1407260402 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c800bcc0 con 0x7f41d01609f0 2023-03-30T08:10:35.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.361+0000 7f41d70dc700 1 -- 172.21.15.87:0/1407260402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d01609f0 msgr2=0x7f41d006a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:35.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.361+0000 7f41d70dc700 1 --2- 172.21.15.87:0/1407260402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d01609f0 0x7f41d006a210 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f41d006add0 tx=0x7f41c800b330 comp rx=0 tx=0).stop 2023-03-30T08:10:35.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.361+0000 7f41d70dc700 1 -- 172.21.15.87:0/1407260402 shutdown_connections 2023-03-30T08:10:35.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.361+0000 7f41d70dc700 1 --2- 172.21.15.87:0/1407260402 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d01609f0 0x7f41d006a210 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.361+0000 7f41d70dc700 1 --2- 172.21.15.87:0/1407260402 >> v2:172.21.15.115:3300/0 conn(0x7f41d00d27e0 0x7f41d0069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.361+0000 7f41d70dc700 1 --2- 172.21.15.87:0/1407260402 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41d00b8380 0x7f41d00d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.361+0000 7f41d70dc700 1 -- 172.21.15.87:0/1407260402 >> 172.21.15.87:0/1407260402 conn(0x7f41d00b53f0 msgr2=0x7f41d00cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:35.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.361+0000 7f41d70dc700 1 -- 172.21.15.87:0/1407260402 shutdown_connections 2023-03-30T08:10:35.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.361+0000 7f41d70dc700 1 -- 172.21.15.87:0/1407260402 wait complete. 2023-03-30T08:10:35.367 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f4b7275a2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-30T08:10:35.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d70dc700 1 Processor -- start 2023-03-30T08:10:35.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d70dc700 1 -- start start 2023-03-30T08:10:35.369 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d70dc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41d00b8380 0x7f41d00ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:35.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d70dc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d01609f0 0x7f41d01f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:35.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d70dc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d015e5a0 0x7f41d00b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:35.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d70dc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00cad90 con 0x7f41d015e5a0 2023-03-30T08:10:35.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d70dc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00cb070 con 0x7f41d01609f0 2023-03-30T08:10:35.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d70dc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00cb350 con 0x7f41d00b8380 2023-03-30T08:10:35.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d68db700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d015e5a0 0x7f41d00b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:35.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d68db700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d015e5a0 0x7f41d00b2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41386/0 (socket says 172.21.15.87:41386) 2023-03-30T08:10:35.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d68db700 1 -- 172.21.15.87:0/1904919949 learned_addr learned my addr 172.21.15.87:0/1904919949 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:35.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d58d9700 1 --2- 172.21.15.87:0/1904919949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d01609f0 0x7f41d01f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:35.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d60da700 1 --2- 172.21.15.87:0/1904919949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41d00b8380 0x7f41d00ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:35.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d68db700 1 -- 172.21.15.87:0/1904919949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41d00b8380 msgr2=0x7f41d00ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:35.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d68db700 1 --2- 172.21.15.87:0/1904919949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41d00b8380 0x7f41d00ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d68db700 1 -- 172.21.15.87:0/1904919949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d01609f0 msgr2=0x7f41d01f4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:35.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d68db700 1 --2- 172.21.15.87:0/1904919949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d01609f0 0x7f41d01f4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.365+0000 7f41d68db700 1 -- 172.21.15.87:0/1904919949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c8009b30 con 0x7f41d015e5a0 2023-03-30T08:10:35.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.369+0000 7f41d68db700 1 --2- 172.21.15.87:0/1904919949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d015e5a0 0x7f41d00b2c10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f41d008bd10 tx=0x7f41c8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:35.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.369+0000 7f41c6ffd700 1 -- 172.21.15.87:0/1904919949 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c8004250 con 0x7f41d015e5a0 2023-03-30T08:10:35.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.369+0000 7f41c6ffd700 1 -- 172.21.15.87:0/1904919949 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c80043d0 con 0x7f41d015e5a0 2023-03-30T08:10:35.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.369+0000 7f41d70dc700 1 -- 172.21.15.87:0/1904919949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d00cf480 con 0x7f41d015e5a0 2023-03-30T08:10:35.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.369+0000 7f41c6ffd700 1 -- 172.21.15.87:0/1904919949 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c8004780 con 0x7f41d015e5a0 2023-03-30T08:10:35.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.369+0000 7f41d70dc700 1 -- 172.21.15.87:0/1904919949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d00cf1a0 con 0x7f41d015e5a0 2023-03-30T08:10:35.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.369+0000 7f41c6ffd700 1 -- 172.21.15.87:0/1904919949 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f41c801b730 con 0x7f41d015e5a0 2023-03-30T08:10:35.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.369+0000 7f41c6ffd700 1 -- 172.21.15.87:0/1904919949 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f41c8024c70 con 0x7f41d015e5a0 2023-03-30T08:10:35.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.369+0000 7f41d70dc700 1 -- 172.21.15.87:0/1904919949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d00b8750 con 0x7f41d015e5a0 2023-03-30T08:10:35.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.373+0000 7f41c6ffd700 1 -- 172.21.15.87:0/1904919949 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f41c8029060 con 0x7f41d015e5a0 2023-03-30T08:10:35.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.437+0000 7f41d70dc700 1 -- 172.21.15.87:0/1904919949 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41d0072cf0 con 0x7f41d015e5a0 2023-03-30T08:10:35.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.441+0000 7f41c6ffd700 1 -- 172.21.15.87:0/1904919949 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f41c8033090 con 0x7f41d015e5a0 2023-03-30T08:10:35.444 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:10:35.444 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":10,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:10:35.124293+0000","last_up_change":"0.000000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:10:35.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.441+0000 7f41d70dc700 1 -- 172.21.15.87:0/1904919949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d015e5a0 msgr2=0x7f41d00b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:35.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.441+0000 7f41d70dc700 1 --2- 172.21.15.87:0/1904919949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d015e5a0 0x7f41d00b2c10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f41d008bd10 tx=0x7f41c8004af0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.441+0000 7f41d70dc700 1 -- 172.21.15.87:0/1904919949 shutdown_connections 2023-03-30T08:10:35.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.441+0000 7f41d70dc700 1 --2- 172.21.15.87:0/1904919949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41d015e5a0 0x7f41d00b2c10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.441+0000 7f41d70dc700 1 --2- 172.21.15.87:0/1904919949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41d01609f0 0x7f41d01f4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.441+0000 7f41d70dc700 1 --2- 172.21.15.87:0/1904919949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f41d00b8380 0x7f41d00ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:35.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.441+0000 7f41d70dc700 1 -- 172.21.15.87:0/1904919949 >> 172.21.15.87:0/1904919949 conn(0x7f41d00b53f0 msgr2=0x7f41d0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:35.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.441+0000 7f41d70dc700 1 -- 172.21.15.87:0/1904919949 shutdown_connections 2023-03-30T08:10:35.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:35.441+0000 7f41d70dc700 1 -- 172.21.15.87:0/1904919949 wait complete. 2023-03-30T08:10:35.465 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-03-30T08:10:35.465 INFO:tasks.ceph:Waiting for OSDs to come up 2023-03-30T08:10:35.470 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:35.466+0000 7f7d1c3662c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-30T08:10:35.471 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:35.469+0000 7f4b7275a2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-30T08:10:35.545 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:35.541+0000 7f4b7275a2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-30T08:10:35.566 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:35.558+0000 7f7d1c3662c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-30T08:10:35.645 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:35.638+0000 7f7d1c3662c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-30T08:10:35.837 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T08:10:35.830+0000 7fe517d2e700 -1 Falling back to public interface 2023-03-30T08:10:35.849 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T08:10:35.842+0000 7fa38ff5c700 -1 Falling back to public interface 2023-03-30T08:10:35.858 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T08:10:35.853+0000 7ff351b8c700 -1 Falling back to public interface 2023-03-30T08:10:35.862 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T08:10:35.857+0000 7f1a69e7c700 -1 Falling back to public interface 2023-03-30T08:10:35.862 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T08:10:35.857+0000 7fb30c1e0700 -1 Falling back to public interface 2023-03-30T08:10:35.863 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T08:10:35.858+0000 7f2758311700 -1 Falling back to public interface 2023-03-30T08:10:35.876 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T08:10:35.870+0000 7f2ab5ed5700 -1 Falling back to public interface 2023-03-30T08:10:35.877 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T08:10:35.873+0000 7f22d1b8c700 -1 Falling back to public interface 2023-03-30T08:10:36.271 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-30T08:10:36.277 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:36.273+0000 7f4b7275a2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-30T08:10:36.359 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:36.357+0000 7f4b7275a2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-30T08:10:36.413 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.409+0000 7efd4580a700 1 Processor -- start 2023-03-30T08:10:36.414 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.409+0000 7efd4580a700 1 -- start start 2023-03-30T08:10:36.415 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd4580a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efd400adb60 0x7efd4006ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:36.415 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd4580a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd40161e00 con 0x7efd400b03b0 2023-03-30T08:10:36.415 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd4580a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd400cc6a0 con 0x7efd40161960 2023-03-30T08:10:36.415 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd4580a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd4006b340 con 0x7efd400adb60 2023-03-30T08:10:36.416 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd3f7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7efd400b03b0 0x7efd40164a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:49800/0 (socket says 172.21.15.87:49800) 2023-03-30T08:10:36.416 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd3f7fe700 1 -- 172.21.15.87:0/1163908503 learned_addr learned my addr 172.21.15.87:0/1163908503 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:10:36.416 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd3effd700 1 --2- 172.21.15.87:0/1163908503 >> v2:172.21.15.115:3300/0 conn(0x7efd400adb60 0x7efd4006ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:36.417 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd3dffb700 1 -- 172.21.15.87:0/1163908503 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960938579 0 0) 0x7efd40161e00 con 0x7efd400b03b0 2023-03-30T08:10:36.417 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd3dffb700 1 -- 172.21.15.87:0/1163908503 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd280035d0 con 0x7efd400b03b0 2023-03-30T08:10:36.417 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd3effd700 1 -- 172.21.15.87:0/1163908503 >> v1:172.21.15.115:6789/0 conn(0x7efd40161960 legacy=0x7efd4006f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:36.418 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd3effd700 1 -- 172.21.15.87:0/1163908503 >> v1:172.21.15.87:6789/0 conn(0x7efd400b03b0 legacy=0x7efd40164a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:36.418 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd3effd700 1 -- 172.21.15.87:0/1163908503 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd400cc980 con 0x7efd400adb60 2023-03-30T08:10:36.418 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd3effd700 1 --2- 172.21.15.87:0/1163908503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd400adb60 0x7efd4006ac10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efd30009850 tx=0x7efd30009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d628b858be256f1 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:36.418 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd3dffb700 1 -- 172.21.15.87:0/1163908503 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30011830 con 0x7efd400adb60 2023-03-30T08:10:36.418 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd3dffb700 1 -- 172.21.15.87:0/1163908503 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd30011990 con 0x7efd400adb60 2023-03-30T08:10:36.418 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd3dffb700 1 -- 172.21.15.87:0/1163908503 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30011d00 con 0x7efd400adb60 2023-03-30T08:10:36.419 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd4580a700 1 -- 172.21.15.87:0/1163908503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd400adb60 msgr2=0x7efd4006ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:36.419 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.413+0000 7efd4580a700 1 --2- 172.21.15.87:0/1163908503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd400adb60 0x7efd4006ac10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efd30009850 tx=0x7efd30009b60 comp rx=0 tx=0).stop 2023-03-30T08:10:36.419 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.417+0000 7efd4580a700 1 -- 172.21.15.87:0/1163908503 shutdown_connections 2023-03-30T08:10:36.420 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.417+0000 7efd4580a700 1 --2- 172.21.15.87:0/1163908503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd400adb60 0x7efd4006ac10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:36.420 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.417+0000 7efd4580a700 1 -- 172.21.15.87:0/1163908503 >> 172.21.15.87:0/1163908503 conn(0x7efd400cb3b0 msgr2=0x7efd400cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:36.420 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.417+0000 7efd4580a700 1 -- 172.21.15.87:0/1163908503 shutdown_connections 2023-03-30T08:10:36.420 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.417+0000 7efd4580a700 1 -- 172.21.15.87:0/1163908503 wait complete. 2023-03-30T08:10:36.422 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.417+0000 7efd4580a700 1 Processor -- start 2023-03-30T08:10:36.422 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.417+0000 7efd4580a700 1 -- start start 2023-03-30T08:10:36.424 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd4580a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd400adb60 0x7efd400afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:36.425 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd4580a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd400b03b0 0x7efd400c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:36.425 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd4580a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd40161960 0x7efd400c31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:36.425 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd4580a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400b1760 con 0x7efd40161960 2023-03-30T08:10:36.425 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd4580a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400b1970 con 0x7efd400b03b0 2023-03-30T08:10:36.425 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd4580a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd400b1c50 con 0x7efd400adb60 2023-03-30T08:10:36.426 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd3f7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd40161960 0x7efd400c31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:36.426 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd3f7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd40161960 0x7efd400c31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41392/0 (socket says 172.21.15.87:41392) 2023-03-30T08:10:36.427 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd3f7fe700 1 -- 172.21.15.87:0/4039893194 learned_addr learned my addr 172.21.15.87:0/4039893194 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:36.427 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd3e7fc700 1 --2- 172.21.15.87:0/4039893194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd400b03b0 0x7efd400c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:36.427 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd3effd700 1 --2- 172.21.15.87:0/4039893194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd400adb60 0x7efd400afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:36.427 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd3f7fe700 1 -- 172.21.15.87:0/4039893194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd400adb60 msgr2=0x7efd400afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:36.427 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd3f7fe700 1 --2- 172.21.15.87:0/4039893194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd400adb60 0x7efd400afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:36.427 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd3f7fe700 1 -- 172.21.15.87:0/4039893194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd400b03b0 msgr2=0x7efd400c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:36.427 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd3f7fe700 1 --2- 172.21.15.87:0/4039893194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd400b03b0 0x7efd400c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:36.427 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd3f7fe700 1 -- 172.21.15.87:0/4039893194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300094b0 con 0x7efd40161960 2023-03-30T08:10:36.428 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd3effd700 1 --2- 172.21.15.87:0/4039893194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd400adb60 0x7efd400afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:10:36.428 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd3f7fe700 1 --2- 172.21.15.87:0/4039893194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd40161960 0x7efd400c31c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efd3800cb40 tx=0x7efd3800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:36.428 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd27fff700 1 -- 172.21.15.87:0/4039893194 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3800a7b0 con 0x7efd40161960 2023-03-30T08:10:36.428 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd27fff700 1 -- 172.21.15.87:0/4039893194 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3800a910 con 0x7efd40161960 2023-03-30T08:10:36.428 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd27fff700 1 -- 172.21.15.87:0/4039893194 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3800ac80 con 0x7efd40161960 2023-03-30T08:10:36.428 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.421+0000 7efd4580a700 1 -- 172.21.15.87:0/4039893194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4006fbb0 con 0x7efd40161960 2023-03-30T08:10:36.429 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.425+0000 7efd4580a700 1 -- 172.21.15.87:0/4039893194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd401644e0 con 0x7efd40161960 2023-03-30T08:10:36.429 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.425+0000 7efd27fff700 1 -- 172.21.15.87:0/4039893194 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efd3801c440 con 0x7efd40161960 2023-03-30T08:10:36.429 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.425+0000 7efd27fff700 1 -- 172.21.15.87:0/4039893194 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7efd3801cdc0 con 0x7efd40161960 2023-03-30T08:10:36.429 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.425+0000 7efd4580a700 1 -- 172.21.15.87:0/4039893194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd400adf30 con 0x7efd40161960 2023-03-30T08:10:36.430 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.425+0000 7efd27fff700 1 -- 172.21.15.87:0/4039893194 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7efd38021060 con 0x7efd40161960 2023-03-30T08:10:36.480 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:36.474+0000 7f7d1c3662c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-30T08:10:36.493 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.489+0000 7efd4580a700 1 -- 172.21.15.87:0/4039893194 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd40072df0 con 0x7efd40161960 2023-03-30T08:10:36.494 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.489+0000 7efd27fff700 1 -- 172.21.15.87:0/4039893194 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7efd38017070 con 0x7efd40161960 2023-03-30T08:10:36.494 INFO:teuthology.misc.health.smithi087.stdout: 2023-03-30T08:10:36.494 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":10,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:10:35.124293+0000","last_up_change":"0.000000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:10:36.495 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.493+0000 7efd4580a700 1 -- 172.21.15.87:0/4039893194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd40161960 msgr2=0x7efd400c31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:36.495 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.493+0000 7efd4580a700 1 --2- 172.21.15.87:0/4039893194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd40161960 0x7efd400c31c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efd3800cb40 tx=0x7efd3800cb70 comp rx=0 tx=0).stop 2023-03-30T08:10:36.496 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.493+0000 7efd4580a700 1 -- 172.21.15.87:0/4039893194 shutdown_connections 2023-03-30T08:10:36.496 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.493+0000 7efd4580a700 1 --2- 172.21.15.87:0/4039893194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd40161960 0x7efd400c31c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:36.496 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.493+0000 7efd4580a700 1 --2- 172.21.15.87:0/4039893194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd400b03b0 0x7efd400c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:36.496 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.493+0000 7efd4580a700 1 --2- 172.21.15.87:0/4039893194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd400adb60 0x7efd400afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:36.496 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.493+0000 7efd4580a700 1 -- 172.21.15.87:0/4039893194 >> 172.21.15.87:0/4039893194 conn(0x7efd400cb3b0 msgr2=0x7efd400ae1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:36.497 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.493+0000 7efd4580a700 1 -- 172.21.15.87:0/4039893194 shutdown_connections 2023-03-30T08:10:36.497 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:36.493+0000 7efd4580a700 1 -- 172.21.15.87:0/4039893194 wait complete. 2023-03-30T08:10:36.511 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-03-30T08:10:36.511 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:36.509+0000 7f4b7275a2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-30T08:10:36.569 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:36.562+0000 7f7d1c3662c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-30T08:10:36.590 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:36.585+0000 7f4b7275a2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-30T08:10:36.681 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:36.677+0000 7f4b7275a2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-30T08:10:36.735 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:36.730+0000 7f7d1c3662c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-30T08:10:36.822 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:36.814+0000 7f7d1c3662c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-30T08:10:36.878 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:36.873+0000 7f4b7275a2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-30T08:10:36.919 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:36.914+0000 7f7d1c3662c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-30T08:10:37.110 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:37.105+0000 7f4b7275a2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-30T08:10:37.143 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:37.138+0000 7f7d1c3662c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-30T08:10:37.400 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:37.394+0000 7f7d1c3662c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-30T08:10:37.856 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:37.853+0000 7f4b7275a2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-30T08:10:38.221 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-03-30T08:10:38.214+0000 7f7d1c3662c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-30T08:10:38.894 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:38.889+0000 7f4b59a4e700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-03-30T08:10:38.895 INFO:tasks.ceph.mgr.y.smithi087.stderr:2023-03-30T08:10:38.893+0000 7f4b59a4e700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-03-30T08:10:39.798 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T08:10:39.794+0000 7fa38ff5c700 -1 osd.7 0 log_to_monitors true 2023-03-30T08:10:39.801 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T08:10:39.797+0000 7f1a69e7c700 -1 osd.2 0 log_to_monitors true 2023-03-30T08:10:39.816 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T08:10:39.813+0000 7ff351b8c700 -1 osd.0 0 log_to_monitors true 2023-03-30T08:10:39.840 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T08:10:39.837+0000 7fb30c1e0700 -1 osd.3 0 log_to_monitors true 2023-03-30T08:10:39.844 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T08:10:39.838+0000 7f2758311700 -1 osd.5 0 log_to_monitors true 2023-03-30T08:10:39.845 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T08:10:39.841+0000 7f22d1b8c700 -1 osd.1 0 log_to_monitors true 2023-03-30T08:10:40.046 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T08:10:40.042+0000 7fe517d2e700 -1 osd.4 0 log_to_monitors true 2023-03-30T08:10:40.129 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T08:10:40.122+0000 7f2ab5ed5700 -1 osd.6 0 log_to_monitors true 2023-03-30T08:10:42.378 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:10:42.382 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:10:42.567 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T08:10:42.562+0000 7f2754150700 -1 osd.5 0 waiting for initial osdmap 2023-03-30T08:10:42.604 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T08:10:42.598+0000 7f274bbf0700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-30T08:10:42.716 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T08:10:42.710+0000 7fa38bd9b700 -1 osd.7 0 waiting for initial osdmap 2023-03-30T08:10:42.743 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T08:10:42.738+0000 7fa3837f0700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-30T08:10:43.184 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T08:10:43.181+0000 7ff34d9cb700 -1 osd.0 0 waiting for initial osdmap 2023-03-30T08:10:43.195 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T08:10:43.193+0000 7ff3453f0700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-30T08:10:43.262 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T08:10:43.257+0000 7f22cd9cb700 -1 osd.1 0 waiting for initial osdmap 2023-03-30T08:10:43.272 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T08:10:43.269+0000 7f22c53f0700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-30T08:10:43.284 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T08:10:43.281+0000 7f1a66642700 -1 osd.2 0 waiting for initial osdmap 2023-03-30T08:10:43.293 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T08:10:43.289+0000 7f1a5d5f0700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-30T08:10:43.317 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-30T08:10:43.451 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.449+0000 7f02e2cbc700 1 Processor -- start 2023-03-30T08:10:43.452 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.449+0000 7f02e2cbc700 1 -- start start 2023-03-30T08:10:43.454 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.449+0000 7f02e2cbc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02dc158ab0 0x7f02dc15cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:43.454 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.449+0000 7f02e2cbc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f02dc06d800 0x7f02dc1591b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:43.455 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.449+0000 7f02e2cbc700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02dc06ddf0 con 0x7f02dc0adad0 2023-03-30T08:10:43.455 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.449+0000 7f02e2cbc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02dc158e80 con 0x7f02dc06d800 2023-03-30T08:10:43.455 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e2cbc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc15d450 con 0x7f02dc158ab0 2023-03-30T08:10:43.456 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e14b9700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f02dc0adad0 0x7f02dc06d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:33270/0 (socket says 172.21.15.87:33270) 2023-03-30T08:10:43.456 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e14b9700 1 -- 172.21.15.87:0/1238941828 learned_addr learned my addr 172.21.15.87:0/1238941828 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:10:43.456 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e1cba700 1 --2- 172.21.15.87:0/1238941828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02dc158ab0 0x7f02dc15cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:43.456 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e24bb700 1 --2- 172.21.15.87:0/1238941828 >> v2:172.21.15.87:3300/0 conn(0x7f02dc06d800 0x7f02dc1591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:43.457 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e1cba700 1 -- 172.21.15.87:0/1238941828 >> v2:172.21.15.87:3300/0 conn(0x7f02dc06d800 msgr2=0x7f02dc1591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:43.457 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e1cba700 1 --2- 172.21.15.87:0/1238941828 >> v2:172.21.15.87:3300/0 conn(0x7f02dc06d800 0x7f02dc1591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:43.457 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e1cba700 1 -- 172.21.15.87:0/1238941828 >> v1:172.21.15.87:6789/0 conn(0x7f02dc0adad0 legacy=0x7f02dc06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:43.458 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e1cba700 1 -- 172.21.15.87:0/1238941828 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc06e040 con 0x7f02dc158ab0 2023-03-30T08:10:43.458 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e24bb700 1 --2- 172.21.15.87:0/1238941828 >> v2:172.21.15.87:3300/0 conn(0x7f02dc06d800 0x7f02dc1591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:10:43.458 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e1cba700 1 --2- 172.21.15.87:0/1238941828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02dc158ab0 0x7f02dc15cf10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009850 tx=0x7f02d8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79ff49e3669c8ba5 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:43.458 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e0cb8700 1 -- 172.21.15.87:0/1238941828 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8010800 con 0x7f02dc158ab0 2023-03-30T08:10:43.458 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e0cb8700 1 -- 172.21.15.87:0/1238941828 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d8010960 con 0x7f02dc158ab0 2023-03-30T08:10:43.458 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e0cb8700 1 -- 172.21.15.87:0/1238941828 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8010d10 con 0x7f02dc158ab0 2023-03-30T08:10:43.459 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e2cbc700 1 -- 172.21.15.87:0/1238941828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02dc158ab0 msgr2=0x7f02dc15cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:43.459 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e2cbc700 1 --2- 172.21.15.87:0/1238941828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02dc158ab0 0x7f02dc15cf10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009850 tx=0x7f02d8009b60 comp rx=0 tx=0).stop 2023-03-30T08:10:43.459 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e2cbc700 1 -- 172.21.15.87:0/1238941828 shutdown_connections 2023-03-30T08:10:43.459 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e2cbc700 1 --2- 172.21.15.87:0/1238941828 >> v2:172.21.15.87:3300/0 conn(0x7f02dc06d800 0x7f02dc1591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:43.460 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e2cbc700 1 --2- 172.21.15.87:0/1238941828 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02dc158ab0 0x7f02dc15cf10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:43.460 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e2cbc700 1 -- 172.21.15.87:0/1238941828 >> 172.21.15.87:0/1238941828 conn(0x7f02dc0cb3b0 msgr2=0x7f02dc0cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:43.460 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e2cbc700 1 -- 172.21.15.87:0/1238941828 shutdown_connections 2023-03-30T08:10:43.460 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.453+0000 7f02e2cbc700 1 -- 172.21.15.87:0/1238941828 wait complete. 2023-03-30T08:10:43.461 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e2cbc700 1 Processor -- start 2023-03-30T08:10:43.461 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e2cbc700 1 -- start start 2023-03-30T08:10:43.461 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e2cbc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02dc06d800 0x7f02dc0c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:43.462 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e2cbc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02dc0adad0 0x7f02dc06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:43.462 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e2cbc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02dc158ab0 0x7f02dc0700e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:43.462 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e2cbc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0c42f0 con 0x7f02dc158ab0 2023-03-30T08:10:43.462 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e2cbc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc1566e0 con 0x7f02dc0adad0 2023-03-30T08:10:43.462 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e2cbc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc155ad0 con 0x7f02dc06d800 2023-03-30T08:10:43.463 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e1cba700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02dc06d800 0x7f02dc0c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:43.464 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e1cba700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02dc06d800 0x7f02dc0c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:55662/0 (socket says 172.21.15.87:55662) 2023-03-30T08:10:43.464 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e1cba700 1 -- 172.21.15.87:0/830930867 learned_addr learned my addr 172.21.15.87:0/830930867 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:43.464 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e24bb700 1 --2- 172.21.15.87:0/830930867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02dc158ab0 0x7f02dc0700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:43.464 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e14b9700 1 --2- 172.21.15.87:0/830930867 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02dc0adad0 0x7f02dc06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:43.464 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e24bb700 1 -- 172.21.15.87:0/830930867 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02dc06d800 msgr2=0x7f02dc0c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:43.464 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e24bb700 1 --2- 172.21.15.87:0/830930867 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02dc06d800 0x7f02dc0c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:43.465 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e24bb700 1 -- 172.21.15.87:0/830930867 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02dc0adad0 msgr2=0x7f02dc06fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:43.465 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e24bb700 1 --2- 172.21.15.87:0/830930867 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02dc0adad0 0x7f02dc06fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:43.465 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e24bb700 1 -- 172.21.15.87:0/830930867 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d4009a70 con 0x7f02dc158ab0 2023-03-30T08:10:43.465 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.457+0000 7f02e1cba700 1 --2- 172.21.15.87:0/830930867 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02dc06d800 0x7f02dc0c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:10:43.465 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.461+0000 7f02e24bb700 1 --2- 172.21.15.87:0/830930867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02dc158ab0 0x7f02dc0700e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f02d400ef90 tx=0x7f02d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:43.465 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.461+0000 7f02d27fc700 1 -- 172.21.15.87:0/830930867 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d400ca90 con 0x7f02dc158ab0 2023-03-30T08:10:43.465 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.461+0000 7f02d27fc700 1 -- 172.21.15.87:0/830930867 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d400f040 con 0x7f02dc158ab0 2023-03-30T08:10:43.466 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.461+0000 7f02e2cbc700 1 -- 172.21.15.87:0/830930867 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d80094b0 con 0x7f02dc158ab0 2023-03-30T08:10:43.466 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.461+0000 7f02d27fc700 1 -- 172.21.15.87:0/830930867 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d400ce30 con 0x7f02dc158ab0 2023-03-30T08:10:43.466 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.461+0000 7f02e2cbc700 1 -- 172.21.15.87:0/830930867 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02dc0cd170 con 0x7f02dc158ab0 2023-03-30T08:10:43.466 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.461+0000 7f02bffff700 1 -- 172.21.15.87:0/830930867 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02dc0cce90 con 0x7f02dc158ab0 2023-03-30T08:10:43.467 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.465+0000 7f02d27fc700 1 -- 172.21.15.87:0/830930867 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 4) v1 ==== 84174+0+0 (secure 0 0 0) 0x7f02d4014480 con 0x7f02dc158ab0 2023-03-30T08:10:43.468 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.465+0000 7f02d27fc700 1 --2- 172.21.15.87:0/830930867 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02c0065360 0x7f02c0067810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:43.468 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.465+0000 7f02d27fc700 1 -- 172.21.15.87:0/830930867 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f02d4081db0 con 0x7f02dc158ab0 2023-03-30T08:10:43.469 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.465+0000 7f02e1cba700 1 --2- 172.21.15.87:0/830930867 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02c0065360 0x7f02c0067810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:43.469 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.465+0000 7f02e1cba700 1 --2- 172.21.15.87:0/830930867 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02c0065360 0x7f02c0067810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f02d8000c00 tx=0x7f02d801b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:43.475 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.473+0000 7f02d27fc700 1 -- 172.21.15.87:0/830930867 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f02d4050990 con 0x7f02dc158ab0 2023-03-30T08:10:43.509 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T08:10:43.505+0000 7fb3089a6700 -1 osd.3 0 waiting for initial osdmap 2023-03-30T08:10:43.519 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T08:10:43.517+0000 7fb2ff9f0700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-30T08:10:43.584 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T08:10:43.578+0000 7fe513b6d700 -1 osd.4 0 waiting for initial osdmap 2023-03-30T08:10:43.590 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T08:10:43.586+0000 7fe50b5f0700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-30T08:10:43.608 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T08:10:43.602+0000 7f2ab1d14700 -1 osd.6 0 waiting for initial osdmap 2023-03-30T08:10:43.619 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T08:10:43.614+0000 7f2aa95f0700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-30T08:10:43.652 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.649+0000 7f02bffff700 1 -- 172.21.15.87:0/830930867 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02dc0cd450 con 0x7f02dc158ab0 2023-03-30T08:10:43.653 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.649+0000 7f02d27fc700 1 -- 172.21.15.87:0/830930867 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10014 (secure 0 0 0) 0x7f02d4009cc0 con 0x7f02dc158ab0 2023-03-30T08:10:43.654 INFO:teuthology.misc.health.smithi087.stdout: 2023-03-30T08:10:43.654 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":14,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:10:43.610649+0000","last_up_change":"2023-03-30T08:10:43.610649+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:10:43.657 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.653+0000 7f02bffff700 1 -- 172.21.15.87:0/830930867 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02c0065360 msgr2=0x7f02c0067810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:43.657 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.653+0000 7f02bffff700 1 --2- 172.21.15.87:0/830930867 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02c0065360 0x7f02c0067810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f02d8000c00 tx=0x7f02d801b040 comp rx=0 tx=0).stop 2023-03-30T08:10:43.657 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.653+0000 7f02bffff700 1 -- 172.21.15.87:0/830930867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02dc158ab0 msgr2=0x7f02dc0700e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:43.657 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.653+0000 7f02bffff700 1 --2- 172.21.15.87:0/830930867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02dc158ab0 0x7f02dc0700e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f02d400ef90 tx=0x7f02d400c3a0 comp rx=0 tx=0).stop 2023-03-30T08:10:43.657 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.653+0000 7f02bffff700 1 -- 172.21.15.87:0/830930867 shutdown_connections 2023-03-30T08:10:43.658 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.653+0000 7f02bffff700 1 --2- 172.21.15.87:0/830930867 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02c0065360 0x7f02c0067810 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:43.658 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.653+0000 7f02bffff700 1 --2- 172.21.15.87:0/830930867 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02dc158ab0 0x7f02dc0700e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:43.658 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.653+0000 7f02bffff700 1 --2- 172.21.15.87:0/830930867 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02dc0adad0 0x7f02dc06fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:43.658 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.653+0000 7f02bffff700 1 --2- 172.21.15.87:0/830930867 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02dc06d800 0x7f02dc0c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:43.658 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.653+0000 7f02bffff700 1 -- 172.21.15.87:0/830930867 >> 172.21.15.87:0/830930867 conn(0x7f02dc0cb3b0 msgr2=0x7f02dc0ca350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:43.658 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.653+0000 7f02bffff700 1 -- 172.21.15.87:0/830930867 shutdown_connections 2023-03-30T08:10:43.658 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:43.653+0000 7f02bffff700 1 -- 172.21.15.87:0/830930867 wait complete. 2023-03-30T08:10:43.673 DEBUG:teuthology.misc:7 of 8 OSDs are up 2023-03-30T08:10:50.479 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-30T08:10:50.617 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.613+0000 7fe0988bc700 1 Processor -- start 2023-03-30T08:10:50.617 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.613+0000 7fe0988bc700 1 -- start start 2023-03-30T08:10:50.619 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0988bc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe0940adeb0 0x7fe0940c2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:50.619 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0988bc700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09406d220 con 0x7fe0940c8f80 2023-03-30T08:10:50.619 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0988bc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09406d500 con 0x7fe09406b190 2023-03-30T08:10:50.620 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0988bc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09406d7e0 con 0x7fe0940adeb0 2023-03-30T08:10:50.620 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe092ffd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe0940c8f80 0x7fe09406aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52954/0 (socket says 172.21.15.87:52954) 2023-03-30T08:10:50.620 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0937fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe0940adeb0 0x7fe0940c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:50.620 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe092ffd700 1 -- 172.21.15.87:0/738168721 learned_addr learned my addr 172.21.15.87:0/738168721 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:10:50.621 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0927fc700 1 -- 172.21.15.87:0/738168721 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194376114 0 0) 0x7fe09406d220 con 0x7fe0940c8f80 2023-03-30T08:10:50.621 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0927fc700 1 -- 172.21.15.87:0/738168721 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe07c0035d0 con 0x7fe0940c8f80 2023-03-30T08:10:50.621 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0937fe700 1 -- 172.21.15.87:0/738168721 >> v1:172.21.15.115:6789/0 conn(0x7fe09406b190 legacy=0x7fe09415e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:50.621 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0937fe700 1 -- 172.21.15.87:0/738168721 >> v1:172.21.15.87:6789/0 conn(0x7fe0940c8f80 legacy=0x7fe09406aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:50.622 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0937fe700 1 -- 172.21.15.87:0/738168721 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09406dac0 con 0x7fe0940adeb0 2023-03-30T08:10:50.622 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0937fe700 1 --2- 172.21.15.87:0/738168721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0940adeb0 0x7fe0940c2480 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe084009880 tx=0x7fe084009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f50e874f4577298 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:50.623 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0927fc700 1 -- 172.21.15.87:0/738168721 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084011830 con 0x7fe0940adeb0 2023-03-30T08:10:50.623 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0927fc700 1 -- 172.21.15.87:0/738168721 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe084011990 con 0x7fe0940adeb0 2023-03-30T08:10:50.623 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0927fc700 1 -- 172.21.15.87:0/738168721 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084011d20 con 0x7fe0940adeb0 2023-03-30T08:10:50.623 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0988bc700 1 -- 172.21.15.87:0/738168721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0940adeb0 msgr2=0x7fe0940c2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:50.623 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0988bc700 1 --2- 172.21.15.87:0/738168721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0940adeb0 0x7fe0940c2480 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe084009880 tx=0x7fe084009b90 comp rx=0 tx=0).stop 2023-03-30T08:10:50.623 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0988bc700 1 -- 172.21.15.87:0/738168721 shutdown_connections 2023-03-30T08:10:50.623 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0988bc700 1 --2- 172.21.15.87:0/738168721 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0940adeb0 0x7fe0940c2480 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:50.624 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0988bc700 1 -- 172.21.15.87:0/738168721 >> 172.21.15.87:0/738168721 conn(0x7fe0940cb3b0 msgr2=0x7fe0940cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:50.624 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0988bc700 1 -- 172.21.15.87:0/738168721 shutdown_connections 2023-03-30T08:10:50.624 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.617+0000 7fe0988bc700 1 -- 172.21.15.87:0/738168721 wait complete. 2023-03-30T08:10:50.625 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.621+0000 7fe0988bc700 1 Processor -- start 2023-03-30T08:10:50.626 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.621+0000 7fe0988bc700 1 -- start start 2023-03-30T08:10:50.628 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe0988bc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe09406b190 0x7fe094156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:50.628 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe0988bc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0940adeb0 0x7fe09415a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:50.628 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe0988bc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0940c8f80 0x7fe0940ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:50.628 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe0988bc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe094155820 con 0x7fe0940c8f80 2023-03-30T08:10:50.628 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe0988bc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940cc500 con 0x7fe09406b190 2023-03-30T08:10:50.628 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe0988bc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940cca80 con 0x7fe0940adeb0 2023-03-30T08:10:50.630 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe093fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0940c8f80 0x7fe0940ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:50.630 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe093fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0940c8f80 0x7fe0940ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37496/0 (socket says 172.21.15.87:37496) 2023-03-30T08:10:50.630 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe093fff700 1 -- 172.21.15.87:0/4292142552 learned_addr learned my addr 172.21.15.87:0/4292142552 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:50.630 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe092ffd700 1 --2- 172.21.15.87:0/4292142552 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0940adeb0 0x7fe09415a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:50.630 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe0937fe700 1 --2- 172.21.15.87:0/4292142552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe09406b190 0x7fe094156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:50.630 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe093fff700 1 -- 172.21.15.87:0/4292142552 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0940adeb0 msgr2=0x7fe09415a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:50.631 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe093fff700 1 --2- 172.21.15.87:0/4292142552 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0940adeb0 0x7fe09415a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:50.631 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe093fff700 1 -- 172.21.15.87:0/4292142552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe09406b190 msgr2=0x7fe094156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:50.631 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe093fff700 1 --2- 172.21.15.87:0/4292142552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe09406b190 0x7fe094156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:50.631 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe093fff700 1 -- 172.21.15.87:0/4292142552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0840094b0 con 0x7fe0940c8f80 2023-03-30T08:10:50.631 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe0937fe700 1 --2- 172.21.15.87:0/4292142552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe09406b190 0x7fe094156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:10:50.631 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe093fff700 1 --2- 172.21.15.87:0/4292142552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0940c8f80 0x7fe0940ccf10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00cbc0 tx=0x7fe08c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:50.631 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe07bfff700 1 -- 172.21.15.87:0/4292142552 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c003c20 con 0x7fe0940c8f80 2023-03-30T08:10:50.631 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe07bfff700 1 -- 172.21.15.87:0/4292142552 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c003d80 con 0x7fe0940c8f80 2023-03-30T08:10:50.632 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe0988bc700 1 -- 172.21.15.87:0/4292142552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0940cb000 con 0x7fe0940c8f80 2023-03-30T08:10:50.632 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe07bfff700 1 -- 172.21.15.87:0/4292142552 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00ab40 con 0x7fe0940c8f80 2023-03-30T08:10:50.632 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.625+0000 7fe0988bc700 1 -- 172.21.15.87:0/4292142552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09406dda0 con 0x7fe0940c8f80 2023-03-30T08:10:50.632 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.629+0000 7fe0988bc700 1 -- 172.21.15.87:0/4292142552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0940c9400 con 0x7fe0940c8f80 2023-03-30T08:10:50.633 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.629+0000 7fe07bfff700 1 -- 172.21.15.87:0/4292142552 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fe08c00aca0 con 0x7fe0940c8f80 2023-03-30T08:10:50.635 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.633+0000 7fe07bfff700 1 --2- 172.21.15.87:0/4292142552 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe0800653f0 0x7fe0800678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:50.636 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.633+0000 7fe07bfff700 1 -- 172.21.15.87:0/4292142552 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe08c0824f0 con 0x7fe0940c8f80 2023-03-30T08:10:50.636 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.633+0000 7fe0937fe700 1 --2- 172.21.15.87:0/4292142552 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe0800653f0 0x7fe0800678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:50.636 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.633+0000 7fe0937fe700 1 --2- 172.21.15.87:0/4292142552 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe0800653f0 0x7fe0800678a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe0840090b0 tx=0x7fe084008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:50.641 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.637+0000 7fe07bfff700 1 -- 172.21.15.87:0/4292142552 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fe08c0504f0 con 0x7fe0940c8f80 2023-03-30T08:10:50.811 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.809+0000 7fe0988bc700 1 -- 172.21.15.87:0/4292142552 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0940ccc30 con 0x7fe0940c8f80 2023-03-30T08:10:50.813 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.809+0000 7fe07bfff700 1 -- 172.21.15.87:0/4292142552 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12382 (secure 0 0 0) 0x7fe0940ccc30 con 0x7fe0940c8f80 2023-03-30T08:10:50.814 INFO:teuthology.misc.health.smithi087.stdout: 2023-03-30T08:10:50.814 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":17,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:10:46.629232+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:10:50.816 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.813+0000 7fe0988bc700 1 -- 172.21.15.87:0/4292142552 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe0800653f0 msgr2=0x7fe0800678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:50.816 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.813+0000 7fe0988bc700 1 --2- 172.21.15.87:0/4292142552 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe0800653f0 0x7fe0800678a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe0840090b0 tx=0x7fe084008030 comp rx=0 tx=0).stop 2023-03-30T08:10:50.816 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.813+0000 7fe0988bc700 1 -- 172.21.15.87:0/4292142552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0940c8f80 msgr2=0x7fe0940ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:50.816 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.813+0000 7fe0988bc700 1 --2- 172.21.15.87:0/4292142552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0940c8f80 0x7fe0940ccf10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00cbc0 tx=0x7fe08c00ced0 comp rx=0 tx=0).stop 2023-03-30T08:10:50.816 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.813+0000 7fe0988bc700 1 -- 172.21.15.87:0/4292142552 shutdown_connections 2023-03-30T08:10:50.817 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.813+0000 7fe0988bc700 1 --2- 172.21.15.87:0/4292142552 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe0800653f0 0x7fe0800678a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:50.817 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.813+0000 7fe0988bc700 1 --2- 172.21.15.87:0/4292142552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0940c8f80 0x7fe0940ccf10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:50.817 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.813+0000 7fe0988bc700 1 --2- 172.21.15.87:0/4292142552 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0940adeb0 0x7fe09415a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:50.817 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.813+0000 7fe0988bc700 1 --2- 172.21.15.87:0/4292142552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe09406b190 0x7fe094156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:50.817 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.813+0000 7fe0988bc700 1 -- 172.21.15.87:0/4292142552 >> 172.21.15.87:0/4292142552 conn(0x7fe0940cb3b0 msgr2=0x7fe094158ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:50.818 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.813+0000 7fe0988bc700 1 -- 172.21.15.87:0/4292142552 shutdown_connections 2023-03-30T08:10:50.818 INFO:teuthology.misc.health.smithi087.stderr:2023-03-30T08:10:50.813+0000 7fe0988bc700 1 -- 172.21.15.87:0/4292142552 wait complete. 2023-03-30T08:10:50.832 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-03-30T08:10:50.833 INFO:tasks.ceph:Creating RBD pool 2023-03-30T08:10:50.833 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd pool create rbd 8 2023-03-30T08:10:50.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.981+0000 7f5499551700 1 Processor -- start 2023-03-30T08:10:50.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.981+0000 7f5499551700 1 -- start start 2023-03-30T08:10:50.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f5499551700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5494159050 0x7f5494069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:50.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f5499551700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54940afca0 con 0x7f549415cba0 2023-03-30T08:10:50.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f5499551700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549415d110 con 0x7f54940ca4b0 2023-03-30T08:10:50.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f5499551700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54940afb10 con 0x7f5494159050 2023-03-30T08:10:50.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f548b7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f549415cba0 0x7f54940cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52958/0 (socket says 172.21.15.87:52958) 2023-03-30T08:10:50.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f548b7fe700 1 -- 172.21.15.87:0/951819003 learned_addr learned my addr 172.21.15.87:0/951819003 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:10:50.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f5493fff700 1 --2- 172.21.15.87:0/951819003 >> v2:172.21.15.115:3300/0 conn(0x7f5494159050 0x7f5494069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:50.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f54937fe700 1 -- 172.21.15.87:0/951819003 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373308247 0 0) 0x7f54940afca0 con 0x7f549415cba0 2023-03-30T08:10:50.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f54937fe700 1 -- 172.21.15.87:0/951819003 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54800035d0 con 0x7f549415cba0 2023-03-30T08:10:50.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f54937fe700 1 -- 172.21.15.87:0/951819003 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2569885380 0 0) 0x7f54800035d0 con 0x7f549415cba0 2023-03-30T08:10:50.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f54937fe700 1 -- 172.21.15.87:0/951819003 >> v2:172.21.15.115:3300/0 conn(0x7f5494159050 msgr2=0x7f5494069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:50.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f54937fe700 1 --2- 172.21.15.87:0/951819003 >> v2:172.21.15.115:3300/0 conn(0x7f5494159050 0x7f5494069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:50.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f54937fe700 1 -- 172.21.15.87:0/951819003 >> v1:172.21.15.115:6789/0 conn(0x7f54940ca4b0 legacy=0x7f54940b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:50.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f54937fe700 1 -- 172.21.15.87:0/951819003 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549415d3f0 con 0x7f549415cba0 2023-03-30T08:10:50.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f54937fe700 1 -- 172.21.15.87:0/951819003 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f547c001670 con 0x7f549415cba0 2023-03-30T08:10:50.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f54937fe700 1 -- 172.21.15.87:0/951819003 >> v1:172.21.15.87:6789/0 conn(0x7f549415cba0 legacy=0x7f54940cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:50.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f54937fe700 1 --2- 172.21.15.87:0/951819003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5480003a20 0x7f5480003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:50.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f54937fe700 1 --2- 172.21.15.87:0/951819003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5480004870 0x7f5480004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:50.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f54937fe700 1 --2- 172.21.15.87:0/951819003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5480005220 0x7f548000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:50.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f54937fe700 1 -- 172.21.15.87:0/951819003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54940afb10 con 0x7f5480003a20 2023-03-30T08:10:50.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f54937fe700 1 -- 172.21.15.87:0/951819003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548000c0a0 con 0x7f5480005220 2023-03-30T08:10:50.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f54937fe700 1 -- 172.21.15.87:0/951819003 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548000c260 con 0x7f5480004870 2023-03-30T08:10:50.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f5493fff700 1 --2- 172.21.15.87:0/951819003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5480003a20 0x7f5480003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:50.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f548b7fe700 1 --2- 172.21.15.87:0/951819003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5480004870 0x7f5480004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:50.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.985+0000 7f5498d50700 1 --2- 172.21.15.87:0/951819003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5480005220 0x7f548000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:50.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f5493fff700 1 -- 172.21.15.87:0/951819003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5480004870 msgr2=0x7f5480004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:50.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f5493fff700 1 --2- 172.21.15.87:0/951819003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5480004870 0x7f5480004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:50.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f5493fff700 1 -- 172.21.15.87:0/951819003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5480005220 msgr2=0x7f548000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:50.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f5493fff700 1 --2- 172.21.15.87:0/951819003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5480005220 0x7f548000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:50.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f5493fff700 1 -- 172.21.15.87:0/951819003 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54800035d0 con 0x7f5480003a20 2023-03-30T08:10:50.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f5498d50700 1 -- 172.21.15.87:0/951819003 reap_dead start 2023-03-30T08:10:50.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f5493fff700 1 --2- 172.21.15.87:0/951819003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5480003a20 0x7f5480003e30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5484009b70 tx=0x7f54800058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac51f2f6bf071cb3 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:50.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f54937fe700 1 -- 172.21.15.87:0/951819003 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548400e6c0 con 0x7f5480003a20 2023-03-30T08:10:50.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f54937fe700 1 -- 172.21.15.87:0/951819003 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548400e820 con 0x7f5480003a20 2023-03-30T08:10:50.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f54937fe700 1 -- 172.21.15.87:0/951819003 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548400eb90 con 0x7f5480003a20 2023-03-30T08:10:50.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f5499551700 1 -- 172.21.15.87:0/951819003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5480003a20 msgr2=0x7f5480003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:50.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f5499551700 1 --2- 172.21.15.87:0/951819003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5480003a20 0x7f5480003e30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5484009b70 tx=0x7f54800058a0 comp rx=0 tx=0).stop 2023-03-30T08:10:50.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f5499551700 1 -- 172.21.15.87:0/951819003 shutdown_connections 2023-03-30T08:10:50.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f5499551700 1 --2- 172.21.15.87:0/951819003 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5480003a20 0x7f5480003e30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:50.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f5499551700 1 -- 172.21.15.87:0/951819003 >> 172.21.15.87:0/951819003 conn(0x7f54940cf410 msgr2=0x7f54940cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:50.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f5499551700 1 -- 172.21.15.87:0/951819003 shutdown_connections 2023-03-30T08:10:50.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.989+0000 7f5499551700 1 -- 172.21.15.87:0/951819003 wait complete. 2023-03-30T08:10:50.997 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5499551700 1 Processor -- start 2023-03-30T08:10:50.997 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5499551700 1 -- start start 2023-03-30T08:10:50.997 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5499551700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5480003a20 0x7f5494152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:50.997 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5499551700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54941f6de0 0x7f54941f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:50.997 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5499551700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54941558f0 0x7f5494155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:50.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5499551700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54940ccaf0 con 0x7f5480003a20 2023-03-30T08:10:50.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5499551700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5494154b30 con 0x7f54941f6de0 2023-03-30T08:10:50.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5499551700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5494154e10 con 0x7f54941558f0 2023-03-30T08:10:50.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5493fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5480003a20 0x7f5494152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:50.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5493fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5480003a20 0x7f5494152f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37508/0 (socket says 172.21.15.87:37508) 2023-03-30T08:10:50.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5493fff700 1 -- 172.21.15.87:0/3506244657 learned_addr learned my addr 172.21.15.87:0/3506244657 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:51.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5493fff700 1 -- 172.21.15.87:0/3506244657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54941558f0 msgr2=0x7f5494155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:51.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5493fff700 1 --2- 172.21.15.87:0/3506244657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54941558f0 0x7f5494155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:51.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f548b7fe700 1 --2- 172.21.15.87:0/3506244657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54941f6de0 0x7f54941f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:51.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5493fff700 1 -- 172.21.15.87:0/3506244657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54941f6de0 msgr2=0x7f54941f7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:51.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5493fff700 1 --2- 172.21.15.87:0/3506244657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54941f6de0 0x7f54941f7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:51.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f5493fff700 1 -- 172.21.15.87:0/3506244657 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549415d9b0 con 0x7f5480003a20 2023-03-30T08:10:51.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.993+0000 7f548b7fe700 1 --2- 172.21.15.87:0/3506244657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54941f6de0 0x7f54941f7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:10:51.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.997+0000 7f5493fff700 1 --2- 172.21.15.87:0/3506244657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5480003a20 0x7f5494152f10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f548000c070 tx=0x7f54840047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:51.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.997+0000 7f54917fa700 1 -- 172.21.15.87:0/3506244657 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548400e6c0 con 0x7f5480003a20 2023-03-30T08:10:51.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.997+0000 7f54917fa700 1 -- 172.21.15.87:0/3506244657 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5484003b10 con 0x7f5480003a20 2023-03-30T08:10:51.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.997+0000 7f5499551700 1 -- 172.21.15.87:0/3506244657 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549415d6d0 con 0x7f5480003a20 2023-03-30T08:10:51.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.997+0000 7f54917fa700 1 -- 172.21.15.87:0/3506244657 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54840045d0 con 0x7f5480003a20 2023-03-30T08:10:51.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.997+0000 7f5499551700 1 -- 172.21.15.87:0/3506244657 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5494159420 con 0x7f5480003a20 2023-03-30T08:10:51.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.997+0000 7f5499551700 1 -- 172.21.15.87:0/3506244657 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54940733a0 con 0x7f5480003a20 2023-03-30T08:10:51.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:50.997+0000 7f54917fa700 1 -- 172.21.15.87:0/3506244657 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f5484013470 con 0x7f5480003a20 2023-03-30T08:10:51.003 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.001+0000 7f54917fa700 1 --2- 172.21.15.87:0/3506244657 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5474065420 0x7f54740678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:51.003 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.001+0000 7f54917fa700 1 -- 172.21.15.87:0/3506244657 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5484083790 con 0x7f5480003a20 2023-03-30T08:10:51.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.001+0000 7f548b7fe700 1 --2- 172.21.15.87:0/3506244657 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5474065420 0x7f54740678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:51.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.001+0000 7f548b7fe700 1 --2- 172.21.15.87:0/3506244657 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5474065420 0x7f54740678d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f54940b2b50 tx=0x7f547c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:51.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.005+0000 7f54917fa700 1 -- 172.21.15.87:0/3506244657 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f5484051900 con 0x7f5480003a20 2023-03-30T08:10:51.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.173+0000 7f5499551700 1 -- 172.21.15.87:0/3506244657 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f54940ccaf0 con 0x7f5480003a20 2023-03-30T08:10:51.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.841+0000 7f54917fa700 1 -- 172.21.15.87:0/3506244657 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f5484054f20 con 0x7f5480003a20 2023-03-30T08:10:51.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.845+0000 7f5499551700 1 -- 172.21.15.87:0/3506244657 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5474065420 msgr2=0x7f54740678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:51.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.845+0000 7f5499551700 1 --2- 172.21.15.87:0/3506244657 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5474065420 0x7f54740678d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f54940b2b50 tx=0x7f547c009040 comp rx=0 tx=0).stop 2023-03-30T08:10:51.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.845+0000 7f5499551700 1 -- 172.21.15.87:0/3506244657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5480003a20 msgr2=0x7f5494152f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:51.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.845+0000 7f5499551700 1 --2- 172.21.15.87:0/3506244657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5480003a20 0x7f5494152f10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f548000c070 tx=0x7f54840047e0 comp rx=0 tx=0).stop 2023-03-30T08:10:51.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.849+0000 7f5499551700 1 -- 172.21.15.87:0/3506244657 shutdown_connections 2023-03-30T08:10:51.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.849+0000 7f5499551700 1 --2- 172.21.15.87:0/3506244657 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5474065420 0x7f54740678d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:51.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.849+0000 7f5499551700 1 --2- 172.21.15.87:0/3506244657 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54941558f0 0x7f5494155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:51.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.849+0000 7f5499551700 1 --2- 172.21.15.87:0/3506244657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54941f6de0 0x7f54941f7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.849+0000 7f5499551700 1 --2- 172.21.15.87:0/3506244657 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5480003a20 0x7f5494152f10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.849+0000 7f5499551700 1 -- 172.21.15.87:0/3506244657 >> 172.21.15.87:0/3506244657 conn(0x7f54940cf410 msgr2=0x7f54940aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.849+0000 7f5499551700 1 -- 172.21.15.87:0/3506244657 shutdown_connections 2023-03-30T08:10:51.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:51.849+0000 7f5499551700 1 -- 172.21.15.87:0/3506244657 wait complete. 2023-03-30T08:10:51.854 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'rbd' created 2023-03-30T08:10:51.871 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-03-30T08:10:52.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.025+0000 7f0e3d9a0700 1 Processor -- start 2023-03-30T08:10:52.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.025+0000 7f0e3d9a0700 1 -- start start 2023-03-30T08:10:52.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.025+0000 7f0e3d9a0700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0e380b8460 0x7f0e380b4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:52.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.025+0000 7f0e3d9a0700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0e380d27d0 0x7f0e380b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:52.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.025+0000 7f0e3d9a0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e380cd350 con 0x7f0e380cd7e0 2023-03-30T08:10:52.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.025+0000 7f0e3d9a0700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e38160f50 con 0x7f0e380d27d0 2023-03-30T08:10:52.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.025+0000 7f0e3d9a0700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3806c320 con 0x7f0e380b8460 2023-03-30T08:10:52.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.029+0000 7f0e36ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0e380b8460 0x7f0e380b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:52.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.029+0000 7f0e367fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0e380cd7e0 0x7f0e38069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:48880/0 (socket says 172.21.15.87:48880) 2023-03-30T08:10:52.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.029+0000 7f0e367fc700 1 -- 172.21.15.87:0/3155336648 learned_addr learned my addr 172.21.15.87:0/3155336648 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:10:52.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.029+0000 7f0e377fe700 1 --2- 172.21.15.87:0/3155336648 >> v2:172.21.15.87:3300/0 conn(0x7f0e380d27d0 0x7f0e380b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:52.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.029+0000 7f0e35ffb700 1 -- 172.21.15.87:0/3155336648 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777280837 0 0) 0x7f0e380cd350 con 0x7f0e380cd7e0 2023-03-30T08:10:52.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.029+0000 7f0e35ffb700 1 -- 172.21.15.87:0/3155336648 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e200035d0 con 0x7f0e380cd7e0 2023-03-30T08:10:52.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.029+0000 7f0e36ffd700 1 -- 172.21.15.87:0/3155336648 >> v2:172.21.15.87:3300/0 conn(0x7f0e380d27d0 msgr2=0x7f0e380b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:52.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.029+0000 7f0e36ffd700 1 --2- 172.21.15.87:0/3155336648 >> v2:172.21.15.87:3300/0 conn(0x7f0e380d27d0 0x7f0e380b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:52.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.029+0000 7f0e36ffd700 1 -- 172.21.15.87:0/3155336648 >> v1:172.21.15.115:6789/0 conn(0x7f0e380cd7e0 legacy=0x7f0e38069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:52.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.029+0000 7f0e36ffd700 1 -- 172.21.15.87:0/3155336648 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e380b8830 con 0x7f0e380b8460 2023-03-30T08:10:52.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.029+0000 7f0e36ffd700 1 --2- 172.21.15.87:0/3155336648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e380b8460 0x7f0e380b4780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0e3808bf80 tx=0x7f0e28009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17d2c1633be22b5a server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:52.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.029+0000 7f0e35ffb700 1 -- 172.21.15.87:0/3155336648 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28011830 con 0x7f0e380b8460 2023-03-30T08:10:52.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.029+0000 7f0e35ffb700 1 -- 172.21.15.87:0/3155336648 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e28011990 con 0x7f0e380b8460 2023-03-30T08:10:52.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.029+0000 7f0e35ffb700 1 -- 172.21.15.87:0/3155336648 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28011d00 con 0x7f0e380b8460 2023-03-30T08:10:52.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.033+0000 7f0e3d9a0700 1 -- 172.21.15.87:0/3155336648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e380b8460 msgr2=0x7f0e380b4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:52.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.033+0000 7f0e3d9a0700 1 --2- 172.21.15.87:0/3155336648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e380b8460 0x7f0e380b4780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0e3808bf80 tx=0x7f0e28009b30 comp rx=0 tx=0).stop 2023-03-30T08:10:52.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.033+0000 7f0e3d9a0700 1 -- 172.21.15.87:0/3155336648 shutdown_connections 2023-03-30T08:10:52.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.033+0000 7f0e3d9a0700 1 --2- 172.21.15.87:0/3155336648 >> v2:172.21.15.87:3300/0 conn(0x7f0e380d27d0 0x7f0e380b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:52.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.033+0000 7f0e3d9a0700 1 --2- 172.21.15.87:0/3155336648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e380b8460 0x7f0e380b4780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:52.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.033+0000 7f0e3d9a0700 1 -- 172.21.15.87:0/3155336648 >> 172.21.15.87:0/3155336648 conn(0x7f0e380cf780 msgr2=0x7f0e380cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:52.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.033+0000 7f0e3d9a0700 1 -- 172.21.15.87:0/3155336648 shutdown_connections 2023-03-30T08:10:52.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.033+0000 7f0e3d9a0700 1 -- 172.21.15.87:0/3155336648 wait complete. 2023-03-30T08:10:52.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.033+0000 7f0e3d9a0700 1 Processor -- start 2023-03-30T08:10:52.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.033+0000 7f0e3d9a0700 1 -- start start 2023-03-30T08:10:52.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e3d9a0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e380b8460 0x7f0e380b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:52.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e3d9a0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380cd7e0 0x7f0e381f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:52.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e3d9a0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e380d27d0 0x7f0e3814f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:52.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e3d9a0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380b4460 con 0x7f0e380cd7e0 2023-03-30T08:10:52.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e3d9a0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e38153e10 con 0x7f0e380b8460 2023-03-30T08:10:52.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e3d9a0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e381f5a90 con 0x7f0e380d27d0 2023-03-30T08:10:52.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e367fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380cd7e0 0x7f0e381f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:52.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e367fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380cd7e0 0x7f0e381f5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37518/0 (socket says 172.21.15.87:37518) 2023-03-30T08:10:52.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e367fc700 1 -- 172.21.15.87:0/1573379342 learned_addr learned my addr 172.21.15.87:0/1573379342 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:52.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e36ffd700 1 --2- 172.21.15.87:0/1573379342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e380b8460 0x7f0e380b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:52.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e377fe700 1 --2- 172.21.15.87:0/1573379342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e380d27d0 0x7f0e3814f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:52.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e367fc700 1 -- 172.21.15.87:0/1573379342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e380d27d0 msgr2=0x7f0e3814f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:52.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e367fc700 1 --2- 172.21.15.87:0/1573379342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e380d27d0 0x7f0e3814f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:52.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e367fc700 1 -- 172.21.15.87:0/1573379342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e380b8460 msgr2=0x7f0e380b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:52.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e367fc700 1 --2- 172.21.15.87:0/1573379342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e380b8460 0x7f0e380b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:52.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e367fc700 1 -- 172.21.15.87:0/1573379342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e280094b0 con 0x7f0e380cd7e0 2023-03-30T08:10:52.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e367fc700 1 --2- 172.21.15.87:0/1573379342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380cd7e0 0x7f0e381f5550 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c00c730 tx=0x7f0e2c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:52.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e1ffff700 1 -- 172.21.15.87:0/1573379342 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c005d90 con 0x7f0e380cd7e0 2023-03-30T08:10:52.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e3d9a0700 1 -- 172.21.15.87:0/1573379342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e381609b0 con 0x7f0e380cd7e0 2023-03-30T08:10:52.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e1ffff700 1 -- 172.21.15.87:0/1573379342 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2c0070d0 con 0x7f0e380cd7e0 2023-03-30T08:10:52.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e1ffff700 1 -- 172.21.15.87:0/1573379342 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c007480 con 0x7f0e380cd7e0 2023-03-30T08:10:52.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.037+0000 7f0e3d9a0700 1 -- 172.21.15.87:0/1573379342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e380ceeb0 con 0x7f0e380cd7e0 2023-03-30T08:10:52.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.041+0000 7f0e3d9a0700 1 -- 172.21.15.87:0/1573379342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e38160c70 con 0x7f0e380cd7e0 2023-03-30T08:10:52.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.041+0000 7f0e1ffff700 1 -- 172.21.15.87:0/1573379342 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f0e2c0075e0 con 0x7f0e380cd7e0 2023-03-30T08:10:52.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.045+0000 7f0e1ffff700 1 --2- 172.21.15.87:0/1573379342 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0e24065420 0x7f0e240678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:52.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.045+0000 7f0e1ffff700 1 -- 172.21.15.87:0/1573379342 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f0e2c081a60 con 0x7f0e380cd7e0 2023-03-30T08:10:52.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.045+0000 7f0e36ffd700 1 --2- 172.21.15.87:0/1573379342 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0e24065420 0x7f0e240678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:52.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.045+0000 7f0e36ffd700 1 --2- 172.21.15.87:0/1573379342 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0e24065420 0x7f0e240678d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e28000c00 tx=0x7f0e28008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:52.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.049+0000 7f0e1ffff700 1 -- 172.21.15.87:0/1573379342 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f0e2c04fa50 con 0x7f0e380cd7e0 2023-03-30T08:10:52.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.221+0000 7f0e3d9a0700 1 -- 172.21.15.87:0/1573379342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0e38073ee0 con 0x7f0e380cd7e0 2023-03-30T08:10:52.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.857+0000 7f0e1ffff700 1 -- 172.21.15.87:0/1573379342 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0e2c053070 con 0x7f0e380cd7e0 2023-03-30T08:10:52.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.861+0000 7f0e3d9a0700 1 -- 172.21.15.87:0/1573379342 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0e24065420 msgr2=0x7f0e240678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:52.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.861+0000 7f0e3d9a0700 1 --2- 172.21.15.87:0/1573379342 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0e24065420 0x7f0e240678d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e28000c00 tx=0x7f0e28008030 comp rx=0 tx=0).stop 2023-03-30T08:10:52.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.861+0000 7f0e3d9a0700 1 -- 172.21.15.87:0/1573379342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380cd7e0 msgr2=0x7f0e381f5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:52.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.861+0000 7f0e3d9a0700 1 --2- 172.21.15.87:0/1573379342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380cd7e0 0x7f0e381f5550 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c00c730 tx=0x7f0e2c00ca40 comp rx=0 tx=0).stop 2023-03-30T08:10:52.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.861+0000 7f0e3d9a0700 1 -- 172.21.15.87:0/1573379342 shutdown_connections 2023-03-30T08:10:52.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.861+0000 7f0e3d9a0700 1 --2- 172.21.15.87:0/1573379342 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0e24065420 0x7f0e240678d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:52.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.861+0000 7f0e3d9a0700 1 --2- 172.21.15.87:0/1573379342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e380d27d0 0x7f0e3814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:52.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.861+0000 7f0e3d9a0700 1 --2- 172.21.15.87:0/1573379342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e380cd7e0 0x7f0e381f5550 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:52.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.861+0000 7f0e3d9a0700 1 --2- 172.21.15.87:0/1573379342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e380b8460 0x7f0e380b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:52.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.861+0000 7f0e3d9a0700 1 -- 172.21.15.87:0/1573379342 >> 172.21.15.87:0/1573379342 conn(0x7f0e380cf780 msgr2=0x7f0e380c8640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:52.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.861+0000 7f0e3d9a0700 1 -- 172.21.15.87:0/1573379342 shutdown_connections 2023-03-30T08:10:52.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:52.861+0000 7f0e3d9a0700 1 -- 172.21.15.87:0/1573379342 wait complete. 2023-03-30T08:10:52.867 INFO:teuthology.orchestra.run.smithi087.stderr:enabled application 'rbd' on pool 'rbd' 2023-03-30T08:10:52.885 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-03-30T08:10:52.885 INFO:tasks.ceph.mds.a:Restarting daemon 2023-03-30T08:10:52.886 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-03-30T08:10:52.889 INFO:tasks.ceph.mds.a:Started 2023-03-30T08:10:52.889 INFO:tasks.ceph.mds.c:Restarting daemon 2023-03-30T08:10:52.890 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-03-30T08:10:52.893 INFO:tasks.ceph.mds.c:Started 2023-03-30T08:10:52.894 INFO:tasks.ceph.mds.b:Restarting daemon 2023-03-30T08:10:52.894 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-03-30T08:10:52.900 INFO:tasks.ceph.mds.b:Started 2023-03-30T08:10:52.900 INFO:tasks.ceph.mds.d:Restarting daemon 2023-03-30T08:10:52.900 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-03-30T08:10:52.904 INFO:tasks.ceph.mds.d:Started 2023-03-30T08:10:52.904 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-03-30T08:10:52.905 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:10:53.002 INFO:tasks.ceph.mds.c.smithi087.stdout:starting mds.c at 2023-03-30T08:10:53.003 INFO:tasks.ceph.mds.a.smithi087.stdout:starting mds.a at 2023-03-30T08:10:53.012 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-03-30T08:10:53.023 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-03-30T08:10:53.060 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.057+0000 7f177b59e700 1 Processor -- start 2023-03-30T08:10:53.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.057+0000 7f177b59e700 1 -- start start 2023-03-30T08:10:53.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.057+0000 7f177b59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f177c06d320 0x7f177c1650f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.057+0000 7f177b59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177c06b670 con 0x7f177c0b3f30 2023-03-30T08:10:53.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.057+0000 7f177b59e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177c06b0b0 con 0x7f177c0b0c10 2023-03-30T08:10:53.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.057+0000 7f177b59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177c0b1090 con 0x7f177c06d320 2023-03-30T08:10:53.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.057+0000 7f177a59c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f177c0b3f30 0x7f177c06a6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52974/0 (socket says 172.21.15.87:52974) 2023-03-30T08:10:53.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.057+0000 7f177a59c700 1 -- 172.21.15.87:0/3091407454 learned_addr learned my addr 172.21.15.87:0/3091407454 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:10:53.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.057+0000 7f177ad9d700 1 --2- 172.21.15.87:0/3091407454 >> v2:172.21.15.115:3300/0 conn(0x7f177c06d320 0x7f177c1650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f1779d9b700 1 -- 172.21.15.87:0/3091407454 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274986699 0 0) 0x7f177c06b670 con 0x7f177c0b3f30 2023-03-30T08:10:53.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f1779d9b700 1 -- 172.21.15.87:0/3091407454 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17680035d0 con 0x7f177c0b3f30 2023-03-30T08:10:53.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f177ad9d700 1 -- 172.21.15.87:0/3091407454 >> v1:172.21.15.115:6789/0 conn(0x7f177c0b0c10 legacy=0x7f177c0aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f177ad9d700 1 -- 172.21.15.87:0/3091407454 >> v1:172.21.15.87:6789/0 conn(0x7f177c0b3f30 legacy=0x7f177c06a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f177ad9d700 1 -- 172.21.15.87:0/3091407454 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c06b390 con 0x7f177c06d320 2023-03-30T08:10:53.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f177ad9d700 1 --2- 172.21.15.87:0/3091407454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f177c06d320 0x7f177c1650f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1774009d90 tx=0x7f177400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=542ec444c3f567e5 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:53.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f1779d9b700 1 -- 172.21.15.87:0/3091407454 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177400e070 con 0x7f177c06d320 2023-03-30T08:10:53.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f1779d9b700 1 -- 172.21.15.87:0/3091407454 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177400bb20 con 0x7f177c06d320 2023-03-30T08:10:53.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f1779d9b700 1 -- 172.21.15.87:0/3091407454 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774012430 con 0x7f177c06d320 2023-03-30T08:10:53.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f177b59e700 1 -- 172.21.15.87:0/3091407454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f177c06d320 msgr2=0x7f177c1650f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f177b59e700 1 --2- 172.21.15.87:0/3091407454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f177c06d320 0x7f177c1650f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1774009d90 tx=0x7f177400b330 comp rx=0 tx=0).stop 2023-03-30T08:10:53.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f177b59e700 1 -- 172.21.15.87:0/3091407454 shutdown_connections 2023-03-30T08:10:53.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f177b59e700 1 --2- 172.21.15.87:0/3091407454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f177c06d320 0x7f177c1650f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f177b59e700 1 -- 172.21.15.87:0/3091407454 >> 172.21.15.87:0/3091407454 conn(0x7f177c0cf410 msgr2=0x7f177c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:53.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f177b59e700 1 -- 172.21.15.87:0/3091407454 shutdown_connections 2023-03-30T08:10:53.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.061+0000 7f177b59e700 1 -- 172.21.15.87:0/3091407454 wait complete. 2023-03-30T08:10:53.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177b59e700 1 Processor -- start 2023-03-30T08:10:53.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177b59e700 1 -- start start 2023-03-30T08:10:53.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f177c06d320 0x7f177c158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177b59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f177c0b0c10 0x7f177c14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177b59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f177c0b3f30 0x7f177c1f2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c1f2770 con 0x7f177c06d320 2023-03-30T08:10:53.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177b59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c15b590 con 0x7f177c0b0c10 2023-03-30T08:10:53.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177b59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c15c110 con 0x7f177c0b3f30 2023-03-30T08:10:53.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177a59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f177c06d320 0x7f177c158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177a59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f177c06d320 0x7f177c158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37548/0 (socket says 172.21.15.87:37548) 2023-03-30T08:10:53.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177a59c700 1 -- 172.21.15.87:0/1727836820 learned_addr learned my addr 172.21.15.87:0/1727836820 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:53.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177ad9d700 1 --2- 172.21.15.87:0/1727836820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f177c0b3f30 0x7f177c1f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f1771d9b700 1 --2- 172.21.15.87:0/1727836820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f177c0b0c10 0x7f177c14ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177a59c700 1 -- 172.21.15.87:0/1727836820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f177c0b3f30 msgr2=0x7f177c1f2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177a59c700 1 --2- 172.21.15.87:0/1727836820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f177c0b3f30 0x7f177c1f2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177a59c700 1 -- 172.21.15.87:0/1727836820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f177c0b0c10 msgr2=0x7f177c14ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177a59c700 1 --2- 172.21.15.87:0/1727836820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f177c0b0c10 0x7f177c14ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177a59c700 1 -- 172.21.15.87:0/1727836820 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1774009a70 con 0x7f177c06d320 2023-03-30T08:10:53.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177a59c700 1 --2- 172.21.15.87:0/1727836820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f177c06d320 0x7f177c158aa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f176c00c580 tx=0x7f176c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f17737fe700 1 -- 172.21.15.87:0/1727836820 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c005d90 con 0x7f177c06d320 2023-03-30T08:10:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f17737fe700 1 -- 172.21.15.87:0/1727836820 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c0070d0 con 0x7f177c06d320 2023-03-30T08:10:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f17737fe700 1 -- 172.21.15.87:0/1727836820 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c007460 con 0x7f177c06d320 2023-03-30T08:10:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.065+0000 7f177b59e700 1 -- 172.21.15.87:0/1727836820 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177c0ae1b0 con 0x7f177c06d320 2023-03-30T08:10:53.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.069+0000 7f177b59e700 1 -- 172.21.15.87:0/1727836820 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177c0aded0 con 0x7f177c06d320 2023-03-30T08:10:53.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.069+0000 7f177b59e700 1 -- 172.21.15.87:0/1727836820 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177c0b4300 con 0x7f177c06d320 2023-03-30T08:10:53.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.069+0000 7f17737fe700 1 -- 172.21.15.87:0/1727836820 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f176c0075c0 con 0x7f177c06d320 2023-03-30T08:10:53.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.073+0000 7f17737fe700 1 --2- 172.21.15.87:0/1727836820 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f175c0653f0 0x7f175c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.073+0000 7f17737fe700 1 -- 172.21.15.87:0/1727836820 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f176c081a10 con 0x7f177c06d320 2023-03-30T08:10:53.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.073+0000 7f1771d9b700 1 --2- 172.21.15.87:0/1727836820 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f175c0653f0 0x7f175c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.073+0000 7f1771d9b700 1 --2- 172.21.15.87:0/1727836820 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f175c0653f0 0x7f175c0678a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f177c15b4e0 tx=0x7f1764009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:53.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.077+0000 7f17737fe700 1 -- 172.21.15.87:0/1727836820 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f176c04f940 con 0x7f177c06d320 2023-03-30T08:10:53.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.249+0000 7f177b59e700 1 -- 172.21.15.87:0/1727836820 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f177c0c94e0 con 0x7f177c06d320 2023-03-30T08:10:53.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.253+0000 7f17737fe700 1 -- 172.21.15.87:0/1727836820 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14181 (secure 0 0 0) 0x7f176c017090 con 0x7f177c06d320 2023-03-30T08:10:53.255 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:10:53.255 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":19,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:10:52.844789+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:10:53.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.253+0000 7f177b59e700 1 -- 172.21.15.87:0/1727836820 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f175c0653f0 msgr2=0x7f175c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.253+0000 7f177b59e700 1 --2- 172.21.15.87:0/1727836820 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f175c0653f0 0x7f175c0678a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f177c15b4e0 tx=0x7f1764009040 comp rx=0 tx=0).stop 2023-03-30T08:10:53.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.253+0000 7f177b59e700 1 -- 172.21.15.87:0/1727836820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f177c06d320 msgr2=0x7f177c158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.253+0000 7f177b59e700 1 --2- 172.21.15.87:0/1727836820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f177c06d320 0x7f177c158aa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f176c00c580 tx=0x7f176c00c890 comp rx=0 tx=0).stop 2023-03-30T08:10:53.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.253+0000 7f177b59e700 1 -- 172.21.15.87:0/1727836820 shutdown_connections 2023-03-30T08:10:53.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.253+0000 7f177b59e700 1 --2- 172.21.15.87:0/1727836820 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f175c0653f0 0x7f175c0678a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.253+0000 7f177b59e700 1 --2- 172.21.15.87:0/1727836820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f177c0b3f30 0x7f177c1f2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.253+0000 7f177b59e700 1 --2- 172.21.15.87:0/1727836820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f177c0b0c10 0x7f177c14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.253+0000 7f177b59e700 1 --2- 172.21.15.87:0/1727836820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f177c06d320 0x7f177c158aa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.253+0000 7f177b59e700 1 -- 172.21.15.87:0/1727836820 >> 172.21.15.87:0/1727836820 conn(0x7f177c0cf410 msgr2=0x7f177c0c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:53.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.253+0000 7f177b59e700 1 -- 172.21.15.87:0/1727836820 shutdown_connections 2023-03-30T08:10:53.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.253+0000 7f177b59e700 1 -- 172.21.15.87:0/1727836820 wait complete. 2023-03-30T08:10:53.277 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-30T08:10:53.278 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T08:10:53.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.445+0000 7f6681ac4700 1 Processor -- start 2023-03-30T08:10:53.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.445+0000 7f6681ac4700 1 -- start start 2023-03-30T08:10:53.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.445+0000 7f6681ac4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f667c0d27e0 0x7f667c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.445+0000 7f6681ac4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f667c06a3e0 0x7f667c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.445+0000 7f6681ac4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c160ef0 con 0x7f667c0b8380 2023-03-30T08:10:53.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.445+0000 7f6681ac4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c0cd6a0 con 0x7f667c06a3e0 2023-03-30T08:10:53.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.445+0000 7f6681ac4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0cd3a0 con 0x7f667c0d27e0 2023-03-30T08:10:53.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f667bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f667c0d27e0 0x7f667c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f667bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f667c0d27e0 0x7f667c0d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:43472/0 (socket says 172.21.15.87:43472) 2023-03-30T08:10:53.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f667bfff700 1 -- 172.21.15.87:0/1380423221 learned_addr learned my addr 172.21.15.87:0/1380423221 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:53.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f66812c3700 1 --2- 172.21.15.87:0/1380423221 >> v2:172.21.15.115:3300/0 conn(0x7f667c06a3e0 0x7f667c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f667bfff700 1 -- 172.21.15.87:0/1380423221 >> v2:172.21.15.115:3300/0 conn(0x7f667c06a3e0 msgr2=0x7f667c0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:53.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f667bfff700 1 --2- 172.21.15.87:0/1380423221 >> v2:172.21.15.115:3300/0 conn(0x7f667c06a3e0 0x7f667c0d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f667bfff700 1 -- 172.21.15.87:0/1380423221 >> v1:172.21.15.115:6789/0 conn(0x7f667c0b8380 legacy=0x7f667c069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f667bfff700 1 -- 172.21.15.87:0/1380423221 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0cef00 con 0x7f667c0d27e0 2023-03-30T08:10:53.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f667bfff700 1 --2- 172.21.15.87:0/1380423221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f667c0d27e0 0x7f667c0d2200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f666c009910 tx=0x7f666c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f45746474a363de server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:53.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f667b7fe700 1 -- 172.21.15.87:0/1380423221 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c011830 con 0x7f667c0d27e0 2023-03-30T08:10:53.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f667b7fe700 1 -- 172.21.15.87:0/1380423221 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c011990 con 0x7f667c0d27e0 2023-03-30T08:10:53.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f667b7fe700 1 -- 172.21.15.87:0/1380423221 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c011d40 con 0x7f667c0d27e0 2023-03-30T08:10:53.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f6681ac4700 1 -- 172.21.15.87:0/1380423221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f667c0d27e0 msgr2=0x7f667c0d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f6681ac4700 1 --2- 172.21.15.87:0/1380423221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f667c0d27e0 0x7f667c0d2200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f666c009910 tx=0x7f666c009c20 comp rx=0 tx=0).stop 2023-03-30T08:10:53.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f6681ac4700 1 -- 172.21.15.87:0/1380423221 shutdown_connections 2023-03-30T08:10:53.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f6681ac4700 1 --2- 172.21.15.87:0/1380423221 >> v2:172.21.15.115:3300/0 conn(0x7f667c06a3e0 0x7f667c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f6681ac4700 1 --2- 172.21.15.87:0/1380423221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f667c0d27e0 0x7f667c0d2200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f6681ac4700 1 -- 172.21.15.87:0/1380423221 >> 172.21.15.87:0/1380423221 conn(0x7f667c0b53f0 msgr2=0x7f667c0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:53.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f6681ac4700 1 -- 172.21.15.87:0/1380423221 shutdown_connections 2023-03-30T08:10:53.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.449+0000 7f6681ac4700 1 -- 172.21.15.87:0/1380423221 wait complete. 2023-03-30T08:10:53.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.453+0000 7f6681ac4700 1 Processor -- start 2023-03-30T08:10:53.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.453+0000 7f6681ac4700 1 -- start start 2023-03-30T08:10:53.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.453+0000 7f6681ac4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f667c06a3e0 0x7f667c1f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.453+0000 7f6681ac4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f667c0b8380 0x7f667c15f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f6681ac4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f667c0cc9b0 0x7f667c06b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f6681ac4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c1f5970 con 0x7f667c0cc9b0 2023-03-30T08:10:53.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f6681ac4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0c9d80 con 0x7f667c0b8380 2023-03-30T08:10:53.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f6681ac4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c15f900 con 0x7f667c06a3e0 2023-03-30T08:10:53.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f66812c3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f667c0cc9b0 0x7f667c06b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f66812c3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f667c0cc9b0 0x7f667c06b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37556/0 (socket says 172.21.15.87:37556) 2023-03-30T08:10:53.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f66812c3700 1 -- 172.21.15.87:0/1865653607 learned_addr learned my addr 172.21.15.87:0/1865653607 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:53.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f6680ac2700 1 --2- 172.21.15.87:0/1865653607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f667c06a3e0 0x7f667c1f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f667bfff700 1 --2- 172.21.15.87:0/1865653607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f667c0b8380 0x7f667c15f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f66812c3700 1 -- 172.21.15.87:0/1865653607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f667c06a3e0 msgr2=0x7f667c1f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f66812c3700 1 --2- 172.21.15.87:0/1865653607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f667c06a3e0 0x7f667c1f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f66812c3700 1 -- 172.21.15.87:0/1865653607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f667c0b8380 msgr2=0x7f667c15f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f66812c3700 1 --2- 172.21.15.87:0/1865653607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f667c0b8380 0x7f667c15f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f66812c3700 1 -- 172.21.15.87:0/1865653607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c009570 con 0x7f667c0cc9b0 2023-03-30T08:10:53.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f66812c3700 1 --2- 172.21.15.87:0/1865653607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f667c0cc9b0 0x7f667c06b1b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f667400efc0 tx=0x7f667400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:53.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f66797fa700 1 -- 172.21.15.87:0/1865653607 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667400cc90 con 0x7f667c0cc9b0 2023-03-30T08:10:53.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f66797fa700 1 -- 172.21.15.87:0/1865653607 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667400f040 con 0x7f667c0cc9b0 2023-03-30T08:10:53.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f6681ac4700 1 -- 172.21.15.87:0/1865653607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c0cf480 con 0x7f667c0cc9b0 2023-03-30T08:10:53.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f66797fa700 1 -- 172.21.15.87:0/1865653607 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66740146c0 con 0x7f667c0cc9b0 2023-03-30T08:10:53.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.457+0000 7f6681ac4700 1 -- 172.21.15.87:0/1865653607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c0cf1a0 con 0x7f667c0cc9b0 2023-03-30T08:10:53.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.461+0000 7f6681ac4700 1 -- 172.21.15.87:0/1865653607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c0b8750 con 0x7f667c0cc9b0 2023-03-30T08:10:53.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.461+0000 7f66797fa700 1 -- 172.21.15.87:0/1865653607 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6674014820 con 0x7f667c0cc9b0 2023-03-30T08:10:53.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.461+0000 7f66797fa700 1 --2- 172.21.15.87:0/1865653607 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6668065420 0x7f66680678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.461+0000 7f66797fa700 1 -- 172.21.15.87:0/1865653607 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6674083010 con 0x7f667c0cc9b0 2023-03-30T08:10:53.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.461+0000 7f6680ac2700 1 --2- 172.21.15.87:0/1865653607 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6668065420 0x7f66680678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.465+0000 7f6680ac2700 1 --2- 172.21.15.87:0/1865653607 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6668065420 0x7f66680678d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6670000f60 tx=0x7f6670009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:53.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.469+0000 7f66797fa700 1 -- 172.21.15.87:0/1865653607 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f6674050fd0 con 0x7f667c0cc9b0 2023-03-30T08:10:53.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.637+0000 7f6681ac4700 1 -- 172.21.15.87:0/1865653607 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f667c072cf0 con 0x7f667c0cc9b0 2023-03-30T08:10:53.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.637+0000 7f66797fa700 1 -- 172.21.15.87:0/1865653607 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66740545f0 con 0x7f667c0cc9b0 2023-03-30T08:10:53.642 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T08:10:53.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.641+0000 7f6681ac4700 1 -- 172.21.15.87:0/1865653607 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6668065420 msgr2=0x7f66680678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.641+0000 7f6681ac4700 1 --2- 172.21.15.87:0/1865653607 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6668065420 0x7f66680678d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6670000f60 tx=0x7f6670009040 comp rx=0 tx=0).stop 2023-03-30T08:10:53.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.641+0000 7f6681ac4700 1 -- 172.21.15.87:0/1865653607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f667c0cc9b0 msgr2=0x7f667c06b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.641+0000 7f6681ac4700 1 --2- 172.21.15.87:0/1865653607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f667c0cc9b0 0x7f667c06b1b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f667400efc0 tx=0x7f667400c3a0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.641+0000 7f6681ac4700 1 -- 172.21.15.87:0/1865653607 shutdown_connections 2023-03-30T08:10:53.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.641+0000 7f6681ac4700 1 --2- 172.21.15.87:0/1865653607 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6668065420 0x7f66680678d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.641+0000 7f6681ac4700 1 --2- 172.21.15.87:0/1865653607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f667c0cc9b0 0x7f667c06b1b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.641+0000 7f6681ac4700 1 --2- 172.21.15.87:0/1865653607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f667c0b8380 0x7f667c15f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.641+0000 7f6681ac4700 1 --2- 172.21.15.87:0/1865653607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f667c06a3e0 0x7f667c1f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.641+0000 7f6681ac4700 1 -- 172.21.15.87:0/1865653607 >> 172.21.15.87:0/1865653607 conn(0x7f667c0b53f0 msgr2=0x7f667c0b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:53.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.641+0000 7f6681ac4700 1 -- 172.21.15.87:0/1865653607 shutdown_connections 2023-03-30T08:10:53.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.641+0000 7f6681ac4700 1 -- 172.21.15.87:0/1865653607 wait complete. 2023-03-30T08:10:53.667 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T08:10:53.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.829+0000 7f2be2ec4700 1 Processor -- start 2023-03-30T08:10:53.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.829+0000 7f2be2ec4700 1 -- start start 2023-03-30T08:10:53.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.829+0000 7f2be2ec4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2bdc163dc0 0x7f2bdc0c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.829+0000 7f2be2ec4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2bdc0aea30 0x7f2bdc06a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.829+0000 7f2be2ec4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bdc069f00 con 0x7f2bdc164190 2023-03-30T08:10:53.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.829+0000 7f2be2ec4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc06d810 con 0x7f2bdc0aea30 2023-03-30T08:10:53.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.829+0000 7f2be2ec4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc0cc1d0 con 0x7f2bdc163dc0 2023-03-30T08:10:53.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.829+0000 7f2be26c3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2bdc0aea30 0x7f2bdc06a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.829+0000 7f2be26c3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2bdc0aea30 0x7f2bdc06a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37572/0 (socket says 172.21.15.87:37572) 2023-03-30T08:10:53.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.829+0000 7f2be26c3700 1 -- 172.21.15.87:0/669006575 learned_addr learned my addr 172.21.15.87:0/669006575 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:53.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be1ec2700 1 --2- 172.21.15.87:0/669006575 >> v2:172.21.15.115:3300/0 conn(0x7f2bdc163dc0 0x7f2bdc0c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be26c3700 1 -- 172.21.15.87:0/669006575 >> v2:172.21.15.115:3300/0 conn(0x7f2bdc163dc0 msgr2=0x7f2bdc0c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:53.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be26c3700 1 --2- 172.21.15.87:0/669006575 >> v2:172.21.15.115:3300/0 conn(0x7f2bdc163dc0 0x7f2bdc0c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be26c3700 1 -- 172.21.15.87:0/669006575 >> v1:172.21.15.115:6789/0 conn(0x7f2bdc164190 legacy=0x7f2bdc0c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be26c3700 1 -- 172.21.15.87:0/669006575 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc06cf70 con 0x7f2bdc0aea30 2023-03-30T08:10:53.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be26c3700 1 --2- 172.21.15.87:0/669006575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bdc0aea30 0x7f2bdc06a390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0cba30 tx=0x7f2bd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c452cdcf1f66a4f server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:53.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be0ec0700 1 -- 172.21.15.87:0/669006575 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400e070 con 0x7f2bdc0aea30 2023-03-30T08:10:53.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be0ec0700 1 -- 172.21.15.87:0/669006575 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd400b910 con 0x7f2bdc0aea30 2023-03-30T08:10:53.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be0ec0700 1 -- 172.21.15.87:0/669006575 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400bcc0 con 0x7f2bdc0aea30 2023-03-30T08:10:53.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be2ec4700 1 -- 172.21.15.87:0/669006575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bdc0aea30 msgr2=0x7f2bdc06a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be2ec4700 1 --2- 172.21.15.87:0/669006575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bdc0aea30 0x7f2bdc06a390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0cba30 tx=0x7f2bd400b330 comp rx=0 tx=0).stop 2023-03-30T08:10:53.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be2ec4700 1 -- 172.21.15.87:0/669006575 shutdown_connections 2023-03-30T08:10:53.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be2ec4700 1 --2- 172.21.15.87:0/669006575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bdc0aea30 0x7f2bdc06a390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be2ec4700 1 --2- 172.21.15.87:0/669006575 >> v2:172.21.15.115:3300/0 conn(0x7f2bdc163dc0 0x7f2bdc0c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be2ec4700 1 -- 172.21.15.87:0/669006575 >> 172.21.15.87:0/669006575 conn(0x7f2bdc0cf410 msgr2=0x7f2bdc0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:53.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be2ec4700 1 -- 172.21.15.87:0/669006575 shutdown_connections 2023-03-30T08:10:53.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.833+0000 7f2be2ec4700 1 -- 172.21.15.87:0/669006575 wait complete. 2023-03-30T08:10:53.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.837+0000 7f2be2ec4700 1 Processor -- start 2023-03-30T08:10:53.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.837+0000 7f2be2ec4700 1 -- start start 2023-03-30T08:10:53.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.837+0000 7f2be2ec4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bdc0aea30 0x7f2bdc161e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.837+0000 7f2be2ec4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bdc163dc0 0x7f2bdc15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.837+0000 7f2be2ec4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bdc164190 0x7f2bdc0cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.837+0000 7f2be2ec4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc15ba70 con 0x7f2bdc163dc0 2023-03-30T08:10:53.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.837+0000 7f2be2ec4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc1f7290 con 0x7f2bdc0aea30 2023-03-30T08:10:53.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.837+0000 7f2be2ec4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc15b1d0 con 0x7f2bdc164190 2023-03-30T08:10:53.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2be16c1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bdc163dc0 0x7f2bdc15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2be16c1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bdc163dc0 0x7f2bdc15a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37588/0 (socket says 172.21.15.87:37588) 2023-03-30T08:10:53.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2be16c1700 1 -- 172.21.15.87:0/2523348021 learned_addr learned my addr 172.21.15.87:0/2523348021 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:53.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2be1ec2700 1 --2- 172.21.15.87:0/2523348021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bdc0aea30 0x7f2bdc161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2be26c3700 1 --2- 172.21.15.87:0/2523348021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bdc164190 0x7f2bdc0cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2be16c1700 1 -- 172.21.15.87:0/2523348021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bdc164190 msgr2=0x7f2bdc0cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2be16c1700 1 --2- 172.21.15.87:0/2523348021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bdc164190 0x7f2bdc0cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2be16c1700 1 -- 172.21.15.87:0/2523348021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bdc0aea30 msgr2=0x7f2bdc161e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:53.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2be16c1700 1 --2- 172.21.15.87:0/2523348021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bdc0aea30 0x7f2bdc161e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:53.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2be16c1700 1 -- 172.21.15.87:0/2523348021 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd4009b30 con 0x7f2bdc163dc0 2023-03-30T08:10:53.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2be16c1700 1 --2- 172.21.15.87:0/2523348021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bdc163dc0 0x7f2bdc15a810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00c4d0 tx=0x7f2bcc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:53.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2bd27fc700 1 -- 172.21.15.87:0/2523348021 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc0052d0 con 0x7f2bdc163dc0 2023-03-30T08:10:53.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2bd27fc700 1 -- 172.21.15.87:0/2523348021 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc005430 con 0x7f2bdc163dc0 2023-03-30T08:10:53.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2be2ec4700 1 -- 172.21.15.87:0/2523348021 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc06d530 con 0x7f2bdc163dc0 2023-03-30T08:10:53.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2bd27fc700 1 -- 172.21.15.87:0/2523348021 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc0055a0 con 0x7f2bdc163dc0 2023-03-30T08:10:53.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.841+0000 7f2be2ec4700 1 -- 172.21.15.87:0/2523348021 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc06d250 con 0x7f2bdc163dc0 2023-03-30T08:10:53.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.845+0000 7f2be2ec4700 1 -- 172.21.15.87:0/2523348021 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc06cc40 con 0x7f2bdc163dc0 2023-03-30T08:10:53.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.845+0000 7f2bd27fc700 1 -- 172.21.15.87:0/2523348021 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f2bcc0038c0 con 0x7f2bdc163dc0 2023-03-30T08:10:53.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.845+0000 7f2bd27fc700 1 --2- 172.21.15.87:0/2523348021 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2bc0065420 0x7f2bc00678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:53.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.845+0000 7f2bd27fc700 1 -- 172.21.15.87:0/2523348021 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2bcc081900 con 0x7f2bdc163dc0 2023-03-30T08:10:53.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.845+0000 7f2be1ec2700 1 --2- 172.21.15.87:0/2523348021 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2bc0065420 0x7f2bc00678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:53.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.849+0000 7f2be1ec2700 1 --2- 172.21.15.87:0/2523348021 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2bc0065420 0x7f2bc00678d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8009b80 tx=0x7f2bd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:53.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:53.853+0000 7f2bd27fc700 1 -- 172.21.15.87:0/2523348021 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f2bcc04f8c0 con 0x7f2bdc163dc0 2023-03-30T08:10:54.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.021+0000 7f2be2ec4700 1 -- 172.21.15.87:0/2523348021 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2bdc1f7400 con 0x7f2bdc163dc0 2023-03-30T08:10:54.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.025+0000 7f2bd27fc700 1 -- 172.21.15.87:0/2523348021 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2bcc017020 con 0x7f2bdc163dc0 2023-03-30T08:10:54.029 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T08:10:54.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.029+0000 7f2be2ec4700 1 -- 172.21.15.87:0/2523348021 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2bc0065420 msgr2=0x7f2bc00678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:54.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.029+0000 7f2be2ec4700 1 --2- 172.21.15.87:0/2523348021 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2bc0065420 0x7f2bc00678d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8009b80 tx=0x7f2bd8008040 comp rx=0 tx=0).stop 2023-03-30T08:10:54.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.029+0000 7f2be2ec4700 1 -- 172.21.15.87:0/2523348021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bdc163dc0 msgr2=0x7f2bdc15a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:54.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.029+0000 7f2be2ec4700 1 --2- 172.21.15.87:0/2523348021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bdc163dc0 0x7f2bdc15a810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00c4d0 tx=0x7f2bcc00c7e0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.029+0000 7f2be2ec4700 1 -- 172.21.15.87:0/2523348021 shutdown_connections 2023-03-30T08:10:54.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.029+0000 7f2be2ec4700 1 --2- 172.21.15.87:0/2523348021 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2bc0065420 0x7f2bc00678d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.029+0000 7f2be2ec4700 1 --2- 172.21.15.87:0/2523348021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bdc164190 0x7f2bdc0cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.029+0000 7f2be2ec4700 1 --2- 172.21.15.87:0/2523348021 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bdc163dc0 0x7f2bdc15a810 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.029+0000 7f2be2ec4700 1 --2- 172.21.15.87:0/2523348021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bdc0aea30 0x7f2bdc161e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.029+0000 7f2be2ec4700 1 -- 172.21.15.87:0/2523348021 >> 172.21.15.87:0/2523348021 conn(0x7f2bdc0cf410 msgr2=0x7f2bdc06ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:54.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.029+0000 7f2be2ec4700 1 -- 172.21.15.87:0/2523348021 shutdown_connections 2023-03-30T08:10:54.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.029+0000 7f2be2ec4700 1 -- 172.21.15.87:0/2523348021 wait complete. 2023-03-30T08:10:54.050 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T08:10:54.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.209+0000 7f0ef7128700 1 Processor -- start 2023-03-30T08:10:54.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.209+0000 7f0ef7128700 1 -- start start 2023-03-30T08:10:54.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef7128700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0ef0159050 0x7f0ef0069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:54.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef7128700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef00ca4b0 0x7f0ef00ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:54.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef7128700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef00afca0 con 0x7f0ef015cba0 2023-03-30T08:10:54.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef7128700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef00afb10 con 0x7f0ef0159050 2023-03-30T08:10:54.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef7128700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00cae70 con 0x7f0ef00ca4b0 2023-03-30T08:10:54.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef6927700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef00ca4b0 0x7f0ef00ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:54.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef6927700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef00ca4b0 0x7f0ef00ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:43504/0 (socket says 172.21.15.87:43504) 2023-03-30T08:10:54.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef6126700 1 --2- 172.21.15.87:0/3752670092 >> v2:172.21.15.115:3300/0 conn(0x7f0ef0159050 0x7f0ef0069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:54.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef6927700 1 -- 172.21.15.87:0/3752670092 learned_addr learned my addr 172.21.15.87:0/3752670092 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:54.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef5124700 1 -- 172.21.15.87:0/3752670092 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549903241 0 0) 0x7f0ef00afca0 con 0x7f0ef015cba0 2023-03-30T08:10:54.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef6927700 1 -- 172.21.15.87:0/3752670092 >> v2:172.21.15.115:3300/0 conn(0x7f0ef0159050 msgr2=0x7f0ef0069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:54.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef6927700 1 --2- 172.21.15.87:0/3752670092 >> v2:172.21.15.115:3300/0 conn(0x7f0ef0159050 0x7f0ef0069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef6927700 1 -- 172.21.15.87:0/3752670092 >> v1:172.21.15.115:6789/0 conn(0x7f0ef015cba0 legacy=0x7f0ef00cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:54.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef6927700 1 -- 172.21.15.87:0/3752670092 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef015d110 con 0x7f0ef00ca4b0 2023-03-30T08:10:54.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef6126700 1 --2- 172.21.15.87:0/3752670092 >> v2:172.21.15.115:3300/0 conn(0x7f0ef0159050 0x7f0ef0069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:10:54.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.213+0000 7f0ef6927700 1 --2- 172.21.15.87:0/3752670092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef00ca4b0 0x7f0ef00ca930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800bbb0 tx=0x7f0ee800bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=976122fa76fcb2bb server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:54.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.217+0000 7f0ef5124700 1 -- 172.21.15.87:0/3752670092 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800dd30 con 0x7f0ef00ca4b0 2023-03-30T08:10:54.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.217+0000 7f0ef5124700 1 -- 172.21.15.87:0/3752670092 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee800de90 con 0x7f0ef00ca4b0 2023-03-30T08:10:54.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.217+0000 7f0ef5124700 1 -- 172.21.15.87:0/3752670092 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8010690 con 0x7f0ef00ca4b0 2023-03-30T08:10:54.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.217+0000 7f0ef7128700 1 -- 172.21.15.87:0/3752670092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef00ca4b0 msgr2=0x7f0ef00ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:54.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.217+0000 7f0ef7128700 1 --2- 172.21.15.87:0/3752670092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef00ca4b0 0x7f0ef00ca930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800bbb0 tx=0x7f0ee800bec0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.217+0000 7f0ef7128700 1 -- 172.21.15.87:0/3752670092 shutdown_connections 2023-03-30T08:10:54.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.217+0000 7f0ef7128700 1 --2- 172.21.15.87:0/3752670092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef00ca4b0 0x7f0ef00ca930 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.217+0000 7f0ef7128700 1 --2- 172.21.15.87:0/3752670092 >> v2:172.21.15.115:3300/0 conn(0x7f0ef0159050 0x7f0ef0069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.217+0000 7f0ef7128700 1 -- 172.21.15.87:0/3752670092 >> 172.21.15.87:0/3752670092 conn(0x7f0ef00cf410 msgr2=0x7f0ef00cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:54.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.217+0000 7f0ef7128700 1 -- 172.21.15.87:0/3752670092 shutdown_connections 2023-03-30T08:10:54.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.217+0000 7f0ef7128700 1 -- 172.21.15.87:0/3752670092 wait complete. 2023-03-30T08:10:54.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef7128700 1 Processor -- start 2023-03-30T08:10:54.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef7128700 1 -- start start 2023-03-30T08:10:54.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef7128700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef00ca4b0 0x7f0ef00b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:54.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef7128700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef0159050 0x7f0ef01f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:54.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef7128700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ef015cba0 0x7f0ef01f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:54.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef7128700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00b4380 con 0x7f0ef0159050 2023-03-30T08:10:54.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef7128700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00b35f0 con 0x7f0ef015cba0 2023-03-30T08:10:54.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef7128700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00b3800 con 0x7f0ef00ca4b0 2023-03-30T08:10:54.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef5925700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef0159050 0x7f0ef01f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:54.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef5925700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef0159050 0x7f0ef01f3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37604/0 (socket says 172.21.15.87:37604) 2023-03-30T08:10:54.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef5925700 1 -- 172.21.15.87:0/3630340482 learned_addr learned my addr 172.21.15.87:0/3630340482 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:54.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef6126700 1 --2- 172.21.15.87:0/3630340482 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef00ca4b0 0x7f0ef00b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:54.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef6927700 1 --2- 172.21.15.87:0/3630340482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ef015cba0 0x7f0ef01f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:54.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef5925700 1 -- 172.21.15.87:0/3630340482 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef00ca4b0 msgr2=0x7f0ef00b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:54.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef5925700 1 --2- 172.21.15.87:0/3630340482 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef00ca4b0 0x7f0ef00b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef5925700 1 -- 172.21.15.87:0/3630340482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ef015cba0 msgr2=0x7f0ef01f4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:54.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef5925700 1 --2- 172.21.15.87:0/3630340482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ef015cba0 0x7f0ef01f4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef5925700 1 -- 172.21.15.87:0/3630340482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec009a70 con 0x7f0ef0159050 2023-03-30T08:10:54.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef6927700 1 --2- 172.21.15.87:0/3630340482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ef015cba0 0x7f0ef01f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:10:54.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef5925700 1 --2- 172.21.15.87:0/3630340482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef0159050 0x7f0ef01f3ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000c520 tx=0x7f0ee000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:54.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ee6ffd700 1 -- 172.21.15.87:0/3630340482 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee00054e0 con 0x7f0ef0159050 2023-03-30T08:10:54.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ee6ffd700 1 -- 172.21.15.87:0/3630340482 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee00036a0 con 0x7f0ef0159050 2023-03-30T08:10:54.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ee6ffd700 1 -- 172.21.15.87:0/3630340482 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0003a50 con 0x7f0ef0159050 2023-03-30T08:10:54.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef7128700 1 -- 172.21.15.87:0/3630340482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee800b810 con 0x7f0ef0159050 2023-03-30T08:10:54.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.221+0000 7f0ef7128700 1 -- 172.21.15.87:0/3630340482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef015d6d0 con 0x7f0ef0159050 2023-03-30T08:10:54.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.225+0000 7f0ef7128700 1 -- 172.21.15.87:0/3630340482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef015d3f0 con 0x7f0ef0159050 2023-03-30T08:10:54.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.225+0000 7f0ee6ffd700 1 -- 172.21.15.87:0/3630340482 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f0ee0003bb0 con 0x7f0ef0159050 2023-03-30T08:10:54.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.229+0000 7f0ee6ffd700 1 --2- 172.21.15.87:0/3630340482 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0ed40653f0 0x7f0ed40678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:54.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.229+0000 7f0ee6ffd700 1 -- 172.21.15.87:0/3630340482 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0ee00819e0 con 0x7f0ef0159050 2023-03-30T08:10:54.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.229+0000 7f0ef6126700 1 --2- 172.21.15.87:0/3630340482 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0ed40653f0 0x7f0ed40678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:54.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.229+0000 7f0ef6126700 1 --2- 172.21.15.87:0/3630340482 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0ed40653f0 0x7f0ed40678a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009fd0 tx=0x7f0eec00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:54.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.233+0000 7f0ee6ffd700 1 -- 172.21.15.87:0/3630340482 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f0ee004f910 con 0x7f0ef0159050 2023-03-30T08:10:54.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.437+0000 7f0ef7128700 1 -- 172.21.15.87:0/3630340482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ef015d9b0 con 0x7f0ef0159050 2023-03-30T08:10:54.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.441+0000 7f0ee6ffd700 1 -- 172.21.15.87:0/3630340482 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f0ee0017090 con 0x7f0ef0159050 2023-03-30T08:10:54.443 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:10:54.444 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2818344230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2818344230},{"type":"v1","addr":"172.21.15.115:6833","nonce":2818344230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3891185444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3891185444},{"type":"v1","addr":"172.21.15.87:6836","nonce":3891185444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3443119914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3443119914},{"type":"v1","addr":"172.21.15.87:6837","nonce":3443119914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3640886103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3640886103},{"type":"v1","addr":"172.21.15.115:6835","nonce":3640886103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-03-30T08:10:54.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.441+0000 7f0ef7128700 1 -- 172.21.15.87:0/3630340482 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0ed40653f0 msgr2=0x7f0ed40678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:54.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.441+0000 7f0ef7128700 1 --2- 172.21.15.87:0/3630340482 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0ed40653f0 0x7f0ed40678a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009fd0 tx=0x7f0eec00b040 comp rx=0 tx=0).stop 2023-03-30T08:10:54.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.441+0000 7f0ef7128700 1 -- 172.21.15.87:0/3630340482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef0159050 msgr2=0x7f0ef01f3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:54.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.441+0000 7f0ef7128700 1 --2- 172.21.15.87:0/3630340482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef0159050 0x7f0ef01f3ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000c520 tx=0x7f0ee000c830 comp rx=0 tx=0).stop 2023-03-30T08:10:54.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.441+0000 7f0ef7128700 1 -- 172.21.15.87:0/3630340482 shutdown_connections 2023-03-30T08:10:54.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.441+0000 7f0ef7128700 1 --2- 172.21.15.87:0/3630340482 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0ed40653f0 0x7f0ed40678a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.441+0000 7f0ef7128700 1 --2- 172.21.15.87:0/3630340482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ef015cba0 0x7f0ef01f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.441+0000 7f0ef7128700 1 --2- 172.21.15.87:0/3630340482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ef0159050 0x7f0ef01f3ce0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.441+0000 7f0ef7128700 1 --2- 172.21.15.87:0/3630340482 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0ef00ca4b0 0x7f0ef00b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.441+0000 7f0ef7128700 1 -- 172.21.15.87:0/3630340482 >> 172.21.15.87:0/3630340482 conn(0x7f0ef00cf410 msgr2=0x7f0ef00cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:54.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.441+0000 7f0ef7128700 1 -- 172.21.15.87:0/3630340482 shutdown_connections 2023-03-30T08:10:54.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.441+0000 7f0ef7128700 1 -- 172.21.15.87:0/3630340482 wait complete. 2023-03-30T08:10:54.448 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 3 2023-03-30T08:10:54.465 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:10:54.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.621+0000 7f911359e700 1 Processor -- start 2023-03-30T08:10:54.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.621+0000 7f911359e700 1 -- start start 2023-03-30T08:10:54.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.625+0000 7f911359e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91140b3f30 0x7f91140b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:54.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.625+0000 7f911359e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f911406a6e0 0x7f91140aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:54.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.625+0000 7f911359e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911406b670 con 0x7f91140af180 2023-03-30T08:10:54.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.625+0000 7f911359e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91140af600 con 0x7f91140b3f30 2023-03-30T08:10:54.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.625+0000 7f911359e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911406b0b0 con 0x7f911406a6e0 2023-03-30T08:10:54.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.625+0000 7f911259c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91140b3f30 0x7f91140b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:54.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.625+0000 7f911259c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f91140b3f30 0x7f91140b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37614/0 (socket says 172.21.15.87:37614) 2023-03-30T08:10:54.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.625+0000 7f9112d9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f91140af180 0x7f911415ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:48942/0 (socket says 172.21.15.87:48942) 2023-03-30T08:10:54.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.625+0000 7f911259c700 1 -- 172.21.15.87:0/4063865643 learned_addr learned my addr 172.21.15.87:0/4063865643 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:54.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.625+0000 7f9111d9b700 1 --2- 172.21.15.87:0/4063865643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f911406a6e0 0x7f91140aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:54.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.625+0000 7f911159a700 1 -- 172.21.15.87:0/4063865643 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288904758 0 0) 0x7f911406b670 con 0x7f91140af180 2023-03-30T08:10:54.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.625+0000 7f911259c700 1 -- 172.21.15.87:0/4063865643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f911406a6e0 msgr2=0x7f91140aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:54.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.625+0000 7f911259c700 1 --2- 172.21.15.87:0/4063865643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f911406a6e0 0x7f91140aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.625+0000 7f911259c700 1 -- 172.21.15.87:0/4063865643 >> v1:172.21.15.115:6789/0 conn(0x7f91140af180 legacy=0x7f911415ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:54.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.625+0000 7f911259c700 1 -- 172.21.15.87:0/4063865643 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911406b390 con 0x7f91140b3f30 2023-03-30T08:10:54.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.629+0000 7f911259c700 1 --2- 172.21.15.87:0/4063865643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91140b3f30 0x7f91140b0c10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9104009e50 tx=0x7f910400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445a27d8e4749aca server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:54.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.629+0000 7f911159a700 1 -- 172.21.15.87:0/4063865643 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910400e070 con 0x7f91140b3f30 2023-03-30T08:10:54.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.629+0000 7f911159a700 1 -- 172.21.15.87:0/4063865643 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910400b910 con 0x7f91140b3f30 2023-03-30T08:10:54.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.629+0000 7f911159a700 1 -- 172.21.15.87:0/4063865643 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910400bcc0 con 0x7f91140b3f30 2023-03-30T08:10:54.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.629+0000 7f911359e700 1 -- 172.21.15.87:0/4063865643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91140b3f30 msgr2=0x7f91140b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:54.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.629+0000 7f911359e700 1 --2- 172.21.15.87:0/4063865643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91140b3f30 0x7f91140b0c10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9104009e50 tx=0x7f910400b330 comp rx=0 tx=0).stop 2023-03-30T08:10:54.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.629+0000 7f911359e700 1 -- 172.21.15.87:0/4063865643 shutdown_connections 2023-03-30T08:10:54.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.629+0000 7f911359e700 1 --2- 172.21.15.87:0/4063865643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f911406a6e0 0x7f91140aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.629+0000 7f911359e700 1 --2- 172.21.15.87:0/4063865643 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91140b3f30 0x7f91140b0c10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.629+0000 7f911359e700 1 -- 172.21.15.87:0/4063865643 >> 172.21.15.87:0/4063865643 conn(0x7f91140cf410 msgr2=0x7f91140cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:54.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.629+0000 7f911359e700 1 -- 172.21.15.87:0/4063865643 shutdown_connections 2023-03-30T08:10:54.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.629+0000 7f911359e700 1 -- 172.21.15.87:0/4063865643 wait complete. 2023-03-30T08:10:54.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f911359e700 1 Processor -- start 2023-03-30T08:10:54.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f911359e700 1 -- start start 2023-03-30T08:10:54.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f911359e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f911406a6e0 0x7f91140c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:54.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f911359e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91140af180 0x7f91140c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:54.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f911359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91140b3f30 0x7f91140c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:54.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f911359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91140ce010 con 0x7f91140b3f30 2023-03-30T08:10:54.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f911359e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91140c5d90 con 0x7f91140af180 2023-03-30T08:10:54.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f911359e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91140c6030 con 0x7f911406a6e0 2023-03-30T08:10:54.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f9112d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91140b3f30 0x7f91140c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:54.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f9112d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91140b3f30 0x7f91140c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37620/0 (socket says 172.21.15.87:37620) 2023-03-30T08:10:54.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f9112d9d700 1 -- 172.21.15.87:0/959185860 learned_addr learned my addr 172.21.15.87:0/959185860 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:54.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f911259c700 1 --2- 172.21.15.87:0/959185860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f911406a6e0 0x7f91140c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:54.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f9111d9b700 1 --2- 172.21.15.87:0/959185860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91140af180 0x7f91140c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:54.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f9112d9d700 1 -- 172.21.15.87:0/959185860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f911406a6e0 msgr2=0x7f91140c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:54.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f9112d9d700 1 --2- 172.21.15.87:0/959185860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f911406a6e0 0x7f91140c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f9112d9d700 1 -- 172.21.15.87:0/959185860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91140af180 msgr2=0x7f91140c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:54.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f9112d9d700 1 --2- 172.21.15.87:0/959185860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91140af180 0x7f91140c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f9112d9d700 1 -- 172.21.15.87:0/959185860 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9104009b30 con 0x7f91140b3f30 2023-03-30T08:10:54.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.633+0000 7f9112d9d700 1 --2- 172.21.15.87:0/959185860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91140b3f30 0x7f91140c8210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f910c00c460 tx=0x7f910c00c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:54.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.637+0000 7f9102ffd700 1 -- 172.21.15.87:0/959185860 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c004ca0 con 0x7f91140b3f30 2023-03-30T08:10:54.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.637+0000 7f9102ffd700 1 -- 172.21.15.87:0/959185860 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910c004e20 con 0x7f91140b3f30 2023-03-30T08:10:54.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.637+0000 7f911359e700 1 -- 172.21.15.87:0/959185860 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91140ae1b0 con 0x7f91140b3f30 2023-03-30T08:10:54.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.637+0000 7f9102ffd700 1 -- 172.21.15.87:0/959185860 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c007310 con 0x7f91140b3f30 2023-03-30T08:10:54.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.637+0000 7f911359e700 1 -- 172.21.15.87:0/959185860 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91140aded0 con 0x7f91140b3f30 2023-03-30T08:10:54.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.637+0000 7f911359e700 1 -- 172.21.15.87:0/959185860 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91140b4300 con 0x7f91140b3f30 2023-03-30T08:10:54.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.637+0000 7f9102ffd700 1 -- 172.21.15.87:0/959185860 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f910c007470 con 0x7f91140b3f30 2023-03-30T08:10:54.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.641+0000 7f9102ffd700 1 --2- 172.21.15.87:0/959185860 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f90f40653f0 0x7f90f40678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.641+0000 7f9102ffd700 1 -- 172.21.15.87:0/959185860 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f910c082110 con 0x7f91140b3f30 2023-03-30T08:10:54.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.641+0000 7f911259c700 1 --2- 172.21.15.87:0/959185860 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f90f40653f0 0x7f90f40678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:54.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.641+0000 7f911259c700 1 --2- 172.21.15.87:0/959185860 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f90f40653f0 0x7f90f40678a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f910400b370 tx=0x7f9104009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:54.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.645+0000 7f9102ffd700 1 -- 172.21.15.87:0/959185860 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f910c050040 con 0x7f91140b3f30 2023-03-30T08:10:54.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.813+0000 7f911359e700 1 -- 172.21.15.87:0/959185860 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91140733a0 con 0x7f91140b3f30 2023-03-30T08:10:54.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.813+0000 7f9102ffd700 1 -- 172.21.15.87:0/959185860 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14168 (secure 0 0 0) 0x7f910c007720 con 0x7f91140b3f30 2023-03-30T08:10:54.818 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:10:54.818 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":20,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:10:53.857286+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:10:54.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.817+0000 7f911359e700 1 -- 172.21.15.87:0/959185860 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f90f40653f0 msgr2=0x7f90f40678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:54.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.817+0000 7f911359e700 1 --2- 172.21.15.87:0/959185860 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f90f40653f0 0x7f90f40678a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f910400b370 tx=0x7f9104009000 comp rx=0 tx=0).stop 2023-03-30T08:10:54.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.817+0000 7f911359e700 1 -- 172.21.15.87:0/959185860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91140b3f30 msgr2=0x7f91140c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:54.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.817+0000 7f911359e700 1 --2- 172.21.15.87:0/959185860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91140b3f30 0x7f91140c8210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f910c00c460 tx=0x7f910c00c770 comp rx=0 tx=0).stop 2023-03-30T08:10:54.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.817+0000 7f911359e700 1 -- 172.21.15.87:0/959185860 shutdown_connections 2023-03-30T08:10:54.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.817+0000 7f911359e700 1 --2- 172.21.15.87:0/959185860 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f90f40653f0 0x7f90f40678a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.817+0000 7f911359e700 1 --2- 172.21.15.87:0/959185860 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f91140b3f30 0x7f91140c8210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.817+0000 7f911359e700 1 --2- 172.21.15.87:0/959185860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91140af180 0x7f91140c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.817+0000 7f911359e700 1 --2- 172.21.15.87:0/959185860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f911406a6e0 0x7f91140c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:54.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.817+0000 7f911359e700 1 -- 172.21.15.87:0/959185860 >> 172.21.15.87:0/959185860 conn(0x7f91140cf410 msgr2=0x7f91140c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:54.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.817+0000 7f911359e700 1 -- 172.21.15.87:0/959185860 shutdown_connections 2023-03-30T08:10:54.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:54.817+0000 7f911359e700 1 -- 172.21.15.87:0/959185860 wait complete. 2023-03-30T08:10:54.842 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-30T08:10:54.842 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T08:10:55.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.005+0000 7efcd4d13700 1 Processor -- start 2023-03-30T08:10:55.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.005+0000 7efcd4d13700 1 -- start start 2023-03-30T08:10:55.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.005+0000 7efcd4d13700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efcd00c1dc0 0x7efcd00cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.005+0000 7efcd4d13700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efcd0070b30 0x7efcd015a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.005+0000 7efcd4d13700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd0164520 con 0x7efcd00cca70 2023-03-30T08:10:55.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.005+0000 7efcd4d13700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd0164800 con 0x7efcd0070b30 2023-03-30T08:10:55.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.005+0000 7efcd4d13700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd0164ae0 con 0x7efcd00c1dc0 2023-03-30T08:10:55.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcced9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efcd0070b30 0x7efcd015a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcced9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efcd0070b30 0x7efcd015a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37626/0 (socket says 172.21.15.87:37626) 2023-03-30T08:10:55.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcced9d700 1 -- 172.21.15.87:0/3947958176 learned_addr learned my addr 172.21.15.87:0/3947958176 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:55.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcce59c700 1 --2- 172.21.15.87:0/3947958176 >> v2:172.21.15.115:3300/0 conn(0x7efcd00c1dc0 0x7efcd00cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcced9d700 1 -- 172.21.15.87:0/3947958176 >> v2:172.21.15.115:3300/0 conn(0x7efcd00c1dc0 msgr2=0x7efcd00cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:55.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcced9d700 1 --2- 172.21.15.87:0/3947958176 >> v2:172.21.15.115:3300/0 conn(0x7efcd00c1dc0 0x7efcd00cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcced9d700 1 -- 172.21.15.87:0/3947958176 >> v1:172.21.15.115:6789/0 conn(0x7efcd00cca70 legacy=0x7efcd0070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcced9d700 1 -- 172.21.15.87:0/3947958176 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd0164dc0 con 0x7efcd0070b30 2023-03-30T08:10:55.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcce59c700 1 --2- 172.21.15.87:0/3947958176 >> v2:172.21.15.115:3300/0 conn(0x7efcd00c1dc0 0x7efcd00cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:10:55.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcced9d700 1 --2- 172.21.15.87:0/3947958176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd0070b30 0x7efcd015a5d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efcd006e500 tx=0x7efcc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cacb90caca08a6b server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:55.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efccd59a700 1 -- 172.21.15.87:0/3947958176 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc800e070 con 0x7efcd0070b30 2023-03-30T08:10:55.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efccd59a700 1 -- 172.21.15.87:0/3947958176 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc800b9c0 con 0x7efcd0070b30 2023-03-30T08:10:55.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efccd59a700 1 -- 172.21.15.87:0/3947958176 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc800bd70 con 0x7efcd0070b30 2023-03-30T08:10:55.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcd4d13700 1 -- 172.21.15.87:0/3947958176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd0070b30 msgr2=0x7efcd015a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcd4d13700 1 --2- 172.21.15.87:0/3947958176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd0070b30 0x7efcd015a5d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efcd006e500 tx=0x7efcc800b330 comp rx=0 tx=0).stop 2023-03-30T08:10:55.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcd4d13700 1 -- 172.21.15.87:0/3947958176 shutdown_connections 2023-03-30T08:10:55.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcd4d13700 1 --2- 172.21.15.87:0/3947958176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd0070b30 0x7efcd015a5d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcd4d13700 1 --2- 172.21.15.87:0/3947958176 >> v2:172.21.15.115:3300/0 conn(0x7efcd00c1dc0 0x7efcd00cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcd4d13700 1 -- 172.21.15.87:0/3947958176 >> 172.21.15.87:0/3947958176 conn(0x7efcd00ce960 msgr2=0x7efcd00ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:55.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcd4d13700 1 -- 172.21.15.87:0/3947958176 shutdown_connections 2023-03-30T08:10:55.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.009+0000 7efcd4d13700 1 -- 172.21.15.87:0/3947958176 wait complete. 2023-03-30T08:10:55.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcd4d13700 1 Processor -- start 2023-03-30T08:10:55.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcd4d13700 1 -- start start 2023-03-30T08:10:55.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcd4d13700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd0070b30 0x7efcd015d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcd4d13700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c1dc0 0x7efcd006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcd4d13700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd00cca70 0x7efcd006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcd4d13700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd00b18c0 con 0x7efcd0070b30 2023-03-30T08:10:55.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcd4d13700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd015d640 con 0x7efcd00c1dc0 2023-03-30T08:10:55.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcd4d13700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd00b0a30 con 0x7efcd00cca70 2023-03-30T08:10:55.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcce59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd0070b30 0x7efcd015d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcce59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd0070b30 0x7efcd015d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37634/0 (socket says 172.21.15.87:37634) 2023-03-30T08:10:55.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcce59c700 1 -- 172.21.15.87:0/595577004 learned_addr learned my addr 172.21.15.87:0/595577004 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:55.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcced9d700 1 --2- 172.21.15.87:0/595577004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd00cca70 0x7efcd006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efccdd9b700 1 --2- 172.21.15.87:0/595577004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c1dc0 0x7efcd006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcce59c700 1 -- 172.21.15.87:0/595577004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd00cca70 msgr2=0x7efcd006c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcce59c700 1 --2- 172.21.15.87:0/595577004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd00cca70 0x7efcd006c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcce59c700 1 -- 172.21.15.87:0/595577004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c1dc0 msgr2=0x7efcd006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcce59c700 1 --2- 172.21.15.87:0/595577004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c1dc0 0x7efcd006bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.013+0000 7efcce59c700 1 -- 172.21.15.87:0/595577004 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc8009b30 con 0x7efcd0070b30 2023-03-30T08:10:55.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.017+0000 7efcce59c700 1 --2- 172.21.15.87:0/595577004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd0070b30 0x7efcd015d100 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efcc000e810 tx=0x7efcc000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:55.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.017+0000 7efcbeffd700 1 -- 172.21.15.87:0/595577004 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0013610 con 0x7efcd0070b30 2023-03-30T08:10:55.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.017+0000 7efcbeffd700 1 -- 172.21.15.87:0/595577004 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc0013770 con 0x7efcd0070b30 2023-03-30T08:10:55.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.017+0000 7efcd4d13700 1 -- 172.21.15.87:0/595577004 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd00ce540 con 0x7efcd0070b30 2023-03-30T08:10:55.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.017+0000 7efcbeffd700 1 -- 172.21.15.87:0/595577004 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0013b00 con 0x7efcd0070b30 2023-03-30T08:10:55.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.017+0000 7efcd4d13700 1 -- 172.21.15.87:0/595577004 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd01650a0 con 0x7efcd0070b30 2023-03-30T08:10:55.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.017+0000 7efcd4d13700 1 -- 172.21.15.87:0/595577004 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd00c2190 con 0x7efcd0070b30 2023-03-30T08:10:55.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.021+0000 7efcbeffd700 1 -- 172.21.15.87:0/595577004 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7efcc0013c60 con 0x7efcd0070b30 2023-03-30T08:10:55.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.021+0000 7efcbeffd700 1 --2- 172.21.15.87:0/595577004 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efcb00653f0 0x7efcb00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.021+0000 7efcbeffd700 1 -- 172.21.15.87:0/595577004 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efcc0082210 con 0x7efcd0070b30 2023-03-30T08:10:55.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.021+0000 7efccdd9b700 1 --2- 172.21.15.87:0/595577004 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efcb00653f0 0x7efcb00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.021+0000 7efccdd9b700 1 --2- 172.21.15.87:0/595577004 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efcb00653f0 0x7efcb00678a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efcd0163350 tx=0x7efcc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:55.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.025+0000 7efcbeffd700 1 -- 172.21.15.87:0/595577004 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7efcc00501f0 con 0x7efcd0070b30 2023-03-30T08:10:55.199 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.197+0000 7efcd4d13700 1 -- 172.21.15.87:0/595577004 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efcd0073ee0 con 0x7efcd0070b30 2023-03-30T08:10:55.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.197+0000 7efcbeffd700 1 -- 172.21.15.87:0/595577004 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7efcc0053810 con 0x7efcd0070b30 2023-03-30T08:10:55.200 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T08:10:55.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.201+0000 7efcd4d13700 1 -- 172.21.15.87:0/595577004 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efcb00653f0 msgr2=0x7efcb00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.201+0000 7efcd4d13700 1 --2- 172.21.15.87:0/595577004 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efcb00653f0 0x7efcb00678a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efcd0163350 tx=0x7efcc4009040 comp rx=0 tx=0).stop 2023-03-30T08:10:55.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.201+0000 7efcd4d13700 1 -- 172.21.15.87:0/595577004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd0070b30 msgr2=0x7efcd015d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.201+0000 7efcd4d13700 1 --2- 172.21.15.87:0/595577004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd0070b30 0x7efcd015d100 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efcc000e810 tx=0x7efcc000ebd0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.201+0000 7efcd4d13700 1 -- 172.21.15.87:0/595577004 shutdown_connections 2023-03-30T08:10:55.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.201+0000 7efcd4d13700 1 --2- 172.21.15.87:0/595577004 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efcb00653f0 0x7efcb00678a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.201+0000 7efcd4d13700 1 --2- 172.21.15.87:0/595577004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd00cca70 0x7efcd006c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.201+0000 7efcd4d13700 1 --2- 172.21.15.87:0/595577004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd00c1dc0 0x7efcd006bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.201+0000 7efcd4d13700 1 --2- 172.21.15.87:0/595577004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efcd0070b30 0x7efcd015d100 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.201+0000 7efcd4d13700 1 -- 172.21.15.87:0/595577004 >> 172.21.15.87:0/595577004 conn(0x7efcd00ce960 msgr2=0x7efcd00c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:55.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.201+0000 7efcd4d13700 1 -- 172.21.15.87:0/595577004 shutdown_connections 2023-03-30T08:10:55.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.201+0000 7efcd4d13700 1 -- 172.21.15.87:0/595577004 wait complete. 2023-03-30T08:10:55.225 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T08:10:55.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.385+0000 7f6757cd8700 1 Processor -- start 2023-03-30T08:10:55.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.385+0000 7f6757cd8700 1 -- start start 2023-03-30T08:10:55.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.389+0000 7f6757cd8700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f67500b8460 0x7f67500b4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.389+0000 7f6757cd8700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67500cd350 con 0x7f67500cd7e0 2023-03-30T08:10:55.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.389+0000 7f6757cd8700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67500b8830 con 0x7f67500d27d0 2023-03-30T08:10:55.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.389+0000 7f6757cd8700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6750160f50 con 0x7f67500b8460 2023-03-30T08:10:55.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.389+0000 7f6755a74700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f67500b8460 0x7f67500b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.389+0000 7f6755a74700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f67500b8460 0x7f67500b4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37646/0 (socket says 172.21.15.87:37646) 2023-03-30T08:10:55.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.389+0000 7f6755a74700 1 -- 172.21.15.87:0/1320651866 learned_addr learned my addr 172.21.15.87:0/1320651866 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:55.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.389+0000 7f6756275700 1 --1- 172.21.15.87:0/1320651866 >> v1:172.21.15.115:6789/0 conn(0x7f67500d27d0 0x7f675006a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:48948/0 (socket says 172.21.15.87:48948) 2023-03-30T08:10:55.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.389+0000 7f6755273700 1 --1- 172.21.15.87:0/1320651866 >> v1:172.21.15.87:6789/0 conn(0x7f67500cd7e0 0x7f6750069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:52976/0 (socket says 172.21.15.87:52976) 2023-03-30T08:10:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6754a72700 1 -- 172.21.15.87:0/1320651866 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945325624 0 0) 0x7f67500b8830 con 0x7f67500d27d0 2023-03-30T08:10:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6754a72700 1 -- 172.21.15.87:0/1320651866 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f673c0035d0 con 0x7f67500d27d0 2023-03-30T08:10:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6755a74700 1 -- 172.21.15.87:0/1320651866 >> v1:172.21.15.115:6789/0 conn(0x7f67500d27d0 legacy=0x7f675006a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6755a74700 1 -- 172.21.15.87:0/1320651866 >> v1:172.21.15.87:6789/0 conn(0x7f67500cd7e0 legacy=0x7f6750069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6755a74700 1 -- 172.21.15.87:0/1320651866 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675006aaf0 con 0x7f67500b8460 2023-03-30T08:10:55.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6755a74700 1 --2- 172.21.15.87:0/1320651866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500b8460 0x7f67500b4780 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f674c009e50 tx=0x7f674c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721f712c1401f806 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:55.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6754a72700 1 -- 172.21.15.87:0/1320651866 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c00e070 con 0x7f67500b8460 2023-03-30T08:10:55.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6754a72700 1 -- 172.21.15.87:0/1320651866 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c00b910 con 0x7f67500b8460 2023-03-30T08:10:55.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6754a72700 1 -- 172.21.15.87:0/1320651866 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c00bcc0 con 0x7f67500b8460 2023-03-30T08:10:55.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6757cd8700 1 -- 172.21.15.87:0/1320651866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500b8460 msgr2=0x7f67500b4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6757cd8700 1 --2- 172.21.15.87:0/1320651866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500b8460 0x7f67500b4780 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f674c009e50 tx=0x7f674c00b330 comp rx=0 tx=0).stop 2023-03-30T08:10:55.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6757cd8700 1 -- 172.21.15.87:0/1320651866 shutdown_connections 2023-03-30T08:10:55.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6757cd8700 1 --2- 172.21.15.87:0/1320651866 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500b8460 0x7f67500b4780 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6757cd8700 1 -- 172.21.15.87:0/1320651866 >> 172.21.15.87:0/1320651866 conn(0x7f67500cf780 msgr2=0x7f67500cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:55.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6757cd8700 1 -- 172.21.15.87:0/1320651866 shutdown_connections 2023-03-30T08:10:55.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.393+0000 7f6757cd8700 1 -- 172.21.15.87:0/1320651866 wait complete. 2023-03-30T08:10:55.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.397+0000 7f6757cd8700 1 Processor -- start 2023-03-30T08:10:55.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.397+0000 7f6757cd8700 1 -- start start 2023-03-30T08:10:55.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.397+0000 7f6757cd8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67500b8460 0x7f67500cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.397+0000 7f6757cd8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67500cd7e0 0x7f67500c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.397+0000 7f6757cd8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500d27d0 0x7f6750150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.397+0000 7f6757cd8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67500c6cf0 con 0x7f67500d27d0 2023-03-30T08:10:55.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.397+0000 7f6757cd8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67500c6f50 con 0x7f67500b8460 2023-03-30T08:10:55.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.397+0000 7f6757cd8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67500c7230 con 0x7f67500cd7e0 2023-03-30T08:10:55.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.397+0000 7f6756275700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500d27d0 0x7f6750150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.397+0000 7f6756275700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500d27d0 0x7f6750150d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37656/0 (socket says 172.21.15.87:37656) 2023-03-30T08:10:55.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.397+0000 7f6756275700 1 -- 172.21.15.87:0/917328986 learned_addr learned my addr 172.21.15.87:0/917328986 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:55.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.397+0000 7f6755a74700 1 --2- 172.21.15.87:0/917328986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67500b8460 0x7f67500cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.397+0000 7f6755273700 1 --2- 172.21.15.87:0/917328986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67500cd7e0 0x7f67500c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.401+0000 7f6756275700 1 -- 172.21.15.87:0/917328986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67500cd7e0 msgr2=0x7f67500c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.401+0000 7f6756275700 1 --2- 172.21.15.87:0/917328986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67500cd7e0 0x7f67500c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.401+0000 7f6756275700 1 -- 172.21.15.87:0/917328986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67500b8460 msgr2=0x7f67500cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.401+0000 7f6756275700 1 --2- 172.21.15.87:0/917328986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67500b8460 0x7f67500cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.401+0000 7f6756275700 1 -- 172.21.15.87:0/917328986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c009b30 con 0x7f67500d27d0 2023-03-30T08:10:55.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.401+0000 7f6756275700 1 --2- 172.21.15.87:0/917328986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500d27d0 0x7f6750150d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f674800c4d0 tx=0x7f674800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:55.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.401+0000 7f67467fc700 1 -- 172.21.15.87:0/917328986 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6748005cd0 con 0x7f67500d27d0 2023-03-30T08:10:55.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.401+0000 7f67467fc700 1 -- 172.21.15.87:0/917328986 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6748005e30 con 0x7f67500d27d0 2023-03-30T08:10:55.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.401+0000 7f67467fc700 1 -- 172.21.15.87:0/917328986 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67480072d0 con 0x7f67500d27d0 2023-03-30T08:10:55.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.401+0000 7f6757cd8700 1 -- 172.21.15.87:0/917328986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67501609b0 con 0x7f67500d27d0 2023-03-30T08:10:55.406 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.401+0000 7f6757cd8700 1 -- 172.21.15.87:0/917328986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67500ceeb0 con 0x7f67500d27d0 2023-03-30T08:10:55.406 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.401+0000 7f6757cd8700 1 -- 172.21.15.87:0/917328986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6750160c70 con 0x7f67500d27d0 2023-03-30T08:10:55.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.405+0000 7f67467fc700 1 -- 172.21.15.87:0/917328986 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6748007430 con 0x7f67500d27d0 2023-03-30T08:10:55.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.405+0000 7f67467fc700 1 --2- 172.21.15.87:0/917328986 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6734065420 0x7f67340678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.405+0000 7f67467fc700 1 -- 172.21.15.87:0/917328986 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6748081810 con 0x7f67500d27d0 2023-03-30T08:10:55.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.405+0000 7f6755a74700 1 --2- 172.21.15.87:0/917328986 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6734065420 0x7f67340678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.409+0000 7f6755a74700 1 --2- 172.21.15.87:0/917328986 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6734065420 0x7f67340678d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f674c000f80 tx=0x7f674c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:55.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.413+0000 7f67467fc700 1 -- 172.21.15.87:0/917328986 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f674804a5e0 con 0x7f67500d27d0 2023-03-30T08:10:55.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.577+0000 7f6757cd8700 1 -- 172.21.15.87:0/917328986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6750073ee0 con 0x7f67500d27d0 2023-03-30T08:10:55.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.581+0000 7f67467fc700 1 -- 172.21.15.87:0/917328986 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f674804f880 con 0x7f67500d27d0 2023-03-30T08:10:55.584 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T08:10:55.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.581+0000 7f6757cd8700 1 -- 172.21.15.87:0/917328986 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6734065420 msgr2=0x7f67340678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.581+0000 7f6757cd8700 1 --2- 172.21.15.87:0/917328986 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6734065420 0x7f67340678d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f674c000f80 tx=0x7f674c009000 comp rx=0 tx=0).stop 2023-03-30T08:10:55.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.581+0000 7f6757cd8700 1 -- 172.21.15.87:0/917328986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500d27d0 msgr2=0x7f6750150d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.581+0000 7f6757cd8700 1 --2- 172.21.15.87:0/917328986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500d27d0 0x7f6750150d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f674800c4d0 tx=0x7f674800c890 comp rx=0 tx=0).stop 2023-03-30T08:10:55.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.581+0000 7f6757cd8700 1 -- 172.21.15.87:0/917328986 shutdown_connections 2023-03-30T08:10:55.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.581+0000 7f6757cd8700 1 --2- 172.21.15.87:0/917328986 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6734065420 0x7f67340678d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.581+0000 7f6757cd8700 1 --2- 172.21.15.87:0/917328986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f67500d27d0 0x7f6750150d30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.581+0000 7f6757cd8700 1 --2- 172.21.15.87:0/917328986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67500cd7e0 0x7f67500c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.581+0000 7f6757cd8700 1 --2- 172.21.15.87:0/917328986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67500b8460 0x7f67500cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.581+0000 7f6757cd8700 1 -- 172.21.15.87:0/917328986 >> 172.21.15.87:0/917328986 conn(0x7f67500cf780 msgr2=0x7f675015f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:55.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.581+0000 7f6757cd8700 1 -- 172.21.15.87:0/917328986 shutdown_connections 2023-03-30T08:10:55.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.581+0000 7f6757cd8700 1 -- 172.21.15.87:0/917328986 wait complete. 2023-03-30T08:10:55.607 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-30T08:10:55.765 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.761+0000 7ffa71aff700 1 Processor -- start 2023-03-30T08:10:55.765 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.761+0000 7ffa71aff700 1 -- start start 2023-03-30T08:10:55.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.761+0000 7ffa71aff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa6c15c9b0 0x7ffa6c06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.761+0000 7ffa71aff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffa6c06c3d0 0x7ffa6c06b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.761+0000 7ffa71aff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c0ceb70 con 0x7ffa6c06c920 2023-03-30T08:10:55.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.761+0000 7ffa71aff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c0cee50 con 0x7ffa6c06c3d0 2023-03-30T08:10:55.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.761+0000 7ffa71aff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0b49d0 con 0x7ffa6c15c9b0 2023-03-30T08:10:55.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa63fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffa6c06c3d0 0x7ffa6c06b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.768 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa63fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffa6c06c3d0 0x7ffa6c06b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37660/0 (socket says 172.21.15.87:37660) 2023-03-30T08:10:55.768 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa63fff700 1 -- 172.21.15.87:0/3037550181 learned_addr learned my addr 172.21.15.87:0/3037550181 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:55.768 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa70afd700 1 --2- 172.21.15.87:0/3037550181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa6c15c9b0 0x7ffa6c06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.768 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa63fff700 1 -- 172.21.15.87:0/3037550181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa6c15c9b0 msgr2=0x7ffa6c06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:55.768 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa63fff700 1 --2- 172.21.15.87:0/3037550181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa6c15c9b0 0x7ffa6c06ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.768 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa63fff700 1 -- 172.21.15.87:0/3037550181 >> v1:172.21.15.115:6789/0 conn(0x7ffa6c06c920 legacy=0x7ffa6c0b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.769 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa63fff700 1 -- 172.21.15.87:0/3037550181 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c0b4cb0 con 0x7ffa6c06c3d0 2023-03-30T08:10:55.769 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa63fff700 1 --2- 172.21.15.87:0/3037550181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c06c3d0 0x7ffa6c06b320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009910 tx=0x7ffa5c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7686849118bc95a server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:55.769 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa637fe700 1 -- 172.21.15.87:0/3037550181 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00ba60 con 0x7ffa6c06c3d0 2023-03-30T08:10:55.769 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa637fe700 1 -- 172.21.15.87:0/3037550181 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c00bbc0 con 0x7ffa6c06c3d0 2023-03-30T08:10:55.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa637fe700 1 -- 172.21.15.87:0/3037550181 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c009e60 con 0x7ffa6c06c3d0 2023-03-30T08:10:55.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa71aff700 1 -- 172.21.15.87:0/3037550181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c06c3d0 msgr2=0x7ffa6c06b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.771 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa71aff700 1 --2- 172.21.15.87:0/3037550181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c06c3d0 0x7ffa6c06b320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009910 tx=0x7ffa5c009c20 comp rx=0 tx=0).stop 2023-03-30T08:10:55.771 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa71aff700 1 -- 172.21.15.87:0/3037550181 shutdown_connections 2023-03-30T08:10:55.771 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa71aff700 1 --2- 172.21.15.87:0/3037550181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c06c3d0 0x7ffa6c06b320 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.771 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa71aff700 1 --2- 172.21.15.87:0/3037550181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa6c15c9b0 0x7ffa6c06ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.771 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa71aff700 1 -- 172.21.15.87:0/3037550181 >> 172.21.15.87:0/3037550181 conn(0x7ffa6c099dc0 msgr2=0x7ffa6c0d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:55.771 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa71aff700 1 -- 172.21.15.87:0/3037550181 shutdown_connections 2023-03-30T08:10:55.771 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.765+0000 7ffa71aff700 1 -- 172.21.15.87:0/3037550181 wait complete. 2023-03-30T08:10:55.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.769+0000 7ffa71aff700 1 Processor -- start 2023-03-30T08:10:55.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.769+0000 7ffa71aff700 1 -- start start 2023-03-30T08:10:55.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa71aff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa6c06c3d0 0x7ffa6c14eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa71aff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa6c06c920 0x7ffa6c0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa71aff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c15c9b0 0x7ffa6c06e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa71aff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0c7460 con 0x7ffa6c15c9b0 2023-03-30T08:10:55.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa71aff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0c63c0 con 0x7ffa6c06c3d0 2023-03-30T08:10:55.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa71aff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0c66a0 con 0x7ffa6c06c920 2023-03-30T08:10:55.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa712fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c15c9b0 0x7ffa6c06e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa70afd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa6c06c3d0 0x7ffa6c14eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa712fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c15c9b0 0x7ffa6c06e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37664/0 (socket says 172.21.15.87:37664) 2023-03-30T08:10:55.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa712fe700 1 -- 172.21.15.87:0/4276716029 learned_addr learned my addr 172.21.15.87:0/4276716029 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:55.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa63fff700 1 --2- 172.21.15.87:0/4276716029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa6c06c920 0x7ffa6c0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa712fe700 1 -- 172.21.15.87:0/4276716029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa6c06c920 msgr2=0x7ffa6c0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa712fe700 1 --2- 172.21.15.87:0/4276716029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa6c06c920 0x7ffa6c0c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa712fe700 1 -- 172.21.15.87:0/4276716029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa6c06c3d0 msgr2=0x7ffa6c14eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa712fe700 1 --2- 172.21.15.87:0/4276716029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa6c06c3d0 0x7ffa6c14eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa712fe700 1 -- 172.21.15.87:0/4276716029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c009570 con 0x7ffa6c15c9b0 2023-03-30T08:10:55.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa712fe700 1 --2- 172.21.15.87:0/4276716029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c15c9b0 0x7ffa6c06e670 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400cc50 tx=0x7ffa6400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:55.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa617fa700 1 -- 172.21.15.87:0/4276716029 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64003c20 con 0x7ffa6c15c9b0 2023-03-30T08:10:55.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa617fa700 1 -- 172.21.15.87:0/4276716029 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa64003d80 con 0x7ffa6c15c9b0 2023-03-30T08:10:55.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa617fa700 1 -- 172.21.15.87:0/4276716029 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400aab0 con 0x7ffa6c15c9b0 2023-03-30T08:10:55.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa71aff700 1 -- 172.21.15.87:0/4276716029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c0cf130 con 0x7ffa6c15c9b0 2023-03-30T08:10:55.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.773+0000 7ffa71aff700 1 -- 172.21.15.87:0/4276716029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c09a2c0 con 0x7ffa6c15c9b0 2023-03-30T08:10:55.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.777+0000 7ffa71aff700 1 -- 172.21.15.87:0/4276716029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c0b61e0 con 0x7ffa6c15c9b0 2023-03-30T08:10:55.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.777+0000 7ffa617fa700 1 -- 172.21.15.87:0/4276716029 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ffa6400ac10 con 0x7ffa6c15c9b0 2023-03-30T08:10:55.782 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.777+0000 7ffa617fa700 1 --2- 172.21.15.87:0/4276716029 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffa580653f0 0x7ffa580678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.781+0000 7ffa617fa700 1 -- 172.21.15.87:0/4276716029 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ffa64082480 con 0x7ffa6c15c9b0 2023-03-30T08:10:55.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.781+0000 7ffa70afd700 1 --2- 172.21.15.87:0/4276716029 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffa580653f0 0x7ffa580678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:55.784 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.781+0000 7ffa70afd700 1 --2- 172.21.15.87:0/4276716029 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffa580653f0 0x7ffa580678a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa68006fd0 tx=0x7ffa68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:55.785 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.781+0000 7ffa617fa700 1 -- 172.21.15.87:0/4276716029 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7ffa64050400 con 0x7ffa6c15c9b0 2023-03-30T08:10:55.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.953+0000 7ffa71aff700 1 -- 172.21.15.87:0/4276716029 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ffa6c072cf0 con 0x7ffa6c15c9b0 2023-03-30T08:10:55.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.953+0000 7ffa617fa700 1 -- 172.21.15.87:0/4276716029 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7ffa64053a20 con 0x7ffa6c15c9b0 2023-03-30T08:10:55.958 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:10:55.958 INFO:teuthology.orchestra.run.smithi087.stdout:[ 2023-03-30T08:10:55.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:10:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: "poolnum": 1, 2023-03-30T08:10:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: "poolname": ".mgr" 2023-03-30T08:10:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:10:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:10:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: "poolnum": 2, 2023-03-30T08:10:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: "poolname": "rbd" 2023-03-30T08:10:55.959 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:10:55.960 INFO:teuthology.orchestra.run.smithi087.stdout:] 2023-03-30T08:10:55.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.957+0000 7ffa71aff700 1 -- 172.21.15.87:0/4276716029 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffa580653f0 msgr2=0x7ffa580678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.957+0000 7ffa71aff700 1 --2- 172.21.15.87:0/4276716029 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffa580653f0 0x7ffa580678a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa68006fd0 tx=0x7ffa68008040 comp rx=0 tx=0).stop 2023-03-30T08:10:55.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.957+0000 7ffa71aff700 1 -- 172.21.15.87:0/4276716029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c15c9b0 msgr2=0x7ffa6c06e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:55.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.957+0000 7ffa71aff700 1 --2- 172.21.15.87:0/4276716029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c15c9b0 0x7ffa6c06e670 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400cc50 tx=0x7ffa6400cf60 comp rx=0 tx=0).stop 2023-03-30T08:10:55.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.957+0000 7ffa71aff700 1 -- 172.21.15.87:0/4276716029 shutdown_connections 2023-03-30T08:10:55.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.957+0000 7ffa71aff700 1 --2- 172.21.15.87:0/4276716029 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffa580653f0 0x7ffa580678a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.957+0000 7ffa71aff700 1 --2- 172.21.15.87:0/4276716029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa6c15c9b0 0x7ffa6c06e670 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.957+0000 7ffa71aff700 1 --2- 172.21.15.87:0/4276716029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa6c06c920 0x7ffa6c0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.957+0000 7ffa71aff700 1 --2- 172.21.15.87:0/4276716029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa6c06c3d0 0x7ffa6c14eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:55.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.957+0000 7ffa71aff700 1 -- 172.21.15.87:0/4276716029 >> 172.21.15.87:0/4276716029 conn(0x7ffa6c099dc0 msgr2=0x7ffa6c06f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:55.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.957+0000 7ffa71aff700 1 -- 172.21.15.87:0/4276716029 shutdown_connections 2023-03-30T08:10:55.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:55.957+0000 7ffa71aff700 1 -- 172.21.15.87:0/4276716029 wait complete. 2023-03-30T08:10:55.981 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-30T08:10:55.981 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-30T08:10:56.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.145+0000 7f023950b700 1 Processor -- start 2023-03-30T08:10:56.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.145+0000 7f023950b700 1 -- start start 2023-03-30T08:10:56.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f023950b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02340b8380 0x7f02340d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:56.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f023950b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f02340d27e0 0x7f0234069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:56.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f023950b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0234160ef0 con 0x7f02341609f0 2023-03-30T08:10:56.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f023950b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02340cd6a0 con 0x7f02340d27e0 2023-03-30T08:10:56.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f023950b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02340cd3a0 con 0x7f02340b8380 2023-03-30T08:10:56.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f02337fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f02340d27e0 0x7f0234069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:56.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f0233fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02340b8380 0x7f02340d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:56.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f0233fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02340b8380 0x7f02340d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:43576/0 (socket says 172.21.15.87:43576) 2023-03-30T08:10:56.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f0233fff700 1 -- 172.21.15.87:0/3091287439 learned_addr learned my addr 172.21.15.87:0/3091287439 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:56.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f0233fff700 1 -- 172.21.15.87:0/3091287439 >> v2:172.21.15.87:3300/0 conn(0x7f02340d27e0 msgr2=0x7f0234069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:56.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f0233fff700 1 --2- 172.21.15.87:0/3091287439 >> v2:172.21.15.87:3300/0 conn(0x7f02340d27e0 0x7f0234069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:56.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f0233fff700 1 -- 172.21.15.87:0/3091287439 >> v1:172.21.15.87:6789/0 conn(0x7f02341609f0 legacy=0x7f023406b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:56.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f0232ffd700 1 -- 172.21.15.87:0/3091287439 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193259388 0 0) 0x7f0234160ef0 con 0x7f02341609f0 2023-03-30T08:10:56.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f0233fff700 1 -- 172.21.15.87:0/3091287439 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02340cef00 con 0x7f02340b8380 2023-03-30T08:10:56.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f0233fff700 1 --2- 172.21.15.87:0/3091287439 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02340b8380 0x7f02340d2200 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0224009910 tx=0x7f0224009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcd7c91a024b3e69 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:56.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f0232ffd700 1 -- 172.21.15.87:0/3091287439 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224011830 con 0x7f02340b8380 2023-03-30T08:10:56.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f0232ffd700 1 -- 172.21.15.87:0/3091287439 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0224011990 con 0x7f02340b8380 2023-03-30T08:10:56.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.149+0000 7f0232ffd700 1 -- 172.21.15.87:0/3091287439 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224011d40 con 0x7f02340b8380 2023-03-30T08:10:56.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.153+0000 7f023950b700 1 -- 172.21.15.87:0/3091287439 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02340b8380 msgr2=0x7f02340d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:56.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.153+0000 7f023950b700 1 --2- 172.21.15.87:0/3091287439 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02340b8380 0x7f02340d2200 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0224009910 tx=0x7f0224009c20 comp rx=0 tx=0).stop 2023-03-30T08:10:56.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.153+0000 7f023950b700 1 -- 172.21.15.87:0/3091287439 shutdown_connections 2023-03-30T08:10:56.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.153+0000 7f023950b700 1 --2- 172.21.15.87:0/3091287439 >> v2:172.21.15.87:3300/0 conn(0x7f02340d27e0 0x7f0234069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:56.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.153+0000 7f023950b700 1 --2- 172.21.15.87:0/3091287439 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02340b8380 0x7f02340d2200 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:56.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.153+0000 7f023950b700 1 -- 172.21.15.87:0/3091287439 >> 172.21.15.87:0/3091287439 conn(0x7f02340b53f0 msgr2=0x7f02340cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:56.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.153+0000 7f023950b700 1 -- 172.21.15.87:0/3091287439 shutdown_connections 2023-03-30T08:10:56.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.153+0000 7f023950b700 1 -- 172.21.15.87:0/3091287439 wait complete. 2023-03-30T08:10:56.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.153+0000 7f023950b700 1 Processor -- start 2023-03-30T08:10:56.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.153+0000 7f023950b700 1 -- start start 2023-03-30T08:10:56.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f023950b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02340b8380 0x7f023415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:56.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f023950b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02341609f0 0x7f023415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:56.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f023950b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0234151130 0x7f02340b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:56.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f023950b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023415da00 con 0x7f02340b8380 2023-03-30T08:10:56.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f023950b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02340cb050 con 0x7f02341609f0 2023-03-30T08:10:56.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f023950b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023415dca0 con 0x7f0234151130 2023-03-30T08:10:56.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f0233fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02340b8380 0x7f023415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:56.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f0233fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02340b8380 0x7f023415f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37680/0 (socket says 172.21.15.87:37680) 2023-03-30T08:10:56.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f0233fff700 1 -- 172.21.15.87:0/163720208 learned_addr learned my addr 172.21.15.87:0/163720208 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:56.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f0238d0a700 1 --2- 172.21.15.87:0/163720208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0234151130 0x7f02340b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:56.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f02337fe700 1 --2- 172.21.15.87:0/163720208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02341609f0 0x7f023415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:56.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f0233fff700 1 -- 172.21.15.87:0/163720208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0234151130 msgr2=0x7f02340b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:56.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f0233fff700 1 --2- 172.21.15.87:0/163720208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0234151130 0x7f02340b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:56.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f0233fff700 1 -- 172.21.15.87:0/163720208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02341609f0 msgr2=0x7f023415d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:56.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f0233fff700 1 --2- 172.21.15.87:0/163720208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02341609f0 0x7f023415d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:56.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f0233fff700 1 -- 172.21.15.87:0/163720208 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0224009570 con 0x7f02340b8380 2023-03-30T08:10:56.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f0233fff700 1 --2- 172.21.15.87:0/163720208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02340b8380 0x7f023415f7f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0224009f70 tx=0x7f0224004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:56.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f0230ff9700 1 -- 172.21.15.87:0/163720208 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022400ba70 con 0x7f02340b8380 2023-03-30T08:10:56.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f0230ff9700 1 -- 172.21.15.87:0/163720208 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022401f070 con 0x7f02340b8380 2023-03-30T08:10:56.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f023950b700 1 -- 172.21.15.87:0/163720208 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02340cf480 con 0x7f02340b8380 2023-03-30T08:10:56.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f0230ff9700 1 -- 172.21.15.87:0/163720208 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022400be10 con 0x7f02340b8380 2023-03-30T08:10:56.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.157+0000 7f023950b700 1 -- 172.21.15.87:0/163720208 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02340cf1a0 con 0x7f02340b8380 2023-03-30T08:10:56.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.161+0000 7f023950b700 1 -- 172.21.15.87:0/163720208 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02340b8750 con 0x7f02340b8380 2023-03-30T08:10:56.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.161+0000 7f0230ff9700 1 -- 172.21.15.87:0/163720208 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f022401a430 con 0x7f02340b8380 2023-03-30T08:10:56.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.161+0000 7f0230ff9700 1 --2- 172.21.15.87:0/163720208 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02200653f0 0x7f02200678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:56.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.161+0000 7f0230ff9700 1 -- 172.21.15.87:0/163720208 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0224021070 con 0x7f02340b8380 2023-03-30T08:10:56.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.161+0000 7f02337fe700 1 --2- 172.21.15.87:0/163720208 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02200653f0 0x7f02200678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:56.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.165+0000 7f02337fe700 1 --2- 172.21.15.87:0/163720208 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02200653f0 0x7f02200678a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f02340b77d0 tx=0x7f0228008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:56.172 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.169+0000 7f0230ff9700 1 -- 172.21.15.87:0/163720208 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f0224052000 con 0x7f02340b8380 2023-03-30T08:10:56.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.345+0000 7f023950b700 1 -- 172.21.15.87:0/163720208 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0234072cf0 con 0x7f02340b8380 2023-03-30T08:10:56.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.901+0000 7f0230ff9700 1 -- 172.21.15.87:0/163720208 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f02240150b0 con 0x7f02340b8380 2023-03-30T08:10:56.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.909+0000 7f023950b700 1 -- 172.21.15.87:0/163720208 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02200653f0 msgr2=0x7f02200678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:56.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.909+0000 7f023950b700 1 --2- 172.21.15.87:0/163720208 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02200653f0 0x7f02200678a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f02340b77d0 tx=0x7f0228008040 comp rx=0 tx=0).stop 2023-03-30T08:10:56.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.909+0000 7f023950b700 1 -- 172.21.15.87:0/163720208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02340b8380 msgr2=0x7f023415f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:56.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.909+0000 7f023950b700 1 --2- 172.21.15.87:0/163720208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02340b8380 0x7f023415f7f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0224009f70 tx=0x7f0224004770 comp rx=0 tx=0).stop 2023-03-30T08:10:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.909+0000 7f023950b700 1 -- 172.21.15.87:0/163720208 shutdown_connections 2023-03-30T08:10:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.909+0000 7f023950b700 1 --2- 172.21.15.87:0/163720208 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02200653f0 0x7f02200678a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.909+0000 7f023950b700 1 --2- 172.21.15.87:0/163720208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0234151130 0x7f02340b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.909+0000 7f023950b700 1 --2- 172.21.15.87:0/163720208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02341609f0 0x7f023415d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.909+0000 7f023950b700 1 --2- 172.21.15.87:0/163720208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02340b8380 0x7f023415f7f0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0224009f70 tx=0x7f0224004770 comp rx=0 tx=0).stop 2023-03-30T08:10:56.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.909+0000 7f023950b700 1 -- 172.21.15.87:0/163720208 >> 172.21.15.87:0/163720208 conn(0x7f02340b53f0 msgr2=0x7f023406b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:56.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.909+0000 7f023950b700 1 -- 172.21.15.87:0/163720208 shutdown_connections 2023-03-30T08:10:56.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:56.909+0000 7f023950b700 1 -- 172.21.15.87:0/163720208 wait complete. 2023-03-30T08:10:56.916 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' created 2023-03-30T08:10:56.932 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-03-30T08:10:57.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.101+0000 7f342b59e700 1 Processor -- start 2023-03-30T08:10:57.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.101+0000 7f342b59e700 1 -- start start 2023-03-30T08:10:57.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342b59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f342c0cfd90 0x7f342c0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:57.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342b59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f342c0b2100 0x7f342c0d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:57.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342b59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342c0b1ec0 con 0x7f342c0b85b0 2023-03-30T08:10:57.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342b59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342c0cf0d0 con 0x7f342c0b2100 2023-03-30T08:10:57.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342b59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342c160b30 con 0x7f342c0cfd90 2023-03-30T08:10:57.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342a59c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f342c0b85b0 0x7f342c0cf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53002/0 (socket says 172.21.15.87:53002) 2023-03-30T08:10:57.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342a59c700 1 -- 172.21.15.87:0/535484353 learned_addr learned my addr 172.21.15.87:0/535484353 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:10:57.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342ad9d700 1 --2- 172.21.15.87:0/535484353 >> v2:172.21.15.87:3300/0 conn(0x7f342c0b2100 0x7f342c0d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:57.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f3429d9b700 1 --2- 172.21.15.87:0/535484353 >> v2:172.21.15.115:3300/0 conn(0x7f342c0cfd90 0x7f342c0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:57.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342959a700 1 -- 172.21.15.87:0/535484353 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330915986 0 0) 0x7f342c0b1ec0 con 0x7f342c0b85b0 2023-03-30T08:10:57.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342959a700 1 -- 172.21.15.87:0/535484353 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34140035d0 con 0x7f342c0b85b0 2023-03-30T08:10:57.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342ad9d700 1 -- 172.21.15.87:0/535484353 >> v2:172.21.15.115:3300/0 conn(0x7f342c0cfd90 msgr2=0x7f342c0cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:57.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342ad9d700 1 --2- 172.21.15.87:0/535484353 >> v2:172.21.15.115:3300/0 conn(0x7f342c0cfd90 0x7f342c0cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:57.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342ad9d700 1 -- 172.21.15.87:0/535484353 >> v1:172.21.15.87:6789/0 conn(0x7f342c0b85b0 legacy=0x7f342c0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:57.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342ad9d700 1 -- 172.21.15.87:0/535484353 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c160e10 con 0x7f342c0b2100 2023-03-30T08:10:57.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342ad9d700 1 --2- 172.21.15.87:0/535484353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c0b2100 0x7f342c0d26b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f342c0b1940 tx=0x7f342400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbcd66c2e4f951ca server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:57.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342959a700 1 -- 172.21.15.87:0/535484353 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342400e070 con 0x7f342c0b2100 2023-03-30T08:10:57.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342959a700 1 -- 172.21.15.87:0/535484353 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342400bb20 con 0x7f342c0b2100 2023-03-30T08:10:57.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.105+0000 7f342959a700 1 -- 172.21.15.87:0/535484353 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424012430 con 0x7f342c0b2100 2023-03-30T08:10:57.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.109+0000 7f342b59e700 1 -- 172.21.15.87:0/535484353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c0b2100 msgr2=0x7f342c0d26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:57.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.109+0000 7f342b59e700 1 --2- 172.21.15.87:0/535484353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c0b2100 0x7f342c0d26b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f342c0b1940 tx=0x7f342400b330 comp rx=0 tx=0).stop 2023-03-30T08:10:57.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.109+0000 7f342b59e700 1 -- 172.21.15.87:0/535484353 shutdown_connections 2023-03-30T08:10:57.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.109+0000 7f342b59e700 1 --2- 172.21.15.87:0/535484353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c0b2100 0x7f342c0d26b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:57.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.109+0000 7f342b59e700 1 --2- 172.21.15.87:0/535484353 >> v2:172.21.15.115:3300/0 conn(0x7f342c0cfd90 0x7f342c0cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:57.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.109+0000 7f342b59e700 1 -- 172.21.15.87:0/535484353 >> 172.21.15.87:0/535484353 conn(0x7f342c0b4760 msgr2=0x7f342c0b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:57.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.109+0000 7f342b59e700 1 -- 172.21.15.87:0/535484353 shutdown_connections 2023-03-30T08:10:57.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.109+0000 7f342b59e700 1 -- 172.21.15.87:0/535484353 wait complete. 2023-03-30T08:10:57.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.109+0000 7f342b59e700 1 Processor -- start 2023-03-30T08:10:57.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.109+0000 7f342b59e700 1 -- start start 2023-03-30T08:10:57.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c0b2100 0x7f342c153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:57.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342b59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f342c0b85b0 0x7f342c0a9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:57.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342b59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342c0cfd90 0x7f342c15fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:57.115 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c153970 con 0x7f342c0b2100 2023-03-30T08:10:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342b59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c0c9d40 con 0x7f342c0b85b0 2023-03-30T08:10:57.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342b59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342c0c9f90 con 0x7f342c0cfd90 2023-03-30T08:10:57.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342a59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c0b2100 0x7f342c153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:57.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342a59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c0b2100 0x7f342c153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37704/0 (socket says 172.21.15.87:37704) 2023-03-30T08:10:57.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342a59c700 1 -- 172.21.15.87:0/1171091510 learned_addr learned my addr 172.21.15.87:0/1171091510 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:57.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f3429d9b700 1 --2- 172.21.15.87:0/1171091510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f342c0b85b0 0x7f342c0a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:57.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342ad9d700 1 --2- 172.21.15.87:0/1171091510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342c0cfd90 0x7f342c15fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:57.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342a59c700 1 -- 172.21.15.87:0/1171091510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342c0cfd90 msgr2=0x7f342c15fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:57.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342a59c700 1 --2- 172.21.15.87:0/1171091510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342c0cfd90 0x7f342c15fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:57.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342a59c700 1 -- 172.21.15.87:0/1171091510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f342c0b85b0 msgr2=0x7f342c0a9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:57.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342a59c700 1 --2- 172.21.15.87:0/1171091510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f342c0b85b0 0x7f342c0a9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:57.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342a59c700 1 -- 172.21.15.87:0/1171091510 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3424009a70 con 0x7f342c0b2100 2023-03-30T08:10:57.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342a59c700 1 --2- 172.21.15.87:0/1171091510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c0b2100 0x7f342c153430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f341c00c700 tx=0x7f341c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:57.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f341affd700 1 -- 172.21.15.87:0/1171091510 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c005d90 con 0x7f342c0b2100 2023-03-30T08:10:57.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342b59e700 1 -- 172.21.15.87:0/1171091510 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342c0d0840 con 0x7f342c0b2100 2023-03-30T08:10:57.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f341affd700 1 -- 172.21.15.87:0/1171091510 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c0070d0 con 0x7f342c0b2100 2023-03-30T08:10:57.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f341affd700 1 -- 172.21.15.87:0/1171091510 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c007480 con 0x7f342c0b2100 2023-03-30T08:10:57.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.113+0000 7f342b59e700 1 -- 172.21.15.87:0/1171091510 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342c0cf3b0 con 0x7f342c0b2100 2023-03-30T08:10:57.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.117+0000 7f342b59e700 1 -- 172.21.15.87:0/1171091510 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342c0d09d0 con 0x7f342c0b2100 2023-03-30T08:10:57.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.117+0000 7f341affd700 1 -- 172.21.15.87:0/1171091510 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f341c0075e0 con 0x7f342c0b2100 2023-03-30T08:10:57.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.117+0000 7f341affd700 1 --2- 172.21.15.87:0/1171091510 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f340c0653f0 0x7f340c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:57.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.117+0000 7f341affd700 1 -- 172.21.15.87:0/1171091510 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f341c081c90 con 0x7f342c0b2100 2023-03-30T08:10:57.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.117+0000 7f3429d9b700 1 --2- 172.21.15.87:0/1171091510 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f340c0653f0 0x7f340c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:57.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.121+0000 7f3429d9b700 1 --2- 172.21.15.87:0/1171091510 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f340c0653f0 0x7f340c0678a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f342c0b14e0 tx=0x7f3420009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:57.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.125+0000 7f341affd700 1 -- 172.21.15.87:0/1171091510 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f341c04fa60 con 0x7f342c0b2100 2023-03-30T08:10:57.299 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.297+0000 7f342b59e700 1 -- 172.21.15.87:0/1171091510 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f342c072cf0 con 0x7f342c0b2100 2023-03-30T08:10:57.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.909+0000 7f341affd700 1 -- 172.21.15.87:0/1171091510 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7f341c053080 con 0x7f342c0b2100 2023-03-30T08:10:57.930 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.925+0000 7f342b59e700 1 -- 172.21.15.87:0/1171091510 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f340c0653f0 msgr2=0x7f340c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:57.930 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.925+0000 7f342b59e700 1 --2- 172.21.15.87:0/1171091510 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f340c0653f0 0x7f340c0678a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f342c0b14e0 tx=0x7f3420009240 comp rx=0 tx=0).stop 2023-03-30T08:10:57.930 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.925+0000 7f342b59e700 1 -- 172.21.15.87:0/1171091510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c0b2100 msgr2=0x7f342c153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:57.930 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.925+0000 7f342b59e700 1 --2- 172.21.15.87:0/1171091510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c0b2100 0x7f342c153430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f341c00c700 tx=0x7f341c00ca10 comp rx=0 tx=0).stop 2023-03-30T08:10:57.930 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.925+0000 7f342b59e700 1 -- 172.21.15.87:0/1171091510 shutdown_connections 2023-03-30T08:10:57.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.925+0000 7f342b59e700 1 --2- 172.21.15.87:0/1171091510 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f340c0653f0 0x7f340c0678a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:57.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.925+0000 7f342b59e700 1 --2- 172.21.15.87:0/1171091510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f342c0cfd90 0x7f342c15fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:57.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.925+0000 7f342b59e700 1 --2- 172.21.15.87:0/1171091510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f342c0b85b0 0x7f342c0a9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:57.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.925+0000 7f342b59e700 1 --2- 172.21.15.87:0/1171091510 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f342c0b2100 0x7f342c153430 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:57.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.925+0000 7f342b59e700 1 -- 172.21.15.87:0/1171091510 >> 172.21.15.87:0/1171091510 conn(0x7f342c0b4760 msgr2=0x7f342c0c9330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:57.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.929+0000 7f342b59e700 1 -- 172.21.15.87:0/1171091510 shutdown_connections 2023-03-30T08:10:57.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:57.929+0000 7f342b59e700 1 -- 172.21.15.87:0/1171091510 wait complete. 2023-03-30T08:10:57.945 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' created 2023-03-30T08:10:57.961 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-30T08:10:58.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.117+0000 7f6d40d34700 1 Processor -- start 2023-03-30T08:10:58.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.117+0000 7f6d40d34700 1 -- start start 2023-03-30T08:10:58.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.117+0000 7f6d40d34700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6d3c0d27e0 0x7f6d3c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:58.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.117+0000 7f6d40d34700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6d3c06a3e0 0x7f6d3c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:58.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.117+0000 7f6d40d34700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3c160ef0 con 0x7f6d3c0b8380 2023-03-30T08:10:58.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.117+0000 7f6d40d34700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3c0cd6a0 con 0x7f6d3c0d27e0 2023-03-30T08:10:58.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.117+0000 7f6d40d34700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3c0cd3a0 con 0x7f6d3c06a3e0 2023-03-30T08:10:58.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d32ffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6d3c0d27e0 0x7f6d3c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:58.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d3b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6d3c0b8380 0x7f6d3c069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:48964/0 (socket says 172.21.15.87:48964) 2023-03-30T08:10:58.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d3b7fe700 1 -- 172.21.15.87:0/3621486584 learned_addr learned my addr 172.21.15.87:0/3621486584 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:10:58.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d3bfff700 1 --2- 172.21.15.87:0/3621486584 >> v2:172.21.15.115:3300/0 conn(0x7f6d3c06a3e0 0x7f6d3c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:58.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d3affd700 1 -- 172.21.15.87:0/3621486584 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383473445 0 0) 0x7f6d3c160ef0 con 0x7f6d3c0b8380 2023-03-30T08:10:58.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d32ffd700 1 -- 172.21.15.87:0/3621486584 >> v2:172.21.15.115:3300/0 conn(0x7f6d3c06a3e0 msgr2=0x7f6d3c0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:58.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d32ffd700 1 --2- 172.21.15.87:0/3621486584 >> v2:172.21.15.115:3300/0 conn(0x7f6d3c06a3e0 0x7f6d3c0d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:58.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d32ffd700 1 -- 172.21.15.87:0/3621486584 >> v1:172.21.15.115:6789/0 conn(0x7f6d3c0b8380 legacy=0x7f6d3c069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:58.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d32ffd700 1 -- 172.21.15.87:0/3621486584 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c0cef00 con 0x7f6d3c0d27e0 2023-03-30T08:10:58.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d32ffd700 1 --2- 172.21.15.87:0/3621486584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d3c0d27e0 0x7f6d3c0d2200 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009850 tx=0x7f6d24009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8593517702bfd3 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:58.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d3affd700 1 -- 172.21.15.87:0/3621486584 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24011830 con 0x7f6d3c0d27e0 2023-03-30T08:10:58.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d3affd700 1 -- 172.21.15.87:0/3621486584 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d24011990 con 0x7f6d3c0d27e0 2023-03-30T08:10:58.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d3affd700 1 -- 172.21.15.87:0/3621486584 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24011d20 con 0x7f6d3c0d27e0 2023-03-30T08:10:58.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d40d34700 1 -- 172.21.15.87:0/3621486584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d3c0d27e0 msgr2=0x7f6d3c0d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:58.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d40d34700 1 --2- 172.21.15.87:0/3621486584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d3c0d27e0 0x7f6d3c0d2200 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009850 tx=0x7f6d24009b60 comp rx=0 tx=0).stop 2023-03-30T08:10:58.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d40d34700 1 -- 172.21.15.87:0/3621486584 shutdown_connections 2023-03-30T08:10:58.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d40d34700 1 --2- 172.21.15.87:0/3621486584 >> v2:172.21.15.115:3300/0 conn(0x7f6d3c06a3e0 0x7f6d3c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:58.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d40d34700 1 --2- 172.21.15.87:0/3621486584 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d3c0d27e0 0x7f6d3c0d2200 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:58.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d40d34700 1 -- 172.21.15.87:0/3621486584 >> 172.21.15.87:0/3621486584 conn(0x7f6d3c0b53f0 msgr2=0x7f6d3c0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:58.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d40d34700 1 -- 172.21.15.87:0/3621486584 shutdown_connections 2023-03-30T08:10:58.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.121+0000 7f6d40d34700 1 -- 172.21.15.87:0/3621486584 wait complete. 2023-03-30T08:10:58.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.125+0000 7f6d40d34700 1 Processor -- start 2023-03-30T08:10:58.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.125+0000 7f6d40d34700 1 -- start start 2023-03-30T08:10:58.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.125+0000 7f6d40d34700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d3c06a3e0 0x7f6d3c14f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:58.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.125+0000 7f6d40d34700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d3c0b8380 0x7f6d3c15e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:58.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.125+0000 7f6d40d34700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d3c0c8de0 0x7f6d3c0c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:58.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.125+0000 7f6d40d34700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c14f650 con 0x7f6d3c0b8380 2023-03-30T08:10:58.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.125+0000 7f6d40d34700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c0cb490 con 0x7f6d3c0c8de0 2023-03-30T08:10:58.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.125+0000 7f6d40d34700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c0cb770 con 0x7f6d3c06a3e0 2023-03-30T08:10:58.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d32ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d3c0b8380 0x7f6d3c15e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:58.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d32ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d3c0b8380 0x7f6d3c15e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37728/0 (socket says 172.21.15.87:37728) 2023-03-30T08:10:58.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d32ffd700 1 -- 172.21.15.87:0/2045906803 learned_addr learned my addr 172.21.15.87:0/2045906803 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:58.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d3b7fe700 1 --2- 172.21.15.87:0/2045906803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d3c06a3e0 0x7f6d3c14f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:58.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d3bfff700 1 --2- 172.21.15.87:0/2045906803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d3c0c8de0 0x7f6d3c0c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:58.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d32ffd700 1 -- 172.21.15.87:0/2045906803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d3c06a3e0 msgr2=0x7f6d3c14f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:58.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d32ffd700 1 --2- 172.21.15.87:0/2045906803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d3c06a3e0 0x7f6d3c14f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:58.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d32ffd700 1 -- 172.21.15.87:0/2045906803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d3c0c8de0 msgr2=0x7f6d3c0c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:58.133 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d32ffd700 1 --2- 172.21.15.87:0/2045906803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d3c0c8de0 0x7f6d3c0c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:58.133 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d32ffd700 1 -- 172.21.15.87:0/2045906803 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d240094b0 con 0x7f6d3c0b8380 2023-03-30T08:10:58.133 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d32ffd700 1 --2- 172.21.15.87:0/2045906803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d3c0b8380 0x7f6d3c15e540 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6d24014040 tx=0x7f6d24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:58.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d38ff9700 1 -- 172.21.15.87:0/2045906803 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d240045d0 con 0x7f6d3c0b8380 2023-03-30T08:10:58.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d38ff9700 1 -- 172.21.15.87:0/2045906803 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2401e070 con 0x7f6d3c0b8380 2023-03-30T08:10:58.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d40d34700 1 -- 172.21.15.87:0/2045906803 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3c0cf480 con 0x7f6d3c0b8380 2023-03-30T08:10:58.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d38ff9700 1 -- 172.21.15.87:0/2045906803 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24003900 con 0x7f6d3c0b8380 2023-03-30T08:10:58.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d40d34700 1 -- 172.21.15.87:0/2045906803 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3c0cf1a0 con 0x7f6d3c0b8380 2023-03-30T08:10:58.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.129+0000 7f6d40d34700 1 -- 172.21.15.87:0/2045906803 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d3c0b8750 con 0x7f6d3c0b8380 2023-03-30T08:10:58.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.133+0000 7f6d38ff9700 1 -- 172.21.15.87:0/2045906803 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6d24003a60 con 0x7f6d3c0b8380 2023-03-30T08:10:58.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.133+0000 7f6d38ff9700 1 --2- 172.21.15.87:0/2045906803 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6d1c0653f0 0x7f6d1c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:58.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.133+0000 7f6d38ff9700 1 -- 172.21.15.87:0/2045906803 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f6d24083c10 con 0x7f6d3c0b8380 2023-03-30T08:10:58.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.133+0000 7f6d3b7fe700 1 --2- 172.21.15.87:0/2045906803 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6d1c0653f0 0x7f6d1c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:58.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.137+0000 7f6d3b7fe700 1 --2- 172.21.15.87:0/2045906803 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6d1c0653f0 0x7f6d1c0678a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0012e0 tx=0x7f6d2c001b70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:58.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.141+0000 7f6d38ff9700 1 -- 172.21.15.87:0/2045906803 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f6d24051980 con 0x7f6d3c0b8380 2023-03-30T08:10:58.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.345+0000 7f6d40d34700 1 -- 172.21.15.87:0/2045906803 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6d3c072cf0 con 0x7f6d3c0b8380 2023-03-30T08:10:58.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.357+0000 7f6d38ff9700 1 -- 172.21.15.87:0/2045906803 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6d24054fa0 con 0x7f6d3c0b8380 2023-03-30T08:10:58.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.361+0000 7f6d40d34700 1 -- 172.21.15.87:0/2045906803 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6d1c0653f0 msgr2=0x7f6d1c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:58.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.361+0000 7f6d40d34700 1 --2- 172.21.15.87:0/2045906803 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6d1c0653f0 0x7f6d1c0678a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0012e0 tx=0x7f6d2c001b70 comp rx=0 tx=0).stop 2023-03-30T08:10:58.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.361+0000 7f6d40d34700 1 -- 172.21.15.87:0/2045906803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d3c0b8380 msgr2=0x7f6d3c15e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:58.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.361+0000 7f6d40d34700 1 --2- 172.21.15.87:0/2045906803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d3c0b8380 0x7f6d3c15e540 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6d24014040 tx=0x7f6d24004770 comp rx=0 tx=0).stop 2023-03-30T08:10:58.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.361+0000 7f6d40d34700 1 -- 172.21.15.87:0/2045906803 shutdown_connections 2023-03-30T08:10:58.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.361+0000 7f6d40d34700 1 --2- 172.21.15.87:0/2045906803 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6d1c0653f0 0x7f6d1c0678a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:58.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.361+0000 7f6d40d34700 1 --2- 172.21.15.87:0/2045906803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d3c0c8de0 0x7f6d3c0c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:58.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.361+0000 7f6d40d34700 1 --2- 172.21.15.87:0/2045906803 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d3c0b8380 0x7f6d3c15e540 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:58.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.361+0000 7f6d40d34700 1 --2- 172.21.15.87:0/2045906803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d3c06a3e0 0x7f6d3c14f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:58.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.361+0000 7f6d40d34700 1 -- 172.21.15.87:0/2045906803 >> 172.21.15.87:0/2045906803 conn(0x7f6d3c0b53f0 msgr2=0x7f6d3c0cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:58.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.365+0000 7f6d40d34700 1 -- 172.21.15.87:0/2045906803 shutdown_connections 2023-03-30T08:10:58.369 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.365+0000 7f6d40d34700 1 -- 172.21.15.87:0/2045906803 wait complete. 2023-03-30T08:10:58.369 INFO:teuthology.orchestra.run.smithi087.stderr:new fs with metadata pool 3 and data pool 4 2023-03-30T08:10:58.397 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-03-30T08:10:58.398 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-03-30T08:10:58.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.561+0000 7fb03b59e700 1 Processor -- start 2023-03-30T08:10:58.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.561+0000 7fb03b59e700 1 -- start start 2023-03-30T08:10:58.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.565+0000 7fb03b59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb03c0b8380 0x7fb03c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:58.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.565+0000 7fb03b59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb03c0d27e0 0x7fb03c069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:58.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.565+0000 7fb03b59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03c160ef0 con 0x7fb03c1609f0 2023-03-30T08:10:58.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.565+0000 7fb03b59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03c0cd6a0 con 0x7fb03c0b8380 2023-03-30T08:10:58.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.565+0000 7fb03b59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03c0cd3a0 con 0x7fb03c0d27e0 2023-03-30T08:10:58.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.565+0000 7fb03a59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb03c0b8380 0x7fb03c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:58.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.565+0000 7fb03ad9d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb03c1609f0 0x7fb03c06b1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53010/0 (socket says 172.21.15.87:53010) 2023-03-30T08:10:58.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.565+0000 7fb03ad9d700 1 -- 172.21.15.87:0/2330167627 learned_addr learned my addr 172.21.15.87:0/2330167627 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:10:58.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.565+0000 7fb039d9b700 1 --2- 172.21.15.87:0/2330167627 >> v2:172.21.15.115:3300/0 conn(0x7fb03c0d27e0 0x7fb03c069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:58.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.565+0000 7fb03a59c700 1 -- 172.21.15.87:0/2330167627 >> v2:172.21.15.115:3300/0 conn(0x7fb03c0d27e0 msgr2=0x7fb03c069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:58.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.565+0000 7fb03a59c700 1 --2- 172.21.15.87:0/2330167627 >> v2:172.21.15.115:3300/0 conn(0x7fb03c0d27e0 0x7fb03c069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:58.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.565+0000 7fb03a59c700 1 -- 172.21.15.87:0/2330167627 >> v1:172.21.15.87:6789/0 conn(0x7fb03c1609f0 legacy=0x7fb03c06b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:58.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.565+0000 7fb03a59c700 1 -- 172.21.15.87:0/2330167627 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c0cef00 con 0x7fb03c0b8380 2023-03-30T08:10:58.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.565+0000 7fb03959a700 1 -- 172.21.15.87:0/2330167627 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878061638 0 0) 0x7fb03c160ef0 con 0x7fb03c1609f0 2023-03-30T08:10:58.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.569+0000 7fb03a59c700 1 --2- 172.21.15.87:0/2330167627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03c0b8380 0x7fb03c0d2200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0d3d10 tx=0x7fb02c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f182e0c148dbc64d server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:58.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.569+0000 7fb03959a700 1 -- 172.21.15.87:0/2330167627 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c011830 con 0x7fb03c0b8380 2023-03-30T08:10:58.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.569+0000 7fb03959a700 1 -- 172.21.15.87:0/2330167627 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c011990 con 0x7fb03c0b8380 2023-03-30T08:10:58.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.569+0000 7fb03959a700 1 -- 172.21.15.87:0/2330167627 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c011d20 con 0x7fb03c0b8380 2023-03-30T08:10:58.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.569+0000 7fb03b59e700 1 -- 172.21.15.87:0/2330167627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03c0b8380 msgr2=0x7fb03c0d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:58.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.569+0000 7fb03b59e700 1 --2- 172.21.15.87:0/2330167627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03c0b8380 0x7fb03c0d2200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0d3d10 tx=0x7fb02c009b30 comp rx=0 tx=0).stop 2023-03-30T08:10:58.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.569+0000 7fb03b59e700 1 -- 172.21.15.87:0/2330167627 shutdown_connections 2023-03-30T08:10:58.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.569+0000 7fb03b59e700 1 --2- 172.21.15.87:0/2330167627 >> v2:172.21.15.115:3300/0 conn(0x7fb03c0d27e0 0x7fb03c069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:58.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.569+0000 7fb03b59e700 1 --2- 172.21.15.87:0/2330167627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03c0b8380 0x7fb03c0d2200 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:58.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.569+0000 7fb03b59e700 1 -- 172.21.15.87:0/2330167627 >> 172.21.15.87:0/2330167627 conn(0x7fb03c0b53f0 msgr2=0x7fb03c0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:58.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.569+0000 7fb03b59e700 1 -- 172.21.15.87:0/2330167627 shutdown_connections 2023-03-30T08:10:58.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.569+0000 7fb03b59e700 1 -- 172.21.15.87:0/2330167627 wait complete. 2023-03-30T08:10:58.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.573+0000 7fb03b59e700 1 Processor -- start 2023-03-30T08:10:58.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.573+0000 7fb03b59e700 1 -- start start 2023-03-30T08:10:58.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03b59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb03c0b8380 0x7fb03c0cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:58.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03b59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb03c1609f0 0x7fb03c0ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:58.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03c14a820 0x7fb03c0c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:58.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c0cafc0 con 0x7fb03c14a820 2023-03-30T08:10:58.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03b59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c0cbc10 con 0x7fb03c0b8380 2023-03-30T08:10:58.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03b59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c0cbef0 con 0x7fb03c1609f0 2023-03-30T08:10:58.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03ad9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03c14a820 0x7fb03c0c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:58.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03ad9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03c14a820 0x7fb03c0c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37742/0 (socket says 172.21.15.87:37742) 2023-03-30T08:10:58.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb039d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb03c1609f0 0x7fb03c0ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:58.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03ad9d700 1 -- 172.21.15.87:0/1038566834 learned_addr learned my addr 172.21.15.87:0/1038566834 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:58.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03a59c700 1 --2- 172.21.15.87:0/1038566834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb03c0b8380 0x7fb03c0cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:58.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03ad9d700 1 -- 172.21.15.87:0/1038566834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb03c1609f0 msgr2=0x7fb03c0ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:58.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03ad9d700 1 --2- 172.21.15.87:0/1038566834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb03c1609f0 0x7fb03c0ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:58.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03ad9d700 1 -- 172.21.15.87:0/1038566834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb03c0b8380 msgr2=0x7fb03c0cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:58.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03ad9d700 1 --2- 172.21.15.87:0/1038566834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb03c0b8380 0x7fb03c0cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:58.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03ad9d700 1 -- 172.21.15.87:0/1038566834 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0094b0 con 0x7fb03c14a820 2023-03-30T08:10:58.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03ad9d700 1 --2- 172.21.15.87:0/1038566834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03c14a820 0x7fb03c0c89b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb03400cb60 tx=0x7fb03400ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:58.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb02affd700 1 -- 172.21.15.87:0/1038566834 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03400a9e0 con 0x7fb03c14a820 2023-03-30T08:10:58.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb02affd700 1 -- 172.21.15.87:0/1038566834 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03400ab40 con 0x7fb03c14a820 2023-03-30T08:10:58.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03b59e700 1 -- 172.21.15.87:0/1038566834 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03c0cf480 con 0x7fb03c14a820 2023-03-30T08:10:58.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb02affd700 1 -- 172.21.15.87:0/1038566834 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0340070d0 con 0x7fb03c14a820 2023-03-30T08:10:58.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03b59e700 1 -- 172.21.15.87:0/1038566834 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c0cf1a0 con 0x7fb03c14a820 2023-03-30T08:10:58.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.577+0000 7fb03b59e700 1 -- 172.21.15.87:0/1038566834 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03c0b8750 con 0x7fb03c14a820 2023-03-30T08:10:58.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.581+0000 7fb02affd700 1 -- 172.21.15.87:0/1038566834 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fb034007230 con 0x7fb03c14a820 2023-03-30T08:10:58.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.581+0000 7fb02affd700 1 --2- 172.21.15.87:0/1038566834 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb01c0653f0 0x7fb01c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:58.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.581+0000 7fb02affd700 1 -- 172.21.15.87:0/1038566834 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb034082260 con 0x7fb03c14a820 2023-03-30T08:10:58.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.581+0000 7fb03a59c700 1 --2- 172.21.15.87:0/1038566834 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb01c0653f0 0x7fb01c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:58.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.581+0000 7fb03a59c700 1 --2- 172.21.15.87:0/1038566834 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb01c0653f0 0x7fb01c0678a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb02c000c00 tx=0x7fb02c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:58.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.589+0000 7fb02affd700 1 -- 172.21.15.87:0/1038566834 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fb03404fe70 con 0x7fb03c14a820 2023-03-30T08:10:58.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:58.765+0000 7fb03b59e700 1 -- 172.21.15.87:0/1038566834 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fb03c072cf0 con 0x7fb03c14a820 2023-03-30T08:10:59.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.365+0000 7fb02affd700 1 -- 172.21.15.87:0/1038566834 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7fb034053490 con 0x7fb03c14a820 2023-03-30T08:10:59.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.373+0000 7fb03b59e700 1 -- 172.21.15.87:0/1038566834 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb01c0653f0 msgr2=0x7fb01c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:59.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.373+0000 7fb03b59e700 1 --2- 172.21.15.87:0/1038566834 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb01c0653f0 0x7fb01c0678a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb02c000c00 tx=0x7fb02c008030 comp rx=0 tx=0).stop 2023-03-30T08:10:59.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.373+0000 7fb03b59e700 1 -- 172.21.15.87:0/1038566834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03c14a820 msgr2=0x7fb03c0c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:59.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.373+0000 7fb03b59e700 1 --2- 172.21.15.87:0/1038566834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03c14a820 0x7fb03c0c89b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb03400cb60 tx=0x7fb03400ce70 comp rx=0 tx=0).stop 2023-03-30T08:10:59.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.373+0000 7fb03b59e700 1 -- 172.21.15.87:0/1038566834 shutdown_connections 2023-03-30T08:10:59.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.373+0000 7fb03b59e700 1 --2- 172.21.15.87:0/1038566834 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb01c0653f0 0x7fb01c0678a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:59.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.373+0000 7fb03b59e700 1 --2- 172.21.15.87:0/1038566834 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb03c14a820 0x7fb03c0c89b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:59.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.373+0000 7fb03b59e700 1 --2- 172.21.15.87:0/1038566834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb03c1609f0 0x7fb03c0ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:59.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.373+0000 7fb03b59e700 1 --2- 172.21.15.87:0/1038566834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb03c0b8380 0x7fb03c0cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:59.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.373+0000 7fb03b59e700 1 -- 172.21.15.87:0/1038566834 >> 172.21.15.87:0/1038566834 conn(0x7fb03c0b53f0 msgr2=0x7fb03c0d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:59.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.373+0000 7fb03b59e700 1 -- 172.21.15.87:0/1038566834 shutdown_connections 2023-03-30T08:10:59.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.373+0000 7fb03b59e700 1 -- 172.21.15.87:0/1038566834 wait complete. 2023-03-30T08:10:59.396 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-03-30T08:10:59.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.561+0000 7feb0da51700 1 Processor -- start 2023-03-30T08:10:59.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.561+0000 7feb0da51700 1 -- start start 2023-03-30T08:10:59.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.565+0000 7feb0da51700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080cd380 0x7feb0815d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:59.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.565+0000 7feb0da51700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feb080712f0 0x7feb08159440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:59.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.565+0000 7feb0da51700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb080cca10 con 0x7feb080cd750 2023-03-30T08:10:59.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.565+0000 7feb0da51700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0815a050 con 0x7feb080712f0 2023-03-30T08:10:59.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.565+0000 7feb0da51700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0815a330 con 0x7feb080cd380 2023-03-30T08:10:59.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.565+0000 7feb06ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080cd380 0x7feb0815d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:59.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.565+0000 7feb06ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080cd380 0x7feb0815d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:43618/0 (socket says 172.21.15.87:43618) 2023-03-30T08:10:59.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.565+0000 7feb06ffd700 1 -- 172.21.15.87:0/2326311982 learned_addr learned my addr 172.21.15.87:0/2326311982 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:59.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.565+0000 7feb077fe700 1 --2- 172.21.15.87:0/2326311982 >> v2:172.21.15.115:3300/0 conn(0x7feb080712f0 0x7feb08159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:59.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.565+0000 7feb06ffd700 1 -- 172.21.15.87:0/2326311982 >> v2:172.21.15.115:3300/0 conn(0x7feb080712f0 msgr2=0x7feb08159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:10:59.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.565+0000 7feb06ffd700 1 --2- 172.21.15.87:0/2326311982 >> v2:172.21.15.115:3300/0 conn(0x7feb080712f0 0x7feb08159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:59.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.565+0000 7feb06ffd700 1 -- 172.21.15.87:0/2326311982 >> v1:172.21.15.115:6789/0 conn(0x7feb080cd750 legacy=0x7feb08070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:59.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.565+0000 7feb06ffd700 1 -- 172.21.15.87:0/2326311982 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0815cad0 con 0x7feb080cd380 2023-03-30T08:10:59.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.565+0000 7feb06ffd700 1 --2- 172.21.15.87:0/2326311982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080cd380 0x7feb0815d5b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009910 tx=0x7feaf8009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6a8bdd2c5ecf29c server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:59.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.569+0000 7feb05ffb700 1 -- 172.21.15.87:0/2326311982 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf800f8a0 con 0x7feb080cd380 2023-03-30T08:10:59.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.569+0000 7feb05ffb700 1 -- 172.21.15.87:0/2326311982 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf800fa00 con 0x7feb080cd380 2023-03-30T08:10:59.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.569+0000 7feb05ffb700 1 -- 172.21.15.87:0/2326311982 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf800fdb0 con 0x7feb080cd380 2023-03-30T08:10:59.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.569+0000 7feb0da51700 1 -- 172.21.15.87:0/2326311982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080cd380 msgr2=0x7feb0815d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:59.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.569+0000 7feb0da51700 1 --2- 172.21.15.87:0/2326311982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080cd380 0x7feb0815d5b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009910 tx=0x7feaf8009c20 comp rx=0 tx=0).stop 2023-03-30T08:10:59.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.569+0000 7feb0da51700 1 -- 172.21.15.87:0/2326311982 shutdown_connections 2023-03-30T08:10:59.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.569+0000 7feb0da51700 1 --2- 172.21.15.87:0/2326311982 >> v2:172.21.15.115:3300/0 conn(0x7feb080712f0 0x7feb08159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:59.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.569+0000 7feb0da51700 1 --2- 172.21.15.87:0/2326311982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080cd380 0x7feb0815d5b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:59.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.569+0000 7feb0da51700 1 -- 172.21.15.87:0/2326311982 >> 172.21.15.87:0/2326311982 conn(0x7feb080ce750 msgr2=0x7feb080ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:10:59.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.569+0000 7feb0da51700 1 -- 172.21.15.87:0/2326311982 shutdown_connections 2023-03-30T08:10:59.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.569+0000 7feb0da51700 1 -- 172.21.15.87:0/2326311982 wait complete. 2023-03-30T08:10:59.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.569+0000 7feb0da51700 1 Processor -- start 2023-03-30T08:10:59.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb0da51700 1 -- start start 2023-03-30T08:10:59.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb0da51700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb080712f0 0x7feb080adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:59.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb0da51700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080cd380 0x7feb080acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:59.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb0da51700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb080cd750 0x7feb0814ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:59.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb0da51700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb080ab8e0 con 0x7feb080712f0 2023-03-30T08:10:59.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb0da51700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb08149700 con 0x7feb080cd750 2023-03-30T08:10:59.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb0da51700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb080ae0c0 con 0x7feb080cd380 2023-03-30T08:10:59.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb06ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb080712f0 0x7feb080adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:59.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb06ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb080712f0 0x7feb080adb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37744/0 (socket says 172.21.15.87:37744) 2023-03-30T08:10:59.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb06ffd700 1 -- 172.21.15.87:0/1181602651 learned_addr learned my addr 172.21.15.87:0/1181602651 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:10:59.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb077fe700 1 --2- 172.21.15.87:0/1181602651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb080cd750 0x7feb0814ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:59.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb067fc700 1 --2- 172.21.15.87:0/1181602651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080cd380 0x7feb080acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:59.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb06ffd700 1 -- 172.21.15.87:0/1181602651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080cd380 msgr2=0x7feb080acb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:59.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb06ffd700 1 --2- 172.21.15.87:0/1181602651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080cd380 0x7feb080acb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:59.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb06ffd700 1 -- 172.21.15.87:0/1181602651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb080cd750 msgr2=0x7feb0814ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:10:59.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb06ffd700 1 --2- 172.21.15.87:0/1181602651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb080cd750 0x7feb0814ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:10:59.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb06ffd700 1 -- 172.21.15.87:0/1181602651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf8009570 con 0x7feb080712f0 2023-03-30T08:10:59.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb06ffd700 1 --2- 172.21.15.87:0/1181602651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb080712f0 0x7feb080adb80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feaf8000c00 tx=0x7feaf8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:59.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feaeffff700 1 -- 172.21.15.87:0/1181602651 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80038c0 con 0x7feb080712f0 2023-03-30T08:10:59.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feaeffff700 1 -- 172.21.15.87:0/1181602651 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf8003a40 con 0x7feb080712f0 2023-03-30T08:10:59.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feaeffff700 1 -- 172.21.15.87:0/1181602651 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8003df0 con 0x7feb080712f0 2023-03-30T08:10:59.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb0da51700 1 -- 172.21.15.87:0/1181602651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0815d090 con 0x7feb080712f0 2023-03-30T08:10:59.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.573+0000 7feb0da51700 1 -- 172.21.15.87:0/1181602651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0815cdb0 con 0x7feb080712f0 2023-03-30T08:10:59.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.577+0000 7feb0da51700 1 -- 172.21.15.87:0/1181602651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb08072cf0 con 0x7feb080712f0 2023-03-30T08:10:59.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.577+0000 7feaeffff700 1 -- 172.21.15.87:0/1181602651 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7feaf8006c80 con 0x7feb080712f0 2023-03-30T08:10:59.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.577+0000 7feaeffff700 1 --2- 172.21.15.87:0/1181602651 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feaf40653f0 0x7feaf40678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:10:59.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.577+0000 7feaeffff700 1 -- 172.21.15.87:0/1181602651 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6288+0+0 (secure 0 0 0) 0x7feaf8083620 con 0x7feb080712f0 2023-03-30T08:10:59.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.581+0000 7feb067fc700 1 --2- 172.21.15.87:0/1181602651 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feaf40653f0 0x7feaf40678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:10:59.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.581+0000 7feb067fc700 1 --2- 172.21.15.87:0/1181602651 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feaf40653f0 0x7feaf40678a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb080b3dd0 tx=0x7feafc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:10:59.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.585+0000 7feaeffff700 1 -- 172.21.15.87:0/1181602651 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7feaf8051250 con 0x7feb080712f0 2023-03-30T08:10:59.757 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:10:59.753+0000 7feb0da51700 1 -- 172.21.15.87:0/1181602651 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7feb080733a0 con 0x7feb080712f0 2023-03-30T08:11:01.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.385+0000 7feaeffff700 1 -- 172.21.15.87:0/1181602651 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7feaf8054870 con 0x7feb080712f0 2023-03-30T08:11:01.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.393+0000 7feb0da51700 1 -- 172.21.15.87:0/1181602651 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feaf40653f0 msgr2=0x7feaf40678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:01.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.393+0000 7feb0da51700 1 --2- 172.21.15.87:0/1181602651 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feaf40653f0 0x7feaf40678a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb080b3dd0 tx=0x7feafc009040 comp rx=0 tx=0).stop 2023-03-30T08:11:01.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.393+0000 7feb0da51700 1 -- 172.21.15.87:0/1181602651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb080712f0 msgr2=0x7feb080adb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:01.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.397+0000 7feb0da51700 1 --2- 172.21.15.87:0/1181602651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb080712f0 0x7feb080adb80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feaf8000c00 tx=0x7feaf8004770 comp rx=0 tx=0).stop 2023-03-30T08:11:01.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.397+0000 7feb0da51700 1 -- 172.21.15.87:0/1181602651 shutdown_connections 2023-03-30T08:11:01.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.397+0000 7feb0da51700 1 --2- 172.21.15.87:0/1181602651 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feaf40653f0 0x7feaf40678a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:01.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.397+0000 7feb0da51700 1 --2- 172.21.15.87:0/1181602651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb080cd750 0x7feb0814ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:01.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.397+0000 7feb0da51700 1 --2- 172.21.15.87:0/1181602651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080cd380 0x7feb080acb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:01.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.397+0000 7feb0da51700 1 --2- 172.21.15.87:0/1181602651 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb080712f0 0x7feb080adb80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:01.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.397+0000 7feb0da51700 1 -- 172.21.15.87:0/1181602651 >> 172.21.15.87:0/1181602651 conn(0x7feb080ce750 msgr2=0x7feb080ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:01.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.397+0000 7feb0da51700 1 -- 172.21.15.87:0/1181602651 shutdown_connections 2023-03-30T08:11:01.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.397+0000 7feb0da51700 1 -- 172.21.15.87:0/1181602651 wait complete. 2023-03-30T08:11:01.406 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data_ec' created 2023-03-30T08:11:01.421 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-03-30T08:11:01.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.577+0000 7f36ee3e4700 1 Processor -- start 2023-03-30T08:11:01.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.577+0000 7f36ee3e4700 1 -- start start 2023-03-30T08:11:01.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.581+0000 7f36ee3e4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f36e80b8380 0x7f36e80d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:01.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.581+0000 7f36ee3e4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f36e806a3e0 0x7f36e80d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:01.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.581+0000 7f36ee3e4700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e8160ef0 con 0x7f36e80d27e0 2023-03-30T08:11:01.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.581+0000 7f36ee3e4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e80cd6a0 con 0x7f36e80b8380 2023-03-30T08:11:01.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.581+0000 7f36ee3e4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e80cd3a0 con 0x7f36e806a3e0 2023-03-30T08:11:01.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.581+0000 7f36ed3e2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f36e80b8380 0x7f36e80d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:01.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.581+0000 7f36ed3e2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f36e80b8380 0x7f36e80d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51310/0 (socket says 172.21.15.87:51310) 2023-03-30T08:11:01.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.581+0000 7f36ed3e2700 1 -- 172.21.15.87:0/3123265817 learned_addr learned my addr 172.21.15.87:0/3123265817 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:01.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.581+0000 7f36edbe3700 1 --2- 172.21.15.87:0/3123265817 >> v2:172.21.15.115:3300/0 conn(0x7f36e806a3e0 0x7f36e80d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:01.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.581+0000 7f36ed3e2700 1 -- 172.21.15.87:0/3123265817 >> v2:172.21.15.115:3300/0 conn(0x7f36e806a3e0 msgr2=0x7f36e80d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:01.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.581+0000 7f36ed3e2700 1 --2- 172.21.15.87:0/3123265817 >> v2:172.21.15.115:3300/0 conn(0x7f36e806a3e0 0x7f36e80d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:01.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.581+0000 7f36ed3e2700 1 -- 172.21.15.87:0/3123265817 >> v1:172.21.15.87:6789/0 conn(0x7f36e80d27e0 legacy=0x7f36e8069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:01.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.581+0000 7f36ed3e2700 1 -- 172.21.15.87:0/3123265817 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80cef00 con 0x7f36e80b8380 2023-03-30T08:11:01.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.581+0000 7f36ed3e2700 1 --2- 172.21.15.87:0/3123265817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36e80b8380 0x7f36e80d2200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009910 tx=0x7f36e4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86127b6eb6838e82 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:01.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.581+0000 7f36dffff700 1 -- 172.21.15.87:0/3123265817 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4011830 con 0x7f36e80b8380 2023-03-30T08:11:01.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.585+0000 7f36dffff700 1 -- 172.21.15.87:0/3123265817 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e4011990 con 0x7f36e80b8380 2023-03-30T08:11:01.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.585+0000 7f36dffff700 1 -- 172.21.15.87:0/3123265817 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4011d40 con 0x7f36e80b8380 2023-03-30T08:11:01.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.585+0000 7f36ee3e4700 1 -- 172.21.15.87:0/3123265817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36e80b8380 msgr2=0x7f36e80d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:01.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.585+0000 7f36ee3e4700 1 --2- 172.21.15.87:0/3123265817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36e80b8380 0x7f36e80d2200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009910 tx=0x7f36e4009c20 comp rx=0 tx=0).stop 2023-03-30T08:11:01.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.585+0000 7f36ee3e4700 1 -- 172.21.15.87:0/3123265817 shutdown_connections 2023-03-30T08:11:01.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.585+0000 7f36ee3e4700 1 --2- 172.21.15.87:0/3123265817 >> v2:172.21.15.115:3300/0 conn(0x7f36e806a3e0 0x7f36e80d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:01.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.585+0000 7f36ee3e4700 1 --2- 172.21.15.87:0/3123265817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36e80b8380 0x7f36e80d2200 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:01.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.585+0000 7f36ee3e4700 1 -- 172.21.15.87:0/3123265817 >> 172.21.15.87:0/3123265817 conn(0x7f36e80b53f0 msgr2=0x7f36e80cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:01.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.585+0000 7f36ee3e4700 1 -- 172.21.15.87:0/3123265817 shutdown_connections 2023-03-30T08:11:01.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.585+0000 7f36ee3e4700 1 -- 172.21.15.87:0/3123265817 wait complete. 2023-03-30T08:11:01.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ee3e4700 1 Processor -- start 2023-03-30T08:11:01.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ee3e4700 1 -- start start 2023-03-30T08:11:01.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ee3e4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36e806a3e0 0x7f36e815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:01.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ee3e4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e80b8380 0x7f36e8150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:01.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ee3e4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f36e814e920 0x7f36e8151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:01.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ee3e4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80cb920 con 0x7f36e806a3e0 2023-03-30T08:11:01.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ee3e4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e815cae0 con 0x7f36e80b8380 2023-03-30T08:11:01.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ee3e4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e815cdc0 con 0x7f36e814e920 2023-03-30T08:11:01.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ed3e2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36e806a3e0 0x7f36e815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:01.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ed3e2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36e806a3e0 0x7f36e815f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51314/0 (socket says 172.21.15.87:51314) 2023-03-30T08:11:01.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ed3e2700 1 -- 172.21.15.87:0/2956106116 learned_addr learned my addr 172.21.15.87:0/2956106116 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:01.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ed3e2700 1 -- 172.21.15.87:0/2956106116 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f36e814e920 msgr2=0x7f36e8151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:01.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ed3e2700 1 --2- 172.21.15.87:0/2956106116 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f36e814e920 0x7f36e8151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:01.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ed3e2700 1 -- 172.21.15.87:0/2956106116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e80b8380 msgr2=0x7f36e8150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:01.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ed3e2700 1 --2- 172.21.15.87:0/2956106116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e80b8380 0x7f36e8150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:01.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ed3e2700 1 -- 172.21.15.87:0/2956106116 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e4009570 con 0x7f36e806a3e0 2023-03-30T08:11:01.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ed3e2700 1 --2- 172.21.15.87:0/2956106116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36e806a3e0 0x7f36e815f060 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f36e808bd10 tx=0x7f36e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:01.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ddffb700 1 -- 172.21.15.87:0/2956106116 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4004400 con 0x7f36e806a3e0 2023-03-30T08:11:01.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ddffb700 1 -- 172.21.15.87:0/2956106116 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e401f070 con 0x7f36e806a3e0 2023-03-30T08:11:01.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ee3e4700 1 -- 172.21.15.87:0/2956106116 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e80cf480 con 0x7f36e806a3e0 2023-03-30T08:11:01.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.589+0000 7f36ddffb700 1 -- 172.21.15.87:0/2956106116 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4003900 con 0x7f36e806a3e0 2023-03-30T08:11:01.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.593+0000 7f36ee3e4700 1 -- 172.21.15.87:0/2956106116 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e80cf1a0 con 0x7f36e806a3e0 2023-03-30T08:11:01.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.593+0000 7f36ee3e4700 1 -- 172.21.15.87:0/2956106116 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e80b8750 con 0x7f36e806a3e0 2023-03-30T08:11:01.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.593+0000 7f36ddffb700 1 -- 172.21.15.87:0/2956106116 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f36e4021030 con 0x7f36e806a3e0 2023-03-30T08:11:01.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.597+0000 7f36ddffb700 1 --2- 172.21.15.87:0/2956106116 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f36cc0653f0 0x7f36cc0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:01.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.597+0000 7f36ddffb700 1 -- 172.21.15.87:0/2956106116 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f36e4083f20 con 0x7f36e806a3e0 2023-03-30T08:11:01.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.597+0000 7f36ecbe1700 1 --2- 172.21.15.87:0/2956106116 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f36cc0653f0 0x7f36cc0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:01.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.597+0000 7f36ecbe1700 1 --2- 172.21.15.87:0/2956106116 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f36cc0653f0 0x7f36cc0678a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f36d8000f60 tx=0x7f36d8007a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:01.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.601+0000 7f36ddffb700 1 -- 172.21.15.87:0/2956106116 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f36e40518c0 con 0x7f36e806a3e0 2023-03-30T08:11:01.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:01.773+0000 7f36ee3e4700 1 -- 172.21.15.87:0/2956106116 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f36e8072cf0 con 0x7f36e806a3e0 2023-03-30T08:11:02.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.389+0000 7f36ddffb700 1 -- 172.21.15.87:0/2956106116 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f36e4054ee0 con 0x7f36e806a3e0 2023-03-30T08:11:02.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.401+0000 7f36ee3e4700 1 -- 172.21.15.87:0/2956106116 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f36cc0653f0 msgr2=0x7f36cc0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:02.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.401+0000 7f36ee3e4700 1 --2- 172.21.15.87:0/2956106116 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f36cc0653f0 0x7f36cc0678a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f36d8000f60 tx=0x7f36d8007a80 comp rx=0 tx=0).stop 2023-03-30T08:11:02.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.401+0000 7f36ee3e4700 1 -- 172.21.15.87:0/2956106116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36e806a3e0 msgr2=0x7f36e815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:02.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.401+0000 7f36ee3e4700 1 --2- 172.21.15.87:0/2956106116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36e806a3e0 0x7f36e815f060 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f36e808bd10 tx=0x7f36e4004770 comp rx=0 tx=0).stop 2023-03-30T08:11:02.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.401+0000 7f36ee3e4700 1 -- 172.21.15.87:0/2956106116 shutdown_connections 2023-03-30T08:11:02.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.401+0000 7f36ee3e4700 1 --2- 172.21.15.87:0/2956106116 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f36cc0653f0 0x7f36cc0678a0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f36d8000f60 tx=0x7f36d8007a80 comp rx=0 tx=0).stop 2023-03-30T08:11:02.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.401+0000 7f36ee3e4700 1 --2- 172.21.15.87:0/2956106116 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f36e814e920 0x7f36e8151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:02.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.401+0000 7f36ee3e4700 1 --2- 172.21.15.87:0/2956106116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e80b8380 0x7f36e8150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:02.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.401+0000 7f36ee3e4700 1 --2- 172.21.15.87:0/2956106116 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f36e806a3e0 0x7f36e815f060 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f36e808bd10 tx=0x7f36e4004770 comp rx=0 tx=0).stop 2023-03-30T08:11:02.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.401+0000 7f36ee3e4700 1 -- 172.21.15.87:0/2956106116 >> 172.21.15.87:0/2956106116 conn(0x7f36e80b53f0 msgr2=0x7f36e80b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:02.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.405+0000 7f36ee3e4700 1 -- 172.21.15.87:0/2956106116 shutdown_connections 2023-03-30T08:11:02.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.405+0000 7f36ee3e4700 1 -- 172.21.15.87:0/2956106116 wait complete. 2023-03-30T08:11:02.417 INFO:teuthology.orchestra.run.smithi087.stderr:set pool 5 allow_ec_overwrites to true 2023-03-30T08:11:02.446 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-03-30T08:11:02.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.605+0000 7fa3b2901700 1 Processor -- start 2023-03-30T08:11:02.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.605+0000 7fa3b2901700 1 -- start start 2023-03-30T08:11:02.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.605+0000 7fa3b2901700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3ac0c1dc0 0x7fa3ac0cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:02.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.605+0000 7fa3b2901700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa3ac0cca70 0x7fa3ac070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:02.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.605+0000 7fa3b2901700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ac06bd80 0x7fa3ac070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:02.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.605+0000 7fa3b2901700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ac164520 con 0x7fa3ac0c1dc0 2023-03-30T08:11:02.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.605+0000 7fa3b2901700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ac164800 con 0x7fa3ac0cca70 2023-03-30T08:11:02.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.605+0000 7fa3b2901700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac164ae0 con 0x7fa3ac06bd80 2023-03-30T08:11:02.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3abfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3ac0c1dc0 0x7fa3ac0cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:02.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b0e9e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ac06bd80 0x7fa3ac070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:02.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b0e9e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ac06bd80 0x7fa3ac070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:57344/0 (socket says 172.21.15.87:57344) 2023-03-30T08:11:02.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b0e9e700 1 -- 172.21.15.87:0/3443410193 learned_addr learned my addr 172.21.15.87:0/3443410193 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:02.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3ab7fe700 1 --2- 172.21.15.87:0/3443410193 >> v2:172.21.15.115:3300/0 conn(0x7fa3ac0cca70 0x7fa3ac070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:02.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b0e9e700 1 -- 172.21.15.87:0/3443410193 >> v2:172.21.15.115:3300/0 conn(0x7fa3ac0cca70 msgr2=0x7fa3ac070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:02.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b0e9e700 1 --2- 172.21.15.87:0/3443410193 >> v2:172.21.15.115:3300/0 conn(0x7fa3ac0cca70 0x7fa3ac070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:02.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b0e9e700 1 -- 172.21.15.87:0/3443410193 >> v2:172.21.15.87:3300/0 conn(0x7fa3ac0c1dc0 msgr2=0x7fa3ac0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:02.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b0e9e700 1 --2- 172.21.15.87:0/3443410193 >> v2:172.21.15.87:3300/0 conn(0x7fa3ac0c1dc0 0x7fa3ac0cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:02.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b0e9e700 1 -- 172.21.15.87:0/3443410193 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac164dc0 con 0x7fa3ac06bd80 2023-03-30T08:11:02.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b0e9e700 1 --2- 172.21.15.87:0/3443410193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ac06bd80 0x7fa3ac070960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0ce8c0 tx=0x7fa3a4009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15505922c6d704a2 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:02.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3aaffd700 1 -- 172.21.15.87:0/3443410193 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4011830 con 0x7fa3ac06bd80 2023-03-30T08:11:02.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3aaffd700 1 -- 172.21.15.87:0/3443410193 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4011990 con 0x7fa3ac06bd80 2023-03-30T08:11:02.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3aaffd700 1 -- 172.21.15.87:0/3443410193 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4011d20 con 0x7fa3ac06bd80 2023-03-30T08:11:02.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b2901700 1 -- 172.21.15.87:0/3443410193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ac06bd80 msgr2=0x7fa3ac070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:02.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b2901700 1 --2- 172.21.15.87:0/3443410193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ac06bd80 0x7fa3ac070960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0ce8c0 tx=0x7fa3a4009bf0 comp rx=0 tx=0).stop 2023-03-30T08:11:02.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b2901700 1 -- 172.21.15.87:0/3443410193 shutdown_connections 2023-03-30T08:11:02.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b2901700 1 --2- 172.21.15.87:0/3443410193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ac06bd80 0x7fa3ac070960 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:02.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b2901700 1 --2- 172.21.15.87:0/3443410193 >> v2:172.21.15.115:3300/0 conn(0x7fa3ac0cca70 0x7fa3ac070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:02.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b2901700 1 --2- 172.21.15.87:0/3443410193 >> v2:172.21.15.87:3300/0 conn(0x7fa3ac0c1dc0 0x7fa3ac0cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:02.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b2901700 1 -- 172.21.15.87:0/3443410193 >> 172.21.15.87:0/3443410193 conn(0x7fa3ac0ce960 msgr2=0x7fa3ac0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:02.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b2901700 1 -- 172.21.15.87:0/3443410193 shutdown_connections 2023-03-30T08:11:02.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.609+0000 7fa3b2901700 1 -- 172.21.15.87:0/3443410193 wait complete. 2023-03-30T08:11:02.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3b2901700 1 Processor -- start 2023-03-30T08:11:02.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3b2901700 1 -- start start 2023-03-30T08:11:02.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3b2901700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ac06bd80 0x7fa3ac15efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:02.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3b2901700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0c1dc0 0x7fa3ac0afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:02.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3b2901700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ac0cca70 0x7fa3ac0b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:02.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3b2901700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac1f7480 con 0x7fa3ac0c1dc0 2023-03-30T08:11:02.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3b2901700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac1fa250 con 0x7fa3ac06bd80 2023-03-30T08:11:02.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3b2901700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac0b0760 con 0x7fa3ac0cca70 2023-03-30T08:11:02.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3ab7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0c1dc0 0x7fa3ac0afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3ab7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0c1dc0 0x7fa3ac0afce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51330/0 (socket says 172.21.15.87:51330) 2023-03-30T08:11:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3ab7fe700 1 -- 172.21.15.87:0/2762918046 learned_addr learned my addr 172.21.15.87:0/2762918046 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3b0e9e700 1 --2- 172.21.15.87:0/2762918046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ac0cca70 0x7fa3ac0b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3abfff700 1 --2- 172.21.15.87:0/2762918046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ac06bd80 0x7fa3ac15efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3ab7fe700 1 -- 172.21.15.87:0/2762918046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ac0cca70 msgr2=0x7fa3ac0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3ab7fe700 1 --2- 172.21.15.87:0/2762918046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ac0cca70 0x7fa3ac0b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3ab7fe700 1 -- 172.21.15.87:0/2762918046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ac06bd80 msgr2=0x7fa3ac15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3ab7fe700 1 --2- 172.21.15.87:0/2762918046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ac06bd80 0x7fa3ac15efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:02.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3ab7fe700 1 -- 172.21.15.87:0/2762918046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a4009570 con 0x7fa3ac0c1dc0 2023-03-30T08:11:02.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.613+0000 7fa3abfff700 1 --2- 172.21.15.87:0/2762918046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ac06bd80 0x7fa3ac15efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:02.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.617+0000 7fa3ab7fe700 1 --2- 172.21.15.87:0/2762918046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0c1dc0 0x7fa3ac0afce0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000e9a0 tx=0x7fa3a000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:02.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.617+0000 7fa3a8ff9700 1 -- 172.21.15.87:0/2762918046 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0009720 con 0x7fa3ac0c1dc0 2023-03-30T08:11:02.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.617+0000 7fa3a8ff9700 1 -- 172.21.15.87:0/2762918046 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a000c850 con 0x7fa3ac0c1dc0 2023-03-30T08:11:02.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.617+0000 7fa3a8ff9700 1 -- 172.21.15.87:0/2762918046 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a000cc00 con 0x7fa3ac0c1dc0 2023-03-30T08:11:02.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.617+0000 7fa3b2901700 1 -- 172.21.15.87:0/2762918046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac0ce540 con 0x7fa3ac0c1dc0 2023-03-30T08:11:02.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.617+0000 7fa3b2901700 1 -- 172.21.15.87:0/2762918046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac1650a0 con 0x7fa3ac0c1dc0 2023-03-30T08:11:02.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.617+0000 7fa3b2901700 1 -- 172.21.15.87:0/2762918046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ac0c2190 con 0x7fa3ac0c1dc0 2023-03-30T08:11:02.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.621+0000 7fa3a8ff9700 1 -- 172.21.15.87:0/2762918046 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa3a0013470 con 0x7fa3ac0c1dc0 2023-03-30T08:11:02.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.621+0000 7fa3a8ff9700 1 --2- 172.21.15.87:0/2762918046 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa3980653f0 0x7fa3980678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:02.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.621+0000 7fa3a8ff9700 1 -- 172.21.15.87:0/2762918046 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fa3a0082cc0 con 0x7fa3ac0c1dc0 2023-03-30T08:11:02.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.621+0000 7fa3abfff700 1 --2- 172.21.15.87:0/2762918046 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa3980653f0 0x7fa3980678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:02.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.621+0000 7fa3abfff700 1 --2- 172.21.15.87:0/2762918046 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa3980653f0 0x7fa3980678a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac15fac0 tx=0x7fa39c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:02.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.629+0000 7fa3a8ff9700 1 -- 172.21.15.87:0/2762918046 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fa3a0089080 con 0x7fa3ac0c1dc0 2023-03-30T08:11:02.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.837+0000 7fa3b2901700 1 -- 172.21.15.87:0/2762918046 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fa3ac1fa390 con 0x7fa3ac0c1dc0 2023-03-30T08:11:02.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.849+0000 7fa3a8ff9700 1 -- 172.21.15.87:0/2762918046 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fa3a00590b0 con 0x7fa3ac0c1dc0 2023-03-30T08:11:02.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.853+0000 7fa3b2901700 1 -- 172.21.15.87:0/2762918046 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa3980653f0 msgr2=0x7fa3980678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:02.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.853+0000 7fa3b2901700 1 --2- 172.21.15.87:0/2762918046 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa3980653f0 0x7fa3980678a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac15fac0 tx=0x7fa39c00b040 comp rx=0 tx=0).stop 2023-03-30T08:11:02.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.853+0000 7fa3b2901700 1 -- 172.21.15.87:0/2762918046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0c1dc0 msgr2=0x7fa3ac0afce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:02.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.853+0000 7fa3b2901700 1 --2- 172.21.15.87:0/2762918046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0c1dc0 0x7fa3ac0afce0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000e9a0 tx=0x7fa3a000ed60 comp rx=0 tx=0).stop 2023-03-30T08:11:02.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.853+0000 7fa3b2901700 1 -- 172.21.15.87:0/2762918046 shutdown_connections 2023-03-30T08:11:02.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.853+0000 7fa3b2901700 1 --2- 172.21.15.87:0/2762918046 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa3980653f0 0x7fa3980678a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:02.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.853+0000 7fa3b2901700 1 --2- 172.21.15.87:0/2762918046 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3ac0cca70 0x7fa3ac0b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:02.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.853+0000 7fa3b2901700 1 --2- 172.21.15.87:0/2762918046 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3ac0c1dc0 0x7fa3ac0afce0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:02.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.853+0000 7fa3b2901700 1 --2- 172.21.15.87:0/2762918046 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ac06bd80 0x7fa3ac15efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:02.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.853+0000 7fa3b2901700 1 -- 172.21.15.87:0/2762918046 >> 172.21.15.87:0/2762918046 conn(0x7fa3ac0ce960 msgr2=0x7fa3ac163660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:02.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.853+0000 7fa3b2901700 1 -- 172.21.15.87:0/2762918046 shutdown_connections 2023-03-30T08:11:02.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:02.853+0000 7fa3b2901700 1 -- 172.21.15.87:0/2762918046 wait complete. 2023-03-30T08:11:02.859 INFO:teuthology.orchestra.run.smithi087.stderr:added data pool 5 to fsmap 2023-03-30T08:11:02.875 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T08:11:03.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.037+0000 7f25e359e700 1 Processor -- start 2023-03-30T08:11:03.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.041+0000 7f25e359e700 1 -- start start 2023-03-30T08:11:03.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.041+0000 7f25e359e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f25e40b8380 0x7f25e40d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.041+0000 7f25e359e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e4160ef0 con 0x7f25e406a3e0 2023-03-30T08:11:03.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.041+0000 7f25e359e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e40cd6a0 con 0x7f25e40d27e0 2023-03-30T08:11:03.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.041+0000 7f25e359e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e40cd3a0 con 0x7f25e40b8380 2023-03-30T08:11:03.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.041+0000 7f25e259c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f25e40b8380 0x7f25e40d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.041+0000 7f25e259c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f25e40b8380 0x7f25e40d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51340/0 (socket says 172.21.15.87:51340) 2023-03-30T08:11:03.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.041+0000 7f25e259c700 1 -- 172.21.15.87:0/3770760612 learned_addr learned my addr 172.21.15.87:0/3770760612 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:03.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.041+0000 7f25e259c700 1 -- 172.21.15.87:0/3770760612 >> v1:172.21.15.115:6789/0 conn(0x7f25e40d27e0 legacy=0x7f25e4069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.041+0000 7f25e259c700 1 -- 172.21.15.87:0/3770760612 >> v1:172.21.15.87:6789/0 conn(0x7f25e406a3e0 legacy=0x7f25e40d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.041+0000 7f25e259c700 1 -- 172.21.15.87:0/3770760612 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e40cef00 con 0x7f25e40b8380 2023-03-30T08:11:03.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.041+0000 7f25e259c700 1 --2- 172.21.15.87:0/3770760612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40b8380 0x7f25e40d2200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009940 tx=0x7f25d4009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2647af0fc20255 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:03.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.041+0000 7f25e159a700 1 -- 172.21.15.87:0/3770760612 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d400ba20 con 0x7f25e40b8380 2023-03-30T08:11:03.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.041+0000 7f25e159a700 1 -- 172.21.15.87:0/3770760612 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d4009e90 con 0x7f25e40b8380 2023-03-30T08:11:03.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.041+0000 7f25e159a700 1 -- 172.21.15.87:0/3770760612 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d400bda0 con 0x7f25e40b8380 2023-03-30T08:11:03.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.045+0000 7f25e359e700 1 -- 172.21.15.87:0/3770760612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40b8380 msgr2=0x7f25e40d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.045+0000 7f25e359e700 1 --2- 172.21.15.87:0/3770760612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40b8380 0x7f25e40d2200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009940 tx=0x7f25d4009c50 comp rx=0 tx=0).stop 2023-03-30T08:11:03.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.045+0000 7f25e359e700 1 -- 172.21.15.87:0/3770760612 shutdown_connections 2023-03-30T08:11:03.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.045+0000 7f25e359e700 1 --2- 172.21.15.87:0/3770760612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40b8380 0x7f25e40d2200 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.045+0000 7f25e359e700 1 -- 172.21.15.87:0/3770760612 >> 172.21.15.87:0/3770760612 conn(0x7f25e40b53f0 msgr2=0x7f25e40cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:03.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.045+0000 7f25e359e700 1 -- 172.21.15.87:0/3770760612 shutdown_connections 2023-03-30T08:11:03.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.045+0000 7f25e359e700 1 -- 172.21.15.87:0/3770760612 wait complete. 2023-03-30T08:11:03.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.045+0000 7f25e359e700 1 Processor -- start 2023-03-30T08:11:03.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.045+0000 7f25e359e700 1 -- start start 2023-03-30T08:11:03.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.045+0000 7f25e359e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e406a3e0 0x7f25e40c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40b8380 0x7f25e415ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e359e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25e40c67e0 0x7f25e4157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e40cb070 con 0x7f25e40b8380 2023-03-30T08:11:03.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e359e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e415ce10 con 0x7f25e40c67e0 2023-03-30T08:11:03.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e359e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e415f610 con 0x7f25e406a3e0 2023-03-30T08:11:03.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e1d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40b8380 0x7f25e415ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e1d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40b8380 0x7f25e415ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51354/0 (socket says 172.21.15.87:51354) 2023-03-30T08:11:03.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e1d9b700 1 -- 172.21.15.87:0/1324930290 learned_addr learned my addr 172.21.15.87:0/1324930290 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:03.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e259c700 1 --2- 172.21.15.87:0/1324930290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e406a3e0 0x7f25e40c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e2d9d700 1 --2- 172.21.15.87:0/1324930290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25e40c67e0 0x7f25e4157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e1d9b700 1 -- 172.21.15.87:0/1324930290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e406a3e0 msgr2=0x7f25e40c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e1d9b700 1 --2- 172.21.15.87:0/1324930290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e406a3e0 0x7f25e40c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e1d9b700 1 -- 172.21.15.87:0/1324930290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25e40c67e0 msgr2=0x7f25e4157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e1d9b700 1 --2- 172.21.15.87:0/1324930290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25e40c67e0 0x7f25e4157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e1d9b700 1 -- 172.21.15.87:0/1324930290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d4009570 con 0x7f25e40b8380 2023-03-30T08:11:03.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e1d9b700 1 --2- 172.21.15.87:0/1324930290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40b8380 0x7f25e415ef50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f25d800c4d0 tx=0x7f25d800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:03.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25d2ffd700 1 -- 172.21.15.87:0/1324930290 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d80052d0 con 0x7f25e40b8380 2023-03-30T08:11:03.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25d2ffd700 1 -- 172.21.15.87:0/1324930290 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d8005430 con 0x7f25e40b8380 2023-03-30T08:11:03.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e359e700 1 -- 172.21.15.87:0/1324930290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e40cf480 con 0x7f25e40b8380 2023-03-30T08:11:03.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25d2ffd700 1 -- 172.21.15.87:0/1324930290 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d80055a0 con 0x7f25e40b8380 2023-03-30T08:11:03.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e359e700 1 -- 172.21.15.87:0/1324930290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e40cf1a0 con 0x7f25e40b8380 2023-03-30T08:11:03.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.049+0000 7f25e359e700 1 -- 172.21.15.87:0/1324930290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e40b8750 con 0x7f25e40b8380 2023-03-30T08:11:03.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.053+0000 7f25d2ffd700 1 -- 172.21.15.87:0/1324930290 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f25d80038c0 con 0x7f25e40b8380 2023-03-30T08:11:03.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.053+0000 7f25d2ffd700 1 --2- 172.21.15.87:0/1324930290 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f25c40653f0 0x7f25c40678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.053+0000 7f25d2ffd700 1 -- 172.21.15.87:0/1324930290 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f25d8081f40 con 0x7f25e40b8380 2023-03-30T08:11:03.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.053+0000 7f25e259c700 1 --2- 172.21.15.87:0/1324930290 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f25c40653f0 0x7f25c40678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.057+0000 7f25e259c700 1 --2- 172.21.15.87:0/1324930290 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f25c40653f0 0x7f25c40678a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f25d4006f80 tx=0x7f25d4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:03.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.061+0000 7f25d2ffd700 1 -- 172.21.15.87:0/1324930290 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f25d804f8c0 con 0x7f25e40b8380 2023-03-30T08:11:03.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.261+0000 7f25e359e700 1 -- 172.21.15.87:0/1324930290 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25e4072cf0 con 0x7f25e40b8380 2023-03-30T08:11:03.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.265+0000 7f25d2ffd700 1 -- 172.21.15.87:0/1324930290 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f25d8052ee0 con 0x7f25e40b8380 2023-03-30T08:11:03.268 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:03.268 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2818344230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2818344230},{"type":"v1","addr":"172.21.15.115:6833","nonce":2818344230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3891185444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3891185444},{"type":"v1","addr":"172.21.15.87:6836","nonce":3891185444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3443119914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3443119914},{"type":"v1","addr":"172.21.15.87:6837","nonce":3443119914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-30T08:10:58.351331+0000","modified":"2023-03-30T08:11:02.841929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3640886103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3640886103},{"type":"v1","addr":"172.21.15.115:6835","nonce":3640886103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-03-30T08:11:03.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.269+0000 7f25e359e700 1 -- 172.21.15.87:0/1324930290 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f25c40653f0 msgr2=0x7f25c40678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.269+0000 7f25e359e700 1 --2- 172.21.15.87:0/1324930290 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f25c40653f0 0x7f25c40678a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f25d4006f80 tx=0x7f25d4008030 comp rx=0 tx=0).stop 2023-03-30T08:11:03.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.269+0000 7f25e359e700 1 -- 172.21.15.87:0/1324930290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40b8380 msgr2=0x7f25e415ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.269+0000 7f25e359e700 1 --2- 172.21.15.87:0/1324930290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40b8380 0x7f25e415ef50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f25d800c4d0 tx=0x7f25d800c7e0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.269+0000 7f25e359e700 1 -- 172.21.15.87:0/1324930290 shutdown_connections 2023-03-30T08:11:03.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.269+0000 7f25e359e700 1 --2- 172.21.15.87:0/1324930290 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f25c40653f0 0x7f25c40678a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.269+0000 7f25e359e700 1 --2- 172.21.15.87:0/1324930290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25e40c67e0 0x7f25e4157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.269+0000 7f25e359e700 1 --2- 172.21.15.87:0/1324930290 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25e40b8380 0x7f25e415ef50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.269+0000 7f25e359e700 1 --2- 172.21.15.87:0/1324930290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e406a3e0 0x7f25e40c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.269+0000 7f25e359e700 1 -- 172.21.15.87:0/1324930290 >> 172.21.15.87:0/1324930290 conn(0x7f25e40b53f0 msgr2=0x7f25e415c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:03.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.269+0000 7f25e359e700 1 -- 172.21.15.87:0/1324930290 shutdown_connections 2023-03-30T08:11:03.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.269+0000 7f25e359e700 1 -- 172.21.15.87:0/1324930290 wait complete. 2023-03-30T08:11:03.274 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 7 2023-03-30T08:11:03.293 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:03.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.453+0000 7fe0ad551700 1 Processor -- start 2023-03-30T08:11:03.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.453+0000 7fe0ad551700 1 -- start start 2023-03-30T08:11:03.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.453+0000 7fe0ad551700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a8163dc0 0x7fe0a80c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.453+0000 7fe0ad551700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe0a80aea30 0x7fe0a806a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.453+0000 7fe0ad551700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a8069f00 con 0x7fe0a8164190 2023-03-30T08:11:03.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0ad551700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a806d810 con 0x7fe0a80aea30 2023-03-30T08:11:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0ad551700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80cc1d0 con 0x7fe0a8163dc0 2023-03-30T08:11:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0a7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a8163dc0 0x7fe0a80c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0a7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a8163dc0 0x7fe0a80c95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:57368/0 (socket says 172.21.15.87:57368) 2023-03-30T08:11:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0a7fff700 1 -- 172.21.15.87:0/4017198829 learned_addr learned my addr 172.21.15.87:0/4017198829 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:03.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0acd50700 1 --2- 172.21.15.87:0/4017198829 >> v2:172.21.15.115:3300/0 conn(0x7fe0a80aea30 0x7fe0a806a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0a7fff700 1 -- 172.21.15.87:0/4017198829 >> v2:172.21.15.115:3300/0 conn(0x7fe0a80aea30 msgr2=0x7fe0a806a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:03.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0a7fff700 1 --2- 172.21.15.87:0/4017198829 >> v2:172.21.15.115:3300/0 conn(0x7fe0a80aea30 0x7fe0a806a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0a7fff700 1 -- 172.21.15.87:0/4017198829 >> v1:172.21.15.115:6789/0 conn(0x7fe0a8164190 legacy=0x7fe0a80c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0a7fff700 1 -- 172.21.15.87:0/4017198829 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a806cf70 con 0x7fe0a8163dc0 2023-03-30T08:11:03.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0a77fe700 1 -- 172.21.15.87:0/4017198829 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279297093 0 0) 0x7fe0a8069f00 con 0x7fe0a8164190 2023-03-30T08:11:03.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0a7fff700 1 --2- 172.21.15.87:0/4017198829 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a8163dc0 0x7fe0a80c95c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe098009910 tx=0x7fe098009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=552ded349fa9cca5 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:03.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0a77fe700 1 -- 172.21.15.87:0/4017198829 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098011830 con 0x7fe0a8163dc0 2023-03-30T08:11:03.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0a77fe700 1 -- 172.21.15.87:0/4017198829 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe098011990 con 0x7fe0a8163dc0 2023-03-30T08:11:03.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0a77fe700 1 -- 172.21.15.87:0/4017198829 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098011d40 con 0x7fe0a8163dc0 2023-03-30T08:11:03.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0ad551700 1 -- 172.21.15.87:0/4017198829 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a8163dc0 msgr2=0x7fe0a80c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.457+0000 7fe0ad551700 1 --2- 172.21.15.87:0/4017198829 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a8163dc0 0x7fe0a80c95c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe098009910 tx=0x7fe098009c20 comp rx=0 tx=0).stop 2023-03-30T08:11:03.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.461+0000 7fe0ad551700 1 -- 172.21.15.87:0/4017198829 shutdown_connections 2023-03-30T08:11:03.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.461+0000 7fe0ad551700 1 --2- 172.21.15.87:0/4017198829 >> v2:172.21.15.115:3300/0 conn(0x7fe0a80aea30 0x7fe0a806a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.461+0000 7fe0ad551700 1 --2- 172.21.15.87:0/4017198829 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a8163dc0 0x7fe0a80c95c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.461+0000 7fe0ad551700 1 -- 172.21.15.87:0/4017198829 >> 172.21.15.87:0/4017198829 conn(0x7fe0a80cf410 msgr2=0x7fe0a80cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.461+0000 7fe0ad551700 1 -- 172.21.15.87:0/4017198829 shutdown_connections 2023-03-30T08:11:03.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.461+0000 7fe0ad551700 1 -- 172.21.15.87:0/4017198829 wait complete. 2023-03-30T08:11:03.465 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.461+0000 7fe0ad551700 1 Processor -- start 2023-03-30T08:11:03.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.461+0000 7fe0ad551700 1 -- start start 2023-03-30T08:11:03.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe0ad551700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0a80aea30 0x7fe0a8158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe0ad551700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a8163dc0 0x7fe0a80c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe0ad551700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a8164190 0x7fe0a815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe0ad551700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a8158470 con 0x7fe0a8163dc0 2023-03-30T08:11:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe0ad551700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a8158dd0 con 0x7fe0a80aea30 2023-03-30T08:11:03.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe0ad551700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a815c160 con 0x7fe0a8164190 2023-03-30T08:11:03.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe09f7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a8163dc0 0x7fe0a80c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe09f7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a8163dc0 0x7fe0a80c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51358/0 (socket says 172.21.15.87:51358) 2023-03-30T08:11:03.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe0acd50700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a8164190 0x7fe0a815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe09f7fe700 1 -- 172.21.15.87:0/518057300 learned_addr learned my addr 172.21.15.87:0/518057300 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe0a7fff700 1 --2- 172.21.15.87:0/518057300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0a80aea30 0x7fe0a8158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe09f7fe700 1 -- 172.21.15.87:0/518057300 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a8164190 msgr2=0x7fe0a815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe09f7fe700 1 --2- 172.21.15.87:0/518057300 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a8164190 0x7fe0a815b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe09f7fe700 1 -- 172.21.15.87:0/518057300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0a80aea30 msgr2=0x7fe0a8158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe09f7fe700 1 --2- 172.21.15.87:0/518057300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0a80aea30 0x7fe0a8158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe09f7fe700 1 -- 172.21.15.87:0/518057300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098009570 con 0x7fe0a8163dc0 2023-03-30T08:11:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe09f7fe700 1 --2- 172.21.15.87:0/518057300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a8163dc0 0x7fe0a80c49b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c4a0 tx=0x7fe09000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe0a57fa700 1 -- 172.21.15.87:0/518057300 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0900052d0 con 0x7fe0a8163dc0 2023-03-30T08:11:03.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe0a57fa700 1 -- 172.21.15.87:0/518057300 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe090005430 con 0x7fe0a8163dc0 2023-03-30T08:11:03.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe0a57fa700 1 -- 172.21.15.87:0/518057300 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0900038e0 con 0x7fe0a8163dc0 2023-03-30T08:11:03.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe0ad551700 1 -- 172.21.15.87:0/518057300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a806d530 con 0x7fe0a8163dc0 2023-03-30T08:11:03.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.465+0000 7fe0ad551700 1 -- 172.21.15.87:0/518057300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a806d250 con 0x7fe0a8163dc0 2023-03-30T08:11:03.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.469+0000 7fe0ad551700 1 -- 172.21.15.87:0/518057300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a81585b0 con 0x7fe0a8163dc0 2023-03-30T08:11:03.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.469+0000 7fe0a57fa700 1 -- 172.21.15.87:0/518057300 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fe090003a40 con 0x7fe0a8163dc0 2023-03-30T08:11:03.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.473+0000 7fe0a57fa700 1 --2- 172.21.15.87:0/518057300 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe0880653f0 0x7fe0880678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.473+0000 7fe0a57fa700 1 -- 172.21.15.87:0/518057300 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe090081d50 con 0x7fe0a8163dc0 2023-03-30T08:11:03.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.473+0000 7fe0a7fff700 1 --2- 172.21.15.87:0/518057300 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe0880653f0 0x7fe0880678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.473+0000 7fe0a7fff700 1 --2- 172.21.15.87:0/518057300 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe0880653f0 0x7fe0880678a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe098000c00 tx=0x7fe098008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:03.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.477+0000 7fe0a57fa700 1 -- 172.21.15.87:0/518057300 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fe0a81585b0 con 0x7fe0a8163dc0 2023-03-30T08:11:03.654 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.649+0000 7fe0ad551700 1 -- 172.21.15.87:0/518057300 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0a81585b0 con 0x7fe0a8163dc0 2023-03-30T08:11:03.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.653+0000 7fe0a57fa700 1 -- 172.21.15.87:0/518057300 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19652 (secure 0 0 0) 0x7fe0a81585b0 con 0x7fe0a8163dc0 2023-03-30T08:11:03.658 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:03.658 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":28,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:02.841070+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:03.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.657+0000 7fe0ad551700 1 -- 172.21.15.87:0/518057300 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe0880653f0 msgr2=0x7fe0880678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.657+0000 7fe0ad551700 1 --2- 172.21.15.87:0/518057300 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe0880653f0 0x7fe0880678a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe098000c00 tx=0x7fe098008030 comp rx=0 tx=0).stop 2023-03-30T08:11:03.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.657+0000 7fe0ad551700 1 -- 172.21.15.87:0/518057300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a8163dc0 msgr2=0x7fe0a80c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.657+0000 7fe0ad551700 1 --2- 172.21.15.87:0/518057300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a8163dc0 0x7fe0a80c49b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c4a0 tx=0x7fe09000c7b0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.657+0000 7fe0ad551700 1 -- 172.21.15.87:0/518057300 shutdown_connections 2023-03-30T08:11:03.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.657+0000 7fe0ad551700 1 --2- 172.21.15.87:0/518057300 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe0880653f0 0x7fe0880678a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.657+0000 7fe0ad551700 1 --2- 172.21.15.87:0/518057300 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a8164190 0x7fe0a815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.657+0000 7fe0ad551700 1 --2- 172.21.15.87:0/518057300 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a8163dc0 0x7fe0a80c49b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.657+0000 7fe0ad551700 1 --2- 172.21.15.87:0/518057300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0a80aea30 0x7fe0a8158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.657+0000 7fe0ad551700 1 -- 172.21.15.87:0/518057300 >> 172.21.15.87:0/518057300 conn(0x7fe0a80cf410 msgr2=0x7fe0a815f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:03.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.657+0000 7fe0ad551700 1 -- 172.21.15.87:0/518057300 shutdown_connections 2023-03-30T08:11:03.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.657+0000 7fe0ad551700 1 -- 172.21.15.87:0/518057300 wait complete. 2023-03-30T08:11:03.683 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:03.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.841+0000 7fceb3076700 1 Processor -- start 2023-03-30T08:11:03.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.841+0000 7fceb3076700 1 -- start start 2023-03-30T08:11:03.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.841+0000 7fceb3076700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fceac0b1650 0x7fceac06a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.841+0000 7fceb3076700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac0aff50 con 0x7fceac158b00 2023-03-30T08:11:03.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.841+0000 7fceb3076700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac0af620 con 0x7fceac06ac20 2023-03-30T08:11:03.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.841+0000 7fceb3076700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac0cc020 con 0x7fceac0b1650 2023-03-30T08:11:03.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb2074700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fceac158b00 0x7fceac0cb910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53860/0 (socket says 172.21.15.87:53860) 2023-03-30T08:11:03.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb2074700 1 -- 172.21.15.87:0/4052437126 learned_addr learned my addr 172.21.15.87:0/4052437126 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:03.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb1873700 1 --2- 172.21.15.87:0/4052437126 >> v2:172.21.15.115:3300/0 conn(0x7fceac0b1650 0x7fceac06a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb1072700 1 -- 172.21.15.87:0/4052437126 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642767951 0 0) 0x7fceac0aff50 con 0x7fceac158b00 2023-03-30T08:11:03.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb1072700 1 -- 172.21.15.87:0/4052437126 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce980057e0 con 0x7fceac158b00 2023-03-30T08:11:03.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb1072700 1 -- 172.21.15.87:0/4052437126 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046762474 0 0) 0x7fceac0af620 con 0x7fceac06ac20 2023-03-30T08:11:03.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb1072700 1 -- 172.21.15.87:0/4052437126 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceac0aff50 con 0x7fceac06ac20 2023-03-30T08:11:03.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb1873700 1 -- 172.21.15.87:0/4052437126 >> v1:172.21.15.115:6789/0 conn(0x7fceac06ac20 legacy=0x7fceac0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb1873700 1 -- 172.21.15.87:0/4052437126 >> v1:172.21.15.87:6789/0 conn(0x7fceac158b00 legacy=0x7fceac0cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb1873700 1 -- 172.21.15.87:0/4052437126 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac0af900 con 0x7fceac0b1650 2023-03-30T08:11:03.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb1873700 1 --2- 172.21.15.87:0/4052437126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceac0b1650 0x7fceac06a6e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009850 tx=0x7fce9c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46f10f125c65e091 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:03.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb1072700 1 -- 172.21.15.87:0/4052437126 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c011830 con 0x7fceac0b1650 2023-03-30T08:11:03.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb1072700 1 -- 172.21.15.87:0/4052437126 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c011990 con 0x7fceac0b1650 2023-03-30T08:11:03.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb1072700 1 -- 172.21.15.87:0/4052437126 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c011d40 con 0x7fceac0b1650 2023-03-30T08:11:03.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb3076700 1 -- 172.21.15.87:0/4052437126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceac0b1650 msgr2=0x7fceac06a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.845+0000 7fceb3076700 1 --2- 172.21.15.87:0/4052437126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceac0b1650 0x7fceac06a6e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009850 tx=0x7fce9c009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:03.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.849+0000 7fceb3076700 1 -- 172.21.15.87:0/4052437126 shutdown_connections 2023-03-30T08:11:03.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.849+0000 7fceb3076700 1 --2- 172.21.15.87:0/4052437126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceac0b1650 0x7fceac06a6e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.849+0000 7fceb3076700 1 -- 172.21.15.87:0/4052437126 >> 172.21.15.87:0/4052437126 conn(0x7fceac0cf410 msgr2=0x7fceac0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:03.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.849+0000 7fceb3076700 1 -- 172.21.15.87:0/4052437126 shutdown_connections 2023-03-30T08:11:03.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.849+0000 7fceb3076700 1 -- 172.21.15.87:0/4052437126 wait complete. 2023-03-30T08:11:03.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.849+0000 7fceb3076700 1 Processor -- start 2023-03-30T08:11:03.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.849+0000 7fceb3076700 1 -- start start 2023-03-30T08:11:03.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb3076700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceac06ac20 0x7fceac150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb3076700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceac0b1650 0x7fceac159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb3076700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceac0c5850 0x7fceac151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb3076700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0b2550 con 0x7fceac0b1650 2023-03-30T08:11:03.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb3076700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac15a4b0 con 0x7fceac0c5850 2023-03-30T08:11:03.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb3076700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0b27a0 con 0x7fceac06ac20 2023-03-30T08:11:03.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb1873700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceac0b1650 0x7fceac159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb1873700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceac0b1650 0x7fceac159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51362/0 (socket says 172.21.15.87:51362) 2023-03-30T08:11:03.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb1873700 1 -- 172.21.15.87:0/3769121188 learned_addr learned my addr 172.21.15.87:0/3769121188 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:03.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb2074700 1 --2- 172.21.15.87:0/3769121188 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceac06ac20 0x7fceac150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb2875700 1 --2- 172.21.15.87:0/3769121188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceac0c5850 0x7fceac151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb1873700 1 -- 172.21.15.87:0/3769121188 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceac06ac20 msgr2=0x7fceac150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb1873700 1 --2- 172.21.15.87:0/3769121188 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceac06ac20 0x7fceac150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb1873700 1 -- 172.21.15.87:0/3769121188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceac0c5850 msgr2=0x7fceac151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:03.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb1873700 1 --2- 172.21.15.87:0/3769121188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceac0c5850 0x7fceac151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:03.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb1873700 1 -- 172.21.15.87:0/3769121188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c0094b0 con 0x7fceac0b1650 2023-03-30T08:11:03.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb2875700 1 --2- 172.21.15.87:0/3769121188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceac0c5850 0x7fceac151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:03.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb1873700 1 --2- 172.21.15.87:0/3769121188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceac0b1650 0x7fceac159a10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce9c013000 tx=0x7fce9c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:03.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fcea2ffd700 1 -- 172.21.15.87:0/3769121188 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c01aac0 con 0x7fceac0b1650 2023-03-30T08:11:03.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fcea2ffd700 1 -- 172.21.15.87:0/3769121188 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c01f070 con 0x7fceac0b1650 2023-03-30T08:11:03.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fcea2ffd700 1 -- 172.21.15.87:0/3769121188 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c01ae60 con 0x7fceac0b1650 2023-03-30T08:11:03.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb3076700 1 -- 172.21.15.87:0/3769121188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac0af240 con 0x7fceac0b1650 2023-03-30T08:11:03.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.853+0000 7fceb3076700 1 -- 172.21.15.87:0/3769121188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac0afbe0 con 0x7fceac0b1650 2023-03-30T08:11:03.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.857+0000 7fceb3076700 1 -- 172.21.15.87:0/3769121188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac0af3d0 con 0x7fceac0b1650 2023-03-30T08:11:03.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.857+0000 7fcea2ffd700 1 -- 172.21.15.87:0/3769121188 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fce9c02e450 con 0x7fceac0b1650 2023-03-30T08:11:03.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.857+0000 7fcea2ffd700 1 --2- 172.21.15.87:0/3769121188 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fce900653f0 0x7fce900678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:03.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.857+0000 7fcea2ffd700 1 -- 172.21.15.87:0/3769121188 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fce9c083cd0 con 0x7fceac0b1650 2023-03-30T08:11:03.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.861+0000 7fceb2074700 1 --2- 172.21.15.87:0/3769121188 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fce900653f0 0x7fce900678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:03.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.861+0000 7fceb2074700 1 --2- 172.21.15.87:0/3769121188 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fce900653f0 0x7fce900678a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcea8000f60 tx=0x7fcea8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:03.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:03.861+0000 7fcea2ffd700 1 -- 172.21.15.87:0/3769121188 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fce9c0515f0 con 0x7fceac0b1650 2023-03-30T08:11:04.037 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T08:11:04.034+0000 7f9a34a69700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-30T08:11:04.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.033+0000 7fceb3076700 1 -- 172.21.15.87:0/3769121188 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fceac0733a0 con 0x7fceac0b1650 2023-03-30T08:11:04.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.037+0000 7fcea2ffd700 1 -- 172.21.15.87:0/3769121188 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19652 (secure 0 0 0) 0x7fce9c015020 con 0x7fceac0b1650 2023-03-30T08:11:04.041 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:04.042 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":28,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:02.841070+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.041+0000 7fceb3076700 1 -- 172.21.15.87:0/3769121188 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fce900653f0 msgr2=0x7fce900678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.041+0000 7fceb3076700 1 --2- 172.21.15.87:0/3769121188 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fce900653f0 0x7fce900678a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcea8000f60 tx=0x7fcea8009040 comp rx=0 tx=0).stop 2023-03-30T08:11:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.041+0000 7fceb3076700 1 -- 172.21.15.87:0/3769121188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceac0b1650 msgr2=0x7fceac159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.041+0000 7fceb3076700 1 --2- 172.21.15.87:0/3769121188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceac0b1650 0x7fceac159a10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce9c013000 tx=0x7fce9c004770 comp rx=0 tx=0).stop 2023-03-30T08:11:04.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.041+0000 7fceb3076700 1 -- 172.21.15.87:0/3769121188 shutdown_connections 2023-03-30T08:11:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.041+0000 7fceb3076700 1 --2- 172.21.15.87:0/3769121188 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fce900653f0 0x7fce900678a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.041+0000 7fceb3076700 1 --2- 172.21.15.87:0/3769121188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fceac0c5850 0x7fceac151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:04.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.041+0000 7fceb3076700 1 --2- 172.21.15.87:0/3769121188 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceac0b1650 0x7fceac159a10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:04.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.041+0000 7fceb3076700 1 --2- 172.21.15.87:0/3769121188 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fceac06ac20 0x7fceac150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:04.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.041+0000 7fceb3076700 1 -- 172.21.15.87:0/3769121188 >> 172.21.15.87:0/3769121188 conn(0x7fceac0cf410 msgr2=0x7fceac070180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:04.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.041+0000 7fceb3076700 1 -- 172.21.15.87:0/3769121188 shutdown_connections 2023-03-30T08:11:04.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.041+0000 7fceb3076700 1 -- 172.21.15.87:0/3769121188 wait complete. 2023-03-30T08:11:04.079 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T08:11:04.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.233+0000 7f63068cb700 1 Processor -- start 2023-03-30T08:11:04.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.233+0000 7f63068cb700 1 -- start start 2023-03-30T08:11:04.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63068cb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f63001600d0 0x7f630006a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:04.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63068cb700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f63000ad640 0x7f63001604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:04.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63068cb700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630006a0e0 con 0x7f630006aab0 2023-03-30T08:11:04.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63068cb700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63000c9db0 con 0x7f63000ad640 2023-03-30T08:11:04.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63068cb700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63000ca090 con 0x7f63001600d0 2023-03-30T08:11:04.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63060ca700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f63000ad640 0x7f63001604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:04.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63058c9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f63001600d0 0x7f630006a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:04.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63058c9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f63001600d0 0x7f630006a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:56422/0 (socket says 172.21.15.87:56422) 2023-03-30T08:11:04.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63058c9700 1 -- 172.21.15.87:0/503479594 learned_addr learned my addr 172.21.15.87:0/503479594 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:04.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63050c8700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f630006aab0 0x7f63000abfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:34072/0 (socket says 172.21.15.87:34072) 2023-03-30T08:11:04.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63058c9700 1 -- 172.21.15.87:0/503479594 >> v2:172.21.15.87:3300/0 conn(0x7f63000ad640 msgr2=0x7f63001604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:04.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63058c9700 1 --2- 172.21.15.87:0/503479594 >> v2:172.21.15.87:3300/0 conn(0x7f63000ad640 0x7f63001604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:04.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63058c9700 1 -- 172.21.15.87:0/503479594 >> v1:172.21.15.115:6789/0 conn(0x7f630006aab0 legacy=0x7f63000abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:04.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63058c9700 1 -- 172.21.15.87:0/503479594 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6300069d70 con 0x7f63001600d0 2023-03-30T08:11:04.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63060ca700 1 --2- 172.21.15.87:0/503479594 >> v2:172.21.15.87:3300/0 conn(0x7f63000ad640 0x7f63001604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:04.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63048c7700 1 -- 172.21.15.87:0/503479594 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226798139 0 0) 0x7f630006a0e0 con 0x7f630006aab0 2023-03-30T08:11:04.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63058c9700 1 --2- 172.21.15.87:0/503479594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63001600d0 0x7f630006a570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f630006fe20 tx=0x7f62fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfccd95804729323 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:04.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63048c7700 1 -- 172.21.15.87:0/503479594 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc00e070 con 0x7f63001600d0 2023-03-30T08:11:04.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63048c7700 1 -- 172.21.15.87:0/503479594 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc00b910 con 0x7f63001600d0 2023-03-30T08:11:04.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.237+0000 7f63048c7700 1 -- 172.21.15.87:0/503479594 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc00bcc0 con 0x7f63001600d0 2023-03-30T08:11:04.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.241+0000 7f63068cb700 1 -- 172.21.15.87:0/503479594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63001600d0 msgr2=0x7f630006a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:04.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.241+0000 7f63068cb700 1 --2- 172.21.15.87:0/503479594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63001600d0 0x7f630006a570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f630006fe20 tx=0x7f62fc00b330 comp rx=0 tx=0).stop 2023-03-30T08:11:04.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.241+0000 7f63068cb700 1 -- 172.21.15.87:0/503479594 shutdown_connections 2023-03-30T08:11:04.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.241+0000 7f63068cb700 1 --2- 172.21.15.87:0/503479594 >> v2:172.21.15.87:3300/0 conn(0x7f63000ad640 0x7f63001604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:04.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.241+0000 7f63068cb700 1 --2- 172.21.15.87:0/503479594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63001600d0 0x7f630006a570 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:04.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.241+0000 7f63068cb700 1 -- 172.21.15.87:0/503479594 >> 172.21.15.87:0/503479594 conn(0x7f63000cf410 msgr2=0x7f63000cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:04.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.241+0000 7f63068cb700 1 -- 172.21.15.87:0/503479594 shutdown_connections 2023-03-30T08:11:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.241+0000 7f63068cb700 1 -- 172.21.15.87:0/503479594 wait complete. 2023-03-30T08:11:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63068cb700 1 Processor -- start 2023-03-30T08:11:04.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63068cb700 1 -- start start 2023-03-30T08:11:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63068cb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f630006aab0 0x7f63000c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63068cb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63000ad640 0x7f63001f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63068cb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63001600d0 0x7f63000b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63068cb700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63000c88e0 con 0x7f63000ad640 2023-03-30T08:11:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63068cb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630014cb70 con 0x7f630006aab0 2023-03-30T08:11:04.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63068cb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63001f6830 con 0x7f63001600d0 2023-03-30T08:11:04.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63050c8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63000ad640 0x7f63001f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63050c8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63000ad640 0x7f63001f62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51388/0 (socket says 172.21.15.87:51388) 2023-03-30T08:11:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63050c8700 1 -- 172.21.15.87:0/2190702466 learned_addr learned my addr 172.21.15.87:0/2190702466 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63058c9700 1 --2- 172.21.15.87:0/2190702466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f630006aab0 0x7f63000c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63050c8700 1 -- 172.21.15.87:0/2190702466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63001600d0 msgr2=0x7f63000b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63060ca700 1 --2- 172.21.15.87:0/2190702466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63001600d0 0x7f63000b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63050c8700 1 --2- 172.21.15.87:0/2190702466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63001600d0 0x7f63000b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:04.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63050c8700 1 -- 172.21.15.87:0/2190702466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f630006aab0 msgr2=0x7f63000c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63050c8700 1 --2- 172.21.15.87:0/2190702466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f630006aab0 0x7f63000c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63050c8700 1 -- 172.21.15.87:0/2190702466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f80094b0 con 0x7f63000ad640 2023-03-30T08:11:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63050c8700 1 --2- 172.21.15.87:0/2190702466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63000ad640 0x7f63001f62f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f62f000c5b0 tx=0x7f62f000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f62f67fc700 1 -- 172.21.15.87:0/2190702466 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0004ca0 con 0x7f63000ad640 2023-03-30T08:11:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f62f67fc700 1 -- 172.21.15.87:0/2190702466 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f0004e20 con 0x7f63000ad640 2023-03-30T08:11:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f62f67fc700 1 -- 172.21.15.87:0/2190702466 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0007310 con 0x7f63000ad640 2023-03-30T08:11:04.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63068cb700 1 -- 172.21.15.87:0/2190702466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62fc009b30 con 0x7f63000ad640 2023-03-30T08:11:04.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.245+0000 7f63068cb700 1 -- 172.21.15.87:0/2190702466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63000addc0 con 0x7f63000ad640 2023-03-30T08:11:04.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.249+0000 7f63068cb700 1 -- 172.21.15.87:0/2190702466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63000ca370 con 0x7f63000ad640 2023-03-30T08:11:04.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.249+0000 7f62f67fc700 1 -- 172.21.15.87:0/2190702466 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f62f0007470 con 0x7f63000ad640 2023-03-30T08:11:04.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.249+0000 7f62f67fc700 1 --2- 172.21.15.87:0/2190702466 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f62e40653f0 0x7f62e40678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:04.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.249+0000 7f62f67fc700 1 -- 172.21.15.87:0/2190702466 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f62f0082910 con 0x7f63000ad640 2023-03-30T08:11:04.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.249+0000 7f63058c9700 1 --2- 172.21.15.87:0/2190702466 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f62e40653f0 0x7f62e40678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:04.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.253+0000 7f63058c9700 1 --2- 172.21.15.87:0/2190702466 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f62e40653f0 0x7f62e40678a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009f90 tx=0x7f62fc009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:04.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.257+0000 7f62f67fc700 1 -- 172.21.15.87:0/2190702466 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f62f0050200 con 0x7f63000ad640 2023-03-30T08:11:04.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.461+0000 7f63068cb700 1 -- 172.21.15.87:0/2190702466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f630015d8c0 con 0x7f63000ad640 2023-03-30T08:11:04.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.461+0000 7f62f67fc700 1 -- 172.21.15.87:0/2190702466 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f62f0007720 con 0x7f63000ad640 2023-03-30T08:11:04.465 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:04.465 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2818344230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2818344230},{"type":"v1","addr":"172.21.15.115:6833","nonce":2818344230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3891185444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3891185444},{"type":"v1","addr":"172.21.15.87:6836","nonce":3891185444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3443119914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3443119914},{"type":"v1","addr":"172.21.15.87:6837","nonce":3443119914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-30T08:10:58.351331+0000","modified":"2023-03-30T08:11:02.841929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3640886103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3640886103},{"type":"v1","addr":"172.21.15.115:6835","nonce":3640886103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-03-30T08:11:04.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.465+0000 7f63068cb700 1 -- 172.21.15.87:0/2190702466 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f62e40653f0 msgr2=0x7f62e40678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:04.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.465+0000 7f63068cb700 1 --2- 172.21.15.87:0/2190702466 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f62e40653f0 0x7f62e40678a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009f90 tx=0x7f62fc009000 comp rx=0 tx=0).stop 2023-03-30T08:11:04.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.465+0000 7f63068cb700 1 -- 172.21.15.87:0/2190702466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63000ad640 msgr2=0x7f63001f62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.465+0000 7f63068cb700 1 --2- 172.21.15.87:0/2190702466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63000ad640 0x7f63001f62f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f62f000c5b0 tx=0x7f62f000c970 comp rx=0 tx=0).stop 2023-03-30T08:11:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.465+0000 7f63068cb700 1 -- 172.21.15.87:0/2190702466 shutdown_connections 2023-03-30T08:11:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.465+0000 7f63068cb700 1 --2- 172.21.15.87:0/2190702466 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f62e40653f0 0x7f62e40678a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.465+0000 7f63068cb700 1 --2- 172.21.15.87:0/2190702466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63001600d0 0x7f63000b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.465+0000 7f63068cb700 1 --2- 172.21.15.87:0/2190702466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63000ad640 0x7f63001f62f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.465+0000 7f63068cb700 1 --2- 172.21.15.87:0/2190702466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f630006aab0 0x7f63000c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:04.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.465+0000 7f63068cb700 1 -- 172.21.15.87:0/2190702466 >> 172.21.15.87:0/2190702466 conn(0x7f63000cf410 msgr2=0x7f63000c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.465+0000 7f63068cb700 1 -- 172.21.15.87:0/2190702466 shutdown_connections 2023-03-30T08:11:04.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:04.465+0000 7f63068cb700 1 -- 172.21.15.87:0/2190702466 wait complete. 2023-03-30T08:11:04.472 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 7 2023-03-30T08:11:04.890 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-30T08:10:58.351331+0000', 'modified': '2023-03-30T08:11:02.841929+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6835/3640886103', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 3640886103}, {'type': 'v1', 'addr': '172.21.15.115:6835', 'nonce': 3640886103}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-03-30T08:11:04.891 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-30T08:11:04.891 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-03-30T08:11:05.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.065+0000 7fa928796700 1 Processor -- start 2023-03-30T08:11:05.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.065+0000 7fa928796700 1 -- start start 2023-03-30T08:11:05.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.065+0000 7fa928796700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa920160630 0x7fa92015d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.065+0000 7fa928796700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa920070b30 0x7fa92006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.065+0000 7fa928796700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9200cc8f0 con 0x7fa920160a00 2023-03-30T08:11:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.065+0000 7fa928796700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9200ccbd0 con 0x7fa920070b30 2023-03-30T08:11:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.065+0000 7fa928796700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92015cd90 con 0x7fa920160630 2023-03-30T08:11:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.065+0000 7fa926d33700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa920070b30 0x7fa92006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.065+0000 7fa926d33700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa920070b30 0x7fa92006bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51390/0 (socket says 172.21.15.87:51390) 2023-03-30T08:11:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.065+0000 7fa926d33700 1 -- 172.21.15.87:0/1566341059 learned_addr learned my addr 172.21.15.87:0/1566341059 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.065+0000 7fa926532700 1 --2- 172.21.15.87:0/1566341059 >> v2:172.21.15.115:3300/0 conn(0x7fa920160630 0x7fa92015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.065+0000 7fa926d33700 1 -- 172.21.15.87:0/1566341059 >> v2:172.21.15.115:3300/0 conn(0x7fa920160630 msgr2=0x7fa92015d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:05.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa926d33700 1 --2- 172.21.15.87:0/1566341059 >> v2:172.21.15.115:3300/0 conn(0x7fa920160630 0x7fa92015d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa926d33700 1 -- 172.21.15.87:0/1566341059 >> v1:172.21.15.87:6789/0 conn(0x7fa920160a00 legacy=0x7fa920070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa926d33700 1 -- 172.21.15.87:0/1566341059 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92015d070 con 0x7fa920070b30 2023-03-30T08:11:05.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa926532700 1 --2- 172.21.15.87:0/1566341059 >> v2:172.21.15.115:3300/0 conn(0x7fa920160630 0x7fa92015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:05.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa926d33700 1 --2- 172.21.15.87:0/1566341059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa920070b30 0x7fa92006bd80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa92006e500 tx=0x7fa91800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c187763042c86dd server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:05.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa925530700 1 -- 172.21.15.87:0/1566341059 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91800e070 con 0x7fa920070b30 2023-03-30T08:11:05.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa925530700 1 -- 172.21.15.87:0/1566341059 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa918003a40 con 0x7fa920070b30 2023-03-30T08:11:05.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa925530700 1 -- 172.21.15.87:0/1566341059 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918003df0 con 0x7fa920070b30 2023-03-30T08:11:05.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa928796700 1 -- 172.21.15.87:0/1566341059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa920070b30 msgr2=0x7fa92006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa928796700 1 --2- 172.21.15.87:0/1566341059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa920070b30 0x7fa92006bd80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa92006e500 tx=0x7fa91800b330 comp rx=0 tx=0).stop 2023-03-30T08:11:05.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa928796700 1 -- 172.21.15.87:0/1566341059 shutdown_connections 2023-03-30T08:11:05.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa928796700 1 --2- 172.21.15.87:0/1566341059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa920070b30 0x7fa92006bd80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa928796700 1 --2- 172.21.15.87:0/1566341059 >> v2:172.21.15.115:3300/0 conn(0x7fa920160630 0x7fa92015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa928796700 1 -- 172.21.15.87:0/1566341059 >> 172.21.15.87:0/1566341059 conn(0x7fa9200ce960 msgr2=0x7fa9200ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:05.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa928796700 1 -- 172.21.15.87:0/1566341059 shutdown_connections 2023-03-30T08:11:05.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.069+0000 7fa928796700 1 -- 172.21.15.87:0/1566341059 wait complete. 2023-03-30T08:11:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa928796700 1 Processor -- start 2023-03-30T08:11:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa928796700 1 -- start start 2023-03-30T08:11:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa928796700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa920070b30 0x7fa92014fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa928796700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa920160630 0x7fa9200b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa928796700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa920160a00 0x7fa920151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa928796700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200b2c60 con 0x7fa920160a00 2023-03-30T08:11:05.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa928796700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200b2f40 con 0x7fa920070b30 2023-03-30T08:11:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa928796700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200b3220 con 0x7fa920160630 2023-03-30T08:11:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa926d33700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa920160a00 0x7fa920151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa926d33700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa920160a00 0x7fa920151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51398/0 (socket says 172.21.15.87:51398) 2023-03-30T08:11:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa926d33700 1 -- 172.21.15.87:0/4288420335 learned_addr learned my addr 172.21.15.87:0/4288420335 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa926532700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa920070b30 0x7fa92014fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa926d33700 1 -- 172.21.15.87:0/4288420335 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa920160630 msgr2=0x7fa9200b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa925d31700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa920160630 0x7fa9200b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa926d33700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa920160630 0x7fa9200b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa926d33700 1 -- 172.21.15.87:0/4288420335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa920070b30 msgr2=0x7fa92014fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa926d33700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa920070b30 0x7fa92014fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa926d33700 1 -- 172.21.15.87:0/4288420335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa918009b30 con 0x7fa920160a00 2023-03-30T08:11:05.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa926532700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa920070b30 0x7fa92014fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:05.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa925d31700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa920160630 0x7fa9200b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:05.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.073+0000 7fa926d33700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa920160a00 0x7fa920151960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa91800b730 tx=0x7fa918004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:05.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.077+0000 7fa916ffd700 1 -- 172.21.15.87:0/4288420335 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918004440 con 0x7fa920160a00 2023-03-30T08:11:05.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.077+0000 7fa916ffd700 1 -- 172.21.15.87:0/4288420335 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9180045c0 con 0x7fa920160a00 2023-03-30T08:11:05.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.077+0000 7fa928796700 1 -- 172.21.15.87:0/4288420335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa920160e60 con 0x7fa920160a00 2023-03-30T08:11:05.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.077+0000 7fa916ffd700 1 -- 172.21.15.87:0/4288420335 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918004970 con 0x7fa920160a00 2023-03-30T08:11:05.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.077+0000 7fa928796700 1 -- 172.21.15.87:0/4288420335 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92015ca80 con 0x7fa920160a00 2023-03-30T08:11:05.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.077+0000 7fa916ffd700 1 -- 172.21.15.87:0/4288420335 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa918019040 con 0x7fa920160a00 2023-03-30T08:11:05.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.081+0000 7fa916ffd700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa9040653f0 0x7fa9040678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.081+0000 7fa916ffd700 1 -- 172.21.15.87:0/4288420335 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa918083e30 con 0x7fa920160a00 2023-03-30T08:11:05.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.081+0000 7fa926532700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa9040653f0 0x7fa9040678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.081+0000 7fa926532700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa9040653f0 0x7fa9040678a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa91c006fd0 tx=0x7fa91c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:05.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.081+0000 7fa92ba19740 1 Processor -- start 2023-03-30T08:11:05.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.081+0000 7fa92ba19740 1 -- start start 2023-03-30T08:11:05.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.081+0000 7fa92ba19740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x11b6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.081+0000 7fa92ba19740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06710 0x11b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.081+0000 7fa92ba19740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 0x1186f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.081+0000 7fa92ba19740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x1093bc0 con 0xf06ae0 2023-03-30T08:11:05.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.081+0000 7fa92ba19740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x10e6a00 con 0xf06710 2023-03-30T08:11:05.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.081+0000 7fa92ba19740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x10dfc60 con 0xf51790 2023-03-30T08:11:05.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa926532700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x11b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa926532700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x11b6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51404/0 (socket says 172.21.15.87:51404) 2023-03-30T08:11:05.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa926532700 1 -- 172.21.15.87:0/1695695010 learned_addr learned my addr 172.21.15.87:0/1695695010 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:05.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa926d33700 1 --2- 172.21.15.87:0/1695695010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 0x1186f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa925d31700 1 --2- 172.21.15.87:0/1695695010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06710 0x11b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa926532700 1 -- 172.21.15.87:0/1695695010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 msgr2=0x1186f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:05.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa926532700 1 --2- 172.21.15.87:0/1695695010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 0x1186f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa926532700 1 -- 172.21.15.87:0/1695695010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06710 msgr2=0x11b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:05.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa926532700 1 --2- 172.21.15.87:0/1695695010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06710 0x11b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa926532700 1 -- 172.21.15.87:0/1695695010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x11069b0 con 0xf06ae0 2023-03-30T08:11:05.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa925d31700 1 --2- 172.21.15.87:0/1695695010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06710 0x11b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:05.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa926532700 1 --2- 172.21.15.87:0/1695695010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x11b6510 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00eb90 tx=0x7fa91c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71df37e324210daa server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:05.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa903fff700 1 -- 172.21.15.87:0/1695695010 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c013760 con 0xf06ae0 2023-03-30T08:11:05.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa903fff700 1 -- 172.21.15.87:0/1695695010 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c018070 con 0xf06ae0 2023-03-30T08:11:05.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa903fff700 1 -- 172.21.15.87:0/1695695010 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c013ac0 con 0xf06ae0 2023-03-30T08:11:05.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa92ba19740 1 -- 172.21.15.87:0/1695695010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 msgr2=0x11b6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa92ba19740 1 --2- 172.21.15.87:0/1695695010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x11b6510 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00eb90 tx=0x7fa91c011000 comp rx=0 tx=0).stop 2023-03-30T08:11:05.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa92ba19740 1 -- 172.21.15.87:0/1695695010 shutdown_connections 2023-03-30T08:11:05.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa92ba19740 1 --2- 172.21.15.87:0/1695695010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 0x1186f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa92ba19740 1 --2- 172.21.15.87:0/1695695010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06710 0x11b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa92ba19740 1 --2- 172.21.15.87:0/1695695010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x11b6510 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa92ba19740 1 -- 172.21.15.87:0/1695695010 >> 172.21.15.87:0/1695695010 conn(0xf06eb0 msgr2=0x11a0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa92ba19740 1 -- 172.21.15.87:0/1695695010 shutdown_connections 2023-03-30T08:11:05.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.085+0000 7fa92ba19740 1 -- 172.21.15.87:0/1695695010 wait complete. 2023-03-30T08:11:05.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa92ba19740 1 -- start start 2023-03-30T08:11:05.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa92ba19740 1 Processor -- start 2023-03-30T08:11:05.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa92ba19740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06710 0x1179570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa92ba19740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06ae0 0x11b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa92ba19740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 0x11b9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa92ba19740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0xf8bb20 con 0xf06710 2023-03-30T08:11:05.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa92ba19740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x11b8110 con 0xf06ae0 2023-03-30T08:11:05.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa92ba19740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x1178b90 con 0xf51790 2023-03-30T08:11:05.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa92ba19740 10 client.0 _ll_register_callbacks cb 0x1131c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-30T08:11:05.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa926532700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06710 0x1179570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa926532700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06710 0x1179570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51410/0 (socket says 172.21.15.87:51410) 2023-03-30T08:11:05.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa926532700 1 -- 172.21.15.87:0/3478826388 learned_addr learned my addr 172.21.15.87:0/3478826388 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:05.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa925d31700 1 --2- 172.21.15.87:0/3478826388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06ae0 0x11b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa926d33700 1 --2- 172.21.15.87:0/3478826388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 0x11b9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa926532700 1 -- 172.21.15.87:0/3478826388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 msgr2=0x11b9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:05.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa926532700 1 --2- 172.21.15.87:0/3478826388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 0x11b9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa926532700 1 -- 172.21.15.87:0/3478826388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06ae0 msgr2=0x11b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa926532700 1 --2- 172.21.15.87:0/3478826388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06ae0 0x11b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.089+0000 7fa926532700 1 -- 172.21.15.87:0/3478826388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91c00e840 con 0xf06710 2023-03-30T08:11:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa926532700 1 --2- 172.21.15.87:0/3478826388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06710 0x1179570 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa91c021040 tx=0x7fa91c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d079e8d2a9fa3 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa9017fa700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2023-03-30T08:11:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa9017fa700 1 -- 172.21.15.87:0/3478826388 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c005e40 con 0xf06710 2023-03-30T08:11:05.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa9017fa700 1 -- 172.21.15.87:0/3478826388 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa91c006040 con 0xf06710 2023-03-30T08:11:05.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa92ba19740 1 -- 172.21.15.87:0/3478826388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x10d8c40 con 0xf06710 2023-03-30T08:11:05.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa9017fa700 1 -- 172.21.15.87:0/3478826388 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa91c006200 con 0xf06710 2023-03-30T08:11:05.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa92ba19740 10 client.4428 fetch_fsmap learned FSMap version 7 2023-03-30T08:11:05.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa92ba19740 1 -- 172.21.15.87:0/3478826388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0xf529e0 con 0xf06710 2023-03-30T08:11:05.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa9017fa700 1 -- 172.21.15.87:0/3478826388 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x10d8c40 con 0xf06710 2023-03-30T08:11:05.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa9017fa700 1 -- 172.21.15.87:0/3478826388 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fa91c006360 con 0xf06710 2023-03-30T08:11:05.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa92ba19740 10 client.4428 fetch_fsmap finished waiting for FSMap version 7 2023-03-30T08:11:05.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa92ba19740 10 client.4428 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-30T08:11:05.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa92ba19740 20 client.4428 populate_metadata read hostname 'smithi087' 2023-03-30T08:11:05.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa92ba19740 1 --2- 172.21.15.87:0/3478826388 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0x11b7c00 0x1177720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa92ba19740 4 client.4428 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-30T08:11:05.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa92ba19740 1 -- 172.21.15.87:0/3478826388 --> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x10d8960 con 0x11b7c00 2023-03-30T08:11:05.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa925d31700 1 --2- 172.21.15.87:0/3478826388 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0x11b7c00 0x1177720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa9017fa700 10 client.4428 ms_handle_connect on v2:172.21.15.115:6834/3640886103 2023-03-30T08:11:05.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.093+0000 7fa925d31700 1 --2- 172.21.15.87:0/3478826388 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0x11b7c00 0x1177720 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5537d2f2b316b141 server_cookie=681256eb77c95592 in_seq=0 out_seq=0 2023-03-30T08:11:05.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.097+0000 7fa9017fa700 1 -- 172.21.15.87:0/3478826388 <== mds.0 v2:172.21.15.115:6834/3640886103 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x10d8960 con 0x11b7c00 2023-03-30T08:11:05.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.097+0000 7fa9017fa700 10 client.4428 handle_command_reply: tid=0 2023-03-30T08:11:05.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.097+0000 7fa92ba19740 1 client.4428 shutdown 2023-03-30T08:11:05.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.097+0000 7fa92ba19740 1 -- 172.21.15.87:0/3478826388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06710 msgr2=0x1179570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.097+0000 7fa92ba19740 1 --2- 172.21.15.87:0/3478826388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06710 0x1179570 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa91c021040 tx=0x7fa91c0047e0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.097+0000 7fa92ba19740 1 -- 172.21.15.87:0/3478826388 shutdown_connections 2023-03-30T08:11:05.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.097+0000 7fa92ba19740 1 --2- 172.21.15.87:0/3478826388 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0x11b7c00 0x1177720 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.097+0000 7fa92ba19740 1 --2- 172.21.15.87:0/3478826388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 0x11b9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.097+0000 7fa92ba19740 1 --2- 172.21.15.87:0/3478826388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06ae0 0x11b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.097+0000 7fa9017fa700 0 client.4428 ms_handle_reset on v2:172.21.15.115:6834/3640886103 2023-03-30T08:11:05.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.097+0000 7fa92ba19740 1 --2- 172.21.15.87:0/3478826388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06710 0x1179570 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.097+0000 7fa92ba19740 1 -- 172.21.15.87:0/3478826388 >> 172.21.15.87:0/3478826388 conn(0xf06eb0 msgr2=0x11a0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:05.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.097+0000 7fa92ba19740 1 -- 172.21.15.87:0/3478826388 shutdown_connections 2023-03-30T08:11:05.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.097+0000 7fa92ba19740 1 -- 172.21.15.87:0/3478826388 wait complete. 2023-03-30T08:11:05.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.097+0000 7fa92ba19740 20 client.4428 trim_cache size 0 max 16384 2023-03-30T08:11:05.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.117+0000 7fa92ba19740 1 Processor -- start 2023-03-30T08:11:05.122 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.117+0000 7fa92ba19740 1 -- start start 2023-03-30T08:11:05.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa92ba19740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf06710 0x11c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa92ba19740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x119cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa92ba19740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf51790 0x119d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa92ba19740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x10dd470 con 0xf06ae0 2023-03-30T08:11:05.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa92ba19740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x10b48c0 con 0xf51790 2023-03-30T08:11:05.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa92ba19740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x10aeee0 con 0xf06710 2023-03-30T08:11:05.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa925d31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x119cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa925d31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x119cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51416/0 (socket says 172.21.15.87:51416) 2023-03-30T08:11:05.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa925d31700 1 -- 172.21.15.87:0/926089102 learned_addr learned my addr 172.21.15.87:0/926089102 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:05.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa926532700 1 --2- 172.21.15.87:0/926089102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf06710 0x11c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa926d33700 1 --2- 172.21.15.87:0/926089102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf51790 0x119d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa926532700 1 -- 172.21.15.87:0/926089102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf51790 msgr2=0x119d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:05.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa926532700 1 --2- 172.21.15.87:0/926089102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf51790 0x119d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa926532700 1 -- 172.21.15.87:0/926089102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 msgr2=0x119cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:05.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa926532700 1 --2- 172.21.15.87:0/926089102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x119cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa926532700 1 -- 172.21.15.87:0/926089102 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10a5cc0 con 0xf06710 2023-03-30T08:11:05.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa925d31700 1 --2- 172.21.15.87:0/926089102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x119cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:05.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa926532700 1 --2- 172.21.15.87:0/926089102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf06710 0x11c7ae0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00a9e0 tx=0x7fa91c02b070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaa27ec6f9dc3d56 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:05.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa914ff9700 1 -- 172.21.15.87:0/926089102 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c006870 con 0xf06710 2023-03-30T08:11:05.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa914ff9700 1 -- 172.21.15.87:0/926089102 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c02d070 con 0xf06710 2023-03-30T08:11:05.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa914ff9700 1 -- 172.21.15.87:0/926089102 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c013d90 con 0xf06710 2023-03-30T08:11:05.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa92ba19740 1 -- 172.21.15.87:0/926089102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf06710 msgr2=0x11c7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa92ba19740 1 --2- 172.21.15.87:0/926089102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf06710 0x11c7ae0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00a9e0 tx=0x7fa91c02b070 comp rx=0 tx=0).stop 2023-03-30T08:11:05.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa92ba19740 1 -- 172.21.15.87:0/926089102 shutdown_connections 2023-03-30T08:11:05.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa92ba19740 1 --2- 172.21.15.87:0/926089102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf51790 0x119d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa92ba19740 1 --2- 172.21.15.87:0/926089102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x119cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa92ba19740 1 --2- 172.21.15.87:0/926089102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf06710 0x11c7ae0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.121+0000 7fa92ba19740 1 -- 172.21.15.87:0/926089102 >> 172.21.15.87:0/926089102 conn(0xf06eb0 msgr2=0x11cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:05.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa92ba19740 1 -- 172.21.15.87:0/926089102 shutdown_connections 2023-03-30T08:11:05.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa92ba19740 1 -- 172.21.15.87:0/926089102 wait complete. 2023-03-30T08:11:05.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa92ba19740 1 -- start start 2023-03-30T08:11:05.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa92ba19740 1 Processor -- start 2023-03-30T08:11:05.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa92ba19740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06710 0x118a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa92ba19740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x1189510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa92ba19740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 0x1177720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa92ba19740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x11c75c0 con 0xf06ae0 2023-03-30T08:11:05.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa92ba19740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x11b5040 con 0xf06710 2023-03-30T08:11:05.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa92ba19740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x1175cc0 con 0xf51790 2023-03-30T08:11:05.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa92ba19740 10 client.0 _ll_register_callbacks cb 0x1080b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-30T08:11:05.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa925d31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x1189510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa926532700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06710 0x118a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa925d31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x1189510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51432/0 (socket says 172.21.15.87:51432) 2023-03-30T08:11:05.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa926d33700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 0x1177720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa925d31700 1 -- 172.21.15.87:0/2166342294 learned_addr learned my addr 172.21.15.87:0/2166342294 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:05.133 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa926d33700 1 -- 172.21.15.87:0/2166342294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06710 msgr2=0x118a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:05.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.125+0000 7fa926d33700 1 --2- 172.21.15.87:0/2166342294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06710 0x118a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa926d33700 1 -- 172.21.15.87:0/2166342294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 msgr2=0x1189510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:05.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa926d33700 1 --2- 172.21.15.87:0/2166342294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x1189510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa926d33700 1 -- 172.21.15.87:0/2166342294 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa910017430 con 0xf51790 2023-03-30T08:11:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa925d31700 1 --2- 172.21.15.87:0/2166342294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x1189510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa926d33700 1 --2- 172.21.15.87:0/2166342294 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 0x1177720 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa918081ff0 tx=0x7fa918054ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99d4010173ce7844 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa9017fa700 10 client.0 ms_handle_connect on v2:172.21.15.115:3301/0 2023-03-30T08:11:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa9017fa700 1 -- 172.21.15.87:0/2166342294 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918051500 con 0xf51790 2023-03-30T08:11:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa9017fa700 1 -- 172.21.15.87:0/2166342294 <== mon.2 v2:172.21.15.115:3301/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa918053970 con 0xf51790 2023-03-30T08:11:05.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa92ba19740 1 -- 172.21.15.87:0/2166342294 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa91c018070 con 0xf51790 2023-03-30T08:11:05.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa9017fa700 1 -- 172.21.15.87:0/2166342294 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa918054470 con 0xf51790 2023-03-30T08:11:05.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa92ba19740 10 client.4322 fetch_fsmap learned FSMap version 7 2023-03-30T08:11:05.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa92ba19740 1 -- 172.21.15.87:0/2166342294 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0xf529e0 con 0xf51790 2023-03-30T08:11:05.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa9017fa700 1 -- 172.21.15.87:0/2166342294 <== mon.2 v2:172.21.15.115:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa918061080 con 0xf51790 2023-03-30T08:11:05.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa9017fa700 1 -- 172.21.15.87:0/2166342294 <== mon.2 v2:172.21.15.115:3301/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fa9180545d0 con 0xf51790 2023-03-30T08:11:05.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa92ba19740 10 client.4322 fetch_fsmap finished waiting for FSMap version 7 2023-03-30T08:11:05.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa92ba19740 10 client.4322 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-30T08:11:05.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa92ba19740 20 client.4322 populate_metadata read hostname 'smithi087' 2023-03-30T08:11:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa92ba19740 1 --2- 172.21.15.87:0/2166342294 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0x12206d0 0x1220aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa92ba19740 4 client.4322 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-03-30T08:11:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa92ba19740 1 -- 172.21.15.87:0/2166342294 --> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] -- command(tid 0: {"prefix": "status"}) v1 -- 0xf83260 con 0x12206d0 2023-03-30T08:11:05.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa926532700 1 --2- 172.21.15.87:0/2166342294 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0x12206d0 0x1220aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa9017fa700 10 client.4322 ms_handle_connect on v2:172.21.15.115:6834/3640886103 2023-03-30T08:11:05.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.129+0000 7fa926532700 1 --2- 172.21.15.87:0/2166342294 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0x12206d0 0x1220aa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9185124f2902ebf server_cookie=8747143879e9256 in_seq=0 out_seq=0 2023-03-30T08:11:05.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa9017fa700 1 -- 172.21.15.87:0/2166342294 <== mds.0 v2:172.21.15.115:6834/3640886103 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0xf83260 con 0x12206d0 2023-03-30T08:11:05.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa9017fa700 10 client.4322 handle_command_reply: tid=0 2023-03-30T08:11:05.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa92ba19740 1 client.4322 shutdown 2023-03-30T08:11:05.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa92ba19740 1 -- 172.21.15.87:0/2166342294 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 msgr2=0x1177720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa92ba19740 1 --2- 172.21.15.87:0/2166342294 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 0x1177720 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa918081ff0 tx=0x7fa918054ce0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa92ba19740 1 -- 172.21.15.87:0/2166342294 shutdown_connections 2023-03-30T08:11:05.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa92ba19740 1 --2- 172.21.15.87:0/2166342294 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0x12206d0 0x1220aa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa92ba19740 1 --2- 172.21.15.87:0/2166342294 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xf51790 0x1177720 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa92ba19740 1 --2- 172.21.15.87:0/2166342294 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xf06ae0 0x1189510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa92ba19740 1 --2- 172.21.15.87:0/2166342294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xf06710 0x118a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa92ba19740 1 -- 172.21.15.87:0/2166342294 >> 172.21.15.87:0/2166342294 conn(0xf06eb0 msgr2=0x1178e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:05.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa9017fa700 0 client.4322 ms_handle_reset on v2:172.21.15.115:6834/3640886103 2023-03-30T08:11:05.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa92ba19740 1 -- 172.21.15.87:0/2166342294 shutdown_connections 2023-03-30T08:11:05.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa92ba19740 1 -- 172.21.15.87:0/2166342294 wait complete. 2023-03-30T08:11:05.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa92ba19740 20 client.4322 trim_cache size 0 max 16384 2023-03-30T08:11:05.142 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-03-30T08:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "936aee23-1888-4f7e-bc67-7a45e372f20a", 2023-03-30T08:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2023-03-30T08:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4291, 2023-03-30T08:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2023-03-30T08:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2023-03-30T08:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2023-03-30T08:11:05.143 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 6.7762794319999999, 2023-03-30T08:11:05.144 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 7, 2023-03-30T08:11:05.144 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 28, 2023-03-30T08:11:05.144 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 27, 2023-03-30T08:11:05.144 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 12.106840032999999 2023-03-30T08:11:05.144 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-03-30T08:11:05.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa928796700 1 -- 172.21.15.87:0/4288420335 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa9040653f0 msgr2=0x7fa9040678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa928796700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa9040653f0 0x7fa9040678a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa91c006fd0 tx=0x7fa91c008040 comp rx=0 tx=0).stop 2023-03-30T08:11:05.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa928796700 1 -- 172.21.15.87:0/4288420335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa920160a00 msgr2=0x7fa920151960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa928796700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa920160a00 0x7fa920151960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa91800b730 tx=0x7fa918004af0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa928796700 1 -- 172.21.15.87:0/4288420335 shutdown_connections 2023-03-30T08:11:05.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa928796700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa9040653f0 0x7fa9040678a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa928796700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa920160a00 0x7fa920151960 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa928796700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa920160630 0x7fa9200b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa928796700 1 --2- 172.21.15.87:0/4288420335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa920070b30 0x7fa92014fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa928796700 1 -- 172.21.15.87:0/4288420335 >> 172.21.15.87:0/4288420335 conn(0x7fa9200ce960 msgr2=0x7fa9200cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:05.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa928796700 1 -- 172.21.15.87:0/4288420335 shutdown_connections 2023-03-30T08:11:05.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.133+0000 7fa928796700 1 -- 172.21.15.87:0/4288420335 wait complete. 2023-03-30T08:11:05.157 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-30T08:11:05.158 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-03-30T08:11:05.158 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-30T08:11:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.317+0000 7f22baee7700 1 Processor -- start 2023-03-30T08:11:05.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22baee7700 1 -- start start 2023-03-30T08:11:05.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22baee7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f22b40b8380 0x7f22b40d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22baee7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22b406a3e0 0x7f22b40d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22baee7700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b4160ef0 con 0x7f22b40d27e0 2023-03-30T08:11:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22baee7700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b40cd6a0 con 0x7f22b40b8380 2023-03-30T08:11:05.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22baee7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40cd3a0 con 0x7f22b406a3e0 2023-03-30T08:11:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22b96e4700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f22b40d27e0 0x7f22b4069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53876/0 (socket says 172.21.15.87:53876) 2023-03-30T08:11:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22b96e4700 1 -- 172.21.15.87:0/2630467347 learned_addr learned my addr 172.21.15.87:0/2630467347 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22ba6e6700 1 --2- 172.21.15.87:0/2630467347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22b406a3e0 0x7f22b40d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22b9ee5700 1 --2- 172.21.15.87:0/2630467347 >> v2:172.21.15.115:3300/0 conn(0x7f22b40b8380 0x7f22b40d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22b8ee3700 1 -- 172.21.15.87:0/2630467347 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720493269 0 0) 0x7f22b4160ef0 con 0x7f22b40d27e0 2023-03-30T08:11:05.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22b8ee3700 1 -- 172.21.15.87:0/2630467347 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22a00035d0 con 0x7f22b40d27e0 2023-03-30T08:11:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22ba6e6700 1 -- 172.21.15.87:0/2630467347 >> v2:172.21.15.115:3300/0 conn(0x7f22b40b8380 msgr2=0x7f22b40d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22ba6e6700 1 --2- 172.21.15.87:0/2630467347 >> v2:172.21.15.115:3300/0 conn(0x7f22b40b8380 0x7f22b40d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22ba6e6700 1 -- 172.21.15.87:0/2630467347 >> v1:172.21.15.87:6789/0 conn(0x7f22b40d27e0 legacy=0x7f22b4069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22ba6e6700 1 -- 172.21.15.87:0/2630467347 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b40cef00 con 0x7f22b406a3e0 2023-03-30T08:11:05.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.321+0000 7f22b9ee5700 1 --2- 172.21.15.87:0/2630467347 >> v2:172.21.15.115:3300/0 conn(0x7f22b40b8380 0x7f22b40d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:05.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.325+0000 7f22ba6e6700 1 --2- 172.21.15.87:0/2630467347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22b406a3e0 0x7f22b40d0880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009d90 tx=0x7f22ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec67a754609a608e server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.325+0000 7f22b8ee3700 1 -- 172.21.15.87:0/2630467347 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00e070 con 0x7f22b406a3e0 2023-03-30T08:11:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.325+0000 7f22b8ee3700 1 -- 172.21.15.87:0/2630467347 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac00bb20 con 0x7f22b406a3e0 2023-03-30T08:11:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.325+0000 7f22b8ee3700 1 -- 172.21.15.87:0/2630467347 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac012430 con 0x7f22b406a3e0 2023-03-30T08:11:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.325+0000 7f22baee7700 1 -- 172.21.15.87:0/2630467347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22b406a3e0 msgr2=0x7f22b40d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.325+0000 7f22baee7700 1 --2- 172.21.15.87:0/2630467347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22b406a3e0 0x7f22b40d0880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009d90 tx=0x7f22ac00b330 comp rx=0 tx=0).stop 2023-03-30T08:11:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.325+0000 7f22baee7700 1 -- 172.21.15.87:0/2630467347 shutdown_connections 2023-03-30T08:11:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.325+0000 7f22baee7700 1 --2- 172.21.15.87:0/2630467347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22b406a3e0 0x7f22b40d0880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.325+0000 7f22baee7700 1 --2- 172.21.15.87:0/2630467347 >> v2:172.21.15.115:3300/0 conn(0x7f22b40b8380 0x7f22b40d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.325+0000 7f22baee7700 1 -- 172.21.15.87:0/2630467347 >> 172.21.15.87:0/2630467347 conn(0x7f22b40b53f0 msgr2=0x7f22b40cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:05.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.325+0000 7f22baee7700 1 -- 172.21.15.87:0/2630467347 shutdown_connections 2023-03-30T08:11:05.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.325+0000 7f22baee7700 1 -- 172.21.15.87:0/2630467347 wait complete. 2023-03-30T08:11:05.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22baee7700 1 Processor -- start 2023-03-30T08:11:05.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22baee7700 1 -- start start 2023-03-30T08:11:05.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22baee7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22b406a3e0 0x7f22b40b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22baee7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b40b8380 0x7f22b40c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22baee7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22b415b580 0x7f22b41f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22baee7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b41f1790 con 0x7f22b406a3e0 2023-03-30T08:11:05.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22baee7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40c9750 con 0x7f22b40b8380 2023-03-30T08:11:05.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22baee7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40c8f60 con 0x7f22b415b580 2023-03-30T08:11:05.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22b9ee5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22b406a3e0 0x7f22b40b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22b9ee5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22b406a3e0 0x7f22b40b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51442/0 (socket says 172.21.15.87:51442) 2023-03-30T08:11:05.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22b9ee5700 1 -- 172.21.15.87:0/4218113192 learned_addr learned my addr 172.21.15.87:0/4218113192 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:05.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22ba6e6700 1 --2- 172.21.15.87:0/4218113192 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22b415b580 0x7f22b41f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22b96e4700 1 --2- 172.21.15.87:0/4218113192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b40b8380 0x7f22b40c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22b9ee5700 1 -- 172.21.15.87:0/4218113192 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22b415b580 msgr2=0x7f22b41f2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22b9ee5700 1 --2- 172.21.15.87:0/4218113192 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22b415b580 0x7f22b41f2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22b9ee5700 1 -- 172.21.15.87:0/4218113192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b40b8380 msgr2=0x7f22b40c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22b9ee5700 1 --2- 172.21.15.87:0/4218113192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b40b8380 0x7f22b40c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22b9ee5700 1 -- 172.21.15.87:0/4218113192 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b00094b0 con 0x7f22b406a3e0 2023-03-30T08:11:05.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.329+0000 7f22b96e4700 1 --2- 172.21.15.87:0/4218113192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b40b8380 0x7f22b40c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:05.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.333+0000 7f22b9ee5700 1 --2- 172.21.15.87:0/4218113192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22b406a3e0 0x7f22b40b11d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f22b000ec10 tx=0x7f22b000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:05.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.333+0000 7f22aa7fc700 1 -- 172.21.15.87:0/4218113192 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b000c830 con 0x7f22b406a3e0 2023-03-30T08:11:05.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.333+0000 7f22aa7fc700 1 -- 172.21.15.87:0/4218113192 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b000c990 con 0x7f22b406a3e0 2023-03-30T08:11:05.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.333+0000 7f22aa7fc700 1 -- 172.21.15.87:0/4218113192 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b000cd00 con 0x7f22b406a3e0 2023-03-30T08:11:05.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.333+0000 7f22baee7700 1 -- 172.21.15.87:0/4218113192 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac009a70 con 0x7f22b406a3e0 2023-03-30T08:11:05.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.333+0000 7f22baee7700 1 -- 172.21.15.87:0/4218113192 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b40cf480 con 0x7f22b406a3e0 2023-03-30T08:11:05.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.333+0000 7f22baee7700 1 -- 172.21.15.87:0/4218113192 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b40cf1a0 con 0x7f22b406a3e0 2023-03-30T08:11:05.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.337+0000 7f22aa7fc700 1 -- 172.21.15.87:0/4218113192 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f22b0013470 con 0x7f22b406a3e0 2023-03-30T08:11:05.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.337+0000 7f22aa7fc700 1 --2- 172.21.15.87:0/4218113192 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2298065420 0x7f22980678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.337+0000 7f22aa7fc700 1 -- 172.21.15.87:0/4218113192 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f22b0082b90 con 0x7f22b406a3e0 2023-03-30T08:11:05.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.337+0000 7f22b96e4700 1 --2- 172.21.15.87:0/4218113192 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2298065420 0x7f22980678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:05.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.337+0000 7f22b96e4700 1 --2- 172.21.15.87:0/4218113192 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2298065420 0x7f22980678d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22b40b6440 tx=0x7f22a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:05.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.341+0000 7f22aa7fc700 1 -- 172.21.15.87:0/4218113192 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f22b00504c0 con 0x7f22b406a3e0 2023-03-30T08:11:05.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.549+0000 7f22baee7700 1 -- 172.21.15.87:0/4218113192 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f22b4072cf0 con 0x7f22b406a3e0 2023-03-30T08:11:05.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.549+0000 7f22aa7fc700 1 -- 172.21.15.87:0/4218113192 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f22b0017070 con 0x7f22b406a3e0 2023-03-30T08:11:05.552 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-03-30T08:11:05.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.549+0000 7f22baee7700 1 -- 172.21.15.87:0/4218113192 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2298065420 msgr2=0x7f22980678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.549+0000 7f22baee7700 1 --2- 172.21.15.87:0/4218113192 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2298065420 0x7f22980678d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22b40b6440 tx=0x7f22a4009040 comp rx=0 tx=0).stop 2023-03-30T08:11:05.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.553+0000 7f22baee7700 1 -- 172.21.15.87:0/4218113192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22b406a3e0 msgr2=0x7f22b40b11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:05.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.553+0000 7f22baee7700 1 --2- 172.21.15.87:0/4218113192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22b406a3e0 0x7f22b40b11d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f22b000ec10 tx=0x7f22b000ef20 comp rx=0 tx=0).stop 2023-03-30T08:11:05.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.553+0000 7f22baee7700 1 -- 172.21.15.87:0/4218113192 shutdown_connections 2023-03-30T08:11:05.556 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.553+0000 7f22baee7700 1 --2- 172.21.15.87:0/4218113192 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2298065420 0x7f22980678d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.556 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.553+0000 7f22baee7700 1 --2- 172.21.15.87:0/4218113192 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22b415b580 0x7f22b41f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.556 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.553+0000 7f22baee7700 1 --2- 172.21.15.87:0/4218113192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22b40b8380 0x7f22b40c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.556 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.553+0000 7f22baee7700 1 --2- 172.21.15.87:0/4218113192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22b406a3e0 0x7f22b40b11d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:05.556 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.553+0000 7f22baee7700 1 -- 172.21.15.87:0/4218113192 >> 172.21.15.87:0/4218113192 conn(0x7f22b40b53f0 msgr2=0x7f22b415c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:05.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.553+0000 7f22baee7700 1 -- 172.21.15.87:0/4218113192 shutdown_connections 2023-03-30T08:11:05.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:05.553+0000 7f22baee7700 1 -- 172.21.15.87:0/4218113192 wait complete. 2023-03-30T08:11:05.574 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-03-30T08:11:05.575 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-30T08:11:05.575 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2023-03-30T08:11:05.575 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-03-30T08:11:05.575 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-03-30T08:11:05.576 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-03-30T08:11:05.576 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-30T08:11:05.576 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-30T08:11:05.576 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-03-30T08:11:05.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:05.577 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2023-03-30T08:11:05.592 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-30T08:11:05.592 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-30T08:11:05.592 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2023-03-30T08:11:05.592 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:05.592 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2023-03-30T08:11:05.592 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:05.593 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:11:05.593 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:05.593 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2023-03-30T08:11:05.593 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:11:05.593 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:05.593 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2023-03-30T08:11:05.593 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:11:05.594 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:05.594 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-30T08:11:05.594 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:05.594 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-03-30T08:11:05.594 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42480sec preferred_lft 42480sec 2023-03-30T08:11:05.594 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2023-03-30T08:11:05.594 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:05.594 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-03-30T08:11:05.595 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:18:c5:86:06 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:05.595 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-03-30T08:11:05.595 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:05.596 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-03-30T08:11:05.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:05.597 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-03-30T08:11:05.597 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-03-30T08:11:05.597 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2023-03-30T08:11:05.597 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2023-03-30T08:11:05.598 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2023-03-30T08:11:05.598 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-03-30T08:11:05.598 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-03-30T08:11:05.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:05.738 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-30T08:11:05.766 INFO:teuthology.orchestra.run.smithi087.stdout:1 2023-03-30T08:11:05.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:05.769 DEBUG:teuthology.orchestra.run.smithi087:> route 2023-03-30T08:11:05.844 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2023-03-30T08:11:05.845 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-30T08:11:05.845 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-03-30T08:11:05.845 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-30T08:11:05.845 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-03-30T08:11:05.845 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-03-30T08:11:05.845 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-03-30T08:11:05.845 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-30T08:11:05.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:05.846 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-03-30T08:11:05.847 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-03-30T08:11:05.847 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-30T08:11:05.847 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-30T08:11:05.847 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-30T08:11:05.848 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-03-30T08:11:05.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:05.971 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2023-03-30T08:11:05.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:05.982 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2023-03-30T08:11:06.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:06.038 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-03-30T08:11:06.039 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-03-30T08:11:06.039 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-03-30T08:11:06.039 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-03-30T08:11:06.039 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-03-30T08:11:06.140 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-03-30T08:11:06.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:06.141 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-03-30T08:11:06.141 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-03-30T08:11:06.141 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-03-30T08:11:06.141 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-03-30T08:11:06.142 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-03-30T08:11:06.142 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-03-30T08:11:06.142 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-03-30T08:11:06.143 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-03-30T08:11:06.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:06.289 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-03-30T08:11:06.289 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-03-30T08:11:06.290 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2023-03-30T08:11:06.290 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2023-03-30T08:11:06.290 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-03-30T08:11:06.352 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-03-30T08:11:06.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-30T08:11:06.353 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-03-30T08:11:06.367 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-03-30T08:11:06.367 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-30T08:11:06.368 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-03-30T08:11:06.421 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2023-03-30T08:11:06.493 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-03-30T08:11:06.493 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-03-30T08:11:06.564 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-03-30T08:11:06.566 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-03-30T08:11:06.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:06.568 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2023-03-30T08:11:06.626 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-03-30T08:11:06.626 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-03-30T08:11:06.671 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2023-03-30T08:11:06.702 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-03-30T08:11:06.702 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-03-30T08:11:06.775 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-03-30T08:11:06.777 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-03-30T08:11:06.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:06.779 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2023-03-30T08:11:06.809 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:2023-03-30T08:11:06.805+0000 7febfd190640 -1 init, newargv = 0x55d9ce163a30 newargc=15 2023-03-30T08:11:06.809 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:ceph-fuse[40010]: starting ceph client 2023-03-30T08:11:06.825 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:ceph-fuse[40010]: starting fuse 2023-03-30T08:11:07.920 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2023-03-30T08:11:07.953 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-03-30T08:11:07.953 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-03-30T08:11:08.025 INFO:teuthology.orchestra.run.smithi087.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-03-30T08:11:08.027 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-03-30T08:11:08.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:08.029 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2023-03-30T08:11:08.085 INFO:teuthology.orchestra.run.smithi087.stdout:48 2023-03-30T08:11:08.086 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [48] 2023-03-30T08:11:08.086 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-03-30T08:11:08.086 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2023-03-30T08:11:08.087 DEBUG:teuthology.orchestra.run.smithi087:> import re 2023-03-30T08:11:08.087 DEBUG:teuthology.orchestra.run.smithi087:> import os 2023-03-30T08:11:08.087 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2023-03-30T08:11:08.088 DEBUG:teuthology.orchestra.run.smithi087:> 2023-03-30T08:11:08.088 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2023-03-30T08:11:08.088 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-03-30T08:11:08.088 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2023-03-30T08:11:08.089 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-03-30T08:11:08.089 DEBUG:teuthology.orchestra.run.smithi087:> 2023-03-30T08:11:08.089 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2023-03-30T08:11:08.090 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2023-03-30T08:11:08.090 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2023-03-30T08:11:08.090 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2023-03-30T08:11:08.090 DEBUG:teuthology.orchestra.run.smithi087:> 2023-03-30T08:11:08.091 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2023-03-30T08:11:08.091 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-03-30T08:11:08.091 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2023-03-30T08:11:08.092 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-03-30T08:11:08.092 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2023-03-30T08:11:08.092 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2023-03-30T08:11:08.093 DEBUG:teuthology.orchestra.run.smithi087:> return f 2023-03-30T08:11:08.093 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-03-30T08:11:08.093 DEBUG:teuthology.orchestra.run.smithi087:> 2023-03-30T08:11:08.093 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.admin")) 2023-03-30T08:11:08.094 DEBUG:teuthology.orchestra.run.smithi087:> ' 2023-03-30T08:11:08.236 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.admin.40010.asok 2023-03-30T08:11:08.421 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.40010.asok 2023-03-30T08:11:08.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:08.422 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.40010.asok status 2023-03-30T08:11:08.610 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-03-30T08:11:08.611 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2023-03-30T08:11:08.611 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "f03d69a8741c605ae6711afe2c9991ac46095f7d", 2023-03-30T08:11:08.611 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 18.0.0-3066-gf03d69a8 (f03d69a8741c605ae6711afe2c9991ac46095f7d) reef (dev)", 2023-03-30T08:11:08.611 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "admin", 2023-03-30T08:11:08.611 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2023-03-30T08:11:08.611 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-03-30T08:11:08.612 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "40010", 2023-03-30T08:11:08.612 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2023-03-30T08:11:08.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:11:08.612 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2023-03-30T08:11:08.612 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2023-03-30T08:11:08.612 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4446, 2023-03-30T08:11:08.612 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2023-03-30T08:11:08.613 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2023-03-30T08:11:08.613 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2023-03-30T08:11:08.613 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 4446 2023-03-30T08:11:08.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:11:08.613 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2023-03-30T08:11:08.613 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2023-03-30T08:11:08.614 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2023-03-30T08:11:08.614 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1550702031 2023-03-30T08:11:08.614 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:11:08.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:11:08.614 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2023-03-30T08:11:08.614 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2023-03-30T08:11:08.614 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2023-03-30T08:11:08.615 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1550702031 2023-03-30T08:11:08.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:11:08.615 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.4446 192.168.0.1:0/1550702031", 2023-03-30T08:11:08.615 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/1550702031", 2023-03-30T08:11:08.615 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2023-03-30T08:11:08.615 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 7, 2023-03-30T08:11:08.615 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 28, 2023-03-30T08:11:08.615 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2023-03-30T08:11:08.616 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2023-03-30T08:11:08.616 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2023-03-30T08:11:08.616 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-03-30T08:11:08.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:08.624 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2023-03-30T08:11:08.625 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-03-30T08:11:08.641 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2023-03-30T08:11:08.642 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-03-30T08:11:08.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:08.643 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-03-30T08:11:08.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:08.718 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-03-30T08:11:08.817 INFO:teuthology.orchestra.run.smithi087.stdout:# file: . 2023-03-30T08:11:08.817 INFO:teuthology.orchestra.run.smithi087.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-03-30T08:11:08.817 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:08.818 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:11:08.819 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:08.833 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:09.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.037+0000 7fbac98dc700 1 Processor -- start 2023-03-30T08:11:09.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.037+0000 7fbac98dc700 1 -- start start 2023-03-30T08:11:09.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.037+0000 7fbac98dc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbac40b3f30 0x7fbac40b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.037+0000 7fbac98dc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac40af350 0x7fbac406c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.037+0000 7fbac98dc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac406b670 con 0x7fbac406a6e0 2023-03-30T08:11:09.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.037+0000 7fbac98dc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac406b0b0 con 0x7fbac40b3f30 2023-03-30T08:11:09.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.037+0000 7fbac98dc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac406b390 con 0x7fbac40af350 2023-03-30T08:11:09.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.041+0000 7fbac88da700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbac40b3f30 0x7fbac40b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.041+0000 7fbac90db700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac40af350 0x7fbac406c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.041+0000 7fbabbfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fbac406a6e0 0x7fbac40aec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:34086/0 (socket says 172.21.15.87:34086) 2023-03-30T08:11:09.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.041+0000 7fbac88da700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbac40b3f30 0x7fbac40b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:56488/0 (socket says 172.21.15.87:56488) 2023-03-30T08:11:09.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.041+0000 7fbabbfff700 1 -- 172.21.15.87:0/3327935085 learned_addr learned my addr 172.21.15.87:0/3327935085 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:09.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.041+0000 7fbac90db700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac40af350 0x7fbac406c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:57454/0 (socket says 172.21.15.87:57454) 2023-03-30T08:11:09.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.041+0000 7fbac88da700 1 -- 172.21.15.87:0/3327935085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac40af350 msgr2=0x7fbac406c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:09.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.041+0000 7fbac88da700 1 --2- 172.21.15.87:0/3327935085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac40af350 0x7fbac406c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.041+0000 7fbac88da700 1 -- 172.21.15.87:0/3327935085 >> v1:172.21.15.115:6789/0 conn(0x7fbac406a6e0 legacy=0x7fbac40aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:09.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.041+0000 7fbac88da700 1 -- 172.21.15.87:0/3327935085 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac40aded0 con 0x7fbac40b3f30 2023-03-30T08:11:09.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.041+0000 7fbac90db700 1 --2- 172.21.15.87:0/3327935085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac40af350 0x7fbac406c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:09.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.041+0000 7fbac88da700 1 --2- 172.21.15.87:0/3327935085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbac40b3f30 0x7fbac40b0c10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009850 tx=0x7fbac0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a337348c6ddb892 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:09.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.041+0000 7fbabb7fe700 1 -- 172.21.15.87:0/3327935085 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0011830 con 0x7fbac40b3f30 2023-03-30T08:11:09.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.041+0000 7fbabb7fe700 1 -- 172.21.15.87:0/3327935085 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac0011990 con 0x7fbac40b3f30 2023-03-30T08:11:09.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.041+0000 7fbabb7fe700 1 -- 172.21.15.87:0/3327935085 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0011d40 con 0x7fbac40b3f30 2023-03-30T08:11:09.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.045+0000 7fbac98dc700 1 -- 172.21.15.87:0/3327935085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbac40b3f30 msgr2=0x7fbac40b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:09.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.045+0000 7fbac98dc700 1 --2- 172.21.15.87:0/3327935085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbac40b3f30 0x7fbac40b0c10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009850 tx=0x7fbac0009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:09.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.045+0000 7fbac98dc700 1 -- 172.21.15.87:0/3327935085 shutdown_connections 2023-03-30T08:11:09.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.045+0000 7fbac98dc700 1 --2- 172.21.15.87:0/3327935085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac40af350 0x7fbac406c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.045+0000 7fbac98dc700 1 --2- 172.21.15.87:0/3327935085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbac40b3f30 0x7fbac40b0c10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.045+0000 7fbac98dc700 1 -- 172.21.15.87:0/3327935085 >> 172.21.15.87:0/3327935085 conn(0x7fbac40cf410 msgr2=0x7fbac40cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:09.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.045+0000 7fbac98dc700 1 -- 172.21.15.87:0/3327935085 shutdown_connections 2023-03-30T08:11:09.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.045+0000 7fbac98dc700 1 -- 172.21.15.87:0/3327935085 wait complete. 2023-03-30T08:11:09.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.045+0000 7fbac98dc700 1 Processor -- start 2023-03-30T08:11:09.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.045+0000 7fbac98dc700 1 -- start start 2023-03-30T08:11:09.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbac98dc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac406a6e0 0x7fbac4157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbac98dc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac40af350 0x7fbac4158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbac98dc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbac40b3f30 0x7fbac40c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbac98dc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40c5d90 con 0x7fbac40af350 2023-03-30T08:11:09.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbac98dc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac4157ef0 con 0x7fbac40b3f30 2023-03-30T08:11:09.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbac98dc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac41581d0 con 0x7fbac406a6e0 2023-03-30T08:11:09.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbabbfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac40af350 0x7fbac4158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbabbfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac40af350 0x7fbac4158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51444/0 (socket says 172.21.15.87:51444) 2023-03-30T08:11:09.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbabbfff700 1 -- 172.21.15.87:0/1887132019 learned_addr learned my addr 172.21.15.87:0/1887132019 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:09.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbac90db700 1 --2- 172.21.15.87:0/1887132019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbac40b3f30 0x7fbac40c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbac88da700 1 --2- 172.21.15.87:0/1887132019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac406a6e0 0x7fbac4157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbabbfff700 1 -- 172.21.15.87:0/1887132019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac406a6e0 msgr2=0x7fbac4157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:09.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbabbfff700 1 --2- 172.21.15.87:0/1887132019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac406a6e0 0x7fbac4157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbabbfff700 1 -- 172.21.15.87:0/1887132019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbac40b3f30 msgr2=0x7fbac40c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:09.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbabbfff700 1 --2- 172.21.15.87:0/1887132019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbac40b3f30 0x7fbac40c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbabbfff700 1 -- 172.21.15.87:0/1887132019 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc009a70 con 0x7fbac40af350 2023-03-30T08:11:09.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbabbfff700 1 --2- 172.21.15.87:0/1887132019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac40af350 0x7fbac4158f90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbab4001eb0 tx=0x7fbab400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:09.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbab97fa700 1 -- 172.21.15.87:0/1887132019 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4005d90 con 0x7fbac40af350 2023-03-30T08:11:09.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbab97fa700 1 -- 172.21.15.87:0/1887132019 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab40070d0 con 0x7fbac40af350 2023-03-30T08:11:09.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbab97fa700 1 -- 172.21.15.87:0/1887132019 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4007440 con 0x7fbac40af350 2023-03-30T08:11:09.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbac98dc700 1 -- 172.21.15.87:0/1887132019 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac00094b0 con 0x7fbac40af350 2023-03-30T08:11:09.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.049+0000 7fbac98dc700 1 -- 172.21.15.87:0/1887132019 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac40b4300 con 0x7fbac40af350 2023-03-30T08:11:09.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.053+0000 7fbac98dc700 1 -- 172.21.15.87:0/1887132019 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac40ae1b0 con 0x7fbac40af350 2023-03-30T08:11:09.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.053+0000 7fbab97fa700 1 -- 172.21.15.87:0/1887132019 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fbab40075a0 con 0x7fbac40af350 2023-03-30T08:11:09.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.053+0000 7fbab97fa700 1 --2- 172.21.15.87:0/1887132019 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbab00653f0 0x7fbab00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.053+0000 7fbab97fa700 1 -- 172.21.15.87:0/1887132019 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbab4081ed0 con 0x7fbac40af350 2023-03-30T08:11:09.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.057+0000 7fbac88da700 1 --2- 172.21.15.87:0/1887132019 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbab00653f0 0x7fbab00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.060 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.057+0000 7fbac88da700 1 --2- 172.21.15.87:0/1887132019 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbab00653f0 0x7fbab00678a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbac00090b0 tx=0x7fbac0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:09.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.061+0000 7fbab97fa700 1 -- 172.21.15.87:0/1887132019 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fbab404a5e0 con 0x7fbac40af350 2023-03-30T08:11:09.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.233+0000 7fbac98dc700 1 -- 172.21.15.87:0/1887132019 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbac406ab60 con 0x7fbac40af350 2023-03-30T08:11:09.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.233+0000 7fbab97fa700 1 -- 172.21.15.87:0/1887132019 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19652 (secure 0 0 0) 0x7fbab404f900 con 0x7fbac40af350 2023-03-30T08:11:09.238 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:09.239 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":28,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:02.841070+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:09.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.237+0000 7fbac98dc700 1 -- 172.21.15.87:0/1887132019 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbab00653f0 msgr2=0x7fbab00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:09.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.237+0000 7fbac98dc700 1 --2- 172.21.15.87:0/1887132019 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbab00653f0 0x7fbab00678a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbac00090b0 tx=0x7fbac0008030 comp rx=0 tx=0).stop 2023-03-30T08:11:09.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.237+0000 7fbac98dc700 1 -- 172.21.15.87:0/1887132019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac40af350 msgr2=0x7fbac4158f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:09.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.237+0000 7fbac98dc700 1 --2- 172.21.15.87:0/1887132019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac40af350 0x7fbac4158f90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbab4001eb0 tx=0x7fbab400c860 comp rx=0 tx=0).stop 2023-03-30T08:11:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.237+0000 7fbac98dc700 1 -- 172.21.15.87:0/1887132019 shutdown_connections 2023-03-30T08:11:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.237+0000 7fbac98dc700 1 --2- 172.21.15.87:0/1887132019 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbab00653f0 0x7fbab00678a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.237+0000 7fbac98dc700 1 --2- 172.21.15.87:0/1887132019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbac40b3f30 0x7fbac40c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.237+0000 7fbac98dc700 1 --2- 172.21.15.87:0/1887132019 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbac40af350 0x7fbac4158f90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.237+0000 7fbac98dc700 1 --2- 172.21.15.87:0/1887132019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbac406a6e0 0x7fbac4157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.237+0000 7fbac98dc700 1 -- 172.21.15.87:0/1887132019 >> 172.21.15.87:0/1887132019 conn(0x7fbac40cf410 msgr2=0x7fbac40ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:09.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.237+0000 7fbac98dc700 1 -- 172.21.15.87:0/1887132019 shutdown_connections 2023-03-30T08:11:09.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.237+0000 7fbac98dc700 1 -- 172.21.15.87:0/1887132019 wait complete. 2023-03-30T08:11:09.264 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-30T08:10:56.407927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-30T08:10:57.359214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-30T08:11:00.430972+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-30T08:11:09.265 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T08:11:09.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.417+0000 7f38e09ef700 1 Processor -- start 2023-03-30T08:11:09.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.417+0000 7f38e09ef700 1 -- start start 2023-03-30T08:11:09.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38e09ef700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38dc159050 0x7f38dc069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38e09ef700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f38dc15cba0 0x7f38dc0cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38e09ef700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f38dc0ca4b0 0x7f38dc0ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38e09ef700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc0afb10 con 0x7f38dc0ca4b0 2023-03-30T08:11:09.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38e09ef700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc0cae70 con 0x7f38dc15cba0 2023-03-30T08:11:09.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38e09ef700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0afca0 con 0x7f38dc159050 2023-03-30T08:11:09.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38dbfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f38dc0ca4b0 0x7f38dc0ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38daffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f38dc15cba0 0x7f38dc0cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38dbfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f38dc0ca4b0 0x7f38dc0ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51458/0 (socket says 172.21.15.87:51458) 2023-03-30T08:11:09.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38dbfff700 1 -- 172.21.15.87:0/4143018197 learned_addr learned my addr 172.21.15.87:0/4143018197 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:09.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38db7fe700 1 --2- 172.21.15.87:0/4143018197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38dc159050 0x7f38dc069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38dbfff700 1 -- 172.21.15.87:0/4143018197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38dc159050 msgr2=0x7f38dc069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:09.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38dbfff700 1 --2- 172.21.15.87:0/4143018197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38dc159050 0x7f38dc069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38dbfff700 1 -- 172.21.15.87:0/4143018197 >> v2:172.21.15.115:3300/0 conn(0x7f38dc15cba0 msgr2=0x7f38dc0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:09.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38dbfff700 1 --2- 172.21.15.87:0/4143018197 >> v2:172.21.15.115:3300/0 conn(0x7f38dc15cba0 0x7f38dc0cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38dbfff700 1 -- 172.21.15.87:0/4143018197 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc15d110 con 0x7f38dc0ca4b0 2023-03-30T08:11:09.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.421+0000 7f38daffd700 1 --2- 172.21.15.87:0/4143018197 >> v2:172.21.15.115:3300/0 conn(0x7f38dc15cba0 0x7f38dc0cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:09.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.425+0000 7f38dbfff700 1 --2- 172.21.15.87:0/4143018197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38dc0ca4b0 0x7f38dc0ca930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f38dc06ff70 tx=0x7f38d400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba810403ee5c01a7 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:09.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.425+0000 7f38da7fc700 1 -- 172.21.15.87:0/4143018197 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4010070 con 0x7f38dc0ca4b0 2023-03-30T08:11:09.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.425+0000 7f38da7fc700 1 -- 172.21.15.87:0/4143018197 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d400dce0 con 0x7f38dc0ca4b0 2023-03-30T08:11:09.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.425+0000 7f38da7fc700 1 -- 172.21.15.87:0/4143018197 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d400b310 con 0x7f38dc0ca4b0 2023-03-30T08:11:09.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.425+0000 7f38e09ef700 1 -- 172.21.15.87:0/4143018197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38dc0ca4b0 msgr2=0x7f38dc0ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:09.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.425+0000 7f38e09ef700 1 --2- 172.21.15.87:0/4143018197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38dc0ca4b0 0x7f38dc0ca930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f38dc06ff70 tx=0x7f38d400d430 comp rx=0 tx=0).stop 2023-03-30T08:11:09.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.425+0000 7f38e09ef700 1 -- 172.21.15.87:0/4143018197 shutdown_connections 2023-03-30T08:11:09.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.425+0000 7f38e09ef700 1 --2- 172.21.15.87:0/4143018197 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38dc0ca4b0 0x7f38dc0ca930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.425+0000 7f38e09ef700 1 --2- 172.21.15.87:0/4143018197 >> v2:172.21.15.115:3300/0 conn(0x7f38dc15cba0 0x7f38dc0cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.425+0000 7f38e09ef700 1 --2- 172.21.15.87:0/4143018197 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38dc159050 0x7f38dc069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.425+0000 7f38e09ef700 1 -- 172.21.15.87:0/4143018197 >> 172.21.15.87:0/4143018197 conn(0x7f38dc0cf410 msgr2=0x7f38dc0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:09.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.425+0000 7f38e09ef700 1 -- 172.21.15.87:0/4143018197 shutdown_connections 2023-03-30T08:11:09.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.425+0000 7f38e09ef700 1 -- 172.21.15.87:0/4143018197 wait complete. 2023-03-30T08:11:09.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.429+0000 7f38e09ef700 1 Processor -- start 2023-03-30T08:11:09.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.429+0000 7f38e09ef700 1 -- start start 2023-03-30T08:11:09.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.429+0000 7f38e09ef700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38dc0ca4b0 0x7f38dc1501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.429+0000 7f38e09ef700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38dc159050 0x7f38dc148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.429+0000 7f38e09ef700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38dc15cba0 0x7f38dc15b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.429+0000 7f38e09ef700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0c3410 con 0x7f38dc159050 2023-03-30T08:11:09.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.429+0000 7f38e09ef700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0c2800 con 0x7f38dc15cba0 2023-03-30T08:11:09.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.429+0000 7f38e09ef700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0c2ae0 con 0x7f38dc0ca4b0 2023-03-30T08:11:09.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.429+0000 7f38daffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38dc159050 0x7f38dc148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38daffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38dc159050 0x7f38dc148a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51472/0 (socket says 172.21.15.87:51472) 2023-03-30T08:11:09.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38daffd700 1 -- 172.21.15.87:0/724248917 learned_addr learned my addr 172.21.15.87:0/724248917 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:09.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38db7fe700 1 --2- 172.21.15.87:0/724248917 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38dc0ca4b0 0x7f38dc1501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38dbfff700 1 --2- 172.21.15.87:0/724248917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38dc15cba0 0x7f38dc15b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38daffd700 1 -- 172.21.15.87:0/724248917 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38dc0ca4b0 msgr2=0x7f38dc1501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:09.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38daffd700 1 --2- 172.21.15.87:0/724248917 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38dc0ca4b0 0x7f38dc1501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38daffd700 1 -- 172.21.15.87:0/724248917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38dc15cba0 msgr2=0x7f38dc15b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:09.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38daffd700 1 --2- 172.21.15.87:0/724248917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38dc15cba0 0x7f38dc15b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38daffd700 1 -- 172.21.15.87:0/724248917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d00094b0 con 0x7f38dc159050 2023-03-30T08:11:09.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38daffd700 1 --2- 172.21.15.87:0/724248917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38dc159050 0x7f38dc148a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38d000ebe0 tx=0x7f38d000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:09.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38c3fff700 1 -- 172.21.15.87:0/724248917 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d0009770 con 0x7f38dc159050 2023-03-30T08:11:09.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38c3fff700 1 -- 172.21.15.87:0/724248917 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d000c850 con 0x7f38dc159050 2023-03-30T08:11:09.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38c3fff700 1 -- 172.21.15.87:0/724248917 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d000cbe0 con 0x7f38dc159050 2023-03-30T08:11:09.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38e09ef700 1 -- 172.21.15.87:0/724248917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d400bd40 con 0x7f38dc159050 2023-03-30T08:11:09.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38e09ef700 1 -- 172.21.15.87:0/724248917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc15d6d0 con 0x7f38dc159050 2023-03-30T08:11:09.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.433+0000 7f38e09ef700 1 -- 172.21.15.87:0/724248917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc15d3f0 con 0x7f38dc159050 2023-03-30T08:11:09.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.437+0000 7f38c3fff700 1 -- 172.21.15.87:0/724248917 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f38d000cd40 con 0x7f38dc159050 2023-03-30T08:11:09.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.437+0000 7f38c3fff700 1 --2- 172.21.15.87:0/724248917 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f38c80653f0 0x7f38c80678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.437+0000 7f38c3fff700 1 -- 172.21.15.87:0/724248917 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f38d0082ba0 con 0x7f38dc159050 2023-03-30T08:11:09.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.437+0000 7f38db7fe700 1 --2- 172.21.15.87:0/724248917 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f38c80653f0 0x7f38c80678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.441+0000 7f38db7fe700 1 --2- 172.21.15.87:0/724248917 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f38c80653f0 0x7f38c80678a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009b70 tx=0x7f38cc009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:09.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.441+0000 7f38c3fff700 1 -- 172.21.15.87:0/724248917 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f38d0053ec0 con 0x7f38dc159050 2023-03-30T08:11:09.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.613+0000 7f38e09ef700 1 -- 172.21.15.87:0/724248917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38dc15d9b0 con 0x7f38dc159050 2023-03-30T08:11:09.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.613+0000 7f38c3fff700 1 -- 172.21.15.87:0/724248917 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38d0053ab0 con 0x7f38dc159050 2023-03-30T08:11:09.616 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T08:11:09.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.617+0000 7f38e09ef700 1 -- 172.21.15.87:0/724248917 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f38c80653f0 msgr2=0x7f38c80678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:09.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.617+0000 7f38e09ef700 1 --2- 172.21.15.87:0/724248917 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f38c80653f0 0x7f38c80678a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009b70 tx=0x7f38cc009240 comp rx=0 tx=0).stop 2023-03-30T08:11:09.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.617+0000 7f38e09ef700 1 -- 172.21.15.87:0/724248917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38dc159050 msgr2=0x7f38dc148a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:09.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.617+0000 7f38e09ef700 1 --2- 172.21.15.87:0/724248917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38dc159050 0x7f38dc148a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38d000ebe0 tx=0x7f38d000eef0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.617+0000 7f38e09ef700 1 -- 172.21.15.87:0/724248917 shutdown_connections 2023-03-30T08:11:09.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.617+0000 7f38e09ef700 1 --2- 172.21.15.87:0/724248917 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f38c80653f0 0x7f38c80678a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.617+0000 7f38e09ef700 1 --2- 172.21.15.87:0/724248917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38dc15cba0 0x7f38dc15b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.617+0000 7f38e09ef700 1 --2- 172.21.15.87:0/724248917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38dc159050 0x7f38dc148a90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.617+0000 7f38e09ef700 1 --2- 172.21.15.87:0/724248917 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f38dc0ca4b0 0x7f38dc1501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.617+0000 7f38e09ef700 1 -- 172.21.15.87:0/724248917 >> 172.21.15.87:0/724248917 conn(0x7f38dc0cf410 msgr2=0x7f38dc06ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:09.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.617+0000 7f38e09ef700 1 -- 172.21.15.87:0/724248917 shutdown_connections 2023-03-30T08:11:09.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.617+0000 7f38e09ef700 1 -- 172.21.15.87:0/724248917 wait complete. 2023-03-30T08:11:09.641 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T08:11:09.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.801+0000 7f44cc32d700 1 Processor -- start 2023-03-30T08:11:09.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.801+0000 7f44cc32d700 1 -- start start 2023-03-30T08:11:09.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.805+0000 7f44cc32d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c40b15a0 0x7f44c40b1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.805+0000 7f44cc32d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f44c406a0b0 0x7f44c406a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.805+0000 7f44cc32d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c40b1eb0 con 0x7f44c415c860 2023-03-30T08:11:09.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.805+0000 7f44cc32d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c406aa70 con 0x7f44c406a0b0 2023-03-30T08:11:09.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.805+0000 7f44cc32d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c40cde10 con 0x7f44c40b15a0 2023-03-30T08:11:09.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.805+0000 7f44c98c8700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f44c415c860 0x7f44c40cebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43520/0 (socket says 172.21.15.87:43520) 2023-03-30T08:11:09.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.805+0000 7f44c98c8700 1 -- 172.21.15.87:0/616179207 learned_addr learned my addr 172.21.15.87:0/616179207 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:09.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.805+0000 7f44ca0c9700 1 --2- 172.21.15.87:0/616179207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c40b15a0 0x7f44c40b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.805+0000 7f44ca8ca700 1 --2- 172.21.15.87:0/616179207 >> v2:172.21.15.115:3300/0 conn(0x7f44c406a0b0 0x7f44c406a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.805+0000 7f44c90c7700 1 -- 172.21.15.87:0/616179207 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264224236 0 0) 0x7f44c40b1eb0 con 0x7f44c415c860 2023-03-30T08:11:09.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.805+0000 7f44c90c7700 1 -- 172.21.15.87:0/616179207 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44b00035d0 con 0x7f44c415c860 2023-03-30T08:11:09.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.805+0000 7f44ca8ca700 1 -- 172.21.15.87:0/616179207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c40b15a0 msgr2=0x7f44c40b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:09.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.805+0000 7f44ca8ca700 1 --2- 172.21.15.87:0/616179207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c40b15a0 0x7f44c40b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.805+0000 7f44ca8ca700 1 -- 172.21.15.87:0/616179207 >> v1:172.21.15.87:6789/0 conn(0x7f44c415c860 legacy=0x7f44c40cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:09.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.805+0000 7f44ca8ca700 1 -- 172.21.15.87:0/616179207 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c40ce0f0 con 0x7f44c406a0b0 2023-03-30T08:11:09.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.809+0000 7f44ca8ca700 1 --2- 172.21.15.87:0/616179207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c406a0b0 0x7f44c406a530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009d90 tx=0x7f44bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93b3f2b9473b792c server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:09.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.809+0000 7f44c90c7700 1 -- 172.21.15.87:0/616179207 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc00e070 con 0x7f44c406a0b0 2023-03-30T08:11:09.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.809+0000 7f44c90c7700 1 -- 172.21.15.87:0/616179207 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc00bb20 con 0x7f44c406a0b0 2023-03-30T08:11:09.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.809+0000 7f44c90c7700 1 -- 172.21.15.87:0/616179207 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc012430 con 0x7f44c406a0b0 2023-03-30T08:11:09.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.809+0000 7f44cc32d700 1 -- 172.21.15.87:0/616179207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c406a0b0 msgr2=0x7f44c406a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:09.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.809+0000 7f44cc32d700 1 --2- 172.21.15.87:0/616179207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c406a0b0 0x7f44c406a530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009d90 tx=0x7f44bc00b330 comp rx=0 tx=0).stop 2023-03-30T08:11:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.809+0000 7f44cc32d700 1 -- 172.21.15.87:0/616179207 shutdown_connections 2023-03-30T08:11:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.809+0000 7f44cc32d700 1 --2- 172.21.15.87:0/616179207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c406a0b0 0x7f44c406a530 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.809+0000 7f44cc32d700 1 --2- 172.21.15.87:0/616179207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c40b15a0 0x7f44c40b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.809+0000 7f44cc32d700 1 -- 172.21.15.87:0/616179207 >> 172.21.15.87:0/616179207 conn(0x7f44c40cc5a0 msgr2=0x7f44c40cc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.809+0000 7f44cc32d700 1 -- 172.21.15.87:0/616179207 shutdown_connections 2023-03-30T08:11:09.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.809+0000 7f44cc32d700 1 -- 172.21.15.87:0/616179207 wait complete. 2023-03-30T08:11:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44cc32d700 1 Processor -- start 2023-03-30T08:11:09.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44cc32d700 1 -- start start 2023-03-30T08:11:09.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44cc32d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c406a0b0 0x7f44c40ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44cc32d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c40b15a0 0x7f44c415d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44cc32d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c415ea90 0x7f44c40c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44cc32d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c40abfe0 con 0x7f44c40b15a0 2023-03-30T08:11:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44cc32d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c40ac150 con 0x7f44c406a0b0 2023-03-30T08:11:09.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44cc32d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c406bfa0 con 0x7f44c415ea90 2023-03-30T08:11:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44c98c8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c40b15a0 0x7f44c415d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44c98c8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c40b15a0 0x7f44c415d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56274/0 (socket says 172.21.15.87:56274) 2023-03-30T08:11:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44c98c8700 1 -- 172.21.15.87:0/981590008 learned_addr learned my addr 172.21.15.87:0/981590008 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:09.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44ca0c9700 1 --2- 172.21.15.87:0/981590008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c406a0b0 0x7f44c40ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44ca8ca700 1 --2- 172.21.15.87:0/981590008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c415ea90 0x7f44c40c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44c98c8700 1 -- 172.21.15.87:0/981590008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c415ea90 msgr2=0x7f44c40c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44c98c8700 1 --2- 172.21.15.87:0/981590008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c415ea90 0x7f44c40c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44c98c8700 1 -- 172.21.15.87:0/981590008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c406a0b0 msgr2=0x7f44c40ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44c98c8700 1 --2- 172.21.15.87:0/981590008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c406a0b0 0x7f44c40ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44c98c8700 1 -- 172.21.15.87:0/981590008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc009a70 con 0x7f44c40b15a0 2023-03-30T08:11:09.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44c98c8700 1 --2- 172.21.15.87:0/981590008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c40b15a0 0x7f44c415d650 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f44b400c4f0 tx=0x7f44b400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44baffd700 1 -- 172.21.15.87:0/981590008 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40074e0 con 0x7f44c40b15a0 2023-03-30T08:11:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44baffd700 1 -- 172.21.15.87:0/981590008 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b4007640 con 0x7f44c40b15a0 2023-03-30T08:11:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44baffd700 1 -- 172.21.15.87:0/981590008 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4005a50 con 0x7f44c40b15a0 2023-03-30T08:11:09.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.813+0000 7f44cc32d700 1 -- 172.21.15.87:0/981590008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c40ce6b0 con 0x7f44c40b15a0 2023-03-30T08:11:09.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.817+0000 7f44cc32d700 1 -- 172.21.15.87:0/981590008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c40ce3d0 con 0x7f44c40b15a0 2023-03-30T08:11:09.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.817+0000 7f44cc32d700 1 -- 172.21.15.87:0/981590008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c40cf2e0 con 0x7f44c40b15a0 2023-03-30T08:11:09.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.817+0000 7f44baffd700 1 -- 172.21.15.87:0/981590008 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f44b4005bb0 con 0x7f44c40b15a0 2023-03-30T08:11:09.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.821+0000 7f44baffd700 1 --2- 172.21.15.87:0/981590008 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f44a8065420 0x7f44a80678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:09.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.821+0000 7f44baffd700 1 -- 172.21.15.87:0/981590008 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f44b4081cb0 con 0x7f44c40b15a0 2023-03-30T08:11:09.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.821+0000 7f44ca0c9700 1 --2- 172.21.15.87:0/981590008 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f44a8065420 0x7f44a80678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:09.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.821+0000 7f44ca0c9700 1 --2- 172.21.15.87:0/981590008 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f44a8065420 0x7f44a80678d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f44c40b1da0 tx=0x7f44c0009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:09.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.825+0000 7f44baffd700 1 -- 172.21.15.87:0/981590008 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f44b404a5e0 con 0x7f44c40b15a0 2023-03-30T08:11:10.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.997+0000 7f44cc32d700 1 -- 172.21.15.87:0/981590008 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f44c4073ee0 con 0x7f44c40b15a0 2023-03-30T08:11:10.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:09.997+0000 7f44baffd700 1 -- 172.21.15.87:0/981590008 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f44b4017020 con 0x7f44c40b15a0 2023-03-30T08:11:10.002 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T08:11:10.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.001+0000 7f44cc32d700 1 -- 172.21.15.87:0/981590008 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f44a8065420 msgr2=0x7f44a80678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.001+0000 7f44cc32d700 1 --2- 172.21.15.87:0/981590008 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f44a8065420 0x7f44a80678d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f44c40b1da0 tx=0x7f44c0009240 comp rx=0 tx=0).stop 2023-03-30T08:11:10.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.001+0000 7f44cc32d700 1 -- 172.21.15.87:0/981590008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c40b15a0 msgr2=0x7f44c415d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.001+0000 7f44cc32d700 1 --2- 172.21.15.87:0/981590008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c40b15a0 0x7f44c415d650 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f44b400c4f0 tx=0x7f44b400c800 comp rx=0 tx=0).stop 2023-03-30T08:11:10.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.001+0000 7f44cc32d700 1 -- 172.21.15.87:0/981590008 shutdown_connections 2023-03-30T08:11:10.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.001+0000 7f44cc32d700 1 --2- 172.21.15.87:0/981590008 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f44a8065420 0x7f44a80678d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.001+0000 7f44cc32d700 1 --2- 172.21.15.87:0/981590008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f44c415ea90 0x7f44c40c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.001+0000 7f44cc32d700 1 --2- 172.21.15.87:0/981590008 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44c40b15a0 0x7f44c415d650 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.001+0000 7f44cc32d700 1 --2- 172.21.15.87:0/981590008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44c406a0b0 0x7f44c40ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.001+0000 7f44cc32d700 1 -- 172.21.15.87:0/981590008 >> 172.21.15.87:0/981590008 conn(0x7f44c40cc5a0 msgr2=0x7f44c40cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:10.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.001+0000 7f44cc32d700 1 -- 172.21.15.87:0/981590008 shutdown_connections 2023-03-30T08:11:10.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.001+0000 7f44cc32d700 1 -- 172.21.15.87:0/981590008 wait complete. 2023-03-30T08:11:10.025 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-30T08:11:10.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.184+0000 7f80c57d9700 1 Processor -- start 2023-03-30T08:11:10.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.184+0000 7f80c57d9700 1 -- start start 2023-03-30T08:11:10.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.188+0000 7f80c57d9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80c0156c20 0x7f80c0160c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.188+0000 7f80c57d9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f80c015cbf0 0x7f80c015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.188+0000 7f80c57d9700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c01601e0 con 0x7f80c00cf760 2023-03-30T08:11:10.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.188+0000 7f80c57d9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c01607a0 con 0x7f80c015cbf0 2023-03-30T08:11:10.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.188+0000 7f80c57d9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c0161170 con 0x7f80c0156c20 2023-03-30T08:11:10.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.188+0000 7f80be7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f80c015cbf0 0x7f80c015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.188+0000 7f80beffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80c0156c20 0x7f80c0160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.188+0000 7f80be7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f80c015cbf0 0x7f80c015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34420/0 (socket says 172.21.15.87:34420) 2023-03-30T08:11:10.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.188+0000 7f80be7fc700 1 -- 172.21.15.87:0/1782257151 learned_addr learned my addr 172.21.15.87:0/1782257151 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:10.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.188+0000 7f80bf7fe700 1 --1- 172.21.15.87:0/1782257151 >> v1:172.21.15.115:6789/0 conn(0x7f80c00cf760 0x7f80c00cfba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:49984/0 (socket says 172.21.15.87:49984) 2023-03-30T08:11:10.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.188+0000 7f80be7fc700 1 -- 172.21.15.87:0/1782257151 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80c0156c20 msgr2=0x7f80c0160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:10.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.188+0000 7f80be7fc700 1 --2- 172.21.15.87:0/1782257151 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80c0156c20 0x7f80c0160c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.188+0000 7f80be7fc700 1 -- 172.21.15.87:0/1782257151 >> v1:172.21.15.115:6789/0 conn(0x7f80c00cf760 legacy=0x7f80c00cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.188+0000 7f80be7fc700 1 -- 172.21.15.87:0/1782257151 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c015d6e0 con 0x7f80c015cbf0 2023-03-30T08:11:10.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.192+0000 7f80be7fc700 1 --2- 172.21.15.87:0/1782257151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80c015cbf0 0x7f80c015d040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009910 tx=0x7f80b4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75b84c44564eda4c server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:10.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.192+0000 7f80bdffb700 1 -- 172.21.15.87:0/1782257151 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4011830 con 0x7f80c015cbf0 2023-03-30T08:11:10.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.192+0000 7f80bdffb700 1 -- 172.21.15.87:0/1782257151 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b4011990 con 0x7f80c015cbf0 2023-03-30T08:11:10.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.192+0000 7f80bdffb700 1 -- 172.21.15.87:0/1782257151 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4011d40 con 0x7f80c015cbf0 2023-03-30T08:11:10.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.192+0000 7f80c57d9700 1 -- 172.21.15.87:0/1782257151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80c015cbf0 msgr2=0x7f80c015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.192+0000 7f80c57d9700 1 --2- 172.21.15.87:0/1782257151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80c015cbf0 0x7f80c015d040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009910 tx=0x7f80b4009c20 comp rx=0 tx=0).stop 2023-03-30T08:11:10.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.192+0000 7f80c57d9700 1 -- 172.21.15.87:0/1782257151 shutdown_connections 2023-03-30T08:11:10.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.192+0000 7f80c57d9700 1 --2- 172.21.15.87:0/1782257151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80c015cbf0 0x7f80c015d040 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.192+0000 7f80c57d9700 1 --2- 172.21.15.87:0/1782257151 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80c0156c20 0x7f80c0160c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.192+0000 7f80c57d9700 1 -- 172.21.15.87:0/1782257151 >> 172.21.15.87:0/1782257151 conn(0x7f80c006b2e0 msgr2=0x7f80c006b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:10.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.192+0000 7f80c57d9700 1 -- 172.21.15.87:0/1782257151 shutdown_connections 2023-03-30T08:11:10.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.192+0000 7f80c57d9700 1 -- 172.21.15.87:0/1782257151 wait complete. 2023-03-30T08:11:10.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.192+0000 7f80c57d9700 1 Processor -- start 2023-03-30T08:11:10.199 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80c57d9700 1 -- start start 2023-03-30T08:11:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80c57d9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80c00cf760 0x7f80c00c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80c57d9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80c0156c20 0x7f80c00c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80c57d9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80c015cbf0 0x7f80c00b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80c57d9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c00c7840 con 0x7f80c00cf760 2023-03-30T08:11:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80c57d9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c00c8040 con 0x7f80c0156c20 2023-03-30T08:11:10.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80c57d9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c00c8320 con 0x7f80c015cbf0 2023-03-30T08:11:10.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80beffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80c00cf760 0x7f80c00c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80beffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80c00cf760 0x7f80c00c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56290/0 (socket says 172.21.15.87:56290) 2023-03-30T08:11:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80beffd700 1 -- 172.21.15.87:0/4279693967 learned_addr learned my addr 172.21.15.87:0/4279693967 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80bf7fe700 1 --2- 172.21.15.87:0/4279693967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80c015cbf0 0x7f80c00b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80be7fc700 1 --2- 172.21.15.87:0/4279693967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80c0156c20 0x7f80c00c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80beffd700 1 -- 172.21.15.87:0/4279693967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80c015cbf0 msgr2=0x7f80c00b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80beffd700 1 --2- 172.21.15.87:0/4279693967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80c015cbf0 0x7f80c00b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80beffd700 1 -- 172.21.15.87:0/4279693967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80c0156c20 msgr2=0x7f80c00c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80beffd700 1 --2- 172.21.15.87:0/4279693967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80c0156c20 0x7f80c00c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80beffd700 1 -- 172.21.15.87:0/4279693967 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b4009570 con 0x7f80c00cf760 2023-03-30T08:11:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80beffd700 1 --2- 172.21.15.87:0/4279693967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80c00cf760 0x7f80c00c7a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f80b000efc0 tx=0x7f80b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80a77fe700 1 -- 172.21.15.87:0/4279693967 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b000cd10 con 0x7f80c00cf760 2023-03-30T08:11:10.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80a77fe700 1 -- 172.21.15.87:0/4279693967 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b000f040 con 0x7f80c00cf760 2023-03-30T08:11:10.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80c57d9700 1 -- 172.21.15.87:0/4279693967 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c0160430 con 0x7f80c00cf760 2023-03-30T08:11:10.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80a77fe700 1 -- 172.21.15.87:0/4279693967 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b00146a0 con 0x7f80c00cf760 2023-03-30T08:11:10.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.196+0000 7f80c57d9700 1 -- 172.21.15.87:0/4279693967 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c015d9c0 con 0x7f80c00cf760 2023-03-30T08:11:10.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.200+0000 7f80c57d9700 1 -- 172.21.15.87:0/4279693967 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c0156ff0 con 0x7f80c00cf760 2023-03-30T08:11:10.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.200+0000 7f80a77fe700 1 -- 172.21.15.87:0/4279693967 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f80b0014800 con 0x7f80c00cf760 2023-03-30T08:11:10.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.204+0000 7f80a77fe700 1 --2- 172.21.15.87:0/4279693967 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f80ac0653f0 0x7f80ac0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.204+0000 7f80a77fe700 1 -- 172.21.15.87:0/4279693967 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f80b00833c0 con 0x7f80c00cf760 2023-03-30T08:11:10.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.204+0000 7f80be7fc700 1 --2- 172.21.15.87:0/4279693967 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f80ac0653f0 0x7f80ac0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.204+0000 7f80be7fc700 1 --2- 172.21.15.87:0/4279693967 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f80ac0653f0 0x7f80ac0678a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f80b4000c00 tx=0x7f80b401d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:10.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.208+0000 7f80a77fe700 1 -- 172.21.15.87:0/4279693967 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f80b0050d50 con 0x7f80c00cf760 2023-03-30T08:11:10.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.376+0000 7f80c57d9700 1 -- 172.21.15.87:0/4279693967 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80c0073ee0 con 0x7f80c00cf760 2023-03-30T08:11:10.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.376+0000 7f80a77fe700 1 -- 172.21.15.87:0/4279693967 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80b0054370 con 0x7f80c00cf760 2023-03-30T08:11:10.380 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:10.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.376+0000 7f80c57d9700 1 -- 172.21.15.87:0/4279693967 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f80ac0653f0 msgr2=0x7f80ac0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.376+0000 7f80c57d9700 1 --2- 172.21.15.87:0/4279693967 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f80ac0653f0 0x7f80ac0678a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f80b4000c00 tx=0x7f80b401d040 comp rx=0 tx=0).stop 2023-03-30T08:11:10.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.376+0000 7f80c57d9700 1 -- 172.21.15.87:0/4279693967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80c00cf760 msgr2=0x7f80c00c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.376+0000 7f80c57d9700 1 --2- 172.21.15.87:0/4279693967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80c00cf760 0x7f80c00c7a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f80b000efc0 tx=0x7f80b000c3a0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.376+0000 7f80c57d9700 1 -- 172.21.15.87:0/4279693967 shutdown_connections 2023-03-30T08:11:10.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.376+0000 7f80c57d9700 1 --2- 172.21.15.87:0/4279693967 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f80ac0653f0 0x7f80ac0678a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.376+0000 7f80c57d9700 1 --2- 172.21.15.87:0/4279693967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80c015cbf0 0x7f80c00b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.376+0000 7f80c57d9700 1 --2- 172.21.15.87:0/4279693967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80c0156c20 0x7f80c00c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.376+0000 7f80c57d9700 1 --2- 172.21.15.87:0/4279693967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f80c00cf760 0x7f80c00c7a60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.376+0000 7f80c57d9700 1 -- 172.21.15.87:0/4279693967 >> 172.21.15.87:0/4279693967 conn(0x7f80c006b2e0 msgr2=0x7f80c00d2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:10.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.376+0000 7f80c57d9700 1 -- 172.21.15.87:0/4279693967 shutdown_connections 2023-03-30T08:11:10.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.376+0000 7f80c57d9700 1 -- 172.21.15.87:0/4279693967 wait complete. 2023-03-30T08:11:10.403 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-30T08:11:10.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.552+0000 7f8c75928700 1 Processor -- start 2023-03-30T08:11:10.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.552+0000 7f8c75928700 1 -- start start 2023-03-30T08:11:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c75928700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8c700b3f30 0x7f8c700b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c75928700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8c7006a6e0 0x7f8c700aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c75928700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c700af180 0x7f8c7015ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c75928700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c700af600 con 0x7f8c7006a6e0 2023-03-30T08:11:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c75928700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7006b670 con 0x7f8c700b3f30 2023-03-30T08:11:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c75928700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7006b0b0 con 0x7f8c700af180 2023-03-30T08:11:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c67fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8c7006a6e0 0x7f8c700aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c67fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8c7006a6e0 0x7f8c700aec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56304/0 (socket says 172.21.15.87:56304) 2023-03-30T08:11:10.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c67fff700 1 -- 172.21.15.87:0/497891031 learned_addr learned my addr 172.21.15.87:0/497891031 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:10.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c67fff700 1 -- 172.21.15.87:0/497891031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c700af180 msgr2=0x7f8c7015ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:10.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c67fff700 1 --2- 172.21.15.87:0/497891031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c700af180 0x7f8c7015ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c67fff700 1 -- 172.21.15.87:0/497891031 >> v2:172.21.15.115:3300/0 conn(0x7f8c700b3f30 msgr2=0x7f8c700b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:10.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c67fff700 1 --2- 172.21.15.87:0/497891031 >> v2:172.21.15.115:3300/0 conn(0x7f8c700b3f30 0x7f8c700b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c67fff700 1 -- 172.21.15.87:0/497891031 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7006b390 con 0x7f8c7006a6e0 2023-03-30T08:11:10.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c67fff700 1 --2- 172.21.15.87:0/497891031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c7006a6e0 0x7f8c700aec40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8c700cafe0 tx=0x7f8c60009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e16840d981c92b server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:10.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c677fe700 1 -- 172.21.15.87:0/497891031 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6000b8a0 con 0x7f8c7006a6e0 2023-03-30T08:11:10.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c677fe700 1 -- 172.21.15.87:0/497891031 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6000ba00 con 0x7f8c7006a6e0 2023-03-30T08:11:10.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c677fe700 1 -- 172.21.15.87:0/497891031 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6000bd90 con 0x7f8c7006a6e0 2023-03-30T08:11:10.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c75928700 1 -- 172.21.15.87:0/497891031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c7006a6e0 msgr2=0x7f8c700aec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.556+0000 7f8c75928700 1 --2- 172.21.15.87:0/497891031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c7006a6e0 0x7f8c700aec40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8c700cafe0 tx=0x7f8c60009bf0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.560+0000 7f8c75928700 1 -- 172.21.15.87:0/497891031 shutdown_connections 2023-03-30T08:11:10.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.560+0000 7f8c75928700 1 --2- 172.21.15.87:0/497891031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c700af180 0x7f8c7015ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.560+0000 7f8c75928700 1 --2- 172.21.15.87:0/497891031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c7006a6e0 0x7f8c700aec40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.560+0000 7f8c75928700 1 --2- 172.21.15.87:0/497891031 >> v2:172.21.15.115:3300/0 conn(0x7f8c700b3f30 0x7f8c700b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.560+0000 7f8c75928700 1 -- 172.21.15.87:0/497891031 >> 172.21.15.87:0/497891031 conn(0x7f8c700cf410 msgr2=0x7f8c700cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:10.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.560+0000 7f8c75928700 1 -- 172.21.15.87:0/497891031 shutdown_connections 2023-03-30T08:11:10.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.560+0000 7f8c75928700 1 -- 172.21.15.87:0/497891031 wait complete. 2023-03-30T08:11:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.564+0000 7f8c75928700 1 Processor -- start 2023-03-30T08:11:10.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.564+0000 7f8c75928700 1 -- start start 2023-03-30T08:11:10.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.564+0000 7f8c75928700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c7006a6e0 0x7f8c7014cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.564+0000 7f8c75928700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c700af180 0x7f8c7015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.564+0000 7f8c75928700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c700b3f30 0x7f8c700c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.564+0000 7f8c75928700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700c8dd0 con 0x7f8c700af180 2023-03-30T08:11:10.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.564+0000 7f8c75928700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700c9630 con 0x7f8c7006a6e0 2023-03-30T08:11:10.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.564+0000 7f8c75928700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7015d4b0 con 0x7f8c700b3f30 2023-03-30T08:11:10.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.564+0000 7f8c67fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c700af180 0x7f8c7015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.564+0000 7f8c74926700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c7006a6e0 0x7f8c7014cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.564+0000 7f8c67fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c700af180 0x7f8c7015c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56320/0 (socket says 172.21.15.87:56320) 2023-03-30T08:11:10.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.564+0000 7f8c67fff700 1 -- 172.21.15.87:0/2450637387 learned_addr learned my addr 172.21.15.87:0/2450637387 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:10.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.564+0000 7f8c75127700 1 --2- 172.21.15.87:0/2450637387 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c700b3f30 0x7f8c700c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.568+0000 7f8c74926700 1 -- 172.21.15.87:0/2450637387 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c700b3f30 msgr2=0x7f8c700c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.568+0000 7f8c74926700 1 --2- 172.21.15.87:0/2450637387 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c700b3f30 0x7f8c700c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.568+0000 7f8c74926700 1 -- 172.21.15.87:0/2450637387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c700af180 msgr2=0x7f8c7015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.568+0000 7f8c74926700 1 --2- 172.21.15.87:0/2450637387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c700af180 0x7f8c7015c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.568+0000 7f8c74926700 1 -- 172.21.15.87:0/2450637387 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c60009570 con 0x7f8c7006a6e0 2023-03-30T08:11:10.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.568+0000 7f8c67fff700 1 --2- 172.21.15.87:0/2450637387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c700af180 0x7f8c7015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:10.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.568+0000 7f8c74926700 1 --2- 172.21.15.87:0/2450637387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c7006a6e0 0x7f8c7014cb00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00bd70 tx=0x7f8c6c00bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:10.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.568+0000 7f8c657fa700 1 -- 172.21.15.87:0/2450637387 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00cc10 con 0x7f8c7006a6e0 2023-03-30T08:11:10.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.568+0000 7f8c657fa700 1 -- 172.21.15.87:0/2450637387 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c00cd90 con 0x7f8c7006a6e0 2023-03-30T08:11:10.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.568+0000 7f8c657fa700 1 -- 172.21.15.87:0/2450637387 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c014680 con 0x7f8c7006a6e0 2023-03-30T08:11:10.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.568+0000 7f8c75928700 1 -- 172.21.15.87:0/2450637387 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c700ae1b0 con 0x7f8c7006a6e0 2023-03-30T08:11:10.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.568+0000 7f8c75928700 1 -- 172.21.15.87:0/2450637387 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c700aded0 con 0x7f8c7006a6e0 2023-03-30T08:11:10.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.568+0000 7f8c75928700 1 -- 172.21.15.87:0/2450637387 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c700b4300 con 0x7f8c7006a6e0 2023-03-30T08:11:10.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.572+0000 7f8c657fa700 1 -- 172.21.15.87:0/2450637387 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f8c6c036ad0 con 0x7f8c7006a6e0 2023-03-30T08:11:10.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.572+0000 7f8c657fa700 1 --2- 172.21.15.87:0/2450637387 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8c5c065420 0x7f8c5c0678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.572+0000 7f8c657fa700 1 -- 172.21.15.87:0/2450637387 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c6c082a60 con 0x7f8c7006a6e0 2023-03-30T08:11:10.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.572+0000 7f8c67fff700 1 --2- 172.21.15.87:0/2450637387 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8c5c065420 0x7f8c5c0678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.576+0000 7f8c67fff700 1 --2- 172.21.15.87:0/2450637387 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8c5c065420 0x7f8c5c0678d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009150 tx=0x7f8c60008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:10.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.580+0000 7f8c657fa700 1 -- 172.21.15.87:0/2450637387 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f8c6c0503d0 con 0x7f8c7006a6e0 2023-03-30T08:11:10.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.752+0000 7f8c75928700 1 -- 172.21.15.87:0/2450637387 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c700733a0 con 0x7f8c7006a6e0 2023-03-30T08:11:10.758 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.752+0000 7f8c657fa700 1 -- 172.21.15.87:0/2450637387 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c6c019020 con 0x7f8c7006a6e0 2023-03-30T08:11:10.758 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-03-30T08:11:10.763 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.760+0000 7f8c75928700 1 -- 172.21.15.87:0/2450637387 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8c5c065420 msgr2=0x7f8c5c0678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.763 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.760+0000 7f8c75928700 1 --2- 172.21.15.87:0/2450637387 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8c5c065420 0x7f8c5c0678d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009150 tx=0x7f8c60008030 comp rx=0 tx=0).stop 2023-03-30T08:11:10.763 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.760+0000 7f8c75928700 1 -- 172.21.15.87:0/2450637387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c7006a6e0 msgr2=0x7f8c7014cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.763 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.760+0000 7f8c75928700 1 --2- 172.21.15.87:0/2450637387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c7006a6e0 0x7f8c7014cb00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00bd70 tx=0x7f8c6c00bda0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.764 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.760+0000 7f8c75928700 1 -- 172.21.15.87:0/2450637387 shutdown_connections 2023-03-30T08:11:10.764 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.760+0000 7f8c75928700 1 --2- 172.21.15.87:0/2450637387 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8c5c065420 0x7f8c5c0678d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.764 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.760+0000 7f8c75928700 1 --2- 172.21.15.87:0/2450637387 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c700b3f30 0x7f8c700c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.764 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.760+0000 7f8c75928700 1 --2- 172.21.15.87:0/2450637387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c700af180 0x7f8c7015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.764 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.760+0000 7f8c75928700 1 --2- 172.21.15.87:0/2450637387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c7006a6e0 0x7f8c7014cb00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.765 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.760+0000 7f8c75928700 1 -- 172.21.15.87:0/2450637387 >> 172.21.15.87:0/2450637387 conn(0x7f8c700cf410 msgr2=0x7f8c7006d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:10.765 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.760+0000 7f8c75928700 1 -- 172.21.15.87:0/2450637387 shutdown_connections 2023-03-30T08:11:10.765 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.760+0000 7f8c75928700 1 -- 172.21.15.87:0/2450637387 wait complete. 2023-03-30T08:11:10.782 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-30T08:11:10.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.944+0000 7f23056c8700 1 Processor -- start 2023-03-30T08:11:10.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.944+0000 7f23056c8700 1 -- start start 2023-03-30T08:11:10.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.944+0000 7f23056c8700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2300164190 0x7f23000c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.944+0000 7f23056c8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f23000aea30 0x7f230006a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.944+0000 7f23056c8700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2300069f00 con 0x7f2300163dc0 2023-03-30T08:11:10.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.944+0000 7f23056c8700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230006d810 con 0x7f2300164190 2023-03-30T08:11:10.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.944+0000 7f23056c8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23000cc1d0 con 0x7f23000aea30 2023-03-30T08:11:10.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.944+0000 7f22f7fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2300164190 0x7f23000c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.944+0000 7f22fffff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2300163dc0 0x7f23000c95c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43522/0 (socket says 172.21.15.87:43522) 2023-03-30T08:11:10.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.944+0000 7f22fffff700 1 -- 172.21.15.87:0/4135396058 learned_addr learned my addr 172.21.15.87:0/4135396058 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:10.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f2304ec7700 1 --2- 172.21.15.87:0/4135396058 >> v2:172.21.15.115:3300/0 conn(0x7f23000aea30 0x7f230006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f22f7fff700 1 -- 172.21.15.87:0/4135396058 >> v2:172.21.15.115:3300/0 conn(0x7f23000aea30 msgr2=0x7f230006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:10.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f22f7fff700 1 --2- 172.21.15.87:0/4135396058 >> v2:172.21.15.115:3300/0 conn(0x7f23000aea30 0x7f230006a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f22f7fff700 1 -- 172.21.15.87:0/4135396058 >> v1:172.21.15.87:6789/0 conn(0x7f2300163dc0 legacy=0x7f23000c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f22f7fff700 1 -- 172.21.15.87:0/4135396058 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230006cf70 con 0x7f2300164190 2023-03-30T08:11:10.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f22f7fff700 1 --2- 172.21.15.87:0/4135396058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2300164190 0x7f23000c9cd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f23000cb9a0 tx=0x7f22e8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9efad0404fae61 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:10.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f22ff7fe700 1 -- 172.21.15.87:0/4135396058 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8011830 con 0x7f2300164190 2023-03-30T08:11:10.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f22ff7fe700 1 -- 172.21.15.87:0/4135396058 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e8011990 con 0x7f2300164190 2023-03-30T08:11:10.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f22ff7fe700 1 -- 172.21.15.87:0/4135396058 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8011d40 con 0x7f2300164190 2023-03-30T08:11:10.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f23056c8700 1 -- 172.21.15.87:0/4135396058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2300164190 msgr2=0x7f23000c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f23056c8700 1 --2- 172.21.15.87:0/4135396058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2300164190 0x7f23000c9cd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f23000cb9a0 tx=0x7f22e8009b30 comp rx=0 tx=0).stop 2023-03-30T08:11:10.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f23056c8700 1 -- 172.21.15.87:0/4135396058 shutdown_connections 2023-03-30T08:11:10.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f23056c8700 1 --2- 172.21.15.87:0/4135396058 >> v2:172.21.15.115:3300/0 conn(0x7f23000aea30 0x7f230006a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f23056c8700 1 --2- 172.21.15.87:0/4135396058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2300164190 0x7f23000c9cd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f23056c8700 1 -- 172.21.15.87:0/4135396058 >> 172.21.15.87:0/4135396058 conn(0x7f23000cf410 msgr2=0x7f23000cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:10.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f23056c8700 1 -- 172.21.15.87:0/4135396058 shutdown_connections 2023-03-30T08:11:10.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.948+0000 7f23056c8700 1 -- 172.21.15.87:0/4135396058 wait complete. 2023-03-30T08:11:10.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.952+0000 7f23056c8700 1 Processor -- start 2023-03-30T08:11:10.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.952+0000 7f23056c8700 1 -- start start 2023-03-30T08:11:10.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.952+0000 7f23056c8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23000aea30 0x7f2300158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.952+0000 7f23056c8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2300163dc0 0x7f23000c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.952+0000 7f23056c8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2300164190 0x7f2300161c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.952+0000 7f23056c8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230015aea0 con 0x7f2300163dc0 2023-03-30T08:11:10.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.952+0000 7f23056c8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23000c3460 con 0x7f2300164190 2023-03-30T08:11:10.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.952+0000 7f23056c8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23000c3740 con 0x7f23000aea30 2023-03-30T08:11:10.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.952+0000 7f22f7fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2300163dc0 0x7f23000c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.952+0000 7f22f7fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2300163dc0 0x7f23000c29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56342/0 (socket says 172.21.15.87:56342) 2023-03-30T08:11:10.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.952+0000 7f22f7fff700 1 -- 172.21.15.87:0/1641359852 learned_addr learned my addr 172.21.15.87:0/1641359852 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:10.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.956+0000 7f2304ec7700 1 --2- 172.21.15.87:0/1641359852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2300164190 0x7f2300161c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.956+0000 7f22fffff700 1 --2- 172.21.15.87:0/1641359852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23000aea30 0x7f2300158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.956+0000 7f22f7fff700 1 -- 172.21.15.87:0/1641359852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23000aea30 msgr2=0x7f2300158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.956+0000 7f22f7fff700 1 --2- 172.21.15.87:0/1641359852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23000aea30 0x7f2300158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.956+0000 7f22f7fff700 1 -- 172.21.15.87:0/1641359852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2300164190 msgr2=0x7f2300161c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.956+0000 7f22f7fff700 1 --2- 172.21.15.87:0/1641359852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2300164190 0x7f2300161c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.956+0000 7f22f7fff700 1 -- 172.21.15.87:0/1641359852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e80094b0 con 0x7f2300163dc0 2023-03-30T08:11:10.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.956+0000 7f22f7fff700 1 --2- 172.21.15.87:0/1641359852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2300163dc0 0x7f23000c29a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f22e80090b0 tx=0x7f22e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:10.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.956+0000 7f22fd7fa700 1 -- 172.21.15.87:0/1641359852 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8004570 con 0x7f2300163dc0 2023-03-30T08:11:10.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.956+0000 7f22fd7fa700 1 -- 172.21.15.87:0/1641359852 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e801f070 con 0x7f2300163dc0 2023-03-30T08:11:10.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.956+0000 7f22fd7fa700 1 -- 172.21.15.87:0/1641359852 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8003900 con 0x7f2300163dc0 2023-03-30T08:11:10.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.956+0000 7f23056c8700 1 -- 172.21.15.87:0/1641359852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230006d530 con 0x7f2300163dc0 2023-03-30T08:11:10.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.956+0000 7f23056c8700 1 -- 172.21.15.87:0/1641359852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230006d250 con 0x7f2300163dc0 2023-03-30T08:11:10.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.956+0000 7f23056c8700 1 -- 172.21.15.87:0/1641359852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230006cc40 con 0x7f2300163dc0 2023-03-30T08:11:10.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.960+0000 7f22fd7fa700 1 -- 172.21.15.87:0/1641359852 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f22e8021030 con 0x7f2300163dc0 2023-03-30T08:11:10.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.960+0000 7f22fd7fa700 1 --2- 172.21.15.87:0/1641359852 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f22e0065420 0x7f22e00678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:10.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.960+0000 7f22fd7fa700 1 -- 172.21.15.87:0/1641359852 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f22e8083f50 con 0x7f2300163dc0 2023-03-30T08:11:10.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.960+0000 7f22fffff700 1 --2- 172.21.15.87:0/1641359852 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f22e0065420 0x7f22e00678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:10.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.960+0000 7f22fffff700 1 --2- 172.21.15.87:0/1641359852 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f22e0065420 0x7f22e00678d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f22f0005930 tx=0x7f22f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:10.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:10.968+0000 7f22fd7fa700 1 -- 172.21.15.87:0/1641359852 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f22e8051a20 con 0x7f2300163dc0 2023-03-30T08:11:11.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.136+0000 7f23056c8700 1 -- 172.21.15.87:0/1641359852 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f23000c3c60 con 0x7f2300163dc0 2023-03-30T08:11:11.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.136+0000 7f22fd7fa700 1 -- 172.21.15.87:0/1641359852 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f23000c3c60 con 0x7f2300163dc0 2023-03-30T08:11:11.141 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.140+0000 7f23056c8700 1 -- 172.21.15.87:0/1641359852 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f22e0065420 msgr2=0x7f22e00678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.140+0000 7f23056c8700 1 --2- 172.21.15.87:0/1641359852 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f22e0065420 0x7f22e00678d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f22f0005930 tx=0x7f22f0009040 comp rx=0 tx=0).stop 2023-03-30T08:11:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.140+0000 7f23056c8700 1 -- 172.21.15.87:0/1641359852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2300163dc0 msgr2=0x7f23000c29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:11.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.140+0000 7f23056c8700 1 --2- 172.21.15.87:0/1641359852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2300163dc0 0x7f23000c29a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f22e80090b0 tx=0x7f22e8004770 comp rx=0 tx=0).stop 2023-03-30T08:11:11.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.140+0000 7f23056c8700 1 -- 172.21.15.87:0/1641359852 shutdown_connections 2023-03-30T08:11:11.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.140+0000 7f23056c8700 1 --2- 172.21.15.87:0/1641359852 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f22e0065420 0x7f22e00678d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.140+0000 7f23056c8700 1 --2- 172.21.15.87:0/1641359852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2300164190 0x7f2300161c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.140+0000 7f23056c8700 1 --2- 172.21.15.87:0/1641359852 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2300163dc0 0x7f23000c29a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.140+0000 7f23056c8700 1 --2- 172.21.15.87:0/1641359852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f23000aea30 0x7f2300158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.140+0000 7f23056c8700 1 -- 172.21.15.87:0/1641359852 >> 172.21.15.87:0/1641359852 conn(0x7f23000cf410 msgr2=0x7f23000b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:11.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.140+0000 7f23056c8700 1 -- 172.21.15.87:0/1641359852 shutdown_connections 2023-03-30T08:11:11.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.140+0000 7f23056c8700 1 -- 172.21.15.87:0/1641359852 wait complete. 2023-03-30T08:11:11.165 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-30T08:11:11.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.324+0000 7fd374b03700 1 Processor -- start 2023-03-30T08:11:11.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.324+0000 7fd374b03700 1 -- start start 2023-03-30T08:11:11.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.324+0000 7fd374b03700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3700b8380 0x7fd3700d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:11.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.324+0000 7fd374b03700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd37006a3e0 0x7fd3700d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:11.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.324+0000 7fd374b03700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd370160ef0 con 0x7fd3700d27e0 2023-03-30T08:11:11.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.324+0000 7fd374b03700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3700cd6a0 con 0x7fd37006a3e0 2023-03-30T08:11:11.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.324+0000 7fd374b03700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700cd3a0 con 0x7fd3700b8380 2023-03-30T08:11:11.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.324+0000 7fd366ffd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd3700d27e0 0x7fd370069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43524/0 (socket says 172.21.15.87:43524) 2023-03-30T08:11:11.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.324+0000 7fd366ffd700 1 -- 172.21.15.87:0/774673299 learned_addr learned my addr 172.21.15.87:0/774673299 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:11.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.324+0000 7fd36f7fe700 1 --2- 172.21.15.87:0/774673299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3700b8380 0x7fd3700d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:11.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.324+0000 7fd36ffff700 1 --2- 172.21.15.87:0/774673299 >> v2:172.21.15.115:3300/0 conn(0x7fd37006a3e0 0x7fd3700d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:11.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd36effd700 1 -- 172.21.15.87:0/774673299 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901766207 0 0) 0x7fd370160ef0 con 0x7fd3700d27e0 2023-03-30T08:11:11.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd36effd700 1 -- 172.21.15.87:0/774673299 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd35c0035d0 con 0x7fd3700d27e0 2023-03-30T08:11:11.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd36ffff700 1 -- 172.21.15.87:0/774673299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3700b8380 msgr2=0x7fd3700d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:11.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd36ffff700 1 --2- 172.21.15.87:0/774673299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3700b8380 0x7fd3700d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd36ffff700 1 -- 172.21.15.87:0/774673299 >> v1:172.21.15.87:6789/0 conn(0x7fd3700d27e0 legacy=0x7fd370069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:11.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd36ffff700 1 -- 172.21.15.87:0/774673299 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3700cef00 con 0x7fd37006a3e0 2023-03-30T08:11:11.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd36ffff700 1 --2- 172.21.15.87:0/774673299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd37006a3e0 0x7fd3700d0880 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd368009850 tx=0x7fd368009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e7750a23cc18be9 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:11.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd36effd700 1 -- 172.21.15.87:0/774673299 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368011830 con 0x7fd37006a3e0 2023-03-30T08:11:11.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd36effd700 1 -- 172.21.15.87:0/774673299 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd368011990 con 0x7fd37006a3e0 2023-03-30T08:11:11.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd36effd700 1 -- 172.21.15.87:0/774673299 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368011d40 con 0x7fd37006a3e0 2023-03-30T08:11:11.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd374b03700 1 -- 172.21.15.87:0/774673299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd37006a3e0 msgr2=0x7fd3700d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:11.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd374b03700 1 --2- 172.21.15.87:0/774673299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd37006a3e0 0x7fd3700d0880 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd368009850 tx=0x7fd368009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:11.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd374b03700 1 -- 172.21.15.87:0/774673299 shutdown_connections 2023-03-30T08:11:11.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd374b03700 1 --2- 172.21.15.87:0/774673299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd37006a3e0 0x7fd3700d0880 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd374b03700 1 --2- 172.21.15.87:0/774673299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3700b8380 0x7fd3700d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd374b03700 1 -- 172.21.15.87:0/774673299 >> 172.21.15.87:0/774673299 conn(0x7fd3700b53f0 msgr2=0x7fd3700cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:11.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd374b03700 1 -- 172.21.15.87:0/774673299 shutdown_connections 2023-03-30T08:11:11.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.328+0000 7fd374b03700 1 -- 172.21.15.87:0/774673299 wait complete. 2023-03-30T08:11:11.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.332+0000 7fd374b03700 1 Processor -- start 2023-03-30T08:11:11.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.332+0000 7fd374b03700 1 -- start start 2023-03-30T08:11:11.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.332+0000 7fd374b03700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd37006a3e0 0x7fd3700c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:11.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.332+0000 7fd374b03700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3700b8380 0x7fd3701576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:11.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.332+0000 7fd374b03700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3700c67e0 0x7fd37015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:11.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.332+0000 7fd374b03700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37015e8a0 con 0x7fd3700b8380 2023-03-30T08:11:11.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.332+0000 7fd374b03700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd370157c20 con 0x7fd37006a3e0 2023-03-30T08:11:11.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.332+0000 7fd374b03700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37015dc90 con 0x7fd3700c67e0 2023-03-30T08:11:11.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd366ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3700b8380 0x7fd3701576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:11.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd366ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3700b8380 0x7fd3701576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56354/0 (socket says 172.21.15.87:56354) 2023-03-30T08:11:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd366ffd700 1 -- 172.21.15.87:0/2524525237 learned_addr learned my addr 172.21.15.87:0/2524525237 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd36ffff700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3700c67e0 0x7fd37015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd36f7fe700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd37006a3e0 0x7fd3700c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd366ffd700 1 -- 172.21.15.87:0/2524525237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3700c67e0 msgr2=0x7fd37015ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd366ffd700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3700c67e0 0x7fd37015ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd366ffd700 1 -- 172.21.15.87:0/2524525237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd37006a3e0 msgr2=0x7fd3700c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:11.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd366ffd700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd37006a3e0 0x7fd3700c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd366ffd700 1 -- 172.21.15.87:0/2524525237 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3680094b0 con 0x7fd3700b8380 2023-03-30T08:11:11.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd36ffff700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3700c67e0 0x7fd37015ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:11.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd36f7fe700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd37006a3e0 0x7fd3700c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:11.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd366ffd700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3700b8380 0x7fd3701576e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd35800cbb0 tx=0x7fd35800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:11.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd36cff9700 1 -- 172.21.15.87:0/2524525237 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358007480 con 0x7fd3700b8380 2023-03-30T08:11:11.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd36cff9700 1 -- 172.21.15.87:0/2524525237 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3580075e0 con 0x7fd3700b8380 2023-03-30T08:11:11.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd374b03700 1 -- 172.21.15.87:0/2524525237 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3700cf480 con 0x7fd3700b8380 2023-03-30T08:11:11.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd36cff9700 1 -- 172.21.15.87:0/2524525237 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358007950 con 0x7fd3700b8380 2023-03-30T08:11:11.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.336+0000 7fd374b03700 1 -- 172.21.15.87:0/2524525237 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3700cf1a0 con 0x7fd3700b8380 2023-03-30T08:11:11.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.340+0000 7fd374b03700 1 -- 172.21.15.87:0/2524525237 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3700b8750 con 0x7fd3700b8380 2023-03-30T08:11:11.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.340+0000 7fd36cff9700 1 -- 172.21.15.87:0/2524525237 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd358012400 con 0x7fd3700b8380 2023-03-30T08:11:11.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.340+0000 7fd36cff9700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd3500653f0 0x7fd3500678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:11.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.340+0000 7fd36cff9700 1 -- 172.21.15.87:0/2524525237 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd3580823e0 con 0x7fd3700b8380 2023-03-30T08:11:11.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.340+0000 7fd36f7fe700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd3500653f0 0x7fd3500678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:11.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.344+0000 7fd36f7fe700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd3500653f0 0x7fd3500678a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd3600112c0 tx=0x7fd360009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:11.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.348+0000 7fd36cff9700 1 -- 172.21.15.87:0/2524525237 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fd35804a5e0 con 0x7fd3700b8380 2023-03-30T08:11:11.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.524+0000 7fd374b03700 1 -- 172.21.15.87:0/2524525237 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd370072cf0 con 0x7fd3700b8380 2023-03-30T08:11:11.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.528+0000 7fd36cff9700 1 -- 172.21.15.87:0/2524525237 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd3580537b0 con 0x7fd3700b8380 2023-03-30T08:11:11.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.528+0000 7fd374b03700 1 -- 172.21.15.87:0/2524525237 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd3500653f0 msgr2=0x7fd3500678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:11.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.528+0000 7fd374b03700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd3500653f0 0x7fd3500678a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd3600112c0 tx=0x7fd360009240 comp rx=0 tx=0).stop 2023-03-30T08:11:11.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.528+0000 7fd374b03700 1 -- 172.21.15.87:0/2524525237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3700b8380 msgr2=0x7fd3701576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:11.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.528+0000 7fd374b03700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3700b8380 0x7fd3701576e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd35800cbb0 tx=0x7fd35800cbe0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.528+0000 7fd374b03700 1 -- 172.21.15.87:0/2524525237 shutdown_connections 2023-03-30T08:11:11.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.528+0000 7fd374b03700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd3500653f0 0x7fd3500678a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.528+0000 7fd374b03700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3700c67e0 0x7fd37015ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.528+0000 7fd374b03700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3700b8380 0x7fd3701576e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.528+0000 7fd374b03700 1 --2- 172.21.15.87:0/2524525237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd37006a3e0 0x7fd3700c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.528+0000 7fd374b03700 1 -- 172.21.15.87:0/2524525237 >> 172.21.15.87:0/2524525237 conn(0x7fd3700b53f0 msgr2=0x7fd37015c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:11.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.528+0000 7fd374b03700 1 -- 172.21.15.87:0/2524525237 shutdown_connections 2023-03-30T08:11:11.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.528+0000 7fd374b03700 1 -- 172.21.15.87:0/2524525237 wait complete. 2023-03-30T08:11:11.536 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2023-03-30T08:11:11.553 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:11:11.554 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:11.566 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:11.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.760+0000 7fc83d4dc700 1 Processor -- start 2023-03-30T08:11:11.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.760+0000 7fc83d4dc700 1 -- start start 2023-03-30T08:11:11.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc83d4dc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc838159050 0x7fc838069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:11.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc83d4dc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc8380ca4b0 0x7fc8380ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:11.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc83d4dc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8380afca0 con 0x7fc83815cba0 2023-03-30T08:11:11.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc83d4dc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8380afb10 con 0x7fc8380ca4b0 2023-03-30T08:11:11.768 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc83d4dc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380cae70 con 0x7fc838159050 2023-03-30T08:11:11.769 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc83ccdb700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc8380ca4b0 0x7fc8380ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:11.769 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc837fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc838159050 0x7fc838069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:11.769 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc837fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc838159050 0x7fc838069cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:39302/0 (socket says 172.21.15.87:39302) 2023-03-30T08:11:11.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc837fff700 1 -- 172.21.15.87:0/1683062393 learned_addr learned my addr 172.21.15.87:0/1683062393 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:11.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc82f7fe700 1 --1- 172.21.15.87:0/1683062393 >> v1:172.21.15.115:6789/0 conn(0x7fc83815cba0 0x7fc8380cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:49990/0 (socket says 172.21.15.87:49990) 2023-03-30T08:11:11.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc83ccdb700 1 -- 172.21.15.87:0/1683062393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc838159050 msgr2=0x7fc838069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:11.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc83ccdb700 1 --2- 172.21.15.87:0/1683062393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc838159050 0x7fc838069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc83ccdb700 1 -- 172.21.15.87:0/1683062393 >> v1:172.21.15.115:6789/0 conn(0x7fc83815cba0 legacy=0x7fc8380cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:11.771 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc83ccdb700 1 -- 172.21.15.87:0/1683062393 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83815d110 con 0x7fc8380ca4b0 2023-03-30T08:11:11.772 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc83ccdb700 1 --2- 172.21.15.87:0/1683062393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8380ca4b0 0x7fc8380ca930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc830009850 tx=0x7fc830009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8794d6945b1a0f server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:11.772 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc8377fe700 1 -- 172.21.15.87:0/1683062393 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830011830 con 0x7fc8380ca4b0 2023-03-30T08:11:11.772 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc8377fe700 1 -- 172.21.15.87:0/1683062393 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830011990 con 0x7fc8380ca4b0 2023-03-30T08:11:11.772 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.764+0000 7fc8377fe700 1 -- 172.21.15.87:0/1683062393 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830011d40 con 0x7fc8380ca4b0 2023-03-30T08:11:11.773 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.768+0000 7fc83d4dc700 1 -- 172.21.15.87:0/1683062393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8380ca4b0 msgr2=0x7fc8380ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:11.773 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.768+0000 7fc83d4dc700 1 --2- 172.21.15.87:0/1683062393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8380ca4b0 0x7fc8380ca930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc830009850 tx=0x7fc830009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:11.773 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.768+0000 7fc83d4dc700 1 -- 172.21.15.87:0/1683062393 shutdown_connections 2023-03-30T08:11:11.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.768+0000 7fc83d4dc700 1 --2- 172.21.15.87:0/1683062393 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8380ca4b0 0x7fc8380ca930 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.768+0000 7fc83d4dc700 1 --2- 172.21.15.87:0/1683062393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc838159050 0x7fc838069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.768+0000 7fc83d4dc700 1 -- 172.21.15.87:0/1683062393 >> 172.21.15.87:0/1683062393 conn(0x7fc8380cf410 msgr2=0x7fc8380cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:11.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.768+0000 7fc83d4dc700 1 -- 172.21.15.87:0/1683062393 shutdown_connections 2023-03-30T08:11:11.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.768+0000 7fc83d4dc700 1 -- 172.21.15.87:0/1683062393 wait complete. 2023-03-30T08:11:11.775 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.768+0000 7fc83d4dc700 1 Processor -- start 2023-03-30T08:11:11.775 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc83d4dc700 1 -- start start 2023-03-30T08:11:11.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc83d4dc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8380ca4b0 0x7fc83814fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:11.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc83d4dc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc838159050 0x7fc8380c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:11.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc83d4dc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc83815cba0 0x7fc8380b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:11.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc83d4dc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83815a3c0 con 0x7fc838159050 2023-03-30T08:11:11.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc83d4dc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380c3210 con 0x7fc83815cba0 2023-03-30T08:11:11.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc83d4dc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380c34f0 con 0x7fc8380ca4b0 2023-03-30T08:11:11.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc82f7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc838159050 0x7fc8380c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:11.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc82f7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc838159050 0x7fc8380c40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56380/0 (socket says 172.21.15.87:56380) 2023-03-30T08:11:11.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc82f7fe700 1 -- 172.21.15.87:0/865497766 learned_addr learned my addr 172.21.15.87:0/865497766 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:11.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc837fff700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8380ca4b0 0x7fc83814fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:11.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc83ccdb700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc83815cba0 0x7fc8380b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:11.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc82f7fe700 1 -- 172.21.15.87:0/865497766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8380ca4b0 msgr2=0x7fc83814fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:11.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc82f7fe700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8380ca4b0 0x7fc83814fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc82f7fe700 1 -- 172.21.15.87:0/865497766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc83815cba0 msgr2=0x7fc8380b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:11.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc82f7fe700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc83815cba0 0x7fc8380b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc82f7fe700 1 -- 172.21.15.87:0/865497766 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300094b0 con 0x7fc838159050 2023-03-30T08:11:11.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc837fff700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8380ca4b0 0x7fc83814fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:11.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc83ccdb700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc83815cba0 0x7fc8380b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:11.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc82f7fe700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc838159050 0x7fc8380c40b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc82000c4d0 tx=0x7fc82000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:11.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc8357fa700 1 -- 172.21.15.87:0/865497766 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820005cd0 con 0x7fc838159050 2023-03-30T08:11:11.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc8357fa700 1 -- 172.21.15.87:0/865497766 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc820005e30 con 0x7fc838159050 2023-03-30T08:11:11.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc83d4dc700 1 -- 172.21.15.87:0/865497766 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83815d6d0 con 0x7fc838159050 2023-03-30T08:11:11.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.772+0000 7fc8357fa700 1 -- 172.21.15.87:0/865497766 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200072d0 con 0x7fc838159050 2023-03-30T08:11:11.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.776+0000 7fc83d4dc700 1 -- 172.21.15.87:0/865497766 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83815d3f0 con 0x7fc838159050 2023-03-30T08:11:11.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.776+0000 7fc83d4dc700 1 -- 172.21.15.87:0/865497766 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83815d9b0 con 0x7fc838159050 2023-03-30T08:11:11.782 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.776+0000 7fc8357fa700 1 -- 172.21.15.87:0/865497766 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc820007430 con 0x7fc838159050 2023-03-30T08:11:11.782 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.776+0000 7fc8357fa700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc818065420 0x7fc8180678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:11.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.780+0000 7fc8357fa700 1 -- 172.21.15.87:0/865497766 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc820081fe0 con 0x7fc838159050 2023-03-30T08:11:11.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.780+0000 7fc837fff700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc818065420 0x7fc8180678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:11.784 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.780+0000 7fc837fff700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc818065420 0x7fc8180678d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc828009d70 tx=0x7fc82800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:11.789 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.784+0000 7fc8357fa700 1 -- 172.21.15.87:0/865497766 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fc82004a5e0 con 0x7fc838159050 2023-03-30T08:11:11.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.952+0000 7fc83d4dc700 1 -- 172.21.15.87:0/865497766 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8380733a0 con 0x7fc838159050 2023-03-30T08:11:11.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.956+0000 7fc8357fa700 1 -- 172.21.15.87:0/865497766 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19652 (secure 0 0 0) 0x7fc820017070 con 0x7fc838159050 2023-03-30T08:11:11.962 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:11.962 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":28,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:02.841070+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:11.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.960+0000 7fc83d4dc700 1 -- 172.21.15.87:0/865497766 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc818065420 msgr2=0x7fc8180678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:11.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.960+0000 7fc83d4dc700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc818065420 0x7fc8180678d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc828009d70 tx=0x7fc82800b040 comp rx=0 tx=0).stop 2023-03-30T08:11:11.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.960+0000 7fc83d4dc700 1 -- 172.21.15.87:0/865497766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc838159050 msgr2=0x7fc8380c40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:11.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.960+0000 7fc83d4dc700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc838159050 0x7fc8380c40b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc82000c4d0 tx=0x7fc82000c890 comp rx=0 tx=0).stop 2023-03-30T08:11:11.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.960+0000 7fc83d4dc700 1 -- 172.21.15.87:0/865497766 shutdown_connections 2023-03-30T08:11:11.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.960+0000 7fc83d4dc700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc818065420 0x7fc8180678d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.960+0000 7fc83d4dc700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc83815cba0 0x7fc8380b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.960+0000 7fc83d4dc700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc838159050 0x7fc8380c40b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.960+0000 7fc83d4dc700 1 --2- 172.21.15.87:0/865497766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8380ca4b0 0x7fc83814fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:11.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.960+0000 7fc83d4dc700 1 -- 172.21.15.87:0/865497766 >> 172.21.15.87:0/865497766 conn(0x7fc8380cf410 msgr2=0x7fc83806cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:11.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.960+0000 7fc83d4dc700 1 -- 172.21.15.87:0/865497766 shutdown_connections 2023-03-30T08:11:11.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:11.960+0000 7fc83d4dc700 1 -- 172.21.15.87:0/865497766 wait complete. 2023-03-30T08:11:11.985 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-30T08:10:56.407927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-30T08:10:57.359214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-30T08:11:00.430972+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-30T08:11:11.986 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T08:11:12.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.148+0000 7ff9fef64700 1 Processor -- start 2023-03-30T08:11:12.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.148+0000 7ff9fef64700 1 -- start start 2023-03-30T08:11:12.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fef64700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f80d27e0 0x7ff9f80d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fef64700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f8160ef0 con 0x7ff9f806a3e0 2023-03-30T08:11:12.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fef64700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f80cd6a0 con 0x7ff9f80b8380 2023-03-30T08:11:12.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fef64700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80cd3a0 con 0x7ff9f80d27e0 2023-03-30T08:11:12.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fe763700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff9f806a3e0 0x7ff9f80d0880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43532/0 (socket says 172.21.15.87:43532) 2023-03-30T08:11:12.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fe763700 1 -- 172.21.15.87:0/1436275147 learned_addr learned my addr 172.21.15.87:0/1436275147 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:12.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fd761700 1 --2- 172.21.15.87:0/1436275147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f80d27e0 0x7ff9f80d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fcf60700 1 -- 172.21.15.87:0/1436275147 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627749328 0 0) 0x7ff9f8160ef0 con 0x7ff9f806a3e0 2023-03-30T08:11:12.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fcf60700 1 -- 172.21.15.87:0/1436275147 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9e40035d0 con 0x7ff9f806a3e0 2023-03-30T08:11:12.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fcf60700 1 -- 172.21.15.87:0/1436275147 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4847173 0 0) 0x7ff9f80cd6a0 con 0x7ff9f80b8380 2023-03-30T08:11:12.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fcf60700 1 -- 172.21.15.87:0/1436275147 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9f8160ef0 con 0x7ff9f80b8380 2023-03-30T08:11:12.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fd761700 1 -- 172.21.15.87:0/1436275147 >> v1:172.21.15.115:6789/0 conn(0x7ff9f80b8380 legacy=0x7ff9f8069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fd761700 1 -- 172.21.15.87:0/1436275147 >> v1:172.21.15.87:6789/0 conn(0x7ff9f806a3e0 legacy=0x7ff9f80d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fcf60700 1 -- 172.21.15.87:0/1436275147 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3776117947 0 0) 0x7ff9e40035d0 con 0x7ff9f806a3e0 2023-03-30T08:11:12.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fd761700 1 -- 172.21.15.87:0/1436275147 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f80cef00 con 0x7ff9f80d27e0 2023-03-30T08:11:12.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.152+0000 7ff9fd761700 1 --2- 172.21.15.87:0/1436275147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f80d27e0 0x7ff9f80d2200 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009880 tx=0x7ff9e8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5a6f244703ee36a server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:12.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.156+0000 7ff9fcf60700 1 -- 172.21.15.87:0/1436275147 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00019f0 con 0x7ff9f80d27e0 2023-03-30T08:11:12.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.156+0000 7ff9fcf60700 1 -- 172.21.15.87:0/1436275147 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e8004030 con 0x7ff9f80d27e0 2023-03-30T08:11:12.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.156+0000 7ff9fcf60700 1 -- 172.21.15.87:0/1436275147 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80043c0 con 0x7ff9f80d27e0 2023-03-30T08:11:12.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.156+0000 7ff9fef64700 1 -- 172.21.15.87:0/1436275147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f80d27e0 msgr2=0x7ff9f80d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.156+0000 7ff9fef64700 1 --2- 172.21.15.87:0/1436275147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f80d27e0 0x7ff9f80d2200 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8009880 tx=0x7ff9e8009b90 comp rx=0 tx=0).stop 2023-03-30T08:11:12.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.156+0000 7ff9fef64700 1 -- 172.21.15.87:0/1436275147 shutdown_connections 2023-03-30T08:11:12.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.156+0000 7ff9fef64700 1 --2- 172.21.15.87:0/1436275147 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f80d27e0 0x7ff9f80d2200 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.156+0000 7ff9fef64700 1 -- 172.21.15.87:0/1436275147 >> 172.21.15.87:0/1436275147 conn(0x7ff9f80b53f0 msgr2=0x7ff9f80cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:12.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.156+0000 7ff9fef64700 1 -- 172.21.15.87:0/1436275147 shutdown_connections 2023-03-30T08:11:12.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.156+0000 7ff9fef64700 1 -- 172.21.15.87:0/1436275147 wait complete. 2023-03-30T08:11:12.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.156+0000 7ff9fef64700 1 Processor -- start 2023-03-30T08:11:12.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.156+0000 7ff9fef64700 1 -- start start 2023-03-30T08:11:12.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fef64700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f806a3e0 0x7ff9f81f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fef64700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9f80b8380 0x7ff9f80b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fef64700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f80c9fa0 0x7ff9f814ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fef64700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f81f2d70 con 0x7ff9f80b8380 2023-03-30T08:11:12.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fef64700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f81f62c0 con 0x7ff9f806a3e0 2023-03-30T08:11:12.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fef64700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80cb600 con 0x7ff9f80c9fa0 2023-03-30T08:11:12.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fd761700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9f80b8380 0x7ff9f80b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fd761700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9f80b8380 0x7ff9f80b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56396/0 (socket says 172.21.15.87:56396) 2023-03-30T08:11:12.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fd761700 1 -- 172.21.15.87:0/3074395792 learned_addr learned my addr 172.21.15.87:0/3074395792 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:12.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fe763700 1 --2- 172.21.15.87:0/3074395792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f80c9fa0 0x7ff9f814ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fdf62700 1 --2- 172.21.15.87:0/3074395792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f806a3e0 0x7ff9f81f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fd761700 1 -- 172.21.15.87:0/3074395792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f80c9fa0 msgr2=0x7ff9f814ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fd761700 1 --2- 172.21.15.87:0/3074395792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f80c9fa0 0x7ff9f814ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fd761700 1 -- 172.21.15.87:0/3074395792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f806a3e0 msgr2=0x7ff9f81f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fd761700 1 --2- 172.21.15.87:0/3074395792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f806a3e0 0x7ff9f81f2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fd761700 1 -- 172.21.15.87:0/3074395792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e80094b0 con 0x7ff9f80b8380 2023-03-30T08:11:12.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fd761700 1 --2- 172.21.15.87:0/3074395792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9f80b8380 0x7ff9f80b3160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80090b0 tx=0x7ff9e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:12.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9ee7fc700 1 -- 172.21.15.87:0/3074395792 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8003bd0 con 0x7ff9f80b8380 2023-03-30T08:11:12.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9ee7fc700 1 -- 172.21.15.87:0/3074395792 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e8003d30 con 0x7ff9f80b8380 2023-03-30T08:11:12.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9fef64700 1 -- 172.21.15.87:0/3074395792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f80cf480 con 0x7ff9f80b8380 2023-03-30T08:11:12.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.160+0000 7ff9ee7fc700 1 -- 172.21.15.87:0/3074395792 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8003ea0 con 0x7ff9f80b8380 2023-03-30T08:11:12.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.164+0000 7ff9fef64700 1 -- 172.21.15.87:0/3074395792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f80cf1a0 con 0x7ff9f80b8380 2023-03-30T08:11:12.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.164+0000 7ff9fef64700 1 -- 172.21.15.87:0/3074395792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f80b8750 con 0x7ff9f80b8380 2023-03-30T08:11:12.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.164+0000 7ff9ee7fc700 1 -- 172.21.15.87:0/3074395792 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ff9e8018050 con 0x7ff9f80b8380 2023-03-30T08:11:12.171 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.168+0000 7ff9ee7fc700 1 --2- 172.21.15.87:0/3074395792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff9dc0653f0 0x7ff9dc0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.171 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.168+0000 7ff9ee7fc700 1 -- 172.21.15.87:0/3074395792 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff9e8083500 con 0x7ff9f80b8380 2023-03-30T08:11:12.172 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.168+0000 7ff9fdf62700 1 --2- 172.21.15.87:0/3074395792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff9dc0653f0 0x7ff9dc0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.172 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.168+0000 7ff9fdf62700 1 --2- 172.21.15.87:0/3074395792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff9dc0653f0 0x7ff9dc0678a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40011e0 tx=0x7ff9f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:12.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.172+0000 7ff9ee7fc700 1 -- 172.21.15.87:0/3074395792 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7ff9e8050e80 con 0x7ff9f80b8380 2023-03-30T08:11:12.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.336+0000 7ff9fef64700 1 -- 172.21.15.87:0/3074395792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9f8072cf0 con 0x7ff9f80b8380 2023-03-30T08:11:12.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.340+0000 7ff9ee7fc700 1 -- 172.21.15.87:0/3074395792 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9e80544a0 con 0x7ff9f80b8380 2023-03-30T08:11:12.344 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T08:11:12.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.340+0000 7ff9fef64700 1 -- 172.21.15.87:0/3074395792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff9dc0653f0 msgr2=0x7ff9dc0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.340+0000 7ff9fef64700 1 --2- 172.21.15.87:0/3074395792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff9dc0653f0 0x7ff9dc0678a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40011e0 tx=0x7ff9f4009040 comp rx=0 tx=0).stop 2023-03-30T08:11:12.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.340+0000 7ff9fef64700 1 -- 172.21.15.87:0/3074395792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9f80b8380 msgr2=0x7ff9f80b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.340+0000 7ff9fef64700 1 --2- 172.21.15.87:0/3074395792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9f80b8380 0x7ff9f80b3160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80090b0 tx=0x7ff9e8004770 comp rx=0 tx=0).stop 2023-03-30T08:11:12.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.344+0000 7ff9fef64700 1 -- 172.21.15.87:0/3074395792 shutdown_connections 2023-03-30T08:11:12.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.344+0000 7ff9fef64700 1 --2- 172.21.15.87:0/3074395792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff9dc0653f0 0x7ff9dc0678a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.344+0000 7ff9fef64700 1 --2- 172.21.15.87:0/3074395792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f80c9fa0 0x7ff9f814ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.344+0000 7ff9fef64700 1 --2- 172.21.15.87:0/3074395792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9f80b8380 0x7ff9f80b3160 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.344+0000 7ff9fef64700 1 --2- 172.21.15.87:0/3074395792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f806a3e0 0x7ff9f81f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.344+0000 7ff9fef64700 1 -- 172.21.15.87:0/3074395792 >> 172.21.15.87:0/3074395792 conn(0x7ff9f80b53f0 msgr2=0x7ff9f80cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:12.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.344+0000 7ff9fef64700 1 -- 172.21.15.87:0/3074395792 shutdown_connections 2023-03-30T08:11:12.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.344+0000 7ff9fef64700 1 -- 172.21.15.87:0/3074395792 wait complete. 2023-03-30T08:11:12.369 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T08:11:12.514 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:11:12.520 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:11:12.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.536+0000 7fab8949b700 1 Processor -- start 2023-03-30T08:11:12.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.536+0000 7fab8949b700 1 -- start start 2023-03-30T08:11:12.542 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.536+0000 7fab8949b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fab8415a060 0x7fab8415cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.542 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.536+0000 7fab8949b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8406aa80 con 0x7fab840b0c10 2023-03-30T08:11:12.542 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.536+0000 7fab8949b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab84069e70 con 0x7fab840cd470 2023-03-30T08:11:12.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.536+0000 7fab8949b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8406a150 con 0x7fab8415a060 2023-03-30T08:11:12.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.536+0000 7fab827fc700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fab840b0c10 0x7fab840ccd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43536/0 (socket says 172.21.15.87:43536) 2023-03-30T08:11:12.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.536+0000 7fab837fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fab840cd470 0x7fab84160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:50010/0 (socket says 172.21.15.87:50010) 2023-03-30T08:11:12.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.536+0000 7fab827fc700 1 -- 172.21.15.87:0/3522231401 learned_addr learned my addr 172.21.15.87:0/3522231401 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:12.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.536+0000 7fab82ffd700 1 --2- 172.21.15.87:0/3522231401 >> v2:172.21.15.87:3300/0 conn(0x7fab8415a060 0x7fab8415cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.544 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab81ffb700 1 -- 172.21.15.87:0/3522231401 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115138556 0 0) 0x7fab84069e70 con 0x7fab840cd470 2023-03-30T08:11:12.544 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab81ffb700 1 -- 172.21.15.87:0/3522231401 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab6c0035d0 con 0x7fab840cd470 2023-03-30T08:11:12.544 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab82ffd700 1 -- 172.21.15.87:0/3522231401 >> v1:172.21.15.115:6789/0 conn(0x7fab840cd470 legacy=0x7fab84160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.545 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab81ffb700 1 -- 172.21.15.87:0/3522231401 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100754033 0 0) 0x7fab8406aa80 con 0x7fab840b0c10 2023-03-30T08:11:12.545 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab82ffd700 1 -- 172.21.15.87:0/3522231401 >> v1:172.21.15.87:6789/0 conn(0x7fab840b0c10 legacy=0x7fab840ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.545 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab82ffd700 1 -- 172.21.15.87:0/3522231401 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8406a430 con 0x7fab8415a060 2023-03-30T08:11:12.545 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab82ffd700 1 --2- 172.21.15.87:0/3522231401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8415a060 0x7fab8415cb60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fab74009850 tx=0x7fab74009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04e0f94488bee67 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:12.545 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab81ffb700 1 -- 172.21.15.87:0/3522231401 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74011830 con 0x7fab8415a060 2023-03-30T08:11:12.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab81ffb700 1 -- 172.21.15.87:0/3522231401 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab74011990 con 0x7fab8415a060 2023-03-30T08:11:12.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab81ffb700 1 -- 172.21.15.87:0/3522231401 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74011d40 con 0x7fab8415a060 2023-03-30T08:11:12.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab8949b700 1 -- 172.21.15.87:0/3522231401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8415a060 msgr2=0x7fab8415cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab8949b700 1 --2- 172.21.15.87:0/3522231401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8415a060 0x7fab8415cb60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fab74009850 tx=0x7fab74009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:12.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab8949b700 1 -- 172.21.15.87:0/3522231401 shutdown_connections 2023-03-30T08:11:12.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab8949b700 1 --2- 172.21.15.87:0/3522231401 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8415a060 0x7fab8415cb60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab8949b700 1 -- 172.21.15.87:0/3522231401 >> 172.21.15.87:0/3522231401 conn(0x7fab8406d910 msgr2=0x7fab840cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:12.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab8949b700 1 -- 172.21.15.87:0/3522231401 shutdown_connections 2023-03-30T08:11:12.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.540+0000 7fab8949b700 1 -- 172.21.15.87:0/3522231401 wait complete. 2023-03-30T08:11:12.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.544+0000 7fab8949b700 1 Processor -- start 2023-03-30T08:11:12.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.544+0000 7fab8949b700 1 -- start start 2023-03-30T08:11:12.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.544+0000 7fab8949b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab840b0c10 0x7fab8414b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.544+0000 7fab8949b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab840cd470 0x7fab8415da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.544+0000 7fab8949b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8415a060 0x7fab8415dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.544+0000 7fab8949b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab84157b90 con 0x7fab8415a060 2023-03-30T08:11:12.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.544+0000 7fab8949b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab840b22f0 con 0x7fab840b0c10 2023-03-30T08:11:12.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.544+0000 7fab8949b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab840b25d0 con 0x7fab840cd470 2023-03-30T08:11:12.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.544+0000 7fab837fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8415a060 0x7fab8415dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.544+0000 7fab837fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8415a060 0x7fab8415dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56402/0 (socket says 172.21.15.87:56402) 2023-03-30T08:11:12.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.544+0000 7fab837fe700 1 -- 172.21.15.87:0/1805090976 learned_addr learned my addr 172.21.15.87:0/1805090976 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:12.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.544+0000 7fab82ffd700 1 --2- 172.21.15.87:0/1805090976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab840b0c10 0x7fab8414b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.544+0000 7fab827fc700 1 --2- 172.21.15.87:0/1805090976 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab840cd470 0x7fab8415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.548+0000 7fab837fe700 1 -- 172.21.15.87:0/1805090976 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab840cd470 msgr2=0x7fab8415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.548+0000 7fab837fe700 1 --2- 172.21.15.87:0/1805090976 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab840cd470 0x7fab8415da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.548+0000 7fab837fe700 1 -- 172.21.15.87:0/1805090976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab840b0c10 msgr2=0x7fab8414b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.548+0000 7fab837fe700 1 --2- 172.21.15.87:0/1805090976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab840b0c10 0x7fab8414b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.548+0000 7fab837fe700 1 -- 172.21.15.87:0/1805090976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab740094b0 con 0x7fab8415a060 2023-03-30T08:11:12.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.548+0000 7fab837fe700 1 --2- 172.21.15.87:0/1805090976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8415a060 0x7fab8415dfc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00cc50 tx=0x7fab7c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:12.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.548+0000 7fab6b7fe700 1 -- 172.21.15.87:0/1805090976 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c00aad0 con 0x7fab8415a060 2023-03-30T08:11:12.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.548+0000 7fab6b7fe700 1 -- 172.21.15.87:0/1805090976 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c00ac30 con 0x7fab8415a060 2023-03-30T08:11:12.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.548+0000 7fab8949b700 1 -- 172.21.15.87:0/1805090976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8415a430 con 0x7fab8415a060 2023-03-30T08:11:12.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.548+0000 7fab6b7fe700 1 -- 172.21.15.87:0/1805090976 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c007070 con 0x7fab8415a060 2023-03-30T08:11:12.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.548+0000 7fab8949b700 1 -- 172.21.15.87:0/1805090976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8406a710 con 0x7fab8415a060 2023-03-30T08:11:12.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.548+0000 7fab8949b700 1 -- 172.21.15.87:0/1805090976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8415a5c0 con 0x7fab8415a060 2023-03-30T08:11:12.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.552+0000 7fab6b7fe700 1 -- 172.21.15.87:0/1805090976 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fab7c0071d0 con 0x7fab8415a060 2023-03-30T08:11:12.556 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.552+0000 7fab6b7fe700 1 --2- 172.21.15.87:0/1805090976 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fab70065420 0x7fab700678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.556 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.552+0000 7fab6b7fe700 1 -- 172.21.15.87:0/1805090976 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fab7c082930 con 0x7fab8415a060 2023-03-30T08:11:12.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.552+0000 7fab82ffd700 1 --2- 172.21.15.87:0/1805090976 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fab70065420 0x7fab700678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.552+0000 7fab82ffd700 1 --2- 172.21.15.87:0/1805090976 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fab70065420 0x7fab700678d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab740090b0 tx=0x7fab7401c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:12.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.556+0000 7fab6b7fe700 1 -- 172.21.15.87:0/1805090976 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fab7c050260 con 0x7fab8415a060 2023-03-30T08:11:12.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.724+0000 7fab8949b700 1 -- 172.21.15.87:0/1805090976 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fab840b2810 con 0x7fab8415a060 2023-03-30T08:11:12.730 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.724+0000 7fab6b7fe700 1 -- 172.21.15.87:0/1805090976 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fab840b2810 con 0x7fab8415a060 2023-03-30T08:11:12.730 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T08:11:12.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.728+0000 7fab8949b700 1 -- 172.21.15.87:0/1805090976 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fab70065420 msgr2=0x7fab700678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.728+0000 7fab8949b700 1 --2- 172.21.15.87:0/1805090976 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fab70065420 0x7fab700678d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab740090b0 tx=0x7fab7401c040 comp rx=0 tx=0).stop 2023-03-30T08:11:12.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.728+0000 7fab8949b700 1 -- 172.21.15.87:0/1805090976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8415a060 msgr2=0x7fab8415dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.728+0000 7fab8949b700 1 --2- 172.21.15.87:0/1805090976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8415a060 0x7fab8415dfc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00cc50 tx=0x7fab7c00cf60 comp rx=0 tx=0).stop 2023-03-30T08:11:12.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.728+0000 7fab8949b700 1 -- 172.21.15.87:0/1805090976 shutdown_connections 2023-03-30T08:11:12.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.728+0000 7fab8949b700 1 --2- 172.21.15.87:0/1805090976 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fab70065420 0x7fab700678d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.728+0000 7fab8949b700 1 --2- 172.21.15.87:0/1805090976 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab8415a060 0x7fab8415dfc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.728+0000 7fab8949b700 1 --2- 172.21.15.87:0/1805090976 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab840cd470 0x7fab8415da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.728+0000 7fab8949b700 1 --2- 172.21.15.87:0/1805090976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab840b0c10 0x7fab8414b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.728+0000 7fab8949b700 1 -- 172.21.15.87:0/1805090976 >> 172.21.15.87:0/1805090976 conn(0x7fab8406d910 msgr2=0x7fab840b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:12.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.732+0000 7fab8949b700 1 -- 172.21.15.87:0/1805090976 shutdown_connections 2023-03-30T08:11:12.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.732+0000 7fab8949b700 1 -- 172.21.15.87:0/1805090976 wait complete. 2023-03-30T08:11:12.756 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-30T08:11:12.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.924+0000 7f86b8030700 1 Processor -- start 2023-03-30T08:11:12.929 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.924+0000 7f86b8030700 1 -- start start 2023-03-30T08:11:12.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b8030700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f86b0160c30 0x7f86b00cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b8030700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f86b00cfca0 0x7f86b00d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b8030700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b01601e0 con 0x7f86b0156c20 2023-03-30T08:11:12.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b8030700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b01607a0 con 0x7f86b00cfca0 2023-03-30T08:11:12.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b8030700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b015d6e0 con 0x7f86b0160c30 2023-03-30T08:11:12.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b65cd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f86b00cfca0 0x7f86b00d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b65cd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f86b00cfca0 0x7f86b00d0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56416/0 (socket says 172.21.15.87:56416) 2023-03-30T08:11:12.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b65cd700 1 -- 172.21.15.87:0/3787487329 learned_addr learned my addr 172.21.15.87:0/3787487329 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:12.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b55cb700 1 --2- 172.21.15.87:0/3787487329 >> v2:172.21.15.115:3300/0 conn(0x7f86b0160c30 0x7f86b00cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b65cd700 1 -- 172.21.15.87:0/3787487329 >> v2:172.21.15.115:3300/0 conn(0x7f86b0160c30 msgr2=0x7f86b00cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:12.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b65cd700 1 --2- 172.21.15.87:0/3787487329 >> v2:172.21.15.115:3300/0 conn(0x7f86b0160c30 0x7f86b00cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b65cd700 1 -- 172.21.15.87:0/3787487329 >> v1:172.21.15.115:6789/0 conn(0x7f86b0156c20 legacy=0x7f86b015cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b65cd700 1 -- 172.21.15.87:0/3787487329 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b015d9c0 con 0x7f86b00cfca0 2023-03-30T08:11:12.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b65cd700 1 --2- 172.21.15.87:0/3787487329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86b00cfca0 0x7f86b00d0bb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f86b00cef70 tx=0x7f86a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709367217863afe7 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:12.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b4dca700 1 -- 172.21.15.87:0/3787487329 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a800e070 con 0x7f86b00cfca0 2023-03-30T08:11:12.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b4dca700 1 -- 172.21.15.87:0/3787487329 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a800b910 con 0x7f86b00cfca0 2023-03-30T08:11:12.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b4dca700 1 -- 172.21.15.87:0/3787487329 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a800bcc0 con 0x7f86b00cfca0 2023-03-30T08:11:12.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b8030700 1 -- 172.21.15.87:0/3787487329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86b00cfca0 msgr2=0x7f86b00d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.928+0000 7f86b8030700 1 --2- 172.21.15.87:0/3787487329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86b00cfca0 0x7f86b00d0bb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f86b00cef70 tx=0x7f86a800b330 comp rx=0 tx=0).stop 2023-03-30T08:11:12.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.932+0000 7f86b8030700 1 -- 172.21.15.87:0/3787487329 shutdown_connections 2023-03-30T08:11:12.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.932+0000 7f86b8030700 1 --2- 172.21.15.87:0/3787487329 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86b00cfca0 0x7f86b00d0bb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.932+0000 7f86b8030700 1 --2- 172.21.15.87:0/3787487329 >> v2:172.21.15.115:3300/0 conn(0x7f86b0160c30 0x7f86b00cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.932+0000 7f86b8030700 1 -- 172.21.15.87:0/3787487329 >> 172.21.15.87:0/3787487329 conn(0x7f86b006b2e0 msgr2=0x7f86b006b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:12.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.932+0000 7f86b8030700 1 -- 172.21.15.87:0/3787487329 shutdown_connections 2023-03-30T08:11:12.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.932+0000 7f86b8030700 1 -- 172.21.15.87:0/3787487329 wait complete. 2023-03-30T08:11:12.937 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.932+0000 7f86b8030700 1 Processor -- start 2023-03-30T08:11:12.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.932+0000 7f86b8030700 1 -- start start 2023-03-30T08:11:12.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b8030700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86b00cfca0 0x7f86b00c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b8030700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86b0156c20 0x7f86b00b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b8030700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86b0160c30 0x7f86b00b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b8030700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00c7c40 con 0x7f86b00cfca0 2023-03-30T08:11:12.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b8030700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00c84e0 con 0x7f86b0156c20 2023-03-30T08:11:12.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b8030700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00b7310 con 0x7f86b0160c30 2023-03-30T08:11:12.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b5dcc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86b00cfca0 0x7f86b00c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b5dcc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86b00cfca0 0x7f86b00c9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56430/0 (socket says 172.21.15.87:56430) 2023-03-30T08:11:12.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b5dcc700 1 -- 172.21.15.87:0/2674688213 learned_addr learned my addr 172.21.15.87:0/2674688213 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:12.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b55cb700 1 --2- 172.21.15.87:0/2674688213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86b0156c20 0x7f86b00b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b65cd700 1 --2- 172.21.15.87:0/2674688213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86b0160c30 0x7f86b00b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b5dcc700 1 -- 172.21.15.87:0/2674688213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86b0160c30 msgr2=0x7f86b00b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b5dcc700 1 --2- 172.21.15.87:0/2674688213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86b0160c30 0x7f86b00b68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b5dcc700 1 -- 172.21.15.87:0/2674688213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86b0156c20 msgr2=0x7f86b00b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:12.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b5dcc700 1 --2- 172.21.15.87:0/2674688213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86b0156c20 0x7f86b00b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:12.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b5dcc700 1 -- 172.21.15.87:0/2674688213 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a8009b30 con 0x7f86b00cfca0 2023-03-30T08:11:12.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b5dcc700 1 --2- 172.21.15.87:0/2674688213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86b00cfca0 0x7f86b00c9e90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00c530 tx=0x7f86ac00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:12.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86a67fc700 1 -- 172.21.15.87:0/2674688213 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0052d0 con 0x7f86b00cfca0 2023-03-30T08:11:12.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86a67fc700 1 -- 172.21.15.87:0/2674688213 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac005430 con 0x7f86b00cfca0 2023-03-30T08:11:12.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b8030700 1 -- 172.21.15.87:0/2674688213 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b00d00a0 con 0x7f86b00cfca0 2023-03-30T08:11:12.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86a67fc700 1 -- 172.21.15.87:0/2674688213 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0055a0 con 0x7f86b00cfca0 2023-03-30T08:11:12.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.936+0000 7f86b8030700 1 -- 172.21.15.87:0/2674688213 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b0160430 con 0x7f86b00cfca0 2023-03-30T08:11:12.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.940+0000 7f86b8030700 1 -- 172.21.15.87:0/2674688213 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b01610b0 con 0x7f86b00cfca0 2023-03-30T08:11:12.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.940+0000 7f86a67fc700 1 -- 172.21.15.87:0/2674688213 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f86ac0038e0 con 0x7f86b00cfca0 2023-03-30T08:11:12.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.944+0000 7f86a67fc700 1 --2- 172.21.15.87:0/2674688213 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f86940653f0 0x7f86940678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:12.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.944+0000 7f86a67fc700 1 -- 172.21.15.87:0/2674688213 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f86ac081f40 con 0x7f86b00cfca0 2023-03-30T08:11:12.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.944+0000 7f86b55cb700 1 --2- 172.21.15.87:0/2674688213 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f86940653f0 0x7f86940678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:12.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.944+0000 7f86b55cb700 1 --2- 172.21.15.87:0/2674688213 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f86940653f0 0x7f86940678a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f86b014eb80 tx=0x7f86a0009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:12.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:12.948+0000 7f86a67fc700 1 -- 172.21.15.87:0/2674688213 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f86ac04f830 con 0x7f86b00cfca0 2023-03-30T08:11:13.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.120+0000 7f86b8030700 1 -- 172.21.15.87:0/2674688213 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86b0073ee0 con 0x7f86b00cfca0 2023-03-30T08:11:13.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.120+0000 7f86a67fc700 1 -- 172.21.15.87:0/2674688213 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86ac052e50 con 0x7f86b00cfca0 2023-03-30T08:11:13.126 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:13.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.124+0000 7f86b8030700 1 -- 172.21.15.87:0/2674688213 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f86940653f0 msgr2=0x7f86940678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:13.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.124+0000 7f86b8030700 1 --2- 172.21.15.87:0/2674688213 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f86940653f0 0x7f86940678a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f86b014eb80 tx=0x7f86a0009240 comp rx=0 tx=0).stop 2023-03-30T08:11:13.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.124+0000 7f86b8030700 1 -- 172.21.15.87:0/2674688213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86b00cfca0 msgr2=0x7f86b00c9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:13.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.124+0000 7f86b8030700 1 --2- 172.21.15.87:0/2674688213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86b00cfca0 0x7f86b00c9e90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00c530 tx=0x7f86ac00c840 comp rx=0 tx=0).stop 2023-03-30T08:11:13.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.124+0000 7f86b8030700 1 -- 172.21.15.87:0/2674688213 shutdown_connections 2023-03-30T08:11:13.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.124+0000 7f86b8030700 1 --2- 172.21.15.87:0/2674688213 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f86940653f0 0x7f86940678a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.124+0000 7f86b8030700 1 --2- 172.21.15.87:0/2674688213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f86b0160c30 0x7f86b00b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.124+0000 7f86b8030700 1 --2- 172.21.15.87:0/2674688213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86b0156c20 0x7f86b00b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.124+0000 7f86b8030700 1 --2- 172.21.15.87:0/2674688213 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f86b00cfca0 0x7f86b00c9e90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.124+0000 7f86b8030700 1 -- 172.21.15.87:0/2674688213 >> 172.21.15.87:0/2674688213 conn(0x7f86b006b2e0 msgr2=0x7f86b015dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:13.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.124+0000 7f86b8030700 1 -- 172.21.15.87:0/2674688213 shutdown_connections 2023-03-30T08:11:13.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.124+0000 7f86b8030700 1 -- 172.21.15.87:0/2674688213 wait complete. 2023-03-30T08:11:13.146 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-30T08:11:13.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.300+0000 7fedf4d13700 1 Processor -- start 2023-03-30T08:11:13.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.300+0000 7fedf4d13700 1 -- start start 2023-03-30T08:11:13.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.300+0000 7fedf4d13700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fedf00d27e0 0x7fedf00d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:13.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fedf4d13700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf0160ef0 con 0x7fedf00b8380 2023-03-30T08:11:13.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fedf4d13700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf00cd6a0 con 0x7fedf006a3e0 2023-03-30T08:11:13.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fedf4d13700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf00cd3a0 con 0x7fedf00d27e0 2023-03-30T08:11:13.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fede6ffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fedf00d27e0 0x7fedf00d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:13.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fede6ffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fedf00d27e0 0x7fedf00d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56436/0 (socket says 172.21.15.87:56436) 2023-03-30T08:11:13.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fede6ffd700 1 -- 172.21.15.87:0/4138473675 learned_addr learned my addr 172.21.15.87:0/4138473675 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:13.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fedef7fe700 1 --1- 172.21.15.87:0/4138473675 >> v1:172.21.15.87:6789/0 conn(0x7fedf00b8380 0x7fedf0069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43540/0 (socket says 172.21.15.87:43540) 2023-03-30T08:11:13.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fede6ffd700 1 -- 172.21.15.87:0/4138473675 >> v1:172.21.15.115:6789/0 conn(0x7fedf006a3e0 legacy=0x7fedf00d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:13.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fede6ffd700 1 -- 172.21.15.87:0/4138473675 >> v1:172.21.15.87:6789/0 conn(0x7fedf00b8380 legacy=0x7fedf0069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:13.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fede6ffd700 1 -- 172.21.15.87:0/4138473675 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf00cef00 con 0x7fedf00d27e0 2023-03-30T08:11:13.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fede6ffd700 1 --2- 172.21.15.87:0/4138473675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf00d27e0 0x7fedf00d2200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009e80 tx=0x7fedd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b813067ff1d62b01 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:13.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fedeeffd700 1 -- 172.21.15.87:0/4138473675 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd800e070 con 0x7fedf00d27e0 2023-03-30T08:11:13.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fedeeffd700 1 -- 172.21.15.87:0/4138473675 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd8003a40 con 0x7fedf00d27e0 2023-03-30T08:11:13.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fedeeffd700 1 -- 172.21.15.87:0/4138473675 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8003df0 con 0x7fedf00d27e0 2023-03-30T08:11:13.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fedf4d13700 1 -- 172.21.15.87:0/4138473675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf00d27e0 msgr2=0x7fedf00d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:13.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fedf4d13700 1 --2- 172.21.15.87:0/4138473675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf00d27e0 0x7fedf00d2200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009e80 tx=0x7fedd800b330 comp rx=0 tx=0).stop 2023-03-30T08:11:13.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fedf4d13700 1 -- 172.21.15.87:0/4138473675 shutdown_connections 2023-03-30T08:11:13.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fedf4d13700 1 --2- 172.21.15.87:0/4138473675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf00d27e0 0x7fedf00d2200 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fedf4d13700 1 -- 172.21.15.87:0/4138473675 >> 172.21.15.87:0/4138473675 conn(0x7fedf00b53f0 msgr2=0x7fedf00cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:13.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fedf4d13700 1 -- 172.21.15.87:0/4138473675 shutdown_connections 2023-03-30T08:11:13.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.304+0000 7fedf4d13700 1 -- 172.21.15.87:0/4138473675 wait complete. 2023-03-30T08:11:13.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.308+0000 7fedf4d13700 1 Processor -- start 2023-03-30T08:11:13.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.308+0000 7fedf4d13700 1 -- start start 2023-03-30T08:11:13.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedf4d13700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf006a3e0 0x7fedf00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:13.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedf4d13700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedf00b8380 0x7fedf0159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:13.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedf4d13700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedf015cae0 0x7fedf01593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:13.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedf4d13700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf00c9a80 con 0x7fedf006a3e0 2023-03-30T08:11:13.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedf4d13700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf015cf70 con 0x7fedf015cae0 2023-03-30T08:11:13.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedf4d13700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf015d250 con 0x7fedf00b8380 2023-03-30T08:11:13.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedef7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf006a3e0 0x7fedf00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:13.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedef7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf006a3e0 0x7fedf00cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56448/0 (socket says 172.21.15.87:56448) 2023-03-30T08:11:13.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedef7fe700 1 -- 172.21.15.87:0/877164707 learned_addr learned my addr 172.21.15.87:0/877164707 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:13.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fede6ffd700 1 --2- 172.21.15.87:0/877164707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedf00b8380 0x7fedf0159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:13.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedeffff700 1 --2- 172.21.15.87:0/877164707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedf015cae0 0x7fedf01593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:13.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedef7fe700 1 -- 172.21.15.87:0/877164707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedf00b8380 msgr2=0x7fedf0159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:13.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedef7fe700 1 --2- 172.21.15.87:0/877164707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedf00b8380 0x7fedf0159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedef7fe700 1 -- 172.21.15.87:0/877164707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedf015cae0 msgr2=0x7fedf01593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:13.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedef7fe700 1 --2- 172.21.15.87:0/877164707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedf015cae0 0x7fedf01593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedef7fe700 1 -- 172.21.15.87:0/877164707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd8009b30 con 0x7fedf006a3e0 2023-03-30T08:11:13.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.312+0000 7fedef7fe700 1 --2- 172.21.15.87:0/877164707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf006a3e0 0x7fedf00cc6f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fede000c500 tx=0x7fede000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:13.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.316+0000 7fedecff9700 1 -- 172.21.15.87:0/877164707 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0005cd0 con 0x7fedf006a3e0 2023-03-30T08:11:13.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.316+0000 7fedecff9700 1 -- 172.21.15.87:0/877164707 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede0005e30 con 0x7fedf006a3e0 2023-03-30T08:11:13.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.316+0000 7fedf4d13700 1 -- 172.21.15.87:0/877164707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf00cf480 con 0x7fedf006a3e0 2023-03-30T08:11:13.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.316+0000 7fedecff9700 1 -- 172.21.15.87:0/877164707 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede00072f0 con 0x7fedf006a3e0 2023-03-30T08:11:13.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.316+0000 7fedf4d13700 1 -- 172.21.15.87:0/877164707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf00cf1a0 con 0x7fedf006a3e0 2023-03-30T08:11:13.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.316+0000 7fedf4d13700 1 -- 172.21.15.87:0/877164707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf00b8750 con 0x7fedf006a3e0 2023-03-30T08:11:13.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.316+0000 7fedecff9700 1 -- 172.21.15.87:0/877164707 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fede0007450 con 0x7fedf006a3e0 2023-03-30T08:11:13.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.320+0000 7fedecff9700 1 --2- 172.21.15.87:0/877164707 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fedd00653f0 0x7fedd00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:13.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.320+0000 7fedecff9700 1 -- 172.21.15.87:0/877164707 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fede0081f80 con 0x7fedf006a3e0 2023-03-30T08:11:13.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.320+0000 7fede6ffd700 1 --2- 172.21.15.87:0/877164707 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fedd00653f0 0x7fedd00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:13.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.320+0000 7fede6ffd700 1 --2- 172.21.15.87:0/877164707 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fedd00653f0 0x7fedd00678a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009e80 tx=0x7fedd8009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:13.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.324+0000 7fedecff9700 1 -- 172.21.15.87:0/877164707 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fede004f870 con 0x7fedf006a3e0 2023-03-30T08:11:13.499 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.492+0000 7fedf4d13700 1 -- 172.21.15.87:0/877164707 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fedf0072cf0 con 0x7fedf006a3e0 2023-03-30T08:11:13.500 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.496+0000 7fedecff9700 1 -- 172.21.15.87:0/877164707 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fede00170a0 con 0x7fedf006a3e0 2023-03-30T08:11:13.500 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-03-30T08:11:13.502 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.496+0000 7fedf4d13700 1 -- 172.21.15.87:0/877164707 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fedd00653f0 msgr2=0x7fedd00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:13.502 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.496+0000 7fedf4d13700 1 --2- 172.21.15.87:0/877164707 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fedd00653f0 0x7fedd00678a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009e80 tx=0x7fedd8009000 comp rx=0 tx=0).stop 2023-03-30T08:11:13.502 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.496+0000 7fedf4d13700 1 -- 172.21.15.87:0/877164707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf006a3e0 msgr2=0x7fedf00cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.496+0000 7fedf4d13700 1 --2- 172.21.15.87:0/877164707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf006a3e0 0x7fedf00cc6f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fede000c500 tx=0x7fede000c810 comp rx=0 tx=0).stop 2023-03-30T08:11:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.496+0000 7fedf4d13700 1 -- 172.21.15.87:0/877164707 shutdown_connections 2023-03-30T08:11:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.496+0000 7fedf4d13700 1 --2- 172.21.15.87:0/877164707 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fedd00653f0 0x7fedd00678a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.496+0000 7fedf4d13700 1 --2- 172.21.15.87:0/877164707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedf015cae0 0x7fedf01593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.496+0000 7fedf4d13700 1 --2- 172.21.15.87:0/877164707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fedf00b8380 0x7fedf0159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.496+0000 7fedf4d13700 1 --2- 172.21.15.87:0/877164707 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf006a3e0 0x7fedf00cc6f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.503 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.496+0000 7fedf4d13700 1 -- 172.21.15.87:0/877164707 >> 172.21.15.87:0/877164707 conn(0x7fedf00b53f0 msgr2=0x7fedf00cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:13.504 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.500+0000 7fedf4d13700 1 -- 172.21.15.87:0/877164707 shutdown_connections 2023-03-30T08:11:13.504 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.500+0000 7fedf4d13700 1 -- 172.21.15.87:0/877164707 wait complete. 2023-03-30T08:11:13.521 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-30T08:11:13.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.676+0000 7fdc17061700 1 Processor -- start 2023-03-30T08:11:13.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.676+0000 7fdc17061700 1 -- start start 2023-03-30T08:11:13.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc17061700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdc100d27e0 0x7fdc100d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc17061700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1006a3e0 0x7fdc100d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc17061700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc10160ef0 con 0x7fdc100b8380 2023-03-30T08:11:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc17061700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc100cd6a0 con 0x7fdc100d27e0 2023-03-30T08:11:13.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc17061700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc100cd3a0 con 0x7fdc1006a3e0 2023-03-30T08:11:13.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc1605f700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fdc100b8380 0x7fdc10069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43546/0 (socket says 172.21.15.87:43546) 2023-03-30T08:11:13.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc1605f700 1 -- 172.21.15.87:0/291462326 learned_addr learned my addr 172.21.15.87:0/291462326 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:13.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc1585e700 1 --2- 172.21.15.87:0/291462326 >> v2:172.21.15.87:3300/0 conn(0x7fdc100d27e0 0x7fdc100d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:13.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc16860700 1 --2- 172.21.15.87:0/291462326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1006a3e0 0x7fdc100d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:13.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc1585e700 1 -- 172.21.15.87:0/291462326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1006a3e0 msgr2=0x7fdc100d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:13.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc1585e700 1 --2- 172.21.15.87:0/291462326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1006a3e0 0x7fdc100d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc1585e700 1 -- 172.21.15.87:0/291462326 >> v1:172.21.15.87:6789/0 conn(0x7fdc100b8380 legacy=0x7fdc10069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:13.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc1585e700 1 -- 172.21.15.87:0/291462326 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc100cef00 con 0x7fdc100d27e0 2023-03-30T08:11:13.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc1505d700 1 -- 172.21.15.87:0/291462326 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919895712 0 0) 0x7fdc10160ef0 con 0x7fdc100b8380 2023-03-30T08:11:13.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc1585e700 1 --2- 172.21.15.87:0/291462326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc100d27e0 0x7fdc100d2200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009850 tx=0x7fdc00009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1743295217b0da server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:13.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc1505d700 1 -- 172.21.15.87:0/291462326 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00011830 con 0x7fdc100d27e0 2023-03-30T08:11:13.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc1505d700 1 -- 172.21.15.87:0/291462326 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc00011990 con 0x7fdc100d27e0 2023-03-30T08:11:13.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc1505d700 1 -- 172.21.15.87:0/291462326 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00011d40 con 0x7fdc100d27e0 2023-03-30T08:11:13.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc17061700 1 -- 172.21.15.87:0/291462326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc100d27e0 msgr2=0x7fdc100d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:13.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.680+0000 7fdc17061700 1 --2- 172.21.15.87:0/291462326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc100d27e0 0x7fdc100d2200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009850 tx=0x7fdc00009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:13.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.684+0000 7fdc17061700 1 -- 172.21.15.87:0/291462326 shutdown_connections 2023-03-30T08:11:13.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.684+0000 7fdc17061700 1 --2- 172.21.15.87:0/291462326 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1006a3e0 0x7fdc100d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.684+0000 7fdc17061700 1 --2- 172.21.15.87:0/291462326 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc100d27e0 0x7fdc100d2200 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.684+0000 7fdc17061700 1 -- 172.21.15.87:0/291462326 >> 172.21.15.87:0/291462326 conn(0x7fdc100b53f0 msgr2=0x7fdc100cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:13.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.684+0000 7fdc17061700 1 -- 172.21.15.87:0/291462326 shutdown_connections 2023-03-30T08:11:13.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.684+0000 7fdc17061700 1 -- 172.21.15.87:0/291462326 wait complete. 2023-03-30T08:11:13.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.684+0000 7fdc17061700 1 Processor -- start 2023-03-30T08:11:13.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.684+0000 7fdc17061700 1 -- start start 2023-03-30T08:11:13.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.684+0000 7fdc17061700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc1006a3e0 0x7fdc100b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:13.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.684+0000 7fdc17061700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc100b8380 0x7fdc1015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:13.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.684+0000 7fdc17061700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1015b0c0 0x7fdc100ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:13.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.684+0000 7fdc17061700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc101f2720 con 0x7fdc1006a3e0 2023-03-30T08:11:13.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.684+0000 7fdc17061700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1015b540 con 0x7fdc100b8380 2023-03-30T08:11:13.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.684+0000 7fdc17061700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc100b1320 con 0x7fdc1015b0c0 2023-03-30T08:11:13.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc1605f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc1006a3e0 0x7fdc100b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:13.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc1605f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc1006a3e0 0x7fdc100b0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56462/0 (socket says 172.21.15.87:56462) 2023-03-30T08:11:13.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc1605f700 1 -- 172.21.15.87:0/3126106027 learned_addr learned my addr 172.21.15.87:0/3126106027 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:13.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc16860700 1 --2- 172.21.15.87:0/3126106027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1015b0c0 0x7fdc100ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:13.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc1585e700 1 --2- 172.21.15.87:0/3126106027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc100b8380 0x7fdc1015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:13.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc1605f700 1 -- 172.21.15.87:0/3126106027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1015b0c0 msgr2=0x7fdc100ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:13.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc1605f700 1 --2- 172.21.15.87:0/3126106027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1015b0c0 0x7fdc100ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc1605f700 1 -- 172.21.15.87:0/3126106027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc100b8380 msgr2=0x7fdc1015ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:13.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc1605f700 1 --2- 172.21.15.87:0/3126106027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc100b8380 0x7fdc1015ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc1605f700 1 -- 172.21.15.87:0/3126106027 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc000094b0 con 0x7fdc1006a3e0 2023-03-30T08:11:13.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc1585e700 1 --2- 172.21.15.87:0/3126106027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc100b8380 0x7fdc1015ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:13.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc1605f700 1 --2- 172.21.15.87:0/3126106027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc1006a3e0 0x7fdc100b0de0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00c580 tx=0x7fdc0c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:13.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc06ffd700 1 -- 172.21.15.87:0/3126106027 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c004ca0 con 0x7fdc1006a3e0 2023-03-30T08:11:13.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc06ffd700 1 -- 172.21.15.87:0/3126106027 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c004e20 con 0x7fdc1006a3e0 2023-03-30T08:11:13.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc06ffd700 1 -- 172.21.15.87:0/3126106027 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c007310 con 0x7fdc1006a3e0 2023-03-30T08:11:13.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc17061700 1 -- 172.21.15.87:0/3126106027 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc100cf480 con 0x7fdc1006a3e0 2023-03-30T08:11:13.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc17061700 1 -- 172.21.15.87:0/3126106027 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc100cf1a0 con 0x7fdc1006a3e0 2023-03-30T08:11:13.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.688+0000 7fdc17061700 1 -- 172.21.15.87:0/3126106027 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc100b8750 con 0x7fdc1006a3e0 2023-03-30T08:11:13.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.692+0000 7fdc06ffd700 1 -- 172.21.15.87:0/3126106027 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fdc0c007470 con 0x7fdc1006a3e0 2023-03-30T08:11:13.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.692+0000 7fdc06ffd700 1 --2- 172.21.15.87:0/3126106027 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdbf40653f0 0x7fdbf40678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:13.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.692+0000 7fdc06ffd700 1 -- 172.21.15.87:0/3126106027 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdc0c082810 con 0x7fdc1006a3e0 2023-03-30T08:11:13.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.692+0000 7fdc1585e700 1 --2- 172.21.15.87:0/3126106027 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdbf40653f0 0x7fdbf40678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:13.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.696+0000 7fdc1585e700 1 --2- 172.21.15.87:0/3126106027 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdbf40653f0 0x7fdbf40678a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009850 tx=0x7fdc0001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:13.703 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.700+0000 7fdc06ffd700 1 -- 172.21.15.87:0/3126106027 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fdc0c050190 con 0x7fdc1006a3e0 2023-03-30T08:11:13.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.864+0000 7fdc17061700 1 -- 172.21.15.87:0/3126106027 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdc10072cf0 con 0x7fdc1006a3e0 2023-03-30T08:11:13.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.864+0000 7fdc06ffd700 1 -- 172.21.15.87:0/3126106027 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdc0c007720 con 0x7fdc1006a3e0 2023-03-30T08:11:13.870 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:13.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.868+0000 7fdc17061700 1 -- 172.21.15.87:0/3126106027 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdbf40653f0 msgr2=0x7fdbf40678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:13.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.868+0000 7fdc17061700 1 --2- 172.21.15.87:0/3126106027 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdbf40653f0 0x7fdbf40678a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009850 tx=0x7fdc0001c040 comp rx=0 tx=0).stop 2023-03-30T08:11:13.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.868+0000 7fdc17061700 1 -- 172.21.15.87:0/3126106027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc1006a3e0 msgr2=0x7fdc100b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:13.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.868+0000 7fdc17061700 1 --2- 172.21.15.87:0/3126106027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc1006a3e0 0x7fdc100b0de0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00c580 tx=0x7fdc0c00c890 comp rx=0 tx=0).stop 2023-03-30T08:11:13.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.868+0000 7fdc17061700 1 -- 172.21.15.87:0/3126106027 shutdown_connections 2023-03-30T08:11:13.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.868+0000 7fdc17061700 1 --2- 172.21.15.87:0/3126106027 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdbf40653f0 0x7fdbf40678a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.868+0000 7fdc17061700 1 --2- 172.21.15.87:0/3126106027 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc1015b0c0 0x7fdc100ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.868+0000 7fdc17061700 1 --2- 172.21.15.87:0/3126106027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc100b8380 0x7fdc1015ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.868+0000 7fdc17061700 1 --2- 172.21.15.87:0/3126106027 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdc1006a3e0 0x7fdc100b0de0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:13.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.868+0000 7fdc17061700 1 -- 172.21.15.87:0/3126106027 >> 172.21.15.87:0/3126106027 conn(0x7fdc100b53f0 msgr2=0x7fdc1015c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:13.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.868+0000 7fdc17061700 1 -- 172.21.15.87:0/3126106027 shutdown_connections 2023-03-30T08:11:13.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:13.868+0000 7fdc17061700 1 -- 172.21.15.87:0/3126106027 wait complete. 2023-03-30T08:11:13.893 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-30T08:11:14.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.048+0000 7f99f5a61700 1 Processor -- start 2023-03-30T08:11:14.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.048+0000 7f99f5a61700 1 -- start start 2023-03-30T08:11:14.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.048+0000 7f99f5a61700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f99f00b1ae0 0x7f99f00b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:14.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.048+0000 7f99f5a61700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99f00d09a0 0x7f99f00d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:14.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.048+0000 7f99f5a61700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f00cd880 con 0x7f99f00b4600 2023-03-30T08:11:14.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.048+0000 7f99f5a61700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f00cf410 con 0x7f99f00b1ae0 2023-03-30T08:11:14.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.048+0000 7f99f5a61700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00cd270 con 0x7f99f00d09a0 2023-03-30T08:11:14.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.048+0000 7f99f4a5f700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f99f00b4600 0x7f99f0160b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43558/0 (socket says 172.21.15.87:43558) 2023-03-30T08:11:14.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.048+0000 7f99f4a5f700 1 -- 172.21.15.87:0/2520611473 learned_addr learned my addr 172.21.15.87:0/2520611473 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:14.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.048+0000 7f99f5260700 1 --2- 172.21.15.87:0/2520611473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99f00d09a0 0x7f99f00d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:14.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.048+0000 7f99e7fff700 1 --2- 172.21.15.87:0/2520611473 >> v2:172.21.15.115:3300/0 conn(0x7f99f00b1ae0 0x7f99f00b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:14.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.048+0000 7f99e77fe700 1 -- 172.21.15.87:0/2520611473 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634129227 0 0) 0x7f99f00cd880 con 0x7f99f00b4600 2023-03-30T08:11:14.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99e77fe700 1 -- 172.21.15.87:0/2520611473 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99d80035d0 con 0x7f99f00b4600 2023-03-30T08:11:14.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99e7fff700 1 -- 172.21.15.87:0/2520611473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99f00d09a0 msgr2=0x7f99f00d0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:14.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99e7fff700 1 --2- 172.21.15.87:0/2520611473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99f00d09a0 0x7f99f00d0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99e7fff700 1 -- 172.21.15.87:0/2520611473 >> v1:172.21.15.87:6789/0 conn(0x7f99f00b4600 legacy=0x7f99f0160b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:14.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99e7fff700 1 -- 172.21.15.87:0/2520611473 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f00b4f10 con 0x7f99f00b1ae0 2023-03-30T08:11:14.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99f5260700 1 --2- 172.21.15.87:0/2520611473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99f00d09a0 0x7f99f00d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:14.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99e7fff700 1 --2- 172.21.15.87:0/2520611473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99f00b1ae0 0x7f99f00b49d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009850 tx=0x7f99e0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ea77fab32c01b95 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:14.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99e77fe700 1 -- 172.21.15.87:0/2520611473 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0011830 con 0x7f99f00b1ae0 2023-03-30T08:11:14.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99e77fe700 1 -- 172.21.15.87:0/2520611473 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e0011990 con 0x7f99f00b1ae0 2023-03-30T08:11:14.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99e77fe700 1 -- 172.21.15.87:0/2520611473 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0011d40 con 0x7f99f00b1ae0 2023-03-30T08:11:14.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99f5a61700 1 -- 172.21.15.87:0/2520611473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99f00b1ae0 msgr2=0x7f99f00b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:14.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99f5a61700 1 --2- 172.21.15.87:0/2520611473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99f00b1ae0 0x7f99f00b49d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009850 tx=0x7f99e0009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:14.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99f5a61700 1 -- 172.21.15.87:0/2520611473 shutdown_connections 2023-03-30T08:11:14.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99f5a61700 1 --2- 172.21.15.87:0/2520611473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99f00d09a0 0x7f99f00d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99f5a61700 1 --2- 172.21.15.87:0/2520611473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99f00b1ae0 0x7f99f00b49d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99f5a61700 1 -- 172.21.15.87:0/2520611473 >> 172.21.15.87:0/2520611473 conn(0x7f99f00d0290 msgr2=0x7f99f00d2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:14.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99f5a61700 1 -- 172.21.15.87:0/2520611473 shutdown_connections 2023-03-30T08:11:14.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.052+0000 7f99f5a61700 1 -- 172.21.15.87:0/2520611473 wait complete. 2023-03-30T08:11:14.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.056+0000 7f99f5a61700 1 Processor -- start 2023-03-30T08:11:14.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.056+0000 7f99f5a61700 1 -- start start 2023-03-30T08:11:14.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99f5a61700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99f00b1ae0 0x7f99f015f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:14.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99f5a61700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f00b4600 0x7f99f00cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:14.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99f5a61700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99f00d09a0 0x7f99f0152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:14.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99f5a61700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f015d7f0 con 0x7f99f00b4600 2023-03-30T08:11:14.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99f5a61700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00cc550 con 0x7f99f00b1ae0 2023-03-30T08:11:14.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99f5a61700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00cbf90 con 0x7f99f00d09a0 2023-03-30T08:11:14.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99e7fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f00b4600 0x7f99f00cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:14.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99e7fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f00b4600 0x7f99f00cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56466/0 (socket says 172.21.15.87:56466) 2023-03-30T08:11:14.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99e7fff700 1 -- 172.21.15.87:0/4070394286 learned_addr learned my addr 172.21.15.87:0/4070394286 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:14.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99f4a5f700 1 --2- 172.21.15.87:0/4070394286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99f00b1ae0 0x7f99f015f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:14.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99f5260700 1 --2- 172.21.15.87:0/4070394286 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99f00d09a0 0x7f99f0152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:14.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99e7fff700 1 -- 172.21.15.87:0/4070394286 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99f00d09a0 msgr2=0x7f99f0152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:14.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99e7fff700 1 --2- 172.21.15.87:0/4070394286 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99f00d09a0 0x7f99f0152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99e7fff700 1 -- 172.21.15.87:0/4070394286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99f00b1ae0 msgr2=0x7f99f015f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:14.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99e7fff700 1 --2- 172.21.15.87:0/4070394286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99f00b1ae0 0x7f99f015f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99e7fff700 1 -- 172.21.15.87:0/4070394286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e8009a70 con 0x7f99f00b4600 2023-03-30T08:11:14.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99f5260700 1 --2- 172.21.15.87:0/4070394286 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99f00d09a0 0x7f99f0152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:14.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99e7fff700 1 --2- 172.21.15.87:0/4070394286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f00b4600 0x7f99f00cb620 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f99e0014040 tx=0x7f99e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:14.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99e57fa700 1 -- 172.21.15.87:0/4070394286 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0004590 con 0x7f99f00b4600 2023-03-30T08:11:14.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99e57fa700 1 -- 172.21.15.87:0/4070394286 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e001e070 con 0x7f99f00b4600 2023-03-30T08:11:14.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99e57fa700 1 -- 172.21.15.87:0/4070394286 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0003900 con 0x7f99f00b4600 2023-03-30T08:11:14.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99f5a61700 1 -- 172.21.15.87:0/4070394286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e00094b0 con 0x7f99f00b4600 2023-03-30T08:11:14.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.060+0000 7f99f5a61700 1 -- 172.21.15.87:0/4070394286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f00cd510 con 0x7f99f00b4600 2023-03-30T08:11:14.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.064+0000 7f99f5a61700 1 -- 172.21.15.87:0/4070394286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f00cf130 con 0x7f99f00b4600 2023-03-30T08:11:14.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.064+0000 7f99e57fa700 1 -- 172.21.15.87:0/4070394286 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f99e0003a60 con 0x7f99f00b4600 2023-03-30T08:11:14.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.068+0000 7f99e57fa700 1 --2- 172.21.15.87:0/4070394286 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f99dc0653f0 0x7f99dc0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:14.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.068+0000 7f99e57fa700 1 -- 172.21.15.87:0/4070394286 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f99e0020070 con 0x7f99f00b4600 2023-03-30T08:11:14.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.068+0000 7f99f4a5f700 1 --2- 172.21.15.87:0/4070394286 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f99dc0653f0 0x7f99dc0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:14.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.068+0000 7f99f4a5f700 1 --2- 172.21.15.87:0/4070394286 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f99dc0653f0 0x7f99dc0678a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f99ec007fd0 tx=0x7f99ec007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:14.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.072+0000 7f99e57fa700 1 -- 172.21.15.87:0/4070394286 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f99e00553a0 con 0x7f99f00b4600 2023-03-30T08:11:14.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.256+0000 7f99f5a61700 1 -- 172.21.15.87:0/4070394286 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f99f00cede0 con 0x7f99f00b4600 2023-03-30T08:11:14.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.260+0000 7f99e57fa700 1 -- 172.21.15.87:0/4070394286 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f99e0015080 con 0x7f99f00b4600 2023-03-30T08:11:14.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.260+0000 7f99f5a61700 1 -- 172.21.15.87:0/4070394286 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f99dc0653f0 msgr2=0x7f99dc0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:14.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.260+0000 7f99f5a61700 1 --2- 172.21.15.87:0/4070394286 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f99dc0653f0 0x7f99dc0678a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f99ec007fd0 tx=0x7f99ec007de0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.260+0000 7f99f5a61700 1 -- 172.21.15.87:0/4070394286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f00b4600 msgr2=0x7f99f00cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:14.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.260+0000 7f99f5a61700 1 --2- 172.21.15.87:0/4070394286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f00b4600 0x7f99f00cb620 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f99e0014040 tx=0x7f99e0004770 comp rx=0 tx=0).stop 2023-03-30T08:11:14.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.260+0000 7f99f5a61700 1 -- 172.21.15.87:0/4070394286 shutdown_connections 2023-03-30T08:11:14.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.260+0000 7f99f5a61700 1 --2- 172.21.15.87:0/4070394286 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f99dc0653f0 0x7f99dc0678a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.260+0000 7f99f5a61700 1 --2- 172.21.15.87:0/4070394286 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99f00d09a0 0x7f99f0152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.260+0000 7f99f5a61700 1 --2- 172.21.15.87:0/4070394286 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f00b4600 0x7f99f00cb620 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.260+0000 7f99f5a61700 1 --2- 172.21.15.87:0/4070394286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99f00b1ae0 0x7f99f015f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.260+0000 7f99f5a61700 1 -- 172.21.15.87:0/4070394286 >> 172.21.15.87:0/4070394286 conn(0x7f99f00d0290 msgr2=0x7f99f00d2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:14.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.260+0000 7f99f5a61700 1 -- 172.21.15.87:0/4070394286 shutdown_connections 2023-03-30T08:11:14.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.260+0000 7f99f5a61700 1 -- 172.21.15.87:0/4070394286 wait complete. 2023-03-30T08:11:14.268 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2023-03-30T08:11:14.286 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2023-03-30T08:11:14.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:14.286 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-03-30T08:11:14.323 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi087.stderr:ceph-fuse[40010]: fuse finished with error 0 and tester_r 0 2023-03-30T08:11:14.326 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T08:11:14.396 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2023-03-30T08:11:14.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:14.397 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-03-30T08:11:14.418 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:14.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.620+0000 7fb775a9f700 1 Processor -- start 2023-03-30T08:11:14.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.620+0000 7fb775a9f700 1 -- start start 2023-03-30T08:11:14.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb775a9f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb7700d27e0 0x7fb7700d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:14.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb775a9f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb77006a3e0 0x7fb7700d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:14.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb775a9f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb770160ef0 con 0x7fb7700b8380 2023-03-30T08:11:14.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb775a9f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7700cd6a0 con 0x7fb77006a3e0 2023-03-30T08:11:14.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb775a9f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7700cd3a0 con 0x7fb7700d27e0 2023-03-30T08:11:14.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb77529e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb77006a3e0 0x7fb7700d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:14.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb77529e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb77006a3e0 0x7fb7700d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56474/0 (socket says 172.21.15.87:56474) 2023-03-30T08:11:14.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb77529e700 1 -- 172.21.15.87:0/1178366105 learned_addr learned my addr 172.21.15.87:0/1178366105 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:14.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb77529e700 1 -- 172.21.15.87:0/1178366105 >> v2:172.21.15.115:3300/0 conn(0x7fb7700d27e0 msgr2=0x7fb7700d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:14.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb77529e700 1 --2- 172.21.15.87:0/1178366105 >> v2:172.21.15.115:3300/0 conn(0x7fb7700d27e0 0x7fb7700d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb77529e700 1 -- 172.21.15.87:0/1178366105 >> v1:172.21.15.115:6789/0 conn(0x7fb7700b8380 legacy=0x7fb770069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:14.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb77529e700 1 -- 172.21.15.87:0/1178366105 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700cef00 con 0x7fb77006a3e0 2023-03-30T08:11:14.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb77529e700 1 --2- 172.21.15.87:0/1178366105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb77006a3e0 0x7fb7700d0880 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb768009e50 tx=0x7fb76800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1efbc353c9eddbd server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:14.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb7677fe700 1 -- 172.21.15.87:0/1178366105 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76800e070 con 0x7fb77006a3e0 2023-03-30T08:11:14.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb7677fe700 1 -- 172.21.15.87:0/1178366105 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb768003a40 con 0x7fb77006a3e0 2023-03-30T08:11:14.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.624+0000 7fb7677fe700 1 -- 172.21.15.87:0/1178366105 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768003df0 con 0x7fb77006a3e0 2023-03-30T08:11:14.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.628+0000 7fb775a9f700 1 -- 172.21.15.87:0/1178366105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb77006a3e0 msgr2=0x7fb7700d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:14.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.628+0000 7fb775a9f700 1 --2- 172.21.15.87:0/1178366105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb77006a3e0 0x7fb7700d0880 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb768009e50 tx=0x7fb76800b330 comp rx=0 tx=0).stop 2023-03-30T08:11:14.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.628+0000 7fb775a9f700 1 -- 172.21.15.87:0/1178366105 shutdown_connections 2023-03-30T08:11:14.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.628+0000 7fb775a9f700 1 --2- 172.21.15.87:0/1178366105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb77006a3e0 0x7fb7700d0880 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.628+0000 7fb775a9f700 1 --2- 172.21.15.87:0/1178366105 >> v2:172.21.15.115:3300/0 conn(0x7fb7700d27e0 0x7fb7700d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.628+0000 7fb775a9f700 1 -- 172.21.15.87:0/1178366105 >> 172.21.15.87:0/1178366105 conn(0x7fb7700b53f0 msgr2=0x7fb7700cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:14.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.628+0000 7fb775a9f700 1 -- 172.21.15.87:0/1178366105 shutdown_connections 2023-03-30T08:11:14.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.628+0000 7fb775a9f700 1 -- 172.21.15.87:0/1178366105 wait complete. 2023-03-30T08:11:14.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb775a9f700 1 Processor -- start 2023-03-30T08:11:14.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb775a9f700 1 -- start start 2023-03-30T08:11:14.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb775a9f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb77006a3e0 0x7fb77015cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:14.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb775a9f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7700b8380 0x7fb7701f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:14.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb775a9f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7701f2a40 0x7fb77015e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:14.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb775a9f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77015d020 con 0x7fb77006a3e0 2023-03-30T08:11:14.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb775a9f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77015d250 con 0x7fb7701f2a40 2023-03-30T08:11:14.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb775a9f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77015d530 con 0x7fb7700b8380 2023-03-30T08:11:14.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb774a9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb77006a3e0 0x7fb77015cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:14.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb774a9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb77006a3e0 0x7fb77015cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56476/0 (socket says 172.21.15.87:56476) 2023-03-30T08:11:14.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb774a9d700 1 -- 172.21.15.87:0/4029061865 learned_addr learned my addr 172.21.15.87:0/4029061865 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:14.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb77529e700 1 --2- 172.21.15.87:0/4029061865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7701f2a40 0x7fb77015e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:14.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb767fff700 1 --2- 172.21.15.87:0/4029061865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7700b8380 0x7fb7701f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:14.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb774a9d700 1 -- 172.21.15.87:0/4029061865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7700b8380 msgr2=0x7fb7701f2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:14.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb774a9d700 1 --2- 172.21.15.87:0/4029061865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7700b8380 0x7fb7701f2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb774a9d700 1 -- 172.21.15.87:0/4029061865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7701f2a40 msgr2=0x7fb77015e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:14.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb774a9d700 1 --2- 172.21.15.87:0/4029061865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7701f2a40 0x7fb77015e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb774a9d700 1 -- 172.21.15.87:0/4029061865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb768009b30 con 0x7fb77006a3e0 2023-03-30T08:11:14.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb77529e700 1 --2- 172.21.15.87:0/4029061865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7701f2a40 0x7fb77015e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:14.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb774a9d700 1 --2- 172.21.15.87:0/4029061865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb77006a3e0 0x7fb77015cae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00c4e0 tx=0x7fb76c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:14.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb7657fa700 1 -- 172.21.15.87:0/4029061865 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c011790 con 0x7fb77006a3e0 2023-03-30T08:11:14.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb7657fa700 1 -- 172.21.15.87:0/4029061865 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c011910 con 0x7fb77006a3e0 2023-03-30T08:11:14.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb7657fa700 1 -- 172.21.15.87:0/4029061865 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c011cc0 con 0x7fb77006a3e0 2023-03-30T08:11:14.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.632+0000 7fb775a9f700 1 -- 172.21.15.87:0/4029061865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7700cf480 con 0x7fb77006a3e0 2023-03-30T08:11:14.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.636+0000 7fb775a9f700 1 -- 172.21.15.87:0/4029061865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7700cf1a0 con 0x7fb77006a3e0 2023-03-30T08:11:14.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.636+0000 7fb775a9f700 1 -- 172.21.15.87:0/4029061865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7700b8750 con 0x7fb77006a3e0 2023-03-30T08:11:14.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.636+0000 7fb7657fa700 1 -- 172.21.15.87:0/4029061865 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fb76c01c460 con 0x7fb77006a3e0 2023-03-30T08:11:14.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.640+0000 7fb7657fa700 1 --2- 172.21.15.87:0/4029061865 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb75c0653f0 0x7fb75c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:14.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.640+0000 7fb7657fa700 1 -- 172.21.15.87:0/4029061865 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb76c082990 con 0x7fb77006a3e0 2023-03-30T08:11:14.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.640+0000 7fb767fff700 1 --2- 172.21.15.87:0/4029061865 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb75c0653f0 0x7fb75c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:14.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.640+0000 7fb767fff700 1 --2- 172.21.15.87:0/4029061865 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb75c0653f0 0x7fb75c0678a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb760006fd0 tx=0x7fb760008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:14.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.644+0000 7fb7657fa700 1 -- 172.21.15.87:0/4029061865 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fb76c0502b0 con 0x7fb77006a3e0 2023-03-30T08:11:14.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.816+0000 7fb775a9f700 1 -- 172.21.15.87:0/4029061865 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb770072cf0 con 0x7fb77006a3e0 2023-03-30T08:11:14.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.816+0000 7fb7657fa700 1 -- 172.21.15.87:0/4029061865 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19652 (secure 0 0 0) 0x7fb76c0538d0 con 0x7fb77006a3e0 2023-03-30T08:11:14.822 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:14.822 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":28,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:02.841070+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:14.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.820+0000 7fb775a9f700 1 -- 172.21.15.87:0/4029061865 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb75c0653f0 msgr2=0x7fb75c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:14.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.820+0000 7fb775a9f700 1 --2- 172.21.15.87:0/4029061865 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb75c0653f0 0x7fb75c0678a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb760006fd0 tx=0x7fb760008040 comp rx=0 tx=0).stop 2023-03-30T08:11:14.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.820+0000 7fb775a9f700 1 -- 172.21.15.87:0/4029061865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb77006a3e0 msgr2=0x7fb77015cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:14.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.820+0000 7fb775a9f700 1 --2- 172.21.15.87:0/4029061865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb77006a3e0 0x7fb77015cae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00c4e0 tx=0x7fb76c00c8a0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.820+0000 7fb775a9f700 1 -- 172.21.15.87:0/4029061865 shutdown_connections 2023-03-30T08:11:14.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.820+0000 7fb775a9f700 1 --2- 172.21.15.87:0/4029061865 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb75c0653f0 0x7fb75c0678a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.820+0000 7fb775a9f700 1 --2- 172.21.15.87:0/4029061865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7701f2a40 0x7fb77015e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.820+0000 7fb775a9f700 1 --2- 172.21.15.87:0/4029061865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7700b8380 0x7fb7701f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.820+0000 7fb775a9f700 1 --2- 172.21.15.87:0/4029061865 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb77006a3e0 0x7fb77015cae0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:14.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.820+0000 7fb775a9f700 1 -- 172.21.15.87:0/4029061865 >> 172.21.15.87:0/4029061865 conn(0x7fb7700b53f0 msgr2=0x7fb7700cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:14.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.820+0000 7fb775a9f700 1 -- 172.21.15.87:0/4029061865 shutdown_connections 2023-03-30T08:11:14.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:14.820+0000 7fb775a9f700 1 -- 172.21.15.87:0/4029061865 wait complete. 2023-03-30T08:11:14.846 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:15.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.004+0000 7f111cbef700 1 Processor -- start 2023-03-30T08:11:15.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.004+0000 7f111cbef700 1 -- start start 2023-03-30T08:11:15.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.004+0000 7f111cbef700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f11180b3f30 0x7f11180b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:15.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.004+0000 7f111cbef700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f111806a6e0 0x7f11180aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:15.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.004+0000 7f111cbef700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f111806b670 con 0x7f11180af180 2023-03-30T08:11:15.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.004+0000 7f111cbef700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11180af600 con 0x7f11180b3f30 2023-03-30T08:11:15.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.004+0000 7f111cbef700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111806b0b0 con 0x7f111806a6e0 2023-03-30T08:11:15.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.004+0000 7f11177fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f11180b3f30 0x7f11180b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:15.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.004+0000 7f11177fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f11180b3f30 0x7f11180b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56478/0 (socket says 172.21.15.87:56478) 2023-03-30T08:11:15.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.004+0000 7f11177fe700 1 -- 172.21.15.87:0/2831339271 learned_addr learned my addr 172.21.15.87:0/2831339271 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:15.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.004+0000 7f1116ffd700 1 --2- 172.21.15.87:0/2831339271 >> v2:172.21.15.115:3300/0 conn(0x7f111806a6e0 0x7f11180aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:15.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.008+0000 7f11177fe700 1 -- 172.21.15.87:0/2831339271 >> v2:172.21.15.115:3300/0 conn(0x7f111806a6e0 msgr2=0x7f11180aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:15.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.008+0000 7f11177fe700 1 --2- 172.21.15.87:0/2831339271 >> v2:172.21.15.115:3300/0 conn(0x7f111806a6e0 0x7f11180aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:15.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.008+0000 7f11177fe700 1 -- 172.21.15.87:0/2831339271 >> v1:172.21.15.115:6789/0 conn(0x7f11180af180 legacy=0x7f111815ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:15.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.008+0000 7f11177fe700 1 -- 172.21.15.87:0/2831339271 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111806b390 con 0x7f11180b3f30 2023-03-30T08:11:15.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.008+0000 7f11177fe700 1 --2- 172.21.15.87:0/2831339271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11180b3f30 0x7f11180b0c10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f11180ce750 tx=0x7f1108009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36eb4a1f46f2473d server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:15.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.008+0000 7f11167fc700 1 -- 172.21.15.87:0/2831339271 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108011830 con 0x7f11180b3f30 2023-03-30T08:11:15.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.008+0000 7f11167fc700 1 -- 172.21.15.87:0/2831339271 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1108011990 con 0x7f11180b3f30 2023-03-30T08:11:15.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.008+0000 7f11167fc700 1 -- 172.21.15.87:0/2831339271 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108011d20 con 0x7f11180b3f30 2023-03-30T08:11:15.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.008+0000 7f111cbef700 1 -- 172.21.15.87:0/2831339271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11180b3f30 msgr2=0x7f11180b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:15.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.008+0000 7f111cbef700 1 --2- 172.21.15.87:0/2831339271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11180b3f30 0x7f11180b0c10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f11180ce750 tx=0x7f1108009bf0 comp rx=0 tx=0).stop 2023-03-30T08:11:15.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.008+0000 7f111cbef700 1 -- 172.21.15.87:0/2831339271 shutdown_connections 2023-03-30T08:11:15.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.008+0000 7f111cbef700 1 --2- 172.21.15.87:0/2831339271 >> v2:172.21.15.115:3300/0 conn(0x7f111806a6e0 0x7f11180aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:15.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.008+0000 7f111cbef700 1 --2- 172.21.15.87:0/2831339271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11180b3f30 0x7f11180b0c10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:15.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.008+0000 7f111cbef700 1 -- 172.21.15.87:0/2831339271 >> 172.21.15.87:0/2831339271 conn(0x7f11180cf410 msgr2=0x7f11180cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:15.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.012+0000 7f111cbef700 1 -- 172.21.15.87:0/2831339271 shutdown_connections 2023-03-30T08:11:15.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.012+0000 7f111cbef700 1 -- 172.21.15.87:0/2831339271 wait complete. 2023-03-30T08:11:15.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.012+0000 7f111cbef700 1 Processor -- start 2023-03-30T08:11:15.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.012+0000 7f111cbef700 1 -- start start 2023-03-30T08:11:15.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.012+0000 7f111cbef700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f111806a6e0 0x7f1118153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:15.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.012+0000 7f111cbef700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11180af180 0x7f11180c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:15.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.012+0000 7f111cbef700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11180b3f30 0x7f11180c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:15.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.012+0000 7f111cbef700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11181556d0 con 0x7f11180af180 2023-03-30T08:11:15.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.012+0000 7f111cbef700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11181559b0 con 0x7f11180b3f30 2023-03-30T08:11:15.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.012+0000 7f111cbef700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1118155c90 con 0x7f111806a6e0 2023-03-30T08:11:15.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.012+0000 7f1116ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11180af180 0x7f11180c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:15.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.012+0000 7f1116ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11180af180 0x7f11180c75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56484/0 (socket says 172.21.15.87:56484) 2023-03-30T08:11:15.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.012+0000 7f1116ffd700 1 -- 172.21.15.87:0/1842292875 learned_addr learned my addr 172.21.15.87:0/1842292875 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:15.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.012+0000 7f11177fe700 1 --2- 172.21.15.87:0/1842292875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f111806a6e0 0x7f1118153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:15.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.012+0000 7f1117fff700 1 --2- 172.21.15.87:0/1842292875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11180b3f30 0x7f11180c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:15.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.016+0000 7f1116ffd700 1 -- 172.21.15.87:0/1842292875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f111806a6e0 msgr2=0x7f1118153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:15.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.016+0000 7f1116ffd700 1 --2- 172.21.15.87:0/1842292875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f111806a6e0 0x7f1118153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:15.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.016+0000 7f1116ffd700 1 -- 172.21.15.87:0/1842292875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11180b3f30 msgr2=0x7f11180c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:15.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.016+0000 7f1116ffd700 1 --2- 172.21.15.87:0/1842292875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11180b3f30 0x7f11180c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:15.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.016+0000 7f1116ffd700 1 -- 172.21.15.87:0/1842292875 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1108009570 con 0x7f11180af180 2023-03-30T08:11:15.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.016+0000 7f11177fe700 1 --2- 172.21.15.87:0/1842292875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f111806a6e0 0x7f1118153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:15.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.016+0000 7f1116ffd700 1 --2- 172.21.15.87:0/1842292875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11180af180 0x7f11180c75f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f110c00e840 tx=0x7f110c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:15.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.016+0000 7f10fffff700 1 -- 172.21.15.87:0/1842292875 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c0095a0 con 0x7f11180af180 2023-03-30T08:11:15.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.016+0000 7f10fffff700 1 -- 172.21.15.87:0/1842292875 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c013680 con 0x7f11180af180 2023-03-30T08:11:15.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.016+0000 7f111cbef700 1 -- 172.21.15.87:0/1842292875 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11180ae1b0 con 0x7f11180af180 2023-03-30T08:11:15.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.016+0000 7f10fffff700 1 -- 172.21.15.87:0/1842292875 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c0139f0 con 0x7f11180af180 2023-03-30T08:11:15.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.016+0000 7f111cbef700 1 -- 172.21.15.87:0/1842292875 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11180aded0 con 0x7f11180af180 2023-03-30T08:11:15.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.016+0000 7f111cbef700 1 -- 172.21.15.87:0/1842292875 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11180b4300 con 0x7f11180af180 2023-03-30T08:11:15.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.020+0000 7f10fffff700 1 -- 172.21.15.87:0/1842292875 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f110c013b50 con 0x7f11180af180 2023-03-30T08:11:15.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.020+0000 7f10fffff700 1 --2- 172.21.15.87:0/1842292875 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f11040653f0 0x7f11040678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:15.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.020+0000 7f10fffff700 1 -- 172.21.15.87:0/1842292875 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f110c082940 con 0x7f11180af180 2023-03-30T08:11:15.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.020+0000 7f11177fe700 1 --2- 172.21.15.87:0/1842292875 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f11040653f0 0x7f11040678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:15.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.020+0000 7f11177fe700 1 --2- 172.21.15.87:0/1842292875 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f11040653f0 0x7f11040678a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1108000c00 tx=0x7f1108008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:15.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.028+0000 7f10fffff700 1 -- 172.21.15.87:0/1842292875 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f110c053d00 con 0x7f11180af180 2023-03-30T08:11:15.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.192+0000 7f111cbef700 1 -- 172.21.15.87:0/1842292875 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11180733a0 con 0x7f11180af180 2023-03-30T08:11:15.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.196+0000 7f10fffff700 1 -- 172.21.15.87:0/1842292875 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19652 (secure 0 0 0) 0x7f110c0538f0 con 0x7f11180af180 2023-03-30T08:11:15.200 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:15.200 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":28,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:02.841070+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:15.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.196+0000 7f111cbef700 1 -- 172.21.15.87:0/1842292875 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f11040653f0 msgr2=0x7f11040678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:15.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.196+0000 7f111cbef700 1 --2- 172.21.15.87:0/1842292875 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f11040653f0 0x7f11040678a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1108000c00 tx=0x7f1108008030 comp rx=0 tx=0).stop 2023-03-30T08:11:15.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.196+0000 7f111cbef700 1 -- 172.21.15.87:0/1842292875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11180af180 msgr2=0x7f11180c75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:15.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.196+0000 7f111cbef700 1 --2- 172.21.15.87:0/1842292875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11180af180 0x7f11180c75f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f110c00e840 tx=0x7f110c00eb50 comp rx=0 tx=0).stop 2023-03-30T08:11:15.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.200+0000 7f111cbef700 1 -- 172.21.15.87:0/1842292875 shutdown_connections 2023-03-30T08:11:15.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.200+0000 7f111cbef700 1 --2- 172.21.15.87:0/1842292875 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f11040653f0 0x7f11040678a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:15.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.200+0000 7f111cbef700 1 --2- 172.21.15.87:0/1842292875 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11180b3f30 0x7f11180c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:15.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.200+0000 7f111cbef700 1 --2- 172.21.15.87:0/1842292875 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f11180af180 0x7f11180c75f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:15.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.200+0000 7f111cbef700 1 --2- 172.21.15.87:0/1842292875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f111806a6e0 0x7f1118153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:15.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.200+0000 7f111cbef700 1 -- 172.21.15.87:0/1842292875 >> 172.21.15.87:0/1842292875 conn(0x7f11180cf410 msgr2=0x7f11180cc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:15.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.200+0000 7f111cbef700 1 -- 172.21.15.87:0/1842292875 shutdown_connections 2023-03-30T08:11:15.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.200+0000 7f111cbef700 1 -- 172.21.15.87:0/1842292875 wait complete. 2023-03-30T08:11:15.226 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-30T08:11:15.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.388+0000 7f019b59e700 1 Processor -- start 2023-03-30T08:11:15.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.388+0000 7f019b59e700 1 -- start start 2023-03-30T08:11:15.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.392+0000 7f019b59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f019c06a3e0 0x7f019c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:15.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.392+0000 7f019b59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019c160ef0 con 0x7f019c0d27e0 2023-03-30T08:11:15.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.392+0000 7f019b59e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019c0cd6a0 con 0x7f019c0b8380 2023-03-30T08:11:15.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.392+0000 7f019b59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019c0cd3a0 con 0x7f019c06a3e0 2023-03-30T08:11:15.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.392+0000 7f0199d9b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f019c0d27e0 0x7f019c0d0880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43574/0 (socket says 172.21.15.87:43574) 2023-03-30T08:11:15.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.392+0000 7f0199d9b700 1 -- 172.21.15.87:0/863251675 learned_addr learned my addr 172.21.15.87:0/863251675 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:15.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.392+0000 7f019ad9d700 1 --2- 172.21.15.87:0/863251675 >> v2:172.21.15.87:3300/0 conn(0x7f019c06a3e0 0x7f019c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:15.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.392+0000 7f019ad9d700 1 -- 172.21.15.87:0/863251675 >> v1:172.21.15.115:6789/0 conn(0x7f019c0b8380 legacy=0x7f019c069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:15.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.392+0000 7f019ad9d700 1 -- 172.21.15.87:0/863251675 >> v1:172.21.15.87:6789/0 conn(0x7f019c0d27e0 legacy=0x7f019c0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:15.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.392+0000 7f019ad9d700 1 -- 172.21.15.87:0/863251675 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019c0cef00 con 0x7f019c06a3e0 2023-03-30T08:11:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.392+0000 7f019ad9d700 1 --2- 172.21.15.87:0/863251675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f019c06a3e0 0x7f019c0d2200 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0194009dc0 tx=0x7f019400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5190517bed6b5c1b server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.392+0000 7f019959a700 1 -- 172.21.15.87:0/863251675 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019400e070 con 0x7f019c06a3e0 2023-03-30T08:11:15.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.396+0000 7f019959a700 1 -- 172.21.15.87:0/863251675 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019400bb90 con 0x7f019c06a3e0 2023-03-30T08:11:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.396+0000 7f019959a700 1 -- 172.21.15.87:0/863251675 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194012430 con 0x7f019c06a3e0 2023-03-30T08:11:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.396+0000 7f019b59e700 1 -- 172.21.15.87:0/863251675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f019c06a3e0 msgr2=0x7f019c0d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.396+0000 7f019b59e700 1 --2- 172.21.15.87:0/863251675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f019c06a3e0 0x7f019c0d2200 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0194009dc0 tx=0x7f019400b330 comp rx=0 tx=0).stop 2023-03-30T08:11:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.396+0000 7f019b59e700 1 -- 172.21.15.87:0/863251675 shutdown_connections 2023-03-30T08:11:15.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.396+0000 7f019b59e700 1 --2- 172.21.15.87:0/863251675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f019c06a3e0 0x7f019c0d2200 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:15.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.396+0000 7f019b59e700 1 -- 172.21.15.87:0/863251675 >> 172.21.15.87:0/863251675 conn(0x7f019c0b53f0 msgr2=0x7f019c0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:15.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.396+0000 7f019b59e700 1 -- 172.21.15.87:0/863251675 shutdown_connections 2023-03-30T08:11:15.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.396+0000 7f019b59e700 1 -- 172.21.15.87:0/863251675 wait complete. 2023-03-30T08:11:15.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.396+0000 7f019b59e700 1 Processor -- start 2023-03-30T08:11:15.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019b59e700 1 -- start start 2023-03-30T08:11:15.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f019c06a3e0 0x7f019c14af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:15.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019b59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f019c0b8380 0x7f019c15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:15.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019b59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019c15d090 0x7f019c1f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:15.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c15d8c0 con 0x7f019c06a3e0 2023-03-30T08:11:15.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019b59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c15dba0 con 0x7f019c15d090 2023-03-30T08:11:15.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019b59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019c15de80 con 0x7f019c0b8380 2023-03-30T08:11:15.406 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019a59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f019c06a3e0 0x7f019c14af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:15.406 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019a59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f019c06a3e0 0x7f019c14af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56508/0 (socket says 172.21.15.87:56508) 2023-03-30T08:11:15.406 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019a59c700 1 -- 172.21.15.87:0/3773045336 learned_addr learned my addr 172.21.15.87:0/3773045336 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:15.406 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f0199d9b700 1 --2- 172.21.15.87:0/3773045336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f019c0b8380 0x7f019c15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:15.406 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019ad9d700 1 --2- 172.21.15.87:0/3773045336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019c15d090 0x7f019c1f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:15.406 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019a59c700 1 -- 172.21.15.87:0/3773045336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f019c0b8380 msgr2=0x7f019c15cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019a59c700 1 --2- 172.21.15.87:0/3773045336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f019c0b8380 0x7f019c15cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019a59c700 1 -- 172.21.15.87:0/3773045336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019c15d090 msgr2=0x7f019c1f0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019a59c700 1 --2- 172.21.15.87:0/3773045336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019c15d090 0x7f019c1f0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019a59c700 1 -- 172.21.15.87:0/3773045336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0194009a70 con 0x7f019c06a3e0 2023-03-30T08:11:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019a59c700 1 --2- 172.21.15.87:0/3773045336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f019c06a3e0 0x7f019c14af60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f018c00c500 tx=0x7f018c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f018affd700 1 -- 172.21.15.87:0/3773045336 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0052d0 con 0x7f019c06a3e0 2023-03-30T08:11:15.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f018affd700 1 -- 172.21.15.87:0/3773045336 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c005430 con 0x7f019c06a3e0 2023-03-30T08:11:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019b59e700 1 -- 172.21.15.87:0/3773045336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019c0cf480 con 0x7f019c06a3e0 2023-03-30T08:11:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f018affd700 1 -- 172.21.15.87:0/3773045336 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0055a0 con 0x7f019c06a3e0 2023-03-30T08:11:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.400+0000 7f019b59e700 1 -- 172.21.15.87:0/3773045336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019c0cf1a0 con 0x7f019c06a3e0 2023-03-30T08:11:15.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.404+0000 7f019b59e700 1 -- 172.21.15.87:0/3773045336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019c0b8750 con 0x7f019c06a3e0 2023-03-30T08:11:15.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.404+0000 7f018affd700 1 -- 172.21.15.87:0/3773045336 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f018c0038e0 con 0x7f019c06a3e0 2023-03-30T08:11:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.408+0000 7f018affd700 1 --2- 172.21.15.87:0/3773045336 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f017c0653f0 0x7f017c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.408+0000 7f018affd700 1 -- 172.21.15.87:0/3773045336 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f018c081fe0 con 0x7f019c06a3e0 2023-03-30T08:11:15.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.408+0000 7f0199d9b700 1 --2- 172.21.15.87:0/3773045336 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f017c0653f0 0x7f017c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:15.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.408+0000 7f0199d9b700 1 --2- 172.21.15.87:0/3773045336 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f017c0653f0 0x7f017c0678a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f019c0c9a10 tx=0x7f0190009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:15.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.412+0000 7f018affd700 1 -- 172.21.15.87:0/3773045336 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f018c04f9a0 con 0x7f019c06a3e0 2023-03-30T08:11:15.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:15.616+0000 7f019b59e700 1 -- 172.21.15.87:0/3773045336 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f019c072cf0 con 0x7f019c06a3e0 2023-03-30T08:11:16.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.020+0000 7f018affd700 1 -- 172.21.15.87:0/3773045336 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f018c052fc0 con 0x7f019c06a3e0 2023-03-30T08:11:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.024+0000 7f019b59e700 1 -- 172.21.15.87:0/3773045336 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f017c0653f0 msgr2=0x7f017c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.024+0000 7f019b59e700 1 --2- 172.21.15.87:0/3773045336 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f017c0653f0 0x7f017c0678a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f019c0c9a10 tx=0x7f0190009040 comp rx=0 tx=0).stop 2023-03-30T08:11:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.024+0000 7f019b59e700 1 -- 172.21.15.87:0/3773045336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f019c06a3e0 msgr2=0x7f019c14af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.024+0000 7f019b59e700 1 --2- 172.21.15.87:0/3773045336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f019c06a3e0 0x7f019c14af60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f018c00c500 tx=0x7f018c00c8c0 comp rx=0 tx=0).stop 2023-03-30T08:11:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.024+0000 7f019b59e700 1 -- 172.21.15.87:0/3773045336 shutdown_connections 2023-03-30T08:11:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.024+0000 7f019b59e700 1 --2- 172.21.15.87:0/3773045336 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f017c0653f0 0x7f017c0678a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:16.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.024+0000 7f019b59e700 1 --2- 172.21.15.87:0/3773045336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f019c15d090 0x7f019c1f0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:16.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.024+0000 7f019b59e700 1 --2- 172.21.15.87:0/3773045336 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f019c0b8380 0x7f019c15cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:16.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.024+0000 7f019b59e700 1 --2- 172.21.15.87:0/3773045336 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f019c06a3e0 0x7f019c14af60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:16.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.024+0000 7f019b59e700 1 -- 172.21.15.87:0/3773045336 >> 172.21.15.87:0/3773045336 conn(0x7f019c0b53f0 msgr2=0x7f019c0b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:16.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.024+0000 7f019b59e700 1 -- 172.21.15.87:0/3773045336 shutdown_connections 2023-03-30T08:11:16.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.024+0000 7f019b59e700 1 -- 172.21.15.87:0/3773045336 wait complete. 2023-03-30T08:11:16.051 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-03-30T08:11:16.052 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-03-30T08:11:16.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.220+0000 7fd4b359e700 1 Processor -- start 2023-03-30T08:11:16.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.220+0000 7fd4b359e700 1 -- start start 2023-03-30T08:11:16.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b359e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd4b40b2440 0x7fd4b40b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:16.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b359e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd4b40cd030 0x7fd4b40cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:16.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b359e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b4146280 con 0x7fd4b4145eb0 2023-03-30T08:11:16.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b359e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b40b2e20 con 0x7fd4b40cd030 2023-03-30T08:11:16.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b359e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b406ade0 con 0x7fd4b40b2440 2023-03-30T08:11:16.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b2d9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd4b40cd030 0x7fd4b40cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:16.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b2d9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd4b40cd030 0x7fd4b40cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56516/0 (socket says 172.21.15.87:56516) 2023-03-30T08:11:16.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b2d9d700 1 -- 172.21.15.87:0/1161403233 learned_addr learned my addr 172.21.15.87:0/1161403233 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:16.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b1d9b700 1 --2- 172.21.15.87:0/1161403233 >> v2:172.21.15.115:3300/0 conn(0x7fd4b40b2440 0x7fd4b40b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:16.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b2d9d700 1 -- 172.21.15.87:0/1161403233 >> v2:172.21.15.115:3300/0 conn(0x7fd4b40b2440 msgr2=0x7fd4b40b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:16.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b2d9d700 1 --2- 172.21.15.87:0/1161403233 >> v2:172.21.15.115:3300/0 conn(0x7fd4b40b2440 0x7fd4b40b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:16.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b2d9d700 1 -- 172.21.15.87:0/1161403233 >> v1:172.21.15.115:6789/0 conn(0x7fd4b4145eb0 legacy=0x7fd4b4160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:16.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b2d9d700 1 -- 172.21.15.87:0/1161403233 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b406b3a0 con 0x7fd4b40cd030 2023-03-30T08:11:16.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b1d9b700 1 --2- 172.21.15.87:0/1161403233 >> v2:172.21.15.115:3300/0 conn(0x7fd4b40b2440 0x7fd4b40b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:16.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b2d9d700 1 --2- 172.21.15.87:0/1161403233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4b40cd030 0x7fd4b40cd430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40cf580 tx=0x7fd4ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa6636638f8473f server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:16.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b159a700 1 -- 172.21.15.87:0/1161403233 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00e070 con 0x7fd4b40cd030 2023-03-30T08:11:16.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b159a700 1 -- 172.21.15.87:0/1161403233 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac00b9c0 con 0x7fd4b40cd030 2023-03-30T08:11:16.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.224+0000 7fd4b159a700 1 -- 172.21.15.87:0/1161403233 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00bd70 con 0x7fd4b40cd030 2023-03-30T08:11:16.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.228+0000 7fd4b359e700 1 -- 172.21.15.87:0/1161403233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4b40cd030 msgr2=0x7fd4b40cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:16.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.228+0000 7fd4b359e700 1 --2- 172.21.15.87:0/1161403233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4b40cd030 0x7fd4b40cd430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40cf580 tx=0x7fd4ac00b330 comp rx=0 tx=0).stop 2023-03-30T08:11:16.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.228+0000 7fd4b359e700 1 -- 172.21.15.87:0/1161403233 shutdown_connections 2023-03-30T08:11:16.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.228+0000 7fd4b359e700 1 --2- 172.21.15.87:0/1161403233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4b40cd030 0x7fd4b40cd430 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:16.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.228+0000 7fd4b359e700 1 --2- 172.21.15.87:0/1161403233 >> v2:172.21.15.115:3300/0 conn(0x7fd4b40b2440 0x7fd4b40b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:16.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.228+0000 7fd4b359e700 1 -- 172.21.15.87:0/1161403233 >> 172.21.15.87:0/1161403233 conn(0x7fd4b406e560 msgr2=0x7fd4b406e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:16.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.228+0000 7fd4b359e700 1 -- 172.21.15.87:0/1161403233 shutdown_connections 2023-03-30T08:11:16.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.228+0000 7fd4b359e700 1 -- 172.21.15.87:0/1161403233 wait complete. 2023-03-30T08:11:16.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.228+0000 7fd4b359e700 1 Processor -- start 2023-03-30T08:11:16.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b359e700 1 -- start start 2023-03-30T08:11:16.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b359e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b40b2440 0x7fd4b41f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:16.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4b40cd030 0x7fd4b40c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:16.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b359e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b4145eb0 0x7fd4b41568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b4155690 con 0x7fd4b40cd030 2023-03-30T08:11:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b359e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40b0320 con 0x7fd4b4145eb0 2023-03-30T08:11:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b359e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40b0bc0 con 0x7fd4b40b2440 2023-03-30T08:11:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b1d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4b40cd030 0x7fd4b40c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b1d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4b40cd030 0x7fd4b40c51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56532/0 (socket says 172.21.15.87:56532) 2023-03-30T08:11:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b1d9b700 1 -- 172.21.15.87:0/1675211179 learned_addr learned my addr 172.21.15.87:0/1675211179 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b259c700 1 --2- 172.21.15.87:0/1675211179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b40b2440 0x7fd4b41f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b2d9d700 1 --2- 172.21.15.87:0/1675211179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b4145eb0 0x7fd4b41568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b1d9b700 1 -- 172.21.15.87:0/1675211179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b40b2440 msgr2=0x7fd4b41f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b1d9b700 1 --2- 172.21.15.87:0/1675211179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b40b2440 0x7fd4b41f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b1d9b700 1 -- 172.21.15.87:0/1675211179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b4145eb0 msgr2=0x7fd4b41568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b1d9b700 1 --2- 172.21.15.87:0/1675211179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b4145eb0 0x7fd4b41568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b1d9b700 1 -- 172.21.15.87:0/1675211179 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac009b30 con 0x7fd4b40cd030 2023-03-30T08:11:16.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b1d9b700 1 --2- 172.21.15.87:0/1675211179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4b40cd030 0x7fd4b40c51b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800e790 tx=0x7fd4a800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:16.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4a2ffd700 1 -- 172.21.15.87:0/1675211179 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8004230 con 0x7fd4b40cd030 2023-03-30T08:11:16.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4a2ffd700 1 -- 172.21.15.87:0/1675211179 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a8004390 con 0x7fd4b40cd030 2023-03-30T08:11:16.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b359e700 1 -- 172.21.15.87:0/1675211179 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b4160c30 con 0x7fd4b40cd030 2023-03-30T08:11:16.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4a2ffd700 1 -- 172.21.15.87:0/1675211179 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a80036c0 con 0x7fd4b40cd030 2023-03-30T08:11:16.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.232+0000 7fd4b359e700 1 -- 172.21.15.87:0/1675211179 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b415da70 con 0x7fd4b40cd030 2023-03-30T08:11:16.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.236+0000 7fd4b359e700 1 -- 172.21.15.87:0/1675211179 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b4160f10 con 0x7fd4b40cd030 2023-03-30T08:11:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.236+0000 7fd4a2ffd700 1 -- 172.21.15.87:0/1675211179 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd4a8003840 con 0x7fd4b40cd030 2023-03-30T08:11:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.240+0000 7fd4a2ffd700 1 --2- 172.21.15.87:0/1675211179 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd494065420 0x7fd4940678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.240+0000 7fd4a2ffd700 1 -- 172.21.15.87:0/1675211179 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd4a8082710 con 0x7fd4b40cd030 2023-03-30T08:11:16.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.240+0000 7fd4b259c700 1 --2- 172.21.15.87:0/1675211179 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd494065420 0x7fd4940678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:16.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.240+0000 7fd4b259c700 1 --2- 172.21.15.87:0/1675211179 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd494065420 0x7fd4940678d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40b3360 tx=0x7fd4a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:16.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.244+0000 7fd4a2ffd700 1 -- 172.21.15.87:0/1675211179 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fd4a8050090 con 0x7fd4b40cd030 2023-03-30T08:11:16.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:16.452+0000 7fd4b359e700 1 -- 172.21.15.87:0/1675211179 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd4b4072cf0 con 0x7fd4b40cd030 2023-03-30T08:11:17.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.036+0000 7fd4a2ffd700 1 -- 172.21.15.87:0/1675211179 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd4a80536b0 con 0x7fd4b40cd030 2023-03-30T08:11:17.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.040+0000 7fd4b359e700 1 -- 172.21.15.87:0/1675211179 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd494065420 msgr2=0x7fd4940678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:17.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.040+0000 7fd4b359e700 1 --2- 172.21.15.87:0/1675211179 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd494065420 0x7fd4940678d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40b3360 tx=0x7fd4a4009040 comp rx=0 tx=0).stop 2023-03-30T08:11:17.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.040+0000 7fd4b359e700 1 -- 172.21.15.87:0/1675211179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4b40cd030 msgr2=0x7fd4b40c51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:17.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.040+0000 7fd4b359e700 1 --2- 172.21.15.87:0/1675211179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4b40cd030 0x7fd4b40c51b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800e790 tx=0x7fd4a800eb50 comp rx=0 tx=0).stop 2023-03-30T08:11:17.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.040+0000 7fd4b359e700 1 -- 172.21.15.87:0/1675211179 shutdown_connections 2023-03-30T08:11:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.040+0000 7fd4b359e700 1 --2- 172.21.15.87:0/1675211179 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd494065420 0x7fd4940678d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.040+0000 7fd4b359e700 1 --2- 172.21.15.87:0/1675211179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b4145eb0 0x7fd4b41568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.040+0000 7fd4b359e700 1 --2- 172.21.15.87:0/1675211179 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4b40cd030 0x7fd4b40c51b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.040+0000 7fd4b359e700 1 --2- 172.21.15.87:0/1675211179 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4b40b2440 0x7fd4b41f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.040+0000 7fd4b359e700 1 -- 172.21.15.87:0/1675211179 >> 172.21.15.87:0/1675211179 conn(0x7fd4b406e560 msgr2=0x7fd4b406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:17.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.040+0000 7fd4b359e700 1 -- 172.21.15.87:0/1675211179 shutdown_connections 2023-03-30T08:11:17.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.040+0000 7fd4b359e700 1 -- 172.21.15.87:0/1675211179 wait complete. 2023-03-30T08:11:17.065 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-03-30T08:11:17.066 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T08:11:17.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.220+0000 7fa68519e700 1 Processor -- start 2023-03-30T08:11:17.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.220+0000 7fa68519e700 1 -- start start 2023-03-30T08:11:17.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.224+0000 7fa68519e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6800adb80 0x7fa68006cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:17.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.224+0000 7fa68519e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa680070b30 0x7fa6800c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:17.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.224+0000 7fa68519e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68006c710 con 0x7fa6800cd8e0 2023-03-30T08:11:17.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.224+0000 7fa68519e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68006be20 con 0x7fa680070b30 2023-03-30T08:11:17.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.224+0000 7fa68519e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800adf50 con 0x7fa6800adb80 2023-03-30T08:11:17.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.224+0000 7fa67ed9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6800adb80 0x7fa68006cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:17.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.224+0000 7fa67ed9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6800adb80 0x7fa68006cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:39418/0 (socket says 172.21.15.87:39418) 2023-03-30T08:11:17.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.224+0000 7fa67ed9d700 1 -- 172.21.15.87:0/1585217247 learned_addr learned my addr 172.21.15.87:0/1585217247 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:17.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.224+0000 7fa67f59e700 1 --2- 172.21.15.87:0/1585217247 >> v2:172.21.15.115:3300/0 conn(0x7fa680070b30 0x7fa6800c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:17.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.224+0000 7fa67ed9d700 1 -- 172.21.15.87:0/1585217247 >> v2:172.21.15.115:3300/0 conn(0x7fa680070b30 msgr2=0x7fa6800c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:17.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.224+0000 7fa67ed9d700 1 --2- 172.21.15.87:0/1585217247 >> v2:172.21.15.115:3300/0 conn(0x7fa680070b30 0x7fa6800c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.224+0000 7fa67ed9d700 1 -- 172.21.15.87:0/1585217247 >> v1:172.21.15.115:6789/0 conn(0x7fa6800cd8e0 legacy=0x7fa680070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:17.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.224+0000 7fa67ed9d700 1 -- 172.21.15.87:0/1585217247 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68006c0c0 con 0x7fa6800adb80 2023-03-30T08:11:17.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.224+0000 7fa67f59e700 1 --2- 172.21.15.87:0/1585217247 >> v2:172.21.15.115:3300/0 conn(0x7fa680070b30 0x7fa6800c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:17.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.224+0000 7fa67ed9d700 1 --2- 172.21.15.87:0/1585217247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6800adb80 0x7fa68006cba0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa670009910 tx=0x7fa670009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b371983bffbf7a99 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:17.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.228+0000 7fa67dd9b700 1 -- 172.21.15.87:0/1585217247 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67000ba60 con 0x7fa6800adb80 2023-03-30T08:11:17.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.228+0000 7fa67dd9b700 1 -- 172.21.15.87:0/1585217247 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67000bbc0 con 0x7fa6800adb80 2023-03-30T08:11:17.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.228+0000 7fa67dd9b700 1 -- 172.21.15.87:0/1585217247 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670009e60 con 0x7fa6800adb80 2023-03-30T08:11:17.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.228+0000 7fa68519e700 1 -- 172.21.15.87:0/1585217247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6800adb80 msgr2=0x7fa68006cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:17.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.228+0000 7fa68519e700 1 --2- 172.21.15.87:0/1585217247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6800adb80 0x7fa68006cba0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa670009910 tx=0x7fa670009c20 comp rx=0 tx=0).stop 2023-03-30T08:11:17.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.228+0000 7fa68519e700 1 -- 172.21.15.87:0/1585217247 shutdown_connections 2023-03-30T08:11:17.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.228+0000 7fa68519e700 1 --2- 172.21.15.87:0/1585217247 >> v2:172.21.15.115:3300/0 conn(0x7fa680070b30 0x7fa6800c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.228+0000 7fa68519e700 1 --2- 172.21.15.87:0/1585217247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6800adb80 0x7fa68006cba0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.228+0000 7fa68519e700 1 -- 172.21.15.87:0/1585217247 >> 172.21.15.87:0/1585217247 conn(0x7fa6800ce960 msgr2=0x7fa6800ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:17.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.228+0000 7fa68519e700 1 -- 172.21.15.87:0/1585217247 shutdown_connections 2023-03-30T08:11:17.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.228+0000 7fa68519e700 1 -- 172.21.15.87:0/1585217247 wait complete. 2023-03-30T08:11:17.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa68519e700 1 Processor -- start 2023-03-30T08:11:17.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa68519e700 1 -- start start 2023-03-30T08:11:17.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa68519e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa680070b30 0x7fa6800c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:17.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa68519e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6800adb80 0x7fa68015ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:17.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa68519e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6800cd8e0 0x7fa68015b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:17.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa68519e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800c7020 con 0x7fa680070b30 2023-03-30T08:11:17.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa68519e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800c7440 con 0x7fa6800adb80 2023-03-30T08:11:17.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa68519e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68015c740 con 0x7fa6800cd8e0 2023-03-30T08:11:17.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa67ed9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa680070b30 0x7fa6800c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:17.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa67ed9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa680070b30 0x7fa6800c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56548/0 (socket says 172.21.15.87:56548) 2023-03-30T08:11:17.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa67ed9d700 1 -- 172.21.15.87:0/2962069982 learned_addr learned my addr 172.21.15.87:0/2962069982 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:17.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa67f59e700 1 --2- 172.21.15.87:0/2962069982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6800cd8e0 0x7fa68015b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:17.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa67e59c700 1 --2- 172.21.15.87:0/2962069982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6800adb80 0x7fa68015ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:17.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa67ed9d700 1 -- 172.21.15.87:0/2962069982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6800cd8e0 msgr2=0x7fa68015b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:17.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa67ed9d700 1 --2- 172.21.15.87:0/2962069982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6800cd8e0 0x7fa68015b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa67ed9d700 1 -- 172.21.15.87:0/2962069982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6800adb80 msgr2=0x7fa68015ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:17.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa67ed9d700 1 --2- 172.21.15.87:0/2962069982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6800adb80 0x7fa68015ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa67ed9d700 1 -- 172.21.15.87:0/2962069982 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa670009570 con 0x7fa680070b30 2023-03-30T08:11:17.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa67ed9d700 1 --2- 172.21.15.87:0/2962069982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa680070b30 0x7fa6800c5a30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa6800ae090 tx=0x7fa670004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:17.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.232+0000 7fa6677fe700 1 -- 172.21.15.87:0/2962069982 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670004610 con 0x7fa680070b30 2023-03-30T08:11:17.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.236+0000 7fa6677fe700 1 -- 172.21.15.87:0/2962069982 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67001e070 con 0x7fa680070b30 2023-03-30T08:11:17.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.236+0000 7fa6677fe700 1 -- 172.21.15.87:0/2962069982 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670003920 con 0x7fa680070b30 2023-03-30T08:11:17.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.236+0000 7fa68519e700 1 -- 172.21.15.87:0/2962069982 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68006d0e0 con 0x7fa680070b30 2023-03-30T08:11:17.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.236+0000 7fa68519e700 1 -- 172.21.15.87:0/2962069982 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68006c3a0 con 0x7fa680070b30 2023-03-30T08:11:17.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.236+0000 7fa68519e700 1 -- 172.21.15.87:0/2962069982 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6800cde30 con 0x7fa680070b30 2023-03-30T08:11:17.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.236+0000 7fa6677fe700 1 -- 172.21.15.87:0/2962069982 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa670003a80 con 0x7fa680070b30 2023-03-30T08:11:17.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.236+0000 7fa6677fe700 1 --2- 172.21.15.87:0/2962069982 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa66c0653f0 0x7fa66c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:17.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.240+0000 7fa6677fe700 1 -- 172.21.15.87:0/2962069982 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa670020070 con 0x7fa680070b30 2023-03-30T08:11:17.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.240+0000 7fa67e59c700 1 --2- 172.21.15.87:0/2962069982 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa66c0653f0 0x7fa66c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:17.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.240+0000 7fa67e59c700 1 --2- 172.21.15.87:0/2962069982 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa66c0653f0 0x7fa66c0678a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa6801593d0 tx=0x7fa674009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:17.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.248+0000 7fa6677fe700 1 -- 172.21.15.87:0/2962069982 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fa670051a30 con 0x7fa680070b30 2023-03-30T08:11:17.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.452+0000 7fa68519e700 1 -- 172.21.15.87:0/2962069982 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa680073ee0 con 0x7fa680070b30 2023-03-30T08:11:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.456+0000 7fa6677fe700 1 -- 172.21.15.87:0/2962069982 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7fa670055050 con 0x7fa680070b30 2023-03-30T08:11:17.460 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:17.460 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2818344230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2818344230},{"type":"v1","addr":"172.21.15.115:6833","nonce":2818344230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3891185444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3891185444},{"type":"v1","addr":"172.21.15.87:6836","nonce":3891185444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3443119914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3443119914},{"type":"v1","addr":"172.21.15.87:6837","nonce":3443119914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-30T08:10:58.351331+0000","modified":"2023-03-30T08:11:17.023824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3640886103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3640886103},{"type":"v1","addr":"172.21.15.115:6835","nonce":3640886103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-30T08:11:17.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.456+0000 7fa68519e700 1 -- 172.21.15.87:0/2962069982 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa66c0653f0 msgr2=0x7fa66c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:17.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.456+0000 7fa68519e700 1 --2- 172.21.15.87:0/2962069982 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa66c0653f0 0x7fa66c0678a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa6801593d0 tx=0x7fa674009040 comp rx=0 tx=0).stop 2023-03-30T08:11:17.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.456+0000 7fa68519e700 1 -- 172.21.15.87:0/2962069982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa680070b30 msgr2=0x7fa6800c5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:17.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.456+0000 7fa68519e700 1 --2- 172.21.15.87:0/2962069982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa680070b30 0x7fa6800c5a30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa6800ae090 tx=0x7fa670004770 comp rx=0 tx=0).stop 2023-03-30T08:11:17.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.460+0000 7fa68519e700 1 -- 172.21.15.87:0/2962069982 shutdown_connections 2023-03-30T08:11:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.460+0000 7fa68519e700 1 --2- 172.21.15.87:0/2962069982 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa66c0653f0 0x7fa66c0678a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.460+0000 7fa68519e700 1 --2- 172.21.15.87:0/2962069982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6800cd8e0 0x7fa68015b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.460+0000 7fa68519e700 1 --2- 172.21.15.87:0/2962069982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6800adb80 0x7fa68015ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.460+0000 7fa68519e700 1 --2- 172.21.15.87:0/2962069982 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa680070b30 0x7fa6800c5a30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.460+0000 7fa68519e700 1 -- 172.21.15.87:0/2962069982 >> 172.21.15.87:0/2962069982 conn(0x7fa6800ce960 msgr2=0x7fa6800ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.460+0000 7fa68519e700 1 -- 172.21.15.87:0/2962069982 shutdown_connections 2023-03-30T08:11:17.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.460+0000 7fa68519e700 1 -- 172.21.15.87:0/2962069982 wait complete. 2023-03-30T08:11:17.466 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2023-03-30T08:11:17.483 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:17.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.636+0000 7fbaf448a700 1 Processor -- start 2023-03-30T08:11:17.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.636+0000 7fbaf448a700 1 -- start start 2023-03-30T08:11:17.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.640+0000 7fbaf448a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaec0b3140 0x7fbaec15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:17.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.640+0000 7fbaf448a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaec15cd50 con 0x7fbaec0cdbe0 2023-03-30T08:11:17.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.640+0000 7fbaf448a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaec0d1300 con 0x7fbaec15d720 2023-03-30T08:11:17.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.640+0000 7fbaf448a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec0d1110 con 0x7fbaec0b3140 2023-03-30T08:11:17.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.640+0000 7fbaf2226700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbaec0cdbe0 0x7fbaec0d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43584/0 (socket says 172.21.15.87:43584) 2023-03-30T08:11:17.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.640+0000 7fbaf2226700 1 -- 172.21.15.87:0/563741065 learned_addr learned my addr 172.21.15.87:0/563741065 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:17.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.640+0000 7fbaf1a25700 1 --2- 172.21.15.87:0/563741065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaec0b3140 0x7fbaec15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:17.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.640+0000 7fbaf1224700 1 -- 172.21.15.87:0/563741065 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472396238 0 0) 0x7fbaec0d1300 con 0x7fbaec15d720 2023-03-30T08:11:17.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.640+0000 7fbaf1224700 1 -- 172.21.15.87:0/563741065 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbad80035d0 con 0x7fbaec15d720 2023-03-30T08:11:17.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.640+0000 7fbaf1224700 1 -- 172.21.15.87:0/563741065 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146705751 0 0) 0x7fbaec15cd50 con 0x7fbaec0cdbe0 2023-03-30T08:11:17.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.640+0000 7fbaf1224700 1 -- 172.21.15.87:0/563741065 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaec0d1300 con 0x7fbaec0cdbe0 2023-03-30T08:11:17.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.640+0000 7fbaf1a25700 1 -- 172.21.15.87:0/563741065 >> v1:172.21.15.115:6789/0 conn(0x7fbaec15d720 legacy=0x7fbaec0ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:17.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.640+0000 7fbaf1a25700 1 -- 172.21.15.87:0/563741065 >> v1:172.21.15.87:6789/0 conn(0x7fbaec0cdbe0 legacy=0x7fbaec0d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:17.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.640+0000 7fbaf1a25700 1 -- 172.21.15.87:0/563741065 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec0d15e0 con 0x7fbaec0b3140 2023-03-30T08:11:17.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.644+0000 7fbaf1a25700 1 --2- 172.21.15.87:0/563741065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaec0b3140 0x7fbaec15d1e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009880 tx=0x7fbadc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d24758c14b0e149e server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:17.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.644+0000 7fbaf1224700 1 -- 172.21.15.87:0/563741065 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc011830 con 0x7fbaec0b3140 2023-03-30T08:11:17.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.644+0000 7fbaf1224700 1 -- 172.21.15.87:0/563741065 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc011990 con 0x7fbaec0b3140 2023-03-30T08:11:17.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.644+0000 7fbaf1224700 1 -- 172.21.15.87:0/563741065 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc011d20 con 0x7fbaec0b3140 2023-03-30T08:11:17.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.644+0000 7fbaf448a700 1 -- 172.21.15.87:0/563741065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaec0b3140 msgr2=0x7fbaec15d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:17.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.644+0000 7fbaf448a700 1 --2- 172.21.15.87:0/563741065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaec0b3140 0x7fbaec15d1e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009880 tx=0x7fbadc009b90 comp rx=0 tx=0).stop 2023-03-30T08:11:17.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.644+0000 7fbaf448a700 1 -- 172.21.15.87:0/563741065 shutdown_connections 2023-03-30T08:11:17.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.644+0000 7fbaf448a700 1 --2- 172.21.15.87:0/563741065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaec0b3140 0x7fbaec15d1e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.644+0000 7fbaf448a700 1 -- 172.21.15.87:0/563741065 >> 172.21.15.87:0/563741065 conn(0x7fbaec06e6f0 msgr2=0x7fbaec06eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:17.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.644+0000 7fbaf448a700 1 -- 172.21.15.87:0/563741065 shutdown_connections 2023-03-30T08:11:17.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.644+0000 7fbaf448a700 1 -- 172.21.15.87:0/563741065 wait complete. 2023-03-30T08:11:17.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf448a700 1 Processor -- start 2023-03-30T08:11:17.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf448a700 1 -- start start 2023-03-30T08:11:17.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf448a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaec0b3140 0x7fbaec159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:17.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf448a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaec0cdbe0 0x7fbaec14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:17.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf448a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaec15d720 0x7fbaec0c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:17.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf448a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec0b3a70 con 0x7fbaec15d720 2023-03-30T08:11:17.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf448a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec0ca390 con 0x7fbaec0cdbe0 2023-03-30T08:11:17.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf448a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec0ca670 con 0x7fbaec0b3140 2023-03-30T08:11:17.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf2a27700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaec15d720 0x7fbaec0c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:17.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf2a27700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaec15d720 0x7fbaec0c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56550/0 (socket says 172.21.15.87:56550) 2023-03-30T08:11:17.654 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf2a27700 1 -- 172.21.15.87:0/326434564 learned_addr learned my addr 172.21.15.87:0/326434564 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:17.654 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf1a25700 1 --2- 172.21.15.87:0/326434564 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaec0cdbe0 0x7fbaec14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf2226700 1 --2- 172.21.15.87:0/326434564 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaec0b3140 0x7fbaec159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf2a27700 1 -- 172.21.15.87:0/326434564 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaec0b3140 msgr2=0x7fbaec159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf2a27700 1 --2- 172.21.15.87:0/326434564 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaec0b3140 0x7fbaec159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf2a27700 1 -- 172.21.15.87:0/326434564 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaec0cdbe0 msgr2=0x7fbaec14ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf2a27700 1 --2- 172.21.15.87:0/326434564 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaec0cdbe0 0x7fbaec14ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf2a27700 1 -- 172.21.15.87:0/326434564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbadc0094b0 con 0x7fbaec15d720 2023-03-30T08:11:17.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf2a27700 1 --2- 172.21.15.87:0/326434564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaec15d720 0x7fbaec0c9b40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbae400cc40 tx=0x7fbae400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:17.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbae2ffd700 1 -- 172.21.15.87:0/326434564 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4003c20 con 0x7fbaec15d720 2023-03-30T08:11:17.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbae2ffd700 1 -- 172.21.15.87:0/326434564 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae4003da0 con 0x7fbaec15d720 2023-03-30T08:11:17.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbae2ffd700 1 -- 172.21.15.87:0/326434564 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae400ac60 con 0x7fbaec15d720 2023-03-30T08:11:17.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf448a700 1 -- 172.21.15.87:0/326434564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaec15c970 con 0x7fbaec15d720 2023-03-30T08:11:17.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.648+0000 7fbaf448a700 1 -- 172.21.15.87:0/326434564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaec0d18c0 con 0x7fbaec15d720 2023-03-30T08:11:17.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.652+0000 7fbaf448a700 1 -- 172.21.15.87:0/326434564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaec0b3bb0 con 0x7fbaec15d720 2023-03-30T08:11:17.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.652+0000 7fbae2ffd700 1 -- 172.21.15.87:0/326434564 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fbae40050d0 con 0x7fbaec15d720 2023-03-30T08:11:17.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.652+0000 7fbae2ffd700 1 --2- 172.21.15.87:0/326434564 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbad00653f0 0x7fbad00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:17.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.652+0000 7fbae2ffd700 1 -- 172.21.15.87:0/326434564 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbae4082c90 con 0x7fbaec15d720 2023-03-30T08:11:17.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.652+0000 7fbaf2226700 1 --2- 172.21.15.87:0/326434564 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbad00653f0 0x7fbad00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:17.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.656+0000 7fbaf2226700 1 --2- 172.21.15.87:0/326434564 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbad00653f0 0x7fbad00678a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbae8005930 tx=0x7fbae8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:17.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.660+0000 7fbae2ffd700 1 -- 172.21.15.87:0/326434564 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fbae4050610 con 0x7fbaec15d720 2023-03-30T08:11:17.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.832+0000 7fbaf448a700 1 -- 172.21.15.87:0/326434564 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbaec073ee0 con 0x7fbaec15d720 2023-03-30T08:11:17.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.832+0000 7fbae2ffd700 1 -- 172.21.15.87:0/326434564 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19652 (secure 0 0 0) 0x7fbae4053c30 con 0x7fbaec15d720 2023-03-30T08:11:17.839 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:17.839 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":28,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:02.841070+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:17.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.836+0000 7fbaf448a700 1 -- 172.21.15.87:0/326434564 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbad00653f0 msgr2=0x7fbad00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:17.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.836+0000 7fbaf448a700 1 --2- 172.21.15.87:0/326434564 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbad00653f0 0x7fbad00678a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbae8005930 tx=0x7fbae8009040 comp rx=0 tx=0).stop 2023-03-30T08:11:17.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.836+0000 7fbaf448a700 1 -- 172.21.15.87:0/326434564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaec15d720 msgr2=0x7fbaec0c9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:17.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.836+0000 7fbaf448a700 1 --2- 172.21.15.87:0/326434564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaec15d720 0x7fbaec0c9b40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbae400cc40 tx=0x7fbae400a060 comp rx=0 tx=0).stop 2023-03-30T08:11:17.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.836+0000 7fbaf448a700 1 -- 172.21.15.87:0/326434564 shutdown_connections 2023-03-30T08:11:17.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.836+0000 7fbaf448a700 1 --2- 172.21.15.87:0/326434564 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbad00653f0 0x7fbad00678a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.836+0000 7fbaf448a700 1 --2- 172.21.15.87:0/326434564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbaec15d720 0x7fbaec0c9b40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.836+0000 7fbaf448a700 1 --2- 172.21.15.87:0/326434564 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaec0cdbe0 0x7fbaec14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.836+0000 7fbaf448a700 1 --2- 172.21.15.87:0/326434564 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaec0b3140 0x7fbaec159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:17.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.836+0000 7fbaf448a700 1 -- 172.21.15.87:0/326434564 >> 172.21.15.87:0/326434564 conn(0x7fbaec06e6f0 msgr2=0x7fbaec15b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:17.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.836+0000 7fbaf448a700 1 -- 172.21.15.87:0/326434564 shutdown_connections 2023-03-30T08:11:17.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:17.836+0000 7fbaf448a700 1 -- 172.21.15.87:0/326434564 wait complete. 2023-03-30T08:11:17.863 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-30T08:11:17.863 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-30T08:11:18.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.020+0000 7fe14972d700 1 Processor -- start 2023-03-30T08:11:18.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.020+0000 7fe14972d700 1 -- start start 2023-03-30T08:11:18.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe14972d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe1440cabc0 0x7fe144069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe14972d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1440afca0 con 0x7fe14415cba0 2023-03-30T08:11:18.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe14972d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14415d110 con 0x7fe144159050 2023-03-30T08:11:18.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe14972d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1440afb10 con 0x7fe1440cabc0 2023-03-30T08:11:18.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe13a7fc700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe14415cba0 0x7fe1440ca4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43596/0 (socket says 172.21.15.87:43596) 2023-03-30T08:11:18.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe13a7fc700 1 -- 172.21.15.87:0/2799675671 learned_addr learned my addr 172.21.15.87:0/2799675671 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:18.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe1437fe700 1 --2- 172.21.15.87:0/2799675671 >> v2:172.21.15.87:3300/0 conn(0x7fe1440cabc0 0x7fe144069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe1437fe700 1 -- 172.21.15.87:0/2799675671 >> v1:172.21.15.115:6789/0 conn(0x7fe144159050 legacy=0x7fe1440cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe1437fe700 1 -- 172.21.15.87:0/2799675671 >> v1:172.21.15.87:6789/0 conn(0x7fe14415cba0 legacy=0x7fe1440ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe1427fc700 1 -- 172.21.15.87:0/2799675671 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210503490 0 0) 0x7fe14415d110 con 0x7fe144159050 2023-03-30T08:11:18.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe1437fe700 1 -- 172.21.15.87:0/2799675671 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14415d3f0 con 0x7fe1440cabc0 2023-03-30T08:11:18.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe1437fe700 1 --2- 172.21.15.87:0/2799675671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1440cabc0 0x7fe144069cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009850 tx=0x7fe13c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f40d808974d2a71 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:18.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe1427fc700 1 -- 172.21.15.87:0/2799675671 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c004230 con 0x7fe1440cabc0 2023-03-30T08:11:18.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe1427fc700 1 -- 172.21.15.87:0/2799675671 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c004390 con 0x7fe1440cabc0 2023-03-30T08:11:18.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe1427fc700 1 -- 172.21.15.87:0/2799675671 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c0036c0 con 0x7fe1440cabc0 2023-03-30T08:11:18.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe14972d700 1 -- 172.21.15.87:0/2799675671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1440cabc0 msgr2=0x7fe144069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.024+0000 7fe14972d700 1 --2- 172.21.15.87:0/2799675671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1440cabc0 0x7fe144069cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009850 tx=0x7fe13c009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:18.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.028+0000 7fe14972d700 1 -- 172.21.15.87:0/2799675671 shutdown_connections 2023-03-30T08:11:18.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.028+0000 7fe14972d700 1 --2- 172.21.15.87:0/2799675671 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1440cabc0 0x7fe144069cd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.028+0000 7fe14972d700 1 -- 172.21.15.87:0/2799675671 >> 172.21.15.87:0/2799675671 conn(0x7fe1440cf410 msgr2=0x7fe1440cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:18.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.028+0000 7fe14972d700 1 -- 172.21.15.87:0/2799675671 shutdown_connections 2023-03-30T08:11:18.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.028+0000 7fe14972d700 1 -- 172.21.15.87:0/2799675671 wait complete. 2023-03-30T08:11:18.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.028+0000 7fe14972d700 1 Processor -- start 2023-03-30T08:11:18.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.028+0000 7fe14972d700 1 -- start start 2023-03-30T08:11:18.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe14972d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1440cabc0 0x7fe144153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe14972d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe144159050 0x7fe14415a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe14972d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe14415cba0 0x7fe144154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe14972d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14415bef0 con 0x7fe144159050 2023-03-30T08:11:18.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe14972d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14415b270 con 0x7fe14415cba0 2023-03-30T08:11:18.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe14972d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14415b550 con 0x7fe1440cabc0 2023-03-30T08:11:18.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe13a7fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe144159050 0x7fe14415a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe13a7fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe144159050 0x7fe14415a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56556/0 (socket says 172.21.15.87:56556) 2023-03-30T08:11:18.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe13a7fc700 1 -- 172.21.15.87:0/200727473 learned_addr learned my addr 172.21.15.87:0/200727473 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:18.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe142ffd700 1 --2- 172.21.15.87:0/200727473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1440cabc0 0x7fe144153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe1437fe700 1 --2- 172.21.15.87:0/200727473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe14415cba0 0x7fe144154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe13a7fc700 1 -- 172.21.15.87:0/200727473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1440cabc0 msgr2=0x7fe144153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe13a7fc700 1 --2- 172.21.15.87:0/200727473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1440cabc0 0x7fe144153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe13a7fc700 1 -- 172.21.15.87:0/200727473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe14415cba0 msgr2=0x7fe144154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe13a7fc700 1 --2- 172.21.15.87:0/200727473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe14415cba0 0x7fe144154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe13a7fc700 1 -- 172.21.15.87:0/200727473 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c0094b0 con 0x7fe144159050 2023-03-30T08:11:18.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe13a7fc700 1 --2- 172.21.15.87:0/200727473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe144159050 0x7fe14415a7f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00c780 tx=0x7fe12c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:18.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe13bfff700 1 -- 172.21.15.87:0/200727473 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c004ca0 con 0x7fe144159050 2023-03-30T08:11:18.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe13bfff700 1 -- 172.21.15.87:0/200727473 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12c004e00 con 0x7fe144159050 2023-03-30T08:11:18.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe14972d700 1 -- 172.21.15.87:0/200727473 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14415d9b0 con 0x7fe144159050 2023-03-30T08:11:18.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe13bfff700 1 -- 172.21.15.87:0/200727473 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c0072f0 con 0x7fe144159050 2023-03-30T08:11:18.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.032+0000 7fe14972d700 1 -- 172.21.15.87:0/200727473 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14415d6d0 con 0x7fe144159050 2023-03-30T08:11:18.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.036+0000 7fe14972d700 1 -- 172.21.15.87:0/200727473 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe144159420 con 0x7fe144159050 2023-03-30T08:11:18.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.036+0000 7fe13bfff700 1 -- 172.21.15.87:0/200727473 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fe12c007450 con 0x7fe144159050 2023-03-30T08:11:18.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.036+0000 7fe13bfff700 1 --2- 172.21.15.87:0/200727473 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe124065420 0x7fe1240678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.036+0000 7fe13bfff700 1 -- 172.21.15.87:0/200727473 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe12c082e40 con 0x7fe144159050 2023-03-30T08:11:18.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.040+0000 7fe142ffd700 1 --2- 172.21.15.87:0/200727473 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe124065420 0x7fe1240678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.040+0000 7fe142ffd700 1 --2- 172.21.15.87:0/200727473 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe124065420 0x7fe1240678d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe134002230 tx=0x7fe134009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:18.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.044+0000 7fe13bfff700 1 -- 172.21.15.87:0/200727473 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fe12c0501c0 con 0x7fe144159050 2023-03-30T08:11:18.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.208+0000 7fe14972d700 1 -- 172.21.15.87:0/200727473 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe14415c030 con 0x7fe124065420 2023-03-30T08:11:18.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.228+0000 7fe13bfff700 1 -- 172.21.15.87:0/200727473 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367141 (secure 0 0 0) 0x7fe14415c030 con 0x7fe124065420 2023-03-30T08:11:18.238 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:18.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.236+0000 7fe14972d700 1 -- 172.21.15.87:0/200727473 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe124065420 msgr2=0x7fe1240678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.236+0000 7fe14972d700 1 --2- 172.21.15.87:0/200727473 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe124065420 0x7fe1240678d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe134002230 tx=0x7fe134009040 comp rx=0 tx=0).stop 2023-03-30T08:11:18.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.236+0000 7fe14972d700 1 -- 172.21.15.87:0/200727473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe144159050 msgr2=0x7fe14415a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.236+0000 7fe14972d700 1 --2- 172.21.15.87:0/200727473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe144159050 0x7fe14415a7f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00c780 tx=0x7fe12c00ca90 comp rx=0 tx=0).stop 2023-03-30T08:11:18.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.236+0000 7fe14972d700 1 -- 172.21.15.87:0/200727473 shutdown_connections 2023-03-30T08:11:18.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.236+0000 7fe14972d700 1 --2- 172.21.15.87:0/200727473 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe124065420 0x7fe1240678d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.236+0000 7fe14972d700 1 --2- 172.21.15.87:0/200727473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe14415cba0 0x7fe144154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.236+0000 7fe14972d700 1 --2- 172.21.15.87:0/200727473 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe144159050 0x7fe14415a7f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.236+0000 7fe14972d700 1 --2- 172.21.15.87:0/200727473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1440cabc0 0x7fe144153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.236+0000 7fe14972d700 1 -- 172.21.15.87:0/200727473 >> 172.21.15.87:0/200727473 conn(0x7fe1440cf410 msgr2=0x7fe14406cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:18.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.236+0000 7fe14972d700 1 -- 172.21.15.87:0/200727473 shutdown_connections 2023-03-30T08:11:18.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.236+0000 7fe14972d700 1 -- 172.21.15.87:0/200727473 wait complete. 2023-03-30T08:11:18.243 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-03-30T08:11:18.262 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-03-30T08:11:17.895583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594823,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67620,"kb_used_data":3556,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907100,"statfs":{"total":773094113280,"available":773024870400,"internally_reserved":0,"allocated":3641344,"data_stored":2171039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005016"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.851978+0000","last_change":"2023-03-30T08:11:02.425599+0000","last_active":"2023-03-30T08:11:02.851978+0000","last_peered":"2023-03-30T08:11:02.851978+0000","last_clean":"2023-03-30T08:11:02.851978+0000","last_became_active":"2023-03-30T08:11:02.425042+0000","last_became_peered":"2023-03-30T08:11:02.425042+0000","last_unstale":"2023-03-30T08:11:02.851978+0000","last_undegraded":"2023-03-30T08:11:02.851978+0000","last_fullsized":"2023-03-30T08:11:02.851978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:40:33.035785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406168+0000","last_change":"2023-03-30T08:10:57.939450+0000","last_active":"2023-03-30T08:11:02.406168+0000","last_peered":"2023-03-30T08:11:02.406168+0000","last_clean":"2023-03-30T08:11:02.406168+0000","last_became_active":"2023-03-30T08:10:57.939147+0000","last_became_peered":"2023-03-30T08:10:57.939147+0000","last_unstale":"2023-03-30T08:11:02.406168+0000","last_undegraded":"2023-03-30T08:11:02.406168+0000","last_fullsized":"2023-03-30T08:11:02.406168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:38.146109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395331+0000","last_change":"2023-03-30T08:10:58.389556+0000","last_active":"2023-03-30T08:11:02.395331+0000","last_peered":"2023-03-30T08:11:02.395331+0000","last_clean":"2023-03-30T08:11:02.395331+0000","last_became_active":"2023-03-30T08:10:58.389242+0000","last_became_peered":"2023-03-30T08:10:58.389242+0000","last_unstale":"2023-03-30T08:11:02.395331+0000","last_undegraded":"2023-03-30T08:11:02.395331+0000","last_fullsized":"2023-03-30T08:11:02.395331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:21:53.230935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.959595+0000","last_change":"2023-03-30T08:11:02.434932+0000","last_active":"2023-03-30T08:11:02.959595+0000","last_peered":"2023-03-30T08:11:02.959595+0000","last_clean":"2023-03-30T08:11:02.959595+0000","last_became_active":"2023-03-30T08:11:02.434551+0000","last_became_peered":"2023-03-30T08:11:02.434551+0000","last_unstale":"2023-03-30T08:11:02.959595+0000","last_undegraded":"2023-03-30T08:11:02.959595+0000","last_fullsized":"2023-03-30T08:11:02.959595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:44:14.559765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.411766+0000","last_change":"2023-03-30T08:10:57.937405+0000","last_active":"2023-03-30T08:11:02.411766+0000","last_peered":"2023-03-30T08:11:02.411766+0000","last_clean":"2023-03-30T08:11:02.411766+0000","last_became_active":"2023-03-30T08:10:57.935124+0000","last_became_peered":"2023-03-30T08:10:57.935124+0000","last_unstale":"2023-03-30T08:11:02.411766+0000","last_undegraded":"2023-03-30T08:11:02.411766+0000","last_fullsized":"2023-03-30T08:11:02.411766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:53.405554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399850+0000","last_change":"2023-03-30T08:10:58.403791+0000","last_active":"2023-03-30T08:11:02.399850+0000","last_peered":"2023-03-30T08:11:02.399850+0000","last_clean":"2023-03-30T08:11:02.399850+0000","last_became_active":"2023-03-30T08:10:58.403522+0000","last_became_peered":"2023-03-30T08:10:58.403522+0000","last_unstale":"2023-03-30T08:11:02.399850+0000","last_undegraded":"2023-03-30T08:11:02.399850+0000","last_fullsized":"2023-03-30T08:11:02.399850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:58:27.992306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366005+0000","last_change":"2023-03-30T08:11:02.427878+0000","last_active":"2023-03-30T08:11:03.366005+0000","last_peered":"2023-03-30T08:11:03.366005+0000","last_clean":"2023-03-30T08:11:03.366005+0000","last_became_active":"2023-03-30T08:11:02.421849+0000","last_became_peered":"2023-03-30T08:11:02.421849+0000","last_unstale":"2023-03-30T08:11:03.366005+0000","last_undegraded":"2023-03-30T08:11:03.366005+0000","last_fullsized":"2023-03-30T08:11:03.366005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:38:02.001551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399928+0000","last_change":"2023-03-30T08:10:57.937107+0000","last_active":"2023-03-30T08:11:02.399928+0000","last_peered":"2023-03-30T08:11:02.399928+0000","last_clean":"2023-03-30T08:11:02.399928+0000","last_became_active":"2023-03-30T08:10:57.936809+0000","last_became_peered":"2023-03-30T08:10:57.936809+0000","last_unstale":"2023-03-30T08:11:02.399928+0000","last_undegraded":"2023-03-30T08:11:02.399928+0000","last_fullsized":"2023-03-30T08:11:02.399928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:58:21.827874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394948+0000","last_change":"2023-03-30T08:10:58.390328+0000","last_active":"2023-03-30T08:11:02.394948+0000","last_peered":"2023-03-30T08:11:02.394948+0000","last_clean":"2023-03-30T08:11:02.394948+0000","last_became_active":"2023-03-30T08:10:58.390002+0000","last_became_peered":"2023-03-30T08:10:58.390002+0000","last_unstale":"2023-03-30T08:11:02.394948+0000","last_undegraded":"2023-03-30T08:11:02.394948+0000","last_fullsized":"2023-03-30T08:11:02.394948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:31:49.952044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.854271+0000","last_change":"2023-03-30T08:11:02.427000+0000","last_active":"2023-03-30T08:11:02.854271+0000","last_peered":"2023-03-30T08:11:02.854271+0000","last_clean":"2023-03-30T08:11:02.854271+0000","last_became_active":"2023-03-30T08:11:02.426423+0000","last_became_peered":"2023-03-30T08:11:02.426423+0000","last_unstale":"2023-03-30T08:11:02.854271+0000","last_undegraded":"2023-03-30T08:11:02.854271+0000","last_fullsized":"2023-03-30T08:11:02.854271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:41.480225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399346+0000","last_change":"2023-03-30T08:10:57.937991+0000","last_active":"2023-03-30T08:11:02.399346+0000","last_peered":"2023-03-30T08:11:02.399346+0000","last_clean":"2023-03-30T08:11:02.399346+0000","last_became_active":"2023-03-30T08:10:57.937690+0000","last_became_peered":"2023-03-30T08:10:57.937690+0000","last_unstale":"2023-03-30T08:11:02.399346+0000","last_undegraded":"2023-03-30T08:11:02.399346+0000","last_fullsized":"2023-03-30T08:11:02.399346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:37:16.892431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395882+0000","last_change":"2023-03-30T08:10:58.392963+0000","last_active":"2023-03-30T08:11:02.395882+0000","last_peered":"2023-03-30T08:11:02.395882+0000","last_clean":"2023-03-30T08:11:02.395882+0000","last_became_active":"2023-03-30T08:10:58.388880+0000","last_became_peered":"2023-03-30T08:10:58.388880+0000","last_unstale":"2023-03-30T08:11:02.395882+0000","last_undegraded":"2023-03-30T08:11:02.395882+0000","last_fullsized":"2023-03-30T08:11:02.395882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:25:58.870966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853066+0000","last_change":"2023-03-30T08:11:02.415859+0000","last_active":"2023-03-30T08:11:02.853066+0000","last_peered":"2023-03-30T08:11:02.853066+0000","last_clean":"2023-03-30T08:11:02.853066+0000","last_became_active":"2023-03-30T08:11:02.415410+0000","last_became_peered":"2023-03-30T08:11:02.415410+0000","last_unstale":"2023-03-30T08:11:02.853066+0000","last_undegraded":"2023-03-30T08:11:02.853066+0000","last_fullsized":"2023-03-30T08:11:02.853066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:49:16.476438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406634+0000","last_change":"2023-03-30T08:10:57.947614+0000","last_active":"2023-03-30T08:11:02.406634+0000","last_peered":"2023-03-30T08:11:02.406634+0000","last_clean":"2023-03-30T08:11:02.406634+0000","last_became_active":"2023-03-30T08:10:57.947418+0000","last_became_peered":"2023-03-30T08:10:57.947418+0000","last_unstale":"2023-03-30T08:11:02.406634+0000","last_undegraded":"2023-03-30T08:11:02.406634+0000","last_fullsized":"2023-03-30T08:11:02.406634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:05:18.197097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.417809+0000","last_change":"2023-03-30T08:10:58.394273+0000","last_active":"2023-03-30T08:11:02.417809+0000","last_peered":"2023-03-30T08:11:02.417809+0000","last_clean":"2023-03-30T08:11:02.417809+0000","last_became_active":"2023-03-30T08:10:58.391530+0000","last_became_peered":"2023-03-30T08:10:58.391530+0000","last_unstale":"2023-03-30T08:11:02.417809+0000","last_undegraded":"2023-03-30T08:11:02.417809+0000","last_fullsized":"2023-03-30T08:11:02.417809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:40.846051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.960231+0000","last_change":"2023-03-30T08:11:02.422513+0000","last_active":"2023-03-30T08:11:02.960231+0000","last_peered":"2023-03-30T08:11:02.960231+0000","last_clean":"2023-03-30T08:11:02.960231+0000","last_became_active":"2023-03-30T08:11:02.421920+0000","last_became_peered":"2023-03-30T08:11:02.421920+0000","last_unstale":"2023-03-30T08:11:02.960231+0000","last_undegraded":"2023-03-30T08:11:02.960231+0000","last_fullsized":"2023-03-30T08:11:02.960231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:27:49.655752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395448+0000","last_change":"2023-03-30T08:10:57.940428+0000","last_active":"2023-03-30T08:11:02.395448+0000","last_peered":"2023-03-30T08:11:02.395448+0000","last_clean":"2023-03-30T08:11:02.395448+0000","last_became_active":"2023-03-30T08:10:57.940061+0000","last_became_peered":"2023-03-30T08:10:57.940061+0000","last_unstale":"2023-03-30T08:11:02.395448+0000","last_undegraded":"2023-03-30T08:11:02.395448+0000","last_fullsized":"2023-03-30T08:11:02.395448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:02.973950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413043+0000","last_change":"2023-03-30T08:10:58.392097+0000","last_active":"2023-03-30T08:11:02.413043+0000","last_peered":"2023-03-30T08:11:02.413043+0000","last_clean":"2023-03-30T08:11:02.413043+0000","last_became_active":"2023-03-30T08:10:58.391848+0000","last_became_peered":"2023-03-30T08:10:58.391848+0000","last_unstale":"2023-03-30T08:11:02.413043+0000","last_undegraded":"2023-03-30T08:11:02.413043+0000","last_fullsized":"2023-03-30T08:11:02.413043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366477+0000","last_change":"2023-03-30T08:11:02.423105+0000","last_active":"2023-03-30T08:11:03.366477+0000","last_peered":"2023-03-30T08:11:03.366477+0000","last_clean":"2023-03-30T08:11:03.366477+0000","last_became_active":"2023-03-30T08:11:02.421129+0000","last_became_peered":"2023-03-30T08:11:02.421129+0000","last_unstale":"2023-03-30T08:11:03.366477+0000","last_undegraded":"2023-03-30T08:11:03.366477+0000","last_fullsized":"2023-03-30T08:11:03.366477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:06:26.729383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394857+0000","last_change":"2023-03-30T08:10:57.936602+0000","last_active":"2023-03-30T08:11:02.394857+0000","last_peered":"2023-03-30T08:11:02.394857+0000","last_clean":"2023-03-30T08:11:02.394857+0000","last_became_active":"2023-03-30T08:10:57.936280+0000","last_became_peered":"2023-03-30T08:10:57.936280+0000","last_unstale":"2023-03-30T08:11:02.394857+0000","last_undegraded":"2023-03-30T08:11:02.394857+0000","last_fullsized":"2023-03-30T08:11:02.394857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:53.405554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406100+0000","last_change":"2023-03-30T08:10:58.401670+0000","last_active":"2023-03-30T08:11:02.406100+0000","last_peered":"2023-03-30T08:11:02.406100+0000","last_clean":"2023-03-30T08:11:02.406100+0000","last_became_active":"2023-03-30T08:10:58.401324+0000","last_became_peered":"2023-03-30T08:10:58.401324+0000","last_unstale":"2023-03-30T08:11:02.406100+0000","last_undegraded":"2023-03-30T08:11:02.406100+0000","last_fullsized":"2023-03-30T08:11:02.406100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:35:55.226695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039694+0000","last_change":"2023-03-30T08:11:02.431539+0000","last_active":"2023-03-30T08:11:03.039694+0000","last_peered":"2023-03-30T08:11:03.039694+0000","last_clean":"2023-03-30T08:11:03.039694+0000","last_became_active":"2023-03-30T08:11:02.431107+0000","last_became_peered":"2023-03-30T08:11:02.431107+0000","last_unstale":"2023-03-30T08:11:03.039694+0000","last_undegraded":"2023-03-30T08:11:03.039694+0000","last_fullsized":"2023-03-30T08:11:03.039694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:40:33.035785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396957+0000","last_change":"2023-03-30T08:10:57.943321+0000","last_active":"2023-03-30T08:11:02.396957+0000","last_peered":"2023-03-30T08:11:02.396957+0000","last_clean":"2023-03-30T08:11:02.396957+0000","last_became_active":"2023-03-30T08:10:57.943058+0000","last_became_peered":"2023-03-30T08:10:57.943058+0000","last_unstale":"2023-03-30T08:11:02.396957+0000","last_undegraded":"2023-03-30T08:11:02.396957+0000","last_fullsized":"2023-03-30T08:11:02.396957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:06.629874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403221+0000","last_change":"2023-03-30T08:10:58.401041+0000","last_active":"2023-03-30T08:11:02.403221+0000","last_peered":"2023-03-30T08:11:02.403221+0000","last_clean":"2023-03-30T08:11:02.403221+0000","last_became_active":"2023-03-30T08:10:58.400234+0000","last_became_peered":"2023-03-30T08:10:58.400234+0000","last_unstale":"2023-03-30T08:11:02.403221+0000","last_undegraded":"2023-03-30T08:11:02.403221+0000","last_fullsized":"2023-03-30T08:11:02.403221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:46:19.608053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396781+0000","last_change":"2023-03-30T08:10:58.392868+0000","last_active":"2023-03-30T08:11:02.396781+0000","last_peered":"2023-03-30T08:11:02.396781+0000","last_clean":"2023-03-30T08:11:02.396781+0000","last_became_active":"2023-03-30T08:10:58.392619+0000","last_became_peered":"2023-03-30T08:10:58.392619+0000","last_unstale":"2023-03-30T08:11:02.396781+0000","last_undegraded":"2023-03-30T08:11:02.396781+0000","last_fullsized":"2023-03-30T08:11:02.396781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:15:17.876244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406247+0000","last_change":"2023-03-30T08:10:57.944453+0000","last_active":"2023-03-30T08:11:02.406247+0000","last_peered":"2023-03-30T08:11:02.406247+0000","last_clean":"2023-03-30T08:11:02.406247+0000","last_became_active":"2023-03-30T08:10:57.944114+0000","last_became_peered":"2023-03-30T08:10:57.944114+0000","last_unstale":"2023-03-30T08:11:02.406247+0000","last_undegraded":"2023-03-30T08:11:02.406247+0000","last_fullsized":"2023-03-30T08:11:02.406247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:53.405554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366017+0000","last_change":"2023-03-30T08:11:02.421919+0000","last_active":"2023-03-30T08:11:03.366017+0000","last_peered":"2023-03-30T08:11:03.366017+0000","last_clean":"2023-03-30T08:11:03.366017+0000","last_became_active":"2023-03-30T08:11:02.421212+0000","last_became_peered":"2023-03-30T08:11:02.421212+0000","last_unstale":"2023-03-30T08:11:03.366017+0000","last_undegraded":"2023-03-30T08:11:03.366017+0000","last_fullsized":"2023-03-30T08:11:03.366017+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:43:05.824967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399780+0000","last_change":"2023-03-30T08:10:58.388701+0000","last_active":"2023-03-30T08:11:02.399780+0000","last_peered":"2023-03-30T08:11:02.399780+0000","last_clean":"2023-03-30T08:11:02.399780+0000","last_became_active":"2023-03-30T08:10:58.388445+0000","last_became_peered":"2023-03-30T08:10:58.388445+0000","last_unstale":"2023-03-30T08:11:02.399780+0000","last_undegraded":"2023-03-30T08:11:02.399780+0000","last_fullsized":"2023-03-30T08:11:02.399780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:35:55.226695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.401923+0000","last_change":"2023-03-30T08:10:57.930016+0000","last_active":"2023-03-30T08:11:02.401923+0000","last_peered":"2023-03-30T08:11:02.401923+0000","last_clean":"2023-03-30T08:11:02.401923+0000","last_became_active":"2023-03-30T08:10:57.929673+0000","last_became_peered":"2023-03-30T08:10:57.929673+0000","last_unstale":"2023-03-30T08:11:02.401923+0000","last_undegraded":"2023-03-30T08:11:02.401923+0000","last_fullsized":"2023-03-30T08:11:02.401923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:35:11.040783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853357+0000","last_change":"2023-03-30T08:11:02.426850+0000","last_active":"2023-03-30T08:11:02.853357+0000","last_peered":"2023-03-30T08:11:02.853357+0000","last_clean":"2023-03-30T08:11:02.853357+0000","last_became_active":"2023-03-30T08:11:02.426417+0000","last_became_peered":"2023-03-30T08:11:02.426417+0000","last_unstale":"2023-03-30T08:11:02.853357+0000","last_undegraded":"2023-03-30T08:11:02.853357+0000","last_fullsized":"2023-03-30T08:11:02.853357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:02.698017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.415514+0000","last_change":"2023-03-30T08:10:57.939163+0000","last_active":"2023-03-30T08:11:02.415514+0000","last_peered":"2023-03-30T08:11:02.415514+0000","last_clean":"2023-03-30T08:11:02.415514+0000","last_became_active":"2023-03-30T08:10:57.938683+0000","last_became_peered":"2023-03-30T08:10:57.938683+0000","last_unstale":"2023-03-30T08:11:02.415514+0000","last_undegraded":"2023-03-30T08:11:02.415514+0000","last_fullsized":"2023-03-30T08:11:02.415514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:38.146109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396028+0000","last_change":"2023-03-30T08:10:58.378190+0000","last_active":"2023-03-30T08:11:02.396028+0000","last_peered":"2023-03-30T08:11:02.396028+0000","last_clean":"2023-03-30T08:11:02.396028+0000","last_became_active":"2023-03-30T08:10:58.377665+0000","last_became_peered":"2023-03-30T08:10:58.377665+0000","last_unstale":"2023-03-30T08:11:02.396028+0000","last_undegraded":"2023-03-30T08:11:02.396028+0000","last_fullsized":"2023-03-30T08:11:02.396028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:32:06.544654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.364405+0000","last_change":"2023-03-30T08:11:02.414726+0000","last_active":"2023-03-30T08:11:03.364405+0000","last_peered":"2023-03-30T08:11:03.364405+0000","last_clean":"2023-03-30T08:11:03.364405+0000","last_became_active":"2023-03-30T08:11:02.414203+0000","last_became_peered":"2023-03-30T08:11:02.414203+0000","last_unstale":"2023-03-30T08:11:03.364405+0000","last_undegraded":"2023-03-30T08:11:03.364405+0000","last_fullsized":"2023-03-30T08:11:03.364405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:40:33.035785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'8","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:06.822261+0000","last_change":"2023-03-30T08:10:57.938434+0000","last_active":"2023-03-30T08:11:06.822261+0000","last_peered":"2023-03-30T08:11:06.822261+0000","last_clean":"2023-03-30T08:11:06.822261+0000","last_became_active":"2023-03-30T08:10:57.937335+0000","last_became_peered":"2023-03-30T08:10:57.937335+0000","last_unstale":"2023-03-30T08:11:06.822261+0000","last_undegraded":"2023-03-30T08:11:06.822261+0000","last_fullsized":"2023-03-30T08:11:06.822261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:53:52.935025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396026+0000","last_change":"2023-03-30T08:10:58.376378+0000","last_active":"2023-03-30T08:11:02.396026+0000","last_peered":"2023-03-30T08:11:02.396026+0000","last_clean":"2023-03-30T08:11:02.396026+0000","last_became_active":"2023-03-30T08:10:58.376108+0000","last_became_peered":"2023-03-30T08:10:58.376108+0000","last_unstale":"2023-03-30T08:11:02.396026+0000","last_undegraded":"2023-03-30T08:11:02.396026+0000","last_fullsized":"2023-03-30T08:11:02.396026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:38:23.887005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.852648+0000","last_change":"2023-03-30T08:11:02.421977+0000","last_active":"2023-03-30T08:11:02.852648+0000","last_peered":"2023-03-30T08:11:02.852648+0000","last_clean":"2023-03-30T08:11:02.852648+0000","last_became_active":"2023-03-30T08:11:02.421307+0000","last_became_peered":"2023-03-30T08:11:02.421307+0000","last_unstale":"2023-03-30T08:11:02.852648+0000","last_undegraded":"2023-03-30T08:11:02.852648+0000","last_fullsized":"2023-03-30T08:11:02.852648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:28:34.576988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395167+0000","last_change":"2023-03-30T08:10:58.394164+0000","last_active":"2023-03-30T08:11:02.395167+0000","last_peered":"2023-03-30T08:11:02.395167+0000","last_clean":"2023-03-30T08:11:02.395167+0000","last_became_active":"2023-03-30T08:10:58.393905+0000","last_became_peered":"2023-03-30T08:10:58.393905+0000","last_unstale":"2023-03-30T08:11:02.395167+0000","last_undegraded":"2023-03-30T08:11:02.395167+0000","last_fullsized":"2023-03-30T08:11:02.395167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:41:30.721192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403329+0000","last_change":"2023-03-30T08:10:52.871133+0000","last_active":"2023-03-30T08:11:02.403329+0000","last_peered":"2023-03-30T08:11:02.403329+0000","last_clean":"2023-03-30T08:11:02.403329+0000","last_became_active":"2023-03-30T08:10:52.870678+0000","last_became_peered":"2023-03-30T08:10:52.870678+0000","last_unstale":"2023-03-30T08:11:02.403329+0000","last_undegraded":"2023-03-30T08:11:02.403329+0000","last_fullsized":"2023-03-30T08:11:02.403329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:51.162618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039910+0000","last_change":"2023-03-30T08:10:57.940745+0000","last_active":"2023-03-30T08:11:03.039910+0000","last_peered":"2023-03-30T08:11:03.039910+0000","last_clean":"2023-03-30T08:11:03.039910+0000","last_became_active":"2023-03-30T08:10:57.940137+0000","last_became_peered":"2023-03-30T08:10:57.940137+0000","last_unstale":"2023-03-30T08:11:03.039910+0000","last_undegraded":"2023-03-30T08:11:03.039910+0000","last_fullsized":"2023-03-30T08:11:03.039910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:39.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.364288+0000","last_change":"2023-03-30T08:11:02.420407+0000","last_active":"2023-03-30T08:11:03.364288+0000","last_peered":"2023-03-30T08:11:03.364288+0000","last_clean":"2023-03-30T08:11:03.364288+0000","last_became_active":"2023-03-30T08:11:02.420015+0000","last_became_peered":"2023-03-30T08:11:02.420015+0000","last_unstale":"2023-03-30T08:11:03.364288+0000","last_undegraded":"2023-03-30T08:11:03.364288+0000","last_fullsized":"2023-03-30T08:11:03.364288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:28:34.576988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396868+0000","last_change":"2023-03-30T08:10:58.390779+0000","last_active":"2023-03-30T08:11:02.396868+0000","last_peered":"2023-03-30T08:11:02.396868+0000","last_clean":"2023-03-30T08:11:02.396868+0000","last_became_active":"2023-03-30T08:10:58.389965+0000","last_became_peered":"2023-03-30T08:10:58.389965+0000","last_unstale":"2023-03-30T08:11:02.396868+0000","last_undegraded":"2023-03-30T08:11:02.396868+0000","last_fullsized":"2023-03-30T08:11:02.396868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394961+0000","last_change":"2023-03-30T08:10:52.871548+0000","last_active":"2023-03-30T08:11:02.394961+0000","last_peered":"2023-03-30T08:11:02.394961+0000","last_clean":"2023-03-30T08:11:02.394961+0000","last_became_active":"2023-03-30T08:10:52.871152+0000","last_became_peered":"2023-03-30T08:10:52.871152+0000","last_unstale":"2023-03-30T08:11:02.394961+0000","last_undegraded":"2023-03-30T08:11:02.394961+0000","last_fullsized":"2023-03-30T08:11:02.394961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412264+0000","last_change":"2023-03-30T08:10:57.937918+0000","last_active":"2023-03-30T08:11:02.412264+0000","last_peered":"2023-03-30T08:11:02.412264+0000","last_clean":"2023-03-30T08:11:02.412264+0000","last_became_active":"2023-03-30T08:10:57.937687+0000","last_became_peered":"2023-03-30T08:10:57.937687+0000","last_unstale":"2023-03-30T08:11:02.412264+0000","last_undegraded":"2023-03-30T08:11:02.412264+0000","last_fullsized":"2023-03-30T08:11:02.412264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:12:08.652227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.959598+0000","last_change":"2023-03-30T08:11:02.429990+0000","last_active":"2023-03-30T08:11:02.959598+0000","last_peered":"2023-03-30T08:11:02.959598+0000","last_clean":"2023-03-30T08:11:02.959598+0000","last_became_active":"2023-03-30T08:11:02.429585+0000","last_became_peered":"2023-03-30T08:11:02.429585+0000","last_unstale":"2023-03-30T08:11:02.959598+0000","last_undegraded":"2023-03-30T08:11:02.959598+0000","last_fullsized":"2023-03-30T08:11:02.959598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:11:07.869574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406439+0000","last_change":"2023-03-30T08:10:58.406667+0000","last_active":"2023-03-30T08:11:02.406439+0000","last_peered":"2023-03-30T08:11:02.406439+0000","last_clean":"2023-03-30T08:11:02.406439+0000","last_became_active":"2023-03-30T08:10:58.406362+0000","last_became_peered":"2023-03-30T08:10:58.406362+0000","last_unstale":"2023-03-30T08:11:02.406439+0000","last_undegraded":"2023-03-30T08:11:02.406439+0000","last_fullsized":"2023-03-30T08:11:02.406439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:53.625868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.415949+0000","last_change":"2023-03-30T08:10:52.921525+0000","last_active":"2023-03-30T08:11:02.415949+0000","last_peered":"2023-03-30T08:11:02.415949+0000","last_clean":"2023-03-30T08:11:02.415949+0000","last_became_active":"2023-03-30T08:10:52.920885+0000","last_became_peered":"2023-03-30T08:10:52.920885+0000","last_unstale":"2023-03-30T08:11:02.415949+0000","last_undegraded":"2023-03-30T08:11:02.415949+0000","last_fullsized":"2023-03-30T08:11:02.415949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:38:27.041880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396249+0000","last_change":"2023-03-30T08:10:57.929596+0000","last_active":"2023-03-30T08:11:02.396249+0000","last_peered":"2023-03-30T08:11:02.396249+0000","last_clean":"2023-03-30T08:11:02.396249+0000","last_became_active":"2023-03-30T08:10:57.929334+0000","last_became_peered":"2023-03-30T08:10:57.929334+0000","last_unstale":"2023-03-30T08:11:02.396249+0000","last_undegraded":"2023-03-30T08:11:02.396249+0000","last_fullsized":"2023-03-30T08:11:02.396249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:39.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.365879+0000","last_change":"2023-03-30T08:11:02.420714+0000","last_active":"2023-03-30T08:11:03.365879+0000","last_peered":"2023-03-30T08:11:03.365879+0000","last_clean":"2023-03-30T08:11:03.365879+0000","last_became_active":"2023-03-30T08:11:02.419661+0000","last_became_peered":"2023-03-30T08:11:02.419661+0000","last_unstale":"2023-03-30T08:11:03.365879+0000","last_undegraded":"2023-03-30T08:11:03.365879+0000","last_fullsized":"2023-03-30T08:11:03.365879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:50:58.130125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396109+0000","last_change":"2023-03-30T08:10:58.398687+0000","last_active":"2023-03-30T08:11:02.396109+0000","last_peered":"2023-03-30T08:11:02.396109+0000","last_clean":"2023-03-30T08:11:02.396109+0000","last_became_active":"2023-03-30T08:10:58.398357+0000","last_became_peered":"2023-03-30T08:10:58.398357+0000","last_unstale":"2023-03-30T08:11:02.396109+0000","last_undegraded":"2023-03-30T08:11:02.396109+0000","last_fullsized":"2023-03-30T08:11:02.396109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:40:05.484662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396668+0000","last_change":"2023-03-30T08:10:52.921563+0000","last_active":"2023-03-30T08:11:02.396668+0000","last_peered":"2023-03-30T08:11:02.396668+0000","last_clean":"2023-03-30T08:11:02.396668+0000","last_became_active":"2023-03-30T08:10:52.921234+0000","last_became_peered":"2023-03-30T08:10:52.921234+0000","last_unstale":"2023-03-30T08:11:02.396668+0000","last_undegraded":"2023-03-30T08:11:02.396668+0000","last_fullsized":"2023-03-30T08:11:02.396668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399823+0000","last_change":"2023-03-30T08:10:57.938023+0000","last_active":"2023-03-30T08:11:02.399823+0000","last_peered":"2023-03-30T08:11:02.399823+0000","last_clean":"2023-03-30T08:11:02.399823+0000","last_became_active":"2023-03-30T08:10:57.937727+0000","last_became_peered":"2023-03-30T08:10:57.937727+0000","last_unstale":"2023-03-30T08:11:02.399823+0000","last_undegraded":"2023-03-30T08:11:02.399823+0000","last_fullsized":"2023-03-30T08:11:02.399823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:38.146109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039222+0000","last_change":"2023-03-30T08:11:02.421176+0000","last_active":"2023-03-30T08:11:03.039222+0000","last_peered":"2023-03-30T08:11:03.039222+0000","last_clean":"2023-03-30T08:11:03.039222+0000","last_became_active":"2023-03-30T08:11:02.420282+0000","last_became_peered":"2023-03-30T08:11:02.420282+0000","last_unstale":"2023-03-30T08:11:03.039222+0000","last_undegraded":"2023-03-30T08:11:03.039222+0000","last_fullsized":"2023-03-30T08:11:03.039222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:49:16.476438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395271+0000","last_change":"2023-03-30T08:10:58.393615+0000","last_active":"2023-03-30T08:11:02.395271+0000","last_peered":"2023-03-30T08:11:02.395271+0000","last_clean":"2023-03-30T08:11:02.395271+0000","last_became_active":"2023-03-30T08:10:58.393279+0000","last_became_peered":"2023-03-30T08:10:58.393279+0000","last_unstale":"2023-03-30T08:11:02.395271+0000","last_undegraded":"2023-03-30T08:11:02.395271+0000","last_fullsized":"2023-03-30T08:11:02.395271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396015+0000","last_change":"2023-03-30T08:10:57.940319+0000","last_active":"2023-03-30T08:11:02.396015+0000","last_peered":"2023-03-30T08:11:02.396015+0000","last_clean":"2023-03-30T08:11:02.396015+0000","last_became_active":"2023-03-30T08:10:57.940037+0000","last_became_peered":"2023-03-30T08:10:57.940037+0000","last_unstale":"2023-03-30T08:11:02.396015+0000","last_undegraded":"2023-03-30T08:11:02.396015+0000","last_fullsized":"2023-03-30T08:11:02.396015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:53:42.965405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398522+0000","last_change":"2023-03-30T08:10:52.866272+0000","last_active":"2023-03-30T08:11:02.398522+0000","last_peered":"2023-03-30T08:11:02.398522+0000","last_clean":"2023-03-30T08:11:02.398522+0000","last_became_active":"2023-03-30T08:10:52.865919+0000","last_became_peered":"2023-03-30T08:10:52.865919+0000","last_unstale":"2023-03-30T08:11:02.398522+0000","last_undegraded":"2023-03-30T08:11:02.398522+0000","last_fullsized":"2023-03-30T08:11:02.398522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039424+0000","last_change":"2023-03-30T08:11:02.429404+0000","last_active":"2023-03-30T08:11:03.039424+0000","last_peered":"2023-03-30T08:11:03.039424+0000","last_clean":"2023-03-30T08:11:03.039424+0000","last_became_active":"2023-03-30T08:11:02.424334+0000","last_became_peered":"2023-03-30T08:11:02.424334+0000","last_unstale":"2023-03-30T08:11:03.039424+0000","last_undegraded":"2023-03-30T08:11:03.039424+0000","last_fullsized":"2023-03-30T08:11:03.039424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:24:14.599802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395078+0000","last_change":"2023-03-30T08:10:58.400056+0000","last_active":"2023-03-30T08:11:02.395078+0000","last_peered":"2023-03-30T08:11:02.395078+0000","last_clean":"2023-03-30T08:11:02.395078+0000","last_became_active":"2023-03-30T08:10:58.399774+0000","last_became_peered":"2023-03-30T08:10:58.399774+0000","last_unstale":"2023-03-30T08:11:02.395078+0000","last_undegraded":"2023-03-30T08:11:02.395078+0000","last_fullsized":"2023-03-30T08:11:02.395078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394296+0000","last_change":"2023-03-30T08:10:57.938541+0000","last_active":"2023-03-30T08:11:02.394296+0000","last_peered":"2023-03-30T08:11:02.394296+0000","last_clean":"2023-03-30T08:11:02.394296+0000","last_became_active":"2023-03-30T08:10:57.938279+0000","last_became_peered":"2023-03-30T08:10:57.938279+0000","last_unstale":"2023-03-30T08:11:02.394296+0000","last_undegraded":"2023-03-30T08:11:02.394296+0000","last_fullsized":"2023-03-30T08:11:02.394296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:06.629874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.411865+0000","last_change":"2023-03-30T08:10:52.920796+0000","last_active":"2023-03-30T08:11:02.411865+0000","last_peered":"2023-03-30T08:11:02.411865+0000","last_clean":"2023-03-30T08:11:02.411865+0000","last_became_active":"2023-03-30T08:10:52.920327+0000","last_became_peered":"2023-03-30T08:10:52.920327+0000","last_unstale":"2023-03-30T08:11:02.411865+0000","last_undegraded":"2023-03-30T08:11:02.411865+0000","last_fullsized":"2023-03-30T08:11:02.411865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:17.416386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857569+0000","last_change":"2023-03-30T08:11:02.426961+0000","last_active":"2023-03-30T08:11:02.857569+0000","last_peered":"2023-03-30T08:11:02.857569+0000","last_clean":"2023-03-30T08:11:02.857569+0000","last_became_active":"2023-03-30T08:11:02.426542+0000","last_became_peered":"2023-03-30T08:11:02.426542+0000","last_unstale":"2023-03-30T08:11:02.857569+0000","last_undegraded":"2023-03-30T08:11:02.857569+0000","last_fullsized":"2023-03-30T08:11:02.857569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:35:19.751044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406165+0000","last_change":"2023-03-30T08:10:58.392027+0000","last_active":"2023-03-30T08:11:02.406165+0000","last_peered":"2023-03-30T08:11:02.406165+0000","last_clean":"2023-03-30T08:11:02.406165+0000","last_became_active":"2023-03-30T08:10:58.391260+0000","last_became_peered":"2023-03-30T08:10:58.391260+0000","last_unstale":"2023-03-30T08:11:02.406165+0000","last_undegraded":"2023-03-30T08:11:02.406165+0000","last_fullsized":"2023-03-30T08:11:02.406165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.405859+0000","last_change":"2023-03-30T08:10:57.943504+0000","last_active":"2023-03-30T08:11:02.405859+0000","last_peered":"2023-03-30T08:11:02.405859+0000","last_clean":"2023-03-30T08:11:02.405859+0000","last_became_active":"2023-03-30T08:10:57.943209+0000","last_became_peered":"2023-03-30T08:10:57.943209+0000","last_unstale":"2023-03-30T08:11:02.405859+0000","last_undegraded":"2023-03-30T08:11:02.405859+0000","last_fullsized":"2023-03-30T08:11:02.405859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:12:08.652227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413143+0000","last_change":"2023-03-30T08:10:52.866412+0000","last_active":"2023-03-30T08:11:02.413143+0000","last_peered":"2023-03-30T08:11:02.413143+0000","last_clean":"2023-03-30T08:11:02.413143+0000","last_became_active":"2023-03-30T08:10:52.866055+0000","last_became_peered":"2023-03-30T08:10:52.866055+0000","last_unstale":"2023-03-30T08:11:02.413143+0000","last_undegraded":"2023-03-30T08:11:02.413143+0000","last_fullsized":"2023-03-30T08:11:02.413143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:39.045010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366582+0000","last_change":"2023-03-30T08:11:02.425350+0000","last_active":"2023-03-30T08:11:03.366582+0000","last_peered":"2023-03-30T08:11:03.366582+0000","last_clean":"2023-03-30T08:11:03.366582+0000","last_became_active":"2023-03-30T08:11:02.424984+0000","last_became_peered":"2023-03-30T08:11:02.424984+0000","last_unstale":"2023-03-30T08:11:03.366582+0000","last_undegraded":"2023-03-30T08:11:03.366582+0000","last_fullsized":"2023-03-30T08:11:03.366582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:24:06.284671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.405496+0000","last_change":"2023-03-30T08:10:58.385718+0000","last_active":"2023-03-30T08:11:02.405496+0000","last_peered":"2023-03-30T08:11:02.405496+0000","last_clean":"2023-03-30T08:11:02.405496+0000","last_became_active":"2023-03-30T08:10:58.385408+0000","last_became_peered":"2023-03-30T08:10:58.385408+0000","last_unstale":"2023-03-30T08:11:02.405496+0000","last_undegraded":"2023-03-30T08:11:02.405496+0000","last_fullsized":"2023-03-30T08:11:02.405496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:14:52.425655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403314+0000","last_change":"2023-03-30T08:10:57.937910+0000","last_active":"2023-03-30T08:11:02.403314+0000","last_peered":"2023-03-30T08:11:02.403314+0000","last_clean":"2023-03-30T08:11:02.403314+0000","last_became_active":"2023-03-30T08:10:57.937536+0000","last_became_peered":"2023-03-30T08:10:57.937536+0000","last_unstale":"2023-03-30T08:11:02.403314+0000","last_undegraded":"2023-03-30T08:11:02.403314+0000","last_fullsized":"2023-03-30T08:11:02.403314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:43:19.460541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399212+0000","last_change":"2023-03-30T08:10:52.868170+0000","last_active":"2023-03-30T08:11:02.399212+0000","last_peered":"2023-03-30T08:11:02.399212+0000","last_clean":"2023-03-30T08:11:02.399212+0000","last_became_active":"2023-03-30T08:10:52.867790+0000","last_became_peered":"2023-03-30T08:10:52.867790+0000","last_unstale":"2023-03-30T08:11:02.399212+0000","last_undegraded":"2023-03-30T08:11:02.399212+0000","last_fullsized":"2023-03-30T08:11:02.399212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413220+0000","last_change":"2023-03-30T08:10:45.713084+0000","last_active":"2023-03-30T08:11:02.413220+0000","last_peered":"2023-03-30T08:11:02.413220+0000","last_clean":"2023-03-30T08:11:02.413220+0000","last_became_active":"2023-03-30T08:10:45.711645+0000","last_became_peered":"2023-03-30T08:10:45.711645+0000","last_unstale":"2023-03-30T08:11:02.413220+0000","last_undegraded":"2023-03-30T08:11:02.413220+0000","last_fullsized":"2023-03-30T08:11:02.413220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_clean_scrub_stamp":"2023-03-30T08:10:44.620691+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:58:12.738262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853836+0000","last_change":"2023-03-30T08:11:02.435412+0000","last_active":"2023-03-30T08:11:02.853836+0000","last_peered":"2023-03-30T08:11:02.853836+0000","last_clean":"2023-03-30T08:11:02.853836+0000","last_became_active":"2023-03-30T08:11:02.435007+0000","last_became_peered":"2023-03-30T08:11:02.435007+0000","last_unstale":"2023-03-30T08:11:02.853836+0000","last_undegraded":"2023-03-30T08:11:02.853836+0000","last_fullsized":"2023-03-30T08:11:02.853836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:51:55.638235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394980+0000","last_change":"2023-03-30T08:10:58.385689+0000","last_active":"2023-03-30T08:11:02.394980+0000","last_peered":"2023-03-30T08:11:02.394980+0000","last_clean":"2023-03-30T08:11:02.394980+0000","last_became_active":"2023-03-30T08:10:58.385413+0000","last_became_peered":"2023-03-30T08:10:58.385413+0000","last_unstale":"2023-03-30T08:11:02.394980+0000","last_undegraded":"2023-03-30T08:11:02.394980+0000","last_fullsized":"2023-03-30T08:11:02.394980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:58:27.992306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.397069+0000","last_change":"2023-03-30T08:10:57.936928+0000","last_active":"2023-03-30T08:11:02.397069+0000","last_peered":"2023-03-30T08:11:02.397069+0000","last_clean":"2023-03-30T08:11:02.397069+0000","last_became_active":"2023-03-30T08:10:57.935798+0000","last_became_peered":"2023-03-30T08:10:57.935798+0000","last_unstale":"2023-03-30T08:11:02.397069+0000","last_undegraded":"2023-03-30T08:11:02.397069+0000","last_fullsized":"2023-03-30T08:11:02.397069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:05:18.197097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.960953+0000","last_change":"2023-03-30T08:11:02.423183+0000","last_active":"2023-03-30T08:11:02.960953+0000","last_peered":"2023-03-30T08:11:02.960953+0000","last_clean":"2023-03-30T08:11:02.960953+0000","last_became_active":"2023-03-30T08:11:02.422749+0000","last_became_peered":"2023-03-30T08:11:02.422749+0000","last_unstale":"2023-03-30T08:11:02.960953+0000","last_undegraded":"2023-03-30T08:11:02.960953+0000","last_fullsized":"2023-03-30T08:11:02.960953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:00:38.556877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395463+0000","last_change":"2023-03-30T08:10:58.385022+0000","last_active":"2023-03-30T08:11:02.395463+0000","last_peered":"2023-03-30T08:11:02.395463+0000","last_clean":"2023-03-30T08:11:02.395463+0000","last_became_active":"2023-03-30T08:10:58.384750+0000","last_became_peered":"2023-03-30T08:10:58.384750+0000","last_unstale":"2023-03-30T08:11:02.395463+0000","last_undegraded":"2023-03-30T08:11:02.395463+0000","last_fullsized":"2023-03-30T08:11:02.395463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:56:41.526064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395470+0000","last_change":"2023-03-30T08:10:57.939974+0000","last_active":"2023-03-30T08:11:02.395470+0000","last_peered":"2023-03-30T08:11:02.395470+0000","last_clean":"2023-03-30T08:11:02.395470+0000","last_became_active":"2023-03-30T08:10:57.938857+0000","last_became_peered":"2023-03-30T08:10:57.938857+0000","last_unstale":"2023-03-30T08:11:02.395470+0000","last_undegraded":"2023-03-30T08:11:02.395470+0000","last_fullsized":"2023-03-30T08:11:02.395470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:04:22.947813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366491+0000","last_change":"2023-03-30T08:11:02.427807+0000","last_active":"2023-03-30T08:11:03.366491+0000","last_peered":"2023-03-30T08:11:03.366491+0000","last_clean":"2023-03-30T08:11:03.366491+0000","last_became_active":"2023-03-30T08:11:02.427234+0000","last_became_peered":"2023-03-30T08:11:02.427234+0000","last_unstale":"2023-03-30T08:11:03.366491+0000","last_undegraded":"2023-03-30T08:11:03.366491+0000","last_fullsized":"2023-03-30T08:11:03.366491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:40.748097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394764+0000","last_change":"2023-03-30T08:10:58.396674+0000","last_active":"2023-03-30T08:11:02.394764+0000","last_peered":"2023-03-30T08:11:02.394764+0000","last_clean":"2023-03-30T08:11:02.394764+0000","last_became_active":"2023-03-30T08:10:58.396428+0000","last_became_peered":"2023-03-30T08:10:58.396428+0000","last_unstale":"2023-03-30T08:11:02.394764+0000","last_undegraded":"2023-03-30T08:11:02.394764+0000","last_fullsized":"2023-03-30T08:11:02.394764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:38:03.047478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403474+0000","last_change":"2023-03-30T08:10:57.941837+0000","last_active":"2023-03-30T08:11:02.403474+0000","last_peered":"2023-03-30T08:11:02.403474+0000","last_clean":"2023-03-30T08:11:02.403474+0000","last_became_active":"2023-03-30T08:10:57.941547+0000","last_became_peered":"2023-03-30T08:10:57.941547+0000","last_unstale":"2023-03-30T08:11:02.403474+0000","last_undegraded":"2023-03-30T08:11:02.403474+0000","last_fullsized":"2023-03-30T08:11:02.403474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:02.973950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853079+0000","last_change":"2023-03-30T08:11:02.414849+0000","last_active":"2023-03-30T08:11:02.853079+0000","last_peered":"2023-03-30T08:11:02.853079+0000","last_clean":"2023-03-30T08:11:02.853079+0000","last_became_active":"2023-03-30T08:11:02.414475+0000","last_became_peered":"2023-03-30T08:11:02.414475+0000","last_unstale":"2023-03-30T08:11:02.853079+0000","last_undegraded":"2023-03-30T08:11:02.853079+0000","last_fullsized":"2023-03-30T08:11:02.853079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:51:55.638235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395259+0000","last_change":"2023-03-30T08:10:58.390202+0000","last_active":"2023-03-30T08:11:02.395259+0000","last_peered":"2023-03-30T08:11:02.395259+0000","last_clean":"2023-03-30T08:11:02.395259+0000","last_became_active":"2023-03-30T08:10:58.389111+0000","last_became_peered":"2023-03-30T08:10:58.389111+0000","last_unstale":"2023-03-30T08:11:02.395259+0000","last_undegraded":"2023-03-30T08:11:02.395259+0000","last_fullsized":"2023-03-30T08:11:02.395259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:06:23.251839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.404718+0000","last_change":"2023-03-30T08:10:57.943339+0000","last_active":"2023-03-30T08:11:02.404718+0000","last_peered":"2023-03-30T08:11:02.404718+0000","last_clean":"2023-03-30T08:11:02.404718+0000","last_became_active":"2023-03-30T08:10:57.943025+0000","last_became_peered":"2023-03-30T08:10:57.943025+0000","last_unstale":"2023-03-30T08:11:02.404718+0000","last_undegraded":"2023-03-30T08:11:02.404718+0000","last_fullsized":"2023-03-30T08:11:02.404718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:39.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857288+0000","last_change":"2023-03-30T08:11:02.430259+0000","last_active":"2023-03-30T08:11:02.857288+0000","last_peered":"2023-03-30T08:11:02.857288+0000","last_clean":"2023-03-30T08:11:02.857288+0000","last_became_active":"2023-03-30T08:11:02.429913+0000","last_became_peered":"2023-03-30T08:11:02.429913+0000","last_unstale":"2023-03-30T08:11:02.857288+0000","last_undegraded":"2023-03-30T08:11:02.857288+0000","last_fullsized":"2023-03-30T08:11:02.857288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:57:50.469768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406365+0000","last_change":"2023-03-30T08:10:58.399947+0000","last_active":"2023-03-30T08:11:02.406365+0000","last_peered":"2023-03-30T08:11:02.406365+0000","last_clean":"2023-03-30T08:11:02.406365+0000","last_became_active":"2023-03-30T08:10:58.399634+0000","last_became_peered":"2023-03-30T08:10:58.399634+0000","last_unstale":"2023-03-30T08:11:02.406365+0000","last_undegraded":"2023-03-30T08:11:02.406365+0000","last_fullsized":"2023-03-30T08:11:02.406365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:58:27.992306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399443+0000","last_change":"2023-03-30T08:10:57.934972+0000","last_active":"2023-03-30T08:11:02.399443+0000","last_peered":"2023-03-30T08:11:02.399443+0000","last_clean":"2023-03-30T08:11:02.399443+0000","last_became_active":"2023-03-30T08:10:57.934655+0000","last_became_peered":"2023-03-30T08:10:57.934655+0000","last_unstale":"2023-03-30T08:11:02.399443+0000","last_undegraded":"2023-03-30T08:11:02.399443+0000","last_fullsized":"2023-03-30T08:11:02.399443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:49:48.774880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857279+0000","last_change":"2023-03-30T08:11:02.419444+0000","last_active":"2023-03-30T08:11:02.857279+0000","last_peered":"2023-03-30T08:11:02.857279+0000","last_clean":"2023-03-30T08:11:02.857279+0000","last_became_active":"2023-03-30T08:11:02.419054+0000","last_became_peered":"2023-03-30T08:11:02.419054+0000","last_unstale":"2023-03-30T08:11:02.857279+0000","last_undegraded":"2023-03-30T08:11:02.857279+0000","last_fullsized":"2023-03-30T08:11:02.857279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:35:06.686651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403308+0000","last_change":"2023-03-30T08:10:58.375670+0000","last_active":"2023-03-30T08:11:02.403308+0000","last_peered":"2023-03-30T08:11:02.403308+0000","last_clean":"2023-03-30T08:11:02.403308+0000","last_became_active":"2023-03-30T08:10:58.375401+0000","last_became_peered":"2023-03-30T08:10:58.375401+0000","last_unstale":"2023-03-30T08:11:02.403308+0000","last_undegraded":"2023-03-30T08:11:02.403308+0000","last_fullsized":"2023-03-30T08:11:02.403308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:22:19.993012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.415805+0000","last_change":"2023-03-30T08:10:57.934773+0000","last_active":"2023-03-30T08:11:02.415805+0000","last_peered":"2023-03-30T08:11:02.415805+0000","last_clean":"2023-03-30T08:11:02.415805+0000","last_became_active":"2023-03-30T08:10:57.934496+0000","last_became_peered":"2023-03-30T08:10:57.934496+0000","last_unstale":"2023-03-30T08:11:02.415805+0000","last_undegraded":"2023-03-30T08:11:02.415805+0000","last_fullsized":"2023-03-30T08:11:02.415805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:39:29.317281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857187+0000","last_change":"2023-03-30T08:11:02.431555+0000","last_active":"2023-03-30T08:11:02.857187+0000","last_peered":"2023-03-30T08:11:02.857187+0000","last_clean":"2023-03-30T08:11:02.857187+0000","last_became_active":"2023-03-30T08:11:02.431128+0000","last_became_peered":"2023-03-30T08:11:02.431128+0000","last_unstale":"2023-03-30T08:11:02.857187+0000","last_undegraded":"2023-03-30T08:11:02.857187+0000","last_fullsized":"2023-03-30T08:11:02.857187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:57.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394896+0000","last_change":"2023-03-30T08:10:58.373263+0000","last_active":"2023-03-30T08:11:02.394896+0000","last_peered":"2023-03-30T08:11:02.394896+0000","last_clean":"2023-03-30T08:11:02.394896+0000","last_became_active":"2023-03-30T08:10:58.373002+0000","last_became_peered":"2023-03-30T08:10:58.373002+0000","last_unstale":"2023-03-30T08:11:02.394896+0000","last_undegraded":"2023-03-30T08:11:02.394896+0000","last_fullsized":"2023-03-30T08:11:02.394896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:39:17.667535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416575+0000","last_change":"2023-03-30T08:10:57.948558+0000","last_active":"2023-03-30T08:11:02.416575+0000","last_peered":"2023-03-30T08:11:02.416575+0000","last_clean":"2023-03-30T08:11:02.416575+0000","last_became_active":"2023-03-30T08:10:57.948285+0000","last_became_peered":"2023-03-30T08:10:57.948285+0000","last_unstale":"2023-03-30T08:11:02.416575+0000","last_undegraded":"2023-03-30T08:11:02.416575+0000","last_fullsized":"2023-03-30T08:11:02.416575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:35:11.040783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857020+0000","last_change":"2023-03-30T08:11:02.428125+0000","last_active":"2023-03-30T08:11:02.857020+0000","last_peered":"2023-03-30T08:11:02.857020+0000","last_clean":"2023-03-30T08:11:02.857020+0000","last_became_active":"2023-03-30T08:11:02.427821+0000","last_became_peered":"2023-03-30T08:11:02.427821+0000","last_unstale":"2023-03-30T08:11:02.857020+0000","last_undegraded":"2023-03-30T08:11:02.857020+0000","last_fullsized":"2023-03-30T08:11:02.857020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:19:49.490189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398351+0000","last_change":"2023-03-30T08:10:58.396669+0000","last_active":"2023-03-30T08:11:02.398351+0000","last_peered":"2023-03-30T08:11:02.398351+0000","last_clean":"2023-03-30T08:11:02.398351+0000","last_became_active":"2023-03-30T08:10:58.396369+0000","last_became_peered":"2023-03-30T08:10:58.396369+0000","last_unstale":"2023-03-30T08:11:02.398351+0000","last_undegraded":"2023-03-30T08:11:02.398351+0000","last_fullsized":"2023-03-30T08:11:02.398351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416902+0000","last_change":"2023-03-30T08:10:57.947747+0000","last_active":"2023-03-30T08:11:02.416902+0000","last_peered":"2023-03-30T08:11:02.416902+0000","last_clean":"2023-03-30T08:11:02.416902+0000","last_became_active":"2023-03-30T08:10:57.947479+0000","last_became_peered":"2023-03-30T08:10:57.947479+0000","last_unstale":"2023-03-30T08:11:02.416902+0000","last_undegraded":"2023-03-30T08:11:02.416902+0000","last_fullsized":"2023-03-30T08:11:02.416902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:58:21.827874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.854114+0000","last_change":"2023-03-30T08:11:02.428227+0000","last_active":"2023-03-30T08:11:02.854114+0000","last_peered":"2023-03-30T08:11:02.854114+0000","last_clean":"2023-03-30T08:11:02.854114+0000","last_became_active":"2023-03-30T08:11:02.427865+0000","last_became_peered":"2023-03-30T08:11:02.427865+0000","last_unstale":"2023-03-30T08:11:02.854114+0000","last_undegraded":"2023-03-30T08:11:02.854114+0000","last_fullsized":"2023-03-30T08:11:02.854114+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:57:54.590144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366556+0000","last_change":"2023-03-30T08:11:02.425154+0000","last_active":"2023-03-30T08:11:03.366556+0000","last_peered":"2023-03-30T08:11:03.366556+0000","last_clean":"2023-03-30T08:11:03.366556+0000","last_became_active":"2023-03-30T08:11:02.424719+0000","last_became_peered":"2023-03-30T08:11:02.424719+0000","last_unstale":"2023-03-30T08:11:03.366556+0000","last_undegraded":"2023-03-30T08:11:03.366556+0000","last_fullsized":"2023-03-30T08:11:03.366556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:31:01.730540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403168+0000","last_change":"2023-03-30T08:10:57.943082+0000","last_active":"2023-03-30T08:11:02.403168+0000","last_peered":"2023-03-30T08:11:02.403168+0000","last_clean":"2023-03-30T08:11:02.403168+0000","last_became_active":"2023-03-30T08:10:57.942820+0000","last_became_peered":"2023-03-30T08:10:57.942820+0000","last_unstale":"2023-03-30T08:11:02.403168+0000","last_undegraded":"2023-03-30T08:11:02.403168+0000","last_fullsized":"2023-03-30T08:11:02.403168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:53:52.935025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412130+0000","last_change":"2023-03-30T08:10:58.394733+0000","last_active":"2023-03-30T08:11:02.412130+0000","last_peered":"2023-03-30T08:11:02.412130+0000","last_clean":"2023-03-30T08:11:02.412130+0000","last_became_active":"2023-03-30T08:10:58.394491+0000","last_became_peered":"2023-03-30T08:10:58.394491+0000","last_unstale":"2023-03-30T08:11:02.412130+0000","last_undegraded":"2023-03-30T08:11:02.412130+0000","last_fullsized":"2023-03-30T08:11:02.412130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:53.625868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.365349+0000","last_change":"2023-03-30T08:11:02.422104+0000","last_active":"2023-03-30T08:11:03.365349+0000","last_peered":"2023-03-30T08:11:03.365349+0000","last_clean":"2023-03-30T08:11:03.365349+0000","last_became_active":"2023-03-30T08:11:02.421521+0000","last_became_peered":"2023-03-30T08:11:02.421521+0000","last_unstale":"2023-03-30T08:11:03.365349+0000","last_undegraded":"2023-03-30T08:11:03.365349+0000","last_fullsized":"2023-03-30T08:11:03.365349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:40.748097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.414704+0000","last_change":"2023-03-30T08:10:57.942911+0000","last_active":"2023-03-30T08:11:02.414704+0000","last_peered":"2023-03-30T08:11:02.414704+0000","last_clean":"2023-03-30T08:11:02.414704+0000","last_became_active":"2023-03-30T08:10:57.942621+0000","last_became_peered":"2023-03-30T08:10:57.942621+0000","last_unstale":"2023-03-30T08:11:02.414704+0000","last_undegraded":"2023-03-30T08:11:02.414704+0000","last_fullsized":"2023-03-30T08:11:02.414704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:37:16.892431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406251+0000","last_change":"2023-03-30T08:10:58.401562+0000","last_active":"2023-03-30T08:11:02.406251+0000","last_peered":"2023-03-30T08:11:02.406251+0000","last_clean":"2023-03-30T08:11:02.406251+0000","last_became_active":"2023-03-30T08:10:58.400749+0000","last_became_peered":"2023-03-30T08:10:58.400749+0000","last_unstale":"2023-03-30T08:11:02.406251+0000","last_undegraded":"2023-03-30T08:11:02.406251+0000","last_fullsized":"2023-03-30T08:11:02.406251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406724+0000","last_change":"2023-03-30T08:10:57.943258+0000","last_active":"2023-03-30T08:11:02.406724+0000","last_peered":"2023-03-30T08:11:02.406724+0000","last_clean":"2023-03-30T08:11:02.406724+0000","last_became_active":"2023-03-30T08:10:57.942778+0000","last_became_peered":"2023-03-30T08:10:57.942778+0000","last_unstale":"2023-03-30T08:11:02.406724+0000","last_undegraded":"2023-03-30T08:11:02.406724+0000","last_fullsized":"2023-03-30T08:11:02.406724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:06.629874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399677+0000","last_change":"2023-03-30T08:10:58.395671+0000","last_active":"2023-03-30T08:11:02.399677+0000","last_peered":"2023-03-30T08:11:02.399677+0000","last_clean":"2023-03-30T08:11:02.399677+0000","last_became_active":"2023-03-30T08:10:58.395300+0000","last_became_peered":"2023-03-30T08:10:58.395300+0000","last_unstale":"2023-03-30T08:11:02.399677+0000","last_undegraded":"2023-03-30T08:11:02.399677+0000","last_fullsized":"2023-03-30T08:11:02.399677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.364731+0000","last_change":"2023-03-30T08:11:02.425902+0000","last_active":"2023-03-30T08:11:03.364731+0000","last_peered":"2023-03-30T08:11:03.364731+0000","last_clean":"2023-03-30T08:11:03.364731+0000","last_became_active":"2023-03-30T08:11:02.425557+0000","last_became_peered":"2023-03-30T08:11:02.425557+0000","last_unstale":"2023-03-30T08:11:03.364731+0000","last_undegraded":"2023-03-30T08:11:03.364731+0000","last_fullsized":"2023-03-30T08:11:03.364731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:01:41.681380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416216+0000","last_change":"2023-03-30T08:10:57.942208+0000","last_active":"2023-03-30T08:11:02.416216+0000","last_peered":"2023-03-30T08:11:02.416216+0000","last_clean":"2023-03-30T08:11:02.416216+0000","last_became_active":"2023-03-30T08:10:57.941842+0000","last_became_peered":"2023-03-30T08:10:57.941842+0000","last_unstale":"2023-03-30T08:11:02.416216+0000","last_undegraded":"2023-03-30T08:11:02.416216+0000","last_fullsized":"2023-03-30T08:11:02.416216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:49:48.774880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.411403+0000","last_change":"2023-03-30T08:10:58.390960+0000","last_active":"2023-03-30T08:11:02.411403+0000","last_peered":"2023-03-30T08:11:02.411403+0000","last_clean":"2023-03-30T08:11:02.411403+0000","last_became_active":"2023-03-30T08:10:58.390668+0000","last_became_peered":"2023-03-30T08:10:58.390668+0000","last_unstale":"2023-03-30T08:11:02.411403+0000","last_undegraded":"2023-03-30T08:11:02.411403+0000","last_fullsized":"2023-03-30T08:11:02.411403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:06:29.606761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.367121+0000","last_change":"2023-03-30T08:11:02.415367+0000","last_active":"2023-03-30T08:11:03.367121+0000","last_peered":"2023-03-30T08:11:03.367121+0000","last_clean":"2023-03-30T08:11:03.367121+0000","last_became_active":"2023-03-30T08:11:02.414945+0000","last_became_peered":"2023-03-30T08:11:02.414945+0000","last_unstale":"2023-03-30T08:11:03.367121+0000","last_undegraded":"2023-03-30T08:11:03.367121+0000","last_fullsized":"2023-03-30T08:11:03.367121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:49.266964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403049+0000","last_change":"2023-03-30T08:10:58.390221+0000","last_active":"2023-03-30T08:11:02.403049+0000","last_peered":"2023-03-30T08:11:02.403049+0000","last_clean":"2023-03-30T08:11:02.403049+0000","last_became_active":"2023-03-30T08:10:58.389916+0000","last_became_peered":"2023-03-30T08:10:58.389916+0000","last_unstale":"2023-03-30T08:11:02.403049+0000","last_undegraded":"2023-03-30T08:11:02.403049+0000","last_fullsized":"2023-03-30T08:11:02.403049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:33:09.992519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399692+0000","last_change":"2023-03-30T08:10:58.390234+0000","last_active":"2023-03-30T08:11:02.399692+0000","last_peered":"2023-03-30T08:11:02.399692+0000","last_clean":"2023-03-30T08:11:02.399692+0000","last_became_active":"2023-03-30T08:10:58.388988+0000","last_became_peered":"2023-03-30T08:10:58.388988+0000","last_unstale":"2023-03-30T08:11:02.399692+0000","last_undegraded":"2023-03-30T08:11:02.399692+0000","last_fullsized":"2023-03-30T08:11:02.399692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395321+0000","last_change":"2023-03-30T08:10:58.389994+0000","last_active":"2023-03-30T08:11:02.395321+0000","last_peered":"2023-03-30T08:11:02.395321+0000","last_clean":"2023-03-30T08:11:02.395321+0000","last_became_active":"2023-03-30T08:10:58.389699+0000","last_became_peered":"2023-03-30T08:10:58.389699+0000","last_unstale":"2023-03-30T08:11:02.395321+0000","last_undegraded":"2023-03-30T08:11:02.395321+0000","last_fullsized":"2023-03-30T08:11:02.395321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:43:02.347422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.404578+0000","last_change":"2023-03-30T08:10:58.390408+0000","last_active":"2023-03-30T08:11:02.404578+0000","last_peered":"2023-03-30T08:11:02.404578+0000","last_clean":"2023-03-30T08:11:02.404578+0000","last_became_active":"2023-03-30T08:10:58.389982+0000","last_became_peered":"2023-03-30T08:10:58.389982+0000","last_unstale":"2023-03-30T08:11:02.404578+0000","last_undegraded":"2023-03-30T08:11:02.404578+0000","last_fullsized":"2023-03-30T08:11:02.404578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396569+0000","last_change":"2023-03-30T08:10:58.397943+0000","last_active":"2023-03-30T08:11:02.396569+0000","last_peered":"2023-03-30T08:11:02.396569+0000","last_clean":"2023-03-30T08:11:02.396569+0000","last_became_active":"2023-03-30T08:10:58.397652+0000","last_became_peered":"2023-03-30T08:10:58.397652+0000","last_unstale":"2023-03-30T08:11:02.396569+0000","last_undegraded":"2023-03-30T08:11:02.396569+0000","last_fullsized":"2023-03-30T08:11:02.396569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399691+0000","last_change":"2023-03-30T08:10:58.396929+0000","last_active":"2023-03-30T08:11:02.399691+0000","last_peered":"2023-03-30T08:11:02.399691+0000","last_clean":"2023-03-30T08:11:02.399691+0000","last_became_active":"2023-03-30T08:10:58.396575+0000","last_became_peered":"2023-03-30T08:10:58.396575+0000","last_unstale":"2023-03-30T08:11:02.399691+0000","last_undegraded":"2023-03-30T08:11:02.399691+0000","last_fullsized":"2023-03-30T08:11:02.399691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394877+0000","last_change":"2023-03-30T08:10:58.394396+0000","last_active":"2023-03-30T08:11:02.394877+0000","last_peered":"2023-03-30T08:11:02.394877+0000","last_clean":"2023-03-30T08:11:02.394877+0000","last_became_active":"2023-03-30T08:10:58.394147+0000","last_became_peered":"2023-03-30T08:10:58.394147+0000","last_unstale":"2023-03-30T08:11:02.394877+0000","last_undegraded":"2023-03-30T08:11:02.394877+0000","last_fullsized":"2023-03-30T08:11:02.394877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394856+0000","last_change":"2023-03-30T08:10:58.387684+0000","last_active":"2023-03-30T08:11:02.394856+0000","last_peered":"2023-03-30T08:11:02.394856+0000","last_clean":"2023-03-30T08:11:02.394856+0000","last_became_active":"2023-03-30T08:10:58.387427+0000","last_became_peered":"2023-03-30T08:10:58.387427+0000","last_unstale":"2023-03-30T08:11:02.394856+0000","last_undegraded":"2023-03-30T08:11:02.394856+0000","last_fullsized":"2023-03-30T08:11:02.394856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413072+0000","last_change":"2023-03-30T08:10:58.403140+0000","last_active":"2023-03-30T08:11:02.413072+0000","last_peered":"2023-03-30T08:11:02.413072+0000","last_clean":"2023-03-30T08:11:02.413072+0000","last_became_active":"2023-03-30T08:10:58.402888+0000","last_became_peered":"2023-03-30T08:10:58.402888+0000","last_unstale":"2023-03-30T08:11:02.413072+0000","last_undegraded":"2023-03-30T08:11:02.413072+0000","last_fullsized":"2023-03-30T08:11:02.413072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399593+0000","last_change":"2023-03-30T08:10:58.401396+0000","last_active":"2023-03-30T08:11:02.399593+0000","last_peered":"2023-03-30T08:11:02.399593+0000","last_clean":"2023-03-30T08:11:02.399593+0000","last_became_active":"2023-03-30T08:10:58.399503+0000","last_became_peered":"2023-03-30T08:10:58.399503+0000","last_unstale":"2023-03-30T08:11:02.399593+0000","last_undegraded":"2023-03-30T08:11:02.399593+0000","last_fullsized":"2023-03-30T08:11:02.399593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406636+0000","last_change":"2023-03-30T08:10:58.390937+0000","last_active":"2023-03-30T08:11:02.406636+0000","last_peered":"2023-03-30T08:11:02.406636+0000","last_clean":"2023-03-30T08:11:02.406636+0000","last_became_active":"2023-03-30T08:10:58.389638+0000","last_became_peered":"2023-03-30T08:10:58.389638+0000","last_unstale":"2023-03-30T08:11:02.406636+0000","last_undegraded":"2023-03-30T08:11:02.406636+0000","last_fullsized":"2023-03-30T08:11:02.406636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416142+0000","last_change":"2023-03-30T08:10:58.404544+0000","last_active":"2023-03-30T08:11:02.416142+0000","last_peered":"2023-03-30T08:11:02.416142+0000","last_clean":"2023-03-30T08:11:02.416142+0000","last_became_active":"2023-03-30T08:10:58.404283+0000","last_became_peered":"2023-03-30T08:10:58.404283+0000","last_unstale":"2023-03-30T08:11:02.416142+0000","last_undegraded":"2023-03-30T08:11:02.416142+0000","last_fullsized":"2023-03-30T08:11:02.416142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395184+0000","last_change":"2023-03-30T08:10:58.388172+0000","last_active":"2023-03-30T08:11:02.395184+0000","last_peered":"2023-03-30T08:11:02.395184+0000","last_clean":"2023-03-30T08:11:02.395184+0000","last_became_active":"2023-03-30T08:10:58.384720+0000","last_became_peered":"2023-03-30T08:10:58.384720+0000","last_unstale":"2023-03-30T08:11:02.395184+0000","last_undegraded":"2023-03-30T08:11:02.395184+0000","last_fullsized":"2023-03-30T08:11:02.395184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:50:54.652580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.418243+0000","last_change":"2023-03-30T08:10:58.392445+0000","last_active":"2023-03-30T08:11:02.418243+0000","last_peered":"2023-03-30T08:11:02.418243+0000","last_clean":"2023-03-30T08:11:02.418243+0000","last_became_active":"2023-03-30T08:10:58.392143+0000","last_became_peered":"2023-03-30T08:10:58.392143+0000","last_unstale":"2023-03-30T08:11:02.418243+0000","last_undegraded":"2023-03-30T08:11:02.418243+0000","last_fullsized":"2023-03-30T08:11:02.418243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:07.646179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394615+0000","last_change":"2023-03-30T08:10:58.394487+0000","last_active":"2023-03-30T08:11:02.394615+0000","last_peered":"2023-03-30T08:11:02.394615+0000","last_clean":"2023-03-30T08:11:02.394615+0000","last_became_active":"2023-03-30T08:10:58.394174+0000","last_became_peered":"2023-03-30T08:10:58.394174+0000","last_unstale":"2023-03-30T08:11:02.394615+0000","last_undegraded":"2023-03-30T08:11:02.394615+0000","last_fullsized":"2023-03-30T08:11:02.394615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:38:08.997913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406092+0000","last_change":"2023-03-30T08:10:58.407760+0000","last_active":"2023-03-30T08:11:02.406092+0000","last_peered":"2023-03-30T08:11:02.406092+0000","last_clean":"2023-03-30T08:11:02.406092+0000","last_became_active":"2023-03-30T08:10:58.407549+0000","last_became_peered":"2023-03-30T08:10:58.407549+0000","last_unstale":"2023-03-30T08:11:02.406092+0000","last_undegraded":"2023-03-30T08:11:02.406092+0000","last_fullsized":"2023-03-30T08:11:02.406092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395205+0000","last_change":"2023-03-30T08:10:58.397788+0000","last_active":"2023-03-30T08:11:02.395205+0000","last_peered":"2023-03-30T08:11:02.395205+0000","last_clean":"2023-03-30T08:11:02.395205+0000","last_became_active":"2023-03-30T08:10:58.397456+0000","last_became_peered":"2023-03-30T08:10:58.397456+0000","last_unstale":"2023-03-30T08:11:02.395205+0000","last_undegraded":"2023-03-30T08:11:02.395205+0000","last_fullsized":"2023-03-30T08:11:02.395205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:38:35.434847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.414622+0000","last_change":"2023-03-30T08:10:58.391637+0000","last_active":"2023-03-30T08:11:02.414622+0000","last_peered":"2023-03-30T08:11:02.414622+0000","last_clean":"2023-03-30T08:11:02.414622+0000","last_became_active":"2023-03-30T08:10:58.391241+0000","last_became_peered":"2023-03-30T08:10:58.391241+0000","last_unstale":"2023-03-30T08:11:02.414622+0000","last_undegraded":"2023-03-30T08:11:02.414622+0000","last_fullsized":"2023-03-30T08:11:02.414622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:40:05.484662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398410+0000","last_change":"2023-03-30T08:10:58.392474+0000","last_active":"2023-03-30T08:11:02.398410+0000","last_peered":"2023-03-30T08:11:02.398410+0000","last_clean":"2023-03-30T08:11:02.398410+0000","last_became_active":"2023-03-30T08:10:58.392054+0000","last_became_peered":"2023-03-30T08:10:58.392054+0000","last_unstale":"2023-03-30T08:11:02.398410+0000","last_undegraded":"2023-03-30T08:11:02.398410+0000","last_fullsized":"2023-03-30T08:11:02.398410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412024+0000","last_change":"2023-03-30T08:10:58.397632+0000","last_active":"2023-03-30T08:11:02.412024+0000","last_peered":"2023-03-30T08:11:02.412024+0000","last_clean":"2023-03-30T08:11:02.412024+0000","last_became_active":"2023-03-30T08:10:58.392721+0000","last_became_peered":"2023-03-30T08:10:58.392721+0000","last_unstale":"2023-03-30T08:11:02.412024+0000","last_undegraded":"2023-03-30T08:11:02.412024+0000","last_fullsized":"2023-03-30T08:11:02.412024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:39.162414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412163+0000","last_change":"2023-03-30T08:10:58.399202+0000","last_active":"2023-03-30T08:11:02.412163+0000","last_peered":"2023-03-30T08:11:02.412163+0000","last_clean":"2023-03-30T08:11:02.412163+0000","last_became_active":"2023-03-30T08:10:58.398999+0000","last_became_peered":"2023-03-30T08:10:58.398999+0000","last_unstale":"2023-03-30T08:11:02.412163+0000","last_undegraded":"2023-03-30T08:11:02.412163+0000","last_fullsized":"2023-03-30T08:11:02.412163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:49:49.791186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394623+0000","last_change":"2023-03-30T08:10:58.374475+0000","last_active":"2023-03-30T08:11:02.394623+0000","last_peered":"2023-03-30T08:11:02.394623+0000","last_clean":"2023-03-30T08:11:02.394623+0000","last_became_active":"2023-03-30T08:10:58.373968+0000","last_became_peered":"2023-03-30T08:10:58.373968+0000","last_unstale":"2023-03-30T08:11:02.394623+0000","last_undegraded":"2023-03-30T08:11:02.394623+0000","last_fullsized":"2023-03-30T08:11:02.394623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:37:34.381037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.401841+0000","last_change":"2023-03-30T08:10:58.399051+0000","last_active":"2023-03-30T08:11:02.401841+0000","last_peered":"2023-03-30T08:11:02.401841+0000","last_clean":"2023-03-30T08:11:02.401841+0000","last_became_active":"2023-03-30T08:10:58.398767+0000","last_became_peered":"2023-03-30T08:10:58.398767+0000","last_unstale":"2023-03-30T08:11:02.401841+0000","last_undegraded":"2023-03-30T08:11:02.401841+0000","last_fullsized":"2023-03-30T08:11:02.401841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:35:55.226695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.405995+0000","last_change":"2023-03-30T08:10:58.409451+0000","last_active":"2023-03-30T08:11:02.405995+0000","last_peered":"2023-03-30T08:11:02.405995+0000","last_clean":"2023-03-30T08:11:02.405995+0000","last_became_active":"2023-03-30T08:10:58.409195+0000","last_became_peered":"2023-03-30T08:10:58.409195+0000","last_unstale":"2023-03-30T08:11:02.405995+0000","last_undegraded":"2023-03-30T08:11:02.405995+0000","last_fullsized":"2023-03-30T08:11:02.405995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398208+0000","last_change":"2023-03-30T08:10:58.397829+0000","last_active":"2023-03-30T08:11:02.398208+0000","last_peered":"2023-03-30T08:11:02.398208+0000","last_clean":"2023-03-30T08:11:02.398208+0000","last_became_active":"2023-03-30T08:10:58.397472+0000","last_became_peered":"2023-03-30T08:10:58.397472+0000","last_unstale":"2023-03-30T08:11:02.398208+0000","last_undegraded":"2023-03-30T08:11:02.398208+0000","last_fullsized":"2023-03-30T08:11:02.398208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:53.625868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.414543+0000","last_change":"2023-03-30T08:10:58.391590+0000","last_active":"2023-03-30T08:11:02.414543+0000","last_peered":"2023-03-30T08:11:02.414543+0000","last_clean":"2023-03-30T08:11:02.414543+0000","last_became_active":"2023-03-30T08:10:58.390836+0000","last_became_peered":"2023-03-30T08:10:58.390836+0000","last_unstale":"2023-03-30T08:11:02.414543+0000","last_undegraded":"2023-03-30T08:11:02.414543+0000","last_fullsized":"2023-03-30T08:11:02.414543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394825+0000","last_change":"2023-03-30T08:10:58.384402+0000","last_active":"2023-03-30T08:11:02.394825+0000","last_peered":"2023-03-30T08:11:02.394825+0000","last_clean":"2023-03-30T08:11:02.394825+0000","last_became_active":"2023-03-30T08:10:58.384149+0000","last_became_peered":"2023-03-30T08:10:58.384149+0000","last_unstale":"2023-03-30T08:11:02.394825+0000","last_undegraded":"2023-03-30T08:11:02.394825+0000","last_fullsized":"2023-03-30T08:11:02.394825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:49:19.304132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406516+0000","last_change":"2023-03-30T08:10:58.401419+0000","last_active":"2023-03-30T08:11:02.406516+0000","last_peered":"2023-03-30T08:11:02.406516+0000","last_clean":"2023-03-30T08:11:02.406516+0000","last_became_active":"2023-03-30T08:10:58.401118+0000","last_became_peered":"2023-03-30T08:10:58.401118+0000","last_unstale":"2023-03-30T08:11:02.406516+0000","last_undegraded":"2023-03-30T08:11:02.406516+0000","last_fullsized":"2023-03-30T08:11:02.406516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:40:05.484662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403459+0000","last_change":"2023-03-30T08:10:58.397292+0000","last_active":"2023-03-30T08:11:02.403459+0000","last_peered":"2023-03-30T08:11:02.403459+0000","last_clean":"2023-03-30T08:11:02.403459+0000","last_became_active":"2023-03-30T08:10:58.396977+0000","last_became_peered":"2023-03-30T08:10:58.396977+0000","last_unstale":"2023-03-30T08:11:02.403459+0000","last_undegraded":"2023-03-30T08:11:02.403459+0000","last_fullsized":"2023-03-30T08:11:02.403459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:04:09.104430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394458+0000","last_change":"2023-03-30T08:10:58.406332+0000","last_active":"2023-03-30T08:11:02.394458+0000","last_peered":"2023-03-30T08:11:02.394458+0000","last_clean":"2023-03-30T08:11:02.394458+0000","last_became_active":"2023-03-30T08:10:58.406011+0000","last_became_peered":"2023-03-30T08:10:58.406011+0000","last_unstale":"2023-03-30T08:11:02.394458+0000","last_undegraded":"2023-03-30T08:11:02.394458+0000","last_fullsized":"2023-03-30T08:11:02.394458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:14:36.034697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.401759+0000","last_change":"2023-03-30T08:10:58.397437+0000","last_active":"2023-03-30T08:11:02.401759+0000","last_peered":"2023-03-30T08:11:02.401759+0000","last_clean":"2023-03-30T08:11:02.401759+0000","last_became_active":"2023-03-30T08:10:58.396808+0000","last_became_peered":"2023-03-30T08:10:58.396808+0000","last_unstale":"2023-03-30T08:11:02.401759+0000","last_undegraded":"2023-03-30T08:11:02.401759+0000","last_fullsized":"2023-03-30T08:11:02.401759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.418290+0000","last_change":"2023-03-30T08:10:58.392929+0000","last_active":"2023-03-30T08:11:02.418290+0000","last_peered":"2023-03-30T08:11:02.418290+0000","last_clean":"2023-03-30T08:11:02.418290+0000","last_became_active":"2023-03-30T08:10:58.392655+0000","last_became_peered":"2023-03-30T08:10:58.392655+0000","last_unstale":"2023-03-30T08:11:02.418290+0000","last_undegraded":"2023-03-30T08:11:02.418290+0000","last_fullsized":"2023-03-30T08:11:02.418290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:54.421859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4455,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8108,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363732,"statfs":{"total":96636764160,"available":96628461568,"internally_reserved":0,"allocated":299008,"data_stored":122842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7589999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.968}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.742}]}]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9292,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362548,"statfs":{"total":96636764160,"available":96627249152,"internally_reserved":0,"allocated":921600,"data_stored":717083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":307200,"data_stored":123494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8256,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363584,"statfs":{"total":96636764160,"available":96628310016,"internally_reserved":0,"allocated":319488,"data_stored":126555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":122932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.853}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6020000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0310000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8108,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363732,"statfs":{"total":96636764160,"available":96628461568,"internally_reserved":0,"allocated":299008,"data_stored":122842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8236,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363604,"statfs":{"total":96636764160,"available":96628330496,"internally_reserved":0,"allocated":299008,"data_stored":122842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9264,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362576,"statfs":{"total":96636764160,"available":96627277824,"internally_reserved":0,"allocated":892928,"data_stored":712449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.698}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.802}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-30T08:11:18.272 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-30T08:11:18.465 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.460+0000 7f1975420700 1 Processor -- start 2023-03-30T08:11:18.465 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.460+0000 7f1975420700 1 -- start start 2023-03-30T08:11:18.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.460+0000 7f1975420700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1970164190 0x7f19700c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.460+0000 7f1975420700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19700aea30 0x7f197006a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.460+0000 7f1975420700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1970069f00 con 0x7f1970163dc0 2023-03-30T08:11:18.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.460+0000 7f1975420700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197006d810 con 0x7f1970164190 2023-03-30T08:11:18.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.460+0000 7f1975420700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19700cc1d0 con 0x7f19700aea30 2023-03-30T08:11:18.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.460+0000 7f196ffff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1970163dc0 0x7f19700c95c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43606/0 (socket says 172.21.15.87:43606) 2023-03-30T08:11:18.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.460+0000 7f196ffff700 1 -- 172.21.15.87:0/2169427975 learned_addr learned my addr 172.21.15.87:0/2169427975 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:18.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f1974c1f700 1 --2- 172.21.15.87:0/2169427975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19700aea30 0x7f197006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f19677fe700 1 --2- 172.21.15.87:0/2169427975 >> v2:172.21.15.87:3300/0 conn(0x7f1970164190 0x7f19700c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f196f7fe700 1 -- 172.21.15.87:0/2169427975 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344794463 0 0) 0x7f1970069f00 con 0x7f1970163dc0 2023-03-30T08:11:18.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f196f7fe700 1 -- 172.21.15.87:0/2169427975 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f195c0035d0 con 0x7f1970163dc0 2023-03-30T08:11:18.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f1974c1f700 1 -- 172.21.15.87:0/2169427975 >> v2:172.21.15.87:3300/0 conn(0x7f1970164190 msgr2=0x7f19700c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:18.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f1974c1f700 1 --2- 172.21.15.87:0/2169427975 >> v2:172.21.15.87:3300/0 conn(0x7f1970164190 0x7f19700c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f1974c1f700 1 -- 172.21.15.87:0/2169427975 >> v1:172.21.15.87:6789/0 conn(0x7f1970163dc0 legacy=0x7f19700c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f1974c1f700 1 -- 172.21.15.87:0/2169427975 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197006cf70 con 0x7f19700aea30 2023-03-30T08:11:18.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f19677fe700 1 --2- 172.21.15.87:0/2169427975 >> v2:172.21.15.87:3300/0 conn(0x7f1970164190 0x7f19700c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:18.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f1974c1f700 1 --2- 172.21.15.87:0/2169427975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19700aea30 0x7f197006a390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1968009d90 tx=0x7f196800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76012d2cb677190 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:18.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f196f7fe700 1 -- 172.21.15.87:0/2169427975 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196800e070 con 0x7f19700aea30 2023-03-30T08:11:18.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f196f7fe700 1 -- 172.21.15.87:0/2169427975 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196800bb20 con 0x7f19700aea30 2023-03-30T08:11:18.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f196f7fe700 1 -- 172.21.15.87:0/2169427975 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968012430 con 0x7f19700aea30 2023-03-30T08:11:18.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f1975420700 1 -- 172.21.15.87:0/2169427975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19700aea30 msgr2=0x7f197006a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f1975420700 1 --2- 172.21.15.87:0/2169427975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19700aea30 0x7f197006a390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1968009d90 tx=0x7f196800b330 comp rx=0 tx=0).stop 2023-03-30T08:11:18.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f1975420700 1 -- 172.21.15.87:0/2169427975 shutdown_connections 2023-03-30T08:11:18.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f1975420700 1 --2- 172.21.15.87:0/2169427975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f19700aea30 0x7f197006a390 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f1975420700 1 --2- 172.21.15.87:0/2169427975 >> v2:172.21.15.87:3300/0 conn(0x7f1970164190 0x7f19700c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f1975420700 1 -- 172.21.15.87:0/2169427975 >> 172.21.15.87:0/2169427975 conn(0x7f19700cf410 msgr2=0x7f19700cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:18.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f1975420700 1 -- 172.21.15.87:0/2169427975 shutdown_connections 2023-03-30T08:11:18.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.464+0000 7f1975420700 1 -- 172.21.15.87:0/2169427975 wait complete. 2023-03-30T08:11:18.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.468+0000 7f1975420700 1 Processor -- start 2023-03-30T08:11:18.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.468+0000 7f1975420700 1 -- start start 2023-03-30T08:11:18.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1975420700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19700aea30 0x7f197015cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1975420700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1970163dc0 0x7f1970158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1975420700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1970164190 0x7f197015e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1975420700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197015d2c0 con 0x7f1970164190 2023-03-30T08:11:18.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1975420700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197015c360 con 0x7f19700aea30 2023-03-30T08:11:18.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1975420700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197015c850 con 0x7f1970163dc0 2023-03-30T08:11:18.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1974c1f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1970164190 0x7f197015e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1974c1f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1970164190 0x7f197015e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56574/0 (socket says 172.21.15.87:56574) 2023-03-30T08:11:18.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1974c1f700 1 -- 172.21.15.87:0/3162685647 learned_addr learned my addr 172.21.15.87:0/3162685647 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:18.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f196ffff700 1 --2- 172.21.15.87:0/3162685647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19700aea30 0x7f197015cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f19677fe700 1 --2- 172.21.15.87:0/3162685647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1970163dc0 0x7f1970158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1974c1f700 1 -- 172.21.15.87:0/3162685647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1970163dc0 msgr2=0x7f1970158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1974c1f700 1 --2- 172.21.15.87:0/3162685647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1970163dc0 0x7f1970158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1974c1f700 1 -- 172.21.15.87:0/3162685647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19700aea30 msgr2=0x7f197015cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1974c1f700 1 --2- 172.21.15.87:0/3162685647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19700aea30 0x7f197015cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1974c1f700 1 -- 172.21.15.87:0/3162685647 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1968009a70 con 0x7f1970164190 2023-03-30T08:11:18.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1974c1f700 1 --2- 172.21.15.87:0/3162685647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1970164190 0x7f197015e130 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1968014040 tx=0x7f1968004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:18.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f196d7fa700 1 -- 172.21.15.87:0/3162685647 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968012430 con 0x7f1970164190 2023-03-30T08:11:18.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f196d7fa700 1 -- 172.21.15.87:0/3162685647 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1968020070 con 0x7f1970164190 2023-03-30T08:11:18.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f1975420700 1 -- 172.21.15.87:0/3162685647 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197006d530 con 0x7f1970164190 2023-03-30T08:11:18.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.472+0000 7f196d7fa700 1 -- 172.21.15.87:0/3162685647 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19680098f0 con 0x7f1970164190 2023-03-30T08:11:18.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.476+0000 7f1975420700 1 -- 172.21.15.87:0/3162685647 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197006d250 con 0x7f1970164190 2023-03-30T08:11:18.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.476+0000 7f1975420700 1 -- 172.21.15.87:0/3162685647 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197006cc40 con 0x7f1970164190 2023-03-30T08:11:18.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.476+0000 7f196d7fa700 1 -- 172.21.15.87:0/3162685647 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f1968004040 con 0x7f1970164190 2023-03-30T08:11:18.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.480+0000 7f196d7fa700 1 --2- 172.21.15.87:0/3162685647 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1950065420 0x7f19500678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.480+0000 7f196d7fa700 1 -- 172.21.15.87:0/3162685647 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1968022070 con 0x7f1970164190 2023-03-30T08:11:18.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.480+0000 7f196ffff700 1 --2- 172.21.15.87:0/3162685647 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1950065420 0x7f19500678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.480+0000 7f196ffff700 1 --2- 172.21.15.87:0/3162685647 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1950065420 0x7f19500678d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1960007fd0 tx=0x7f1960007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:18.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.484+0000 7f196d7fa700 1 -- 172.21.15.87:0/3162685647 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f19680522f0 con 0x7f1970164190 2023-03-30T08:11:18.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.648+0000 7f1975420700 1 -- 172.21.15.87:0/3162685647 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f19700733a0 con 0x7f1950065420 2023-03-30T08:11:18.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.664+0000 7f196d7fa700 1 -- 172.21.15.87:0/3162685647 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367141 (secure 0 0 0) 0x7f19700733a0 con 0x7f1950065420 2023-03-30T08:11:18.674 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.672+0000 7f1975420700 1 -- 172.21.15.87:0/3162685647 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1950065420 msgr2=0x7f19500678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.672+0000 7f1975420700 1 --2- 172.21.15.87:0/3162685647 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1950065420 0x7f19500678d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1960007fd0 tx=0x7f1960007de0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.672+0000 7f1975420700 1 -- 172.21.15.87:0/3162685647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1970164190 msgr2=0x7f197015e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.672+0000 7f1975420700 1 --2- 172.21.15.87:0/3162685647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1970164190 0x7f197015e130 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1968014040 tx=0x7f1968004af0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.672+0000 7f1975420700 1 -- 172.21.15.87:0/3162685647 shutdown_connections 2023-03-30T08:11:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.672+0000 7f1975420700 1 --2- 172.21.15.87:0/3162685647 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1950065420 0x7f19500678d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.672+0000 7f1975420700 1 --2- 172.21.15.87:0/3162685647 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1970164190 0x7f197015e130 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.672+0000 7f1975420700 1 --2- 172.21.15.87:0/3162685647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1970163dc0 0x7f1970158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.672+0000 7f1975420700 1 --2- 172.21.15.87:0/3162685647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19700aea30 0x7f197015cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.672+0000 7f1975420700 1 -- 172.21.15.87:0/3162685647 >> 172.21.15.87:0/3162685647 conn(0x7f19700cf410 msgr2=0x7f197015b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:18.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.672+0000 7f1975420700 1 -- 172.21.15.87:0/3162685647 shutdown_connections 2023-03-30T08:11:18.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.672+0000 7f1975420700 1 -- 172.21.15.87:0/3162685647 wait complete. 2023-03-30T08:11:18.680 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-03-30T08:11:18.698 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-03-30T08:11:17.895583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594823,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67620,"kb_used_data":3556,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907100,"statfs":{"total":773094113280,"available":773024870400,"internally_reserved":0,"allocated":3641344,"data_stored":2171039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005016"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.851978+0000","last_change":"2023-03-30T08:11:02.425599+0000","last_active":"2023-03-30T08:11:02.851978+0000","last_peered":"2023-03-30T08:11:02.851978+0000","last_clean":"2023-03-30T08:11:02.851978+0000","last_became_active":"2023-03-30T08:11:02.425042+0000","last_became_peered":"2023-03-30T08:11:02.425042+0000","last_unstale":"2023-03-30T08:11:02.851978+0000","last_undegraded":"2023-03-30T08:11:02.851978+0000","last_fullsized":"2023-03-30T08:11:02.851978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:40:33.035785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406168+0000","last_change":"2023-03-30T08:10:57.939450+0000","last_active":"2023-03-30T08:11:02.406168+0000","last_peered":"2023-03-30T08:11:02.406168+0000","last_clean":"2023-03-30T08:11:02.406168+0000","last_became_active":"2023-03-30T08:10:57.939147+0000","last_became_peered":"2023-03-30T08:10:57.939147+0000","last_unstale":"2023-03-30T08:11:02.406168+0000","last_undegraded":"2023-03-30T08:11:02.406168+0000","last_fullsized":"2023-03-30T08:11:02.406168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:38.146109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395331+0000","last_change":"2023-03-30T08:10:58.389556+0000","last_active":"2023-03-30T08:11:02.395331+0000","last_peered":"2023-03-30T08:11:02.395331+0000","last_clean":"2023-03-30T08:11:02.395331+0000","last_became_active":"2023-03-30T08:10:58.389242+0000","last_became_peered":"2023-03-30T08:10:58.389242+0000","last_unstale":"2023-03-30T08:11:02.395331+0000","last_undegraded":"2023-03-30T08:11:02.395331+0000","last_fullsized":"2023-03-30T08:11:02.395331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:21:53.230935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.959595+0000","last_change":"2023-03-30T08:11:02.434932+0000","last_active":"2023-03-30T08:11:02.959595+0000","last_peered":"2023-03-30T08:11:02.959595+0000","last_clean":"2023-03-30T08:11:02.959595+0000","last_became_active":"2023-03-30T08:11:02.434551+0000","last_became_peered":"2023-03-30T08:11:02.434551+0000","last_unstale":"2023-03-30T08:11:02.959595+0000","last_undegraded":"2023-03-30T08:11:02.959595+0000","last_fullsized":"2023-03-30T08:11:02.959595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:44:14.559765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.411766+0000","last_change":"2023-03-30T08:10:57.937405+0000","last_active":"2023-03-30T08:11:02.411766+0000","last_peered":"2023-03-30T08:11:02.411766+0000","last_clean":"2023-03-30T08:11:02.411766+0000","last_became_active":"2023-03-30T08:10:57.935124+0000","last_became_peered":"2023-03-30T08:10:57.935124+0000","last_unstale":"2023-03-30T08:11:02.411766+0000","last_undegraded":"2023-03-30T08:11:02.411766+0000","last_fullsized":"2023-03-30T08:11:02.411766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:53.405554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399850+0000","last_change":"2023-03-30T08:10:58.403791+0000","last_active":"2023-03-30T08:11:02.399850+0000","last_peered":"2023-03-30T08:11:02.399850+0000","last_clean":"2023-03-30T08:11:02.399850+0000","last_became_active":"2023-03-30T08:10:58.403522+0000","last_became_peered":"2023-03-30T08:10:58.403522+0000","last_unstale":"2023-03-30T08:11:02.399850+0000","last_undegraded":"2023-03-30T08:11:02.399850+0000","last_fullsized":"2023-03-30T08:11:02.399850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:58:27.992306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366005+0000","last_change":"2023-03-30T08:11:02.427878+0000","last_active":"2023-03-30T08:11:03.366005+0000","last_peered":"2023-03-30T08:11:03.366005+0000","last_clean":"2023-03-30T08:11:03.366005+0000","last_became_active":"2023-03-30T08:11:02.421849+0000","last_became_peered":"2023-03-30T08:11:02.421849+0000","last_unstale":"2023-03-30T08:11:03.366005+0000","last_undegraded":"2023-03-30T08:11:03.366005+0000","last_fullsized":"2023-03-30T08:11:03.366005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:38:02.001551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399928+0000","last_change":"2023-03-30T08:10:57.937107+0000","last_active":"2023-03-30T08:11:02.399928+0000","last_peered":"2023-03-30T08:11:02.399928+0000","last_clean":"2023-03-30T08:11:02.399928+0000","last_became_active":"2023-03-30T08:10:57.936809+0000","last_became_peered":"2023-03-30T08:10:57.936809+0000","last_unstale":"2023-03-30T08:11:02.399928+0000","last_undegraded":"2023-03-30T08:11:02.399928+0000","last_fullsized":"2023-03-30T08:11:02.399928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:58:21.827874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394948+0000","last_change":"2023-03-30T08:10:58.390328+0000","last_active":"2023-03-30T08:11:02.394948+0000","last_peered":"2023-03-30T08:11:02.394948+0000","last_clean":"2023-03-30T08:11:02.394948+0000","last_became_active":"2023-03-30T08:10:58.390002+0000","last_became_peered":"2023-03-30T08:10:58.390002+0000","last_unstale":"2023-03-30T08:11:02.394948+0000","last_undegraded":"2023-03-30T08:11:02.394948+0000","last_fullsized":"2023-03-30T08:11:02.394948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:31:49.952044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.854271+0000","last_change":"2023-03-30T08:11:02.427000+0000","last_active":"2023-03-30T08:11:02.854271+0000","last_peered":"2023-03-30T08:11:02.854271+0000","last_clean":"2023-03-30T08:11:02.854271+0000","last_became_active":"2023-03-30T08:11:02.426423+0000","last_became_peered":"2023-03-30T08:11:02.426423+0000","last_unstale":"2023-03-30T08:11:02.854271+0000","last_undegraded":"2023-03-30T08:11:02.854271+0000","last_fullsized":"2023-03-30T08:11:02.854271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:41.480225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399346+0000","last_change":"2023-03-30T08:10:57.937991+0000","last_active":"2023-03-30T08:11:02.399346+0000","last_peered":"2023-03-30T08:11:02.399346+0000","last_clean":"2023-03-30T08:11:02.399346+0000","last_became_active":"2023-03-30T08:10:57.937690+0000","last_became_peered":"2023-03-30T08:10:57.937690+0000","last_unstale":"2023-03-30T08:11:02.399346+0000","last_undegraded":"2023-03-30T08:11:02.399346+0000","last_fullsized":"2023-03-30T08:11:02.399346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:37:16.892431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395882+0000","last_change":"2023-03-30T08:10:58.392963+0000","last_active":"2023-03-30T08:11:02.395882+0000","last_peered":"2023-03-30T08:11:02.395882+0000","last_clean":"2023-03-30T08:11:02.395882+0000","last_became_active":"2023-03-30T08:10:58.388880+0000","last_became_peered":"2023-03-30T08:10:58.388880+0000","last_unstale":"2023-03-30T08:11:02.395882+0000","last_undegraded":"2023-03-30T08:11:02.395882+0000","last_fullsized":"2023-03-30T08:11:02.395882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:25:58.870966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853066+0000","last_change":"2023-03-30T08:11:02.415859+0000","last_active":"2023-03-30T08:11:02.853066+0000","last_peered":"2023-03-30T08:11:02.853066+0000","last_clean":"2023-03-30T08:11:02.853066+0000","last_became_active":"2023-03-30T08:11:02.415410+0000","last_became_peered":"2023-03-30T08:11:02.415410+0000","last_unstale":"2023-03-30T08:11:02.853066+0000","last_undegraded":"2023-03-30T08:11:02.853066+0000","last_fullsized":"2023-03-30T08:11:02.853066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:49:16.476438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406634+0000","last_change":"2023-03-30T08:10:57.947614+0000","last_active":"2023-03-30T08:11:02.406634+0000","last_peered":"2023-03-30T08:11:02.406634+0000","last_clean":"2023-03-30T08:11:02.406634+0000","last_became_active":"2023-03-30T08:10:57.947418+0000","last_became_peered":"2023-03-30T08:10:57.947418+0000","last_unstale":"2023-03-30T08:11:02.406634+0000","last_undegraded":"2023-03-30T08:11:02.406634+0000","last_fullsized":"2023-03-30T08:11:02.406634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:05:18.197097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.417809+0000","last_change":"2023-03-30T08:10:58.394273+0000","last_active":"2023-03-30T08:11:02.417809+0000","last_peered":"2023-03-30T08:11:02.417809+0000","last_clean":"2023-03-30T08:11:02.417809+0000","last_became_active":"2023-03-30T08:10:58.391530+0000","last_became_peered":"2023-03-30T08:10:58.391530+0000","last_unstale":"2023-03-30T08:11:02.417809+0000","last_undegraded":"2023-03-30T08:11:02.417809+0000","last_fullsized":"2023-03-30T08:11:02.417809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:40.846051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.960231+0000","last_change":"2023-03-30T08:11:02.422513+0000","last_active":"2023-03-30T08:11:02.960231+0000","last_peered":"2023-03-30T08:11:02.960231+0000","last_clean":"2023-03-30T08:11:02.960231+0000","last_became_active":"2023-03-30T08:11:02.421920+0000","last_became_peered":"2023-03-30T08:11:02.421920+0000","last_unstale":"2023-03-30T08:11:02.960231+0000","last_undegraded":"2023-03-30T08:11:02.960231+0000","last_fullsized":"2023-03-30T08:11:02.960231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:27:49.655752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395448+0000","last_change":"2023-03-30T08:10:57.940428+0000","last_active":"2023-03-30T08:11:02.395448+0000","last_peered":"2023-03-30T08:11:02.395448+0000","last_clean":"2023-03-30T08:11:02.395448+0000","last_became_active":"2023-03-30T08:10:57.940061+0000","last_became_peered":"2023-03-30T08:10:57.940061+0000","last_unstale":"2023-03-30T08:11:02.395448+0000","last_undegraded":"2023-03-30T08:11:02.395448+0000","last_fullsized":"2023-03-30T08:11:02.395448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:02.973950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413043+0000","last_change":"2023-03-30T08:10:58.392097+0000","last_active":"2023-03-30T08:11:02.413043+0000","last_peered":"2023-03-30T08:11:02.413043+0000","last_clean":"2023-03-30T08:11:02.413043+0000","last_became_active":"2023-03-30T08:10:58.391848+0000","last_became_peered":"2023-03-30T08:10:58.391848+0000","last_unstale":"2023-03-30T08:11:02.413043+0000","last_undegraded":"2023-03-30T08:11:02.413043+0000","last_fullsized":"2023-03-30T08:11:02.413043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366477+0000","last_change":"2023-03-30T08:11:02.423105+0000","last_active":"2023-03-30T08:11:03.366477+0000","last_peered":"2023-03-30T08:11:03.366477+0000","last_clean":"2023-03-30T08:11:03.366477+0000","last_became_active":"2023-03-30T08:11:02.421129+0000","last_became_peered":"2023-03-30T08:11:02.421129+0000","last_unstale":"2023-03-30T08:11:03.366477+0000","last_undegraded":"2023-03-30T08:11:03.366477+0000","last_fullsized":"2023-03-30T08:11:03.366477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:06:26.729383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394857+0000","last_change":"2023-03-30T08:10:57.936602+0000","last_active":"2023-03-30T08:11:02.394857+0000","last_peered":"2023-03-30T08:11:02.394857+0000","last_clean":"2023-03-30T08:11:02.394857+0000","last_became_active":"2023-03-30T08:10:57.936280+0000","last_became_peered":"2023-03-30T08:10:57.936280+0000","last_unstale":"2023-03-30T08:11:02.394857+0000","last_undegraded":"2023-03-30T08:11:02.394857+0000","last_fullsized":"2023-03-30T08:11:02.394857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:53.405554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406100+0000","last_change":"2023-03-30T08:10:58.401670+0000","last_active":"2023-03-30T08:11:02.406100+0000","last_peered":"2023-03-30T08:11:02.406100+0000","last_clean":"2023-03-30T08:11:02.406100+0000","last_became_active":"2023-03-30T08:10:58.401324+0000","last_became_peered":"2023-03-30T08:10:58.401324+0000","last_unstale":"2023-03-30T08:11:02.406100+0000","last_undegraded":"2023-03-30T08:11:02.406100+0000","last_fullsized":"2023-03-30T08:11:02.406100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:35:55.226695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039694+0000","last_change":"2023-03-30T08:11:02.431539+0000","last_active":"2023-03-30T08:11:03.039694+0000","last_peered":"2023-03-30T08:11:03.039694+0000","last_clean":"2023-03-30T08:11:03.039694+0000","last_became_active":"2023-03-30T08:11:02.431107+0000","last_became_peered":"2023-03-30T08:11:02.431107+0000","last_unstale":"2023-03-30T08:11:03.039694+0000","last_undegraded":"2023-03-30T08:11:03.039694+0000","last_fullsized":"2023-03-30T08:11:03.039694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:40:33.035785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396957+0000","last_change":"2023-03-30T08:10:57.943321+0000","last_active":"2023-03-30T08:11:02.396957+0000","last_peered":"2023-03-30T08:11:02.396957+0000","last_clean":"2023-03-30T08:11:02.396957+0000","last_became_active":"2023-03-30T08:10:57.943058+0000","last_became_peered":"2023-03-30T08:10:57.943058+0000","last_unstale":"2023-03-30T08:11:02.396957+0000","last_undegraded":"2023-03-30T08:11:02.396957+0000","last_fullsized":"2023-03-30T08:11:02.396957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:06.629874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403221+0000","last_change":"2023-03-30T08:10:58.401041+0000","last_active":"2023-03-30T08:11:02.403221+0000","last_peered":"2023-03-30T08:11:02.403221+0000","last_clean":"2023-03-30T08:11:02.403221+0000","last_became_active":"2023-03-30T08:10:58.400234+0000","last_became_peered":"2023-03-30T08:10:58.400234+0000","last_unstale":"2023-03-30T08:11:02.403221+0000","last_undegraded":"2023-03-30T08:11:02.403221+0000","last_fullsized":"2023-03-30T08:11:02.403221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:46:19.608053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396781+0000","last_change":"2023-03-30T08:10:58.392868+0000","last_active":"2023-03-30T08:11:02.396781+0000","last_peered":"2023-03-30T08:11:02.396781+0000","last_clean":"2023-03-30T08:11:02.396781+0000","last_became_active":"2023-03-30T08:10:58.392619+0000","last_became_peered":"2023-03-30T08:10:58.392619+0000","last_unstale":"2023-03-30T08:11:02.396781+0000","last_undegraded":"2023-03-30T08:11:02.396781+0000","last_fullsized":"2023-03-30T08:11:02.396781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:15:17.876244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406247+0000","last_change":"2023-03-30T08:10:57.944453+0000","last_active":"2023-03-30T08:11:02.406247+0000","last_peered":"2023-03-30T08:11:02.406247+0000","last_clean":"2023-03-30T08:11:02.406247+0000","last_became_active":"2023-03-30T08:10:57.944114+0000","last_became_peered":"2023-03-30T08:10:57.944114+0000","last_unstale":"2023-03-30T08:11:02.406247+0000","last_undegraded":"2023-03-30T08:11:02.406247+0000","last_fullsized":"2023-03-30T08:11:02.406247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:53.405554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366017+0000","last_change":"2023-03-30T08:11:02.421919+0000","last_active":"2023-03-30T08:11:03.366017+0000","last_peered":"2023-03-30T08:11:03.366017+0000","last_clean":"2023-03-30T08:11:03.366017+0000","last_became_active":"2023-03-30T08:11:02.421212+0000","last_became_peered":"2023-03-30T08:11:02.421212+0000","last_unstale":"2023-03-30T08:11:03.366017+0000","last_undegraded":"2023-03-30T08:11:03.366017+0000","last_fullsized":"2023-03-30T08:11:03.366017+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:43:05.824967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399780+0000","last_change":"2023-03-30T08:10:58.388701+0000","last_active":"2023-03-30T08:11:02.399780+0000","last_peered":"2023-03-30T08:11:02.399780+0000","last_clean":"2023-03-30T08:11:02.399780+0000","last_became_active":"2023-03-30T08:10:58.388445+0000","last_became_peered":"2023-03-30T08:10:58.388445+0000","last_unstale":"2023-03-30T08:11:02.399780+0000","last_undegraded":"2023-03-30T08:11:02.399780+0000","last_fullsized":"2023-03-30T08:11:02.399780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:35:55.226695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.401923+0000","last_change":"2023-03-30T08:10:57.930016+0000","last_active":"2023-03-30T08:11:02.401923+0000","last_peered":"2023-03-30T08:11:02.401923+0000","last_clean":"2023-03-30T08:11:02.401923+0000","last_became_active":"2023-03-30T08:10:57.929673+0000","last_became_peered":"2023-03-30T08:10:57.929673+0000","last_unstale":"2023-03-30T08:11:02.401923+0000","last_undegraded":"2023-03-30T08:11:02.401923+0000","last_fullsized":"2023-03-30T08:11:02.401923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:35:11.040783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853357+0000","last_change":"2023-03-30T08:11:02.426850+0000","last_active":"2023-03-30T08:11:02.853357+0000","last_peered":"2023-03-30T08:11:02.853357+0000","last_clean":"2023-03-30T08:11:02.853357+0000","last_became_active":"2023-03-30T08:11:02.426417+0000","last_became_peered":"2023-03-30T08:11:02.426417+0000","last_unstale":"2023-03-30T08:11:02.853357+0000","last_undegraded":"2023-03-30T08:11:02.853357+0000","last_fullsized":"2023-03-30T08:11:02.853357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:02.698017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.415514+0000","last_change":"2023-03-30T08:10:57.939163+0000","last_active":"2023-03-30T08:11:02.415514+0000","last_peered":"2023-03-30T08:11:02.415514+0000","last_clean":"2023-03-30T08:11:02.415514+0000","last_became_active":"2023-03-30T08:10:57.938683+0000","last_became_peered":"2023-03-30T08:10:57.938683+0000","last_unstale":"2023-03-30T08:11:02.415514+0000","last_undegraded":"2023-03-30T08:11:02.415514+0000","last_fullsized":"2023-03-30T08:11:02.415514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:38.146109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396028+0000","last_change":"2023-03-30T08:10:58.378190+0000","last_active":"2023-03-30T08:11:02.396028+0000","last_peered":"2023-03-30T08:11:02.396028+0000","last_clean":"2023-03-30T08:11:02.396028+0000","last_became_active":"2023-03-30T08:10:58.377665+0000","last_became_peered":"2023-03-30T08:10:58.377665+0000","last_unstale":"2023-03-30T08:11:02.396028+0000","last_undegraded":"2023-03-30T08:11:02.396028+0000","last_fullsized":"2023-03-30T08:11:02.396028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:32:06.544654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.364405+0000","last_change":"2023-03-30T08:11:02.414726+0000","last_active":"2023-03-30T08:11:03.364405+0000","last_peered":"2023-03-30T08:11:03.364405+0000","last_clean":"2023-03-30T08:11:03.364405+0000","last_became_active":"2023-03-30T08:11:02.414203+0000","last_became_peered":"2023-03-30T08:11:02.414203+0000","last_unstale":"2023-03-30T08:11:03.364405+0000","last_undegraded":"2023-03-30T08:11:03.364405+0000","last_fullsized":"2023-03-30T08:11:03.364405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:40:33.035785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'8","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:06.822261+0000","last_change":"2023-03-30T08:10:57.938434+0000","last_active":"2023-03-30T08:11:06.822261+0000","last_peered":"2023-03-30T08:11:06.822261+0000","last_clean":"2023-03-30T08:11:06.822261+0000","last_became_active":"2023-03-30T08:10:57.937335+0000","last_became_peered":"2023-03-30T08:10:57.937335+0000","last_unstale":"2023-03-30T08:11:06.822261+0000","last_undegraded":"2023-03-30T08:11:06.822261+0000","last_fullsized":"2023-03-30T08:11:06.822261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:53:52.935025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396026+0000","last_change":"2023-03-30T08:10:58.376378+0000","last_active":"2023-03-30T08:11:02.396026+0000","last_peered":"2023-03-30T08:11:02.396026+0000","last_clean":"2023-03-30T08:11:02.396026+0000","last_became_active":"2023-03-30T08:10:58.376108+0000","last_became_peered":"2023-03-30T08:10:58.376108+0000","last_unstale":"2023-03-30T08:11:02.396026+0000","last_undegraded":"2023-03-30T08:11:02.396026+0000","last_fullsized":"2023-03-30T08:11:02.396026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:38:23.887005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.852648+0000","last_change":"2023-03-30T08:11:02.421977+0000","last_active":"2023-03-30T08:11:02.852648+0000","last_peered":"2023-03-30T08:11:02.852648+0000","last_clean":"2023-03-30T08:11:02.852648+0000","last_became_active":"2023-03-30T08:11:02.421307+0000","last_became_peered":"2023-03-30T08:11:02.421307+0000","last_unstale":"2023-03-30T08:11:02.852648+0000","last_undegraded":"2023-03-30T08:11:02.852648+0000","last_fullsized":"2023-03-30T08:11:02.852648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:28:34.576988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395167+0000","last_change":"2023-03-30T08:10:58.394164+0000","last_active":"2023-03-30T08:11:02.395167+0000","last_peered":"2023-03-30T08:11:02.395167+0000","last_clean":"2023-03-30T08:11:02.395167+0000","last_became_active":"2023-03-30T08:10:58.393905+0000","last_became_peered":"2023-03-30T08:10:58.393905+0000","last_unstale":"2023-03-30T08:11:02.395167+0000","last_undegraded":"2023-03-30T08:11:02.395167+0000","last_fullsized":"2023-03-30T08:11:02.395167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:41:30.721192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403329+0000","last_change":"2023-03-30T08:10:52.871133+0000","last_active":"2023-03-30T08:11:02.403329+0000","last_peered":"2023-03-30T08:11:02.403329+0000","last_clean":"2023-03-30T08:11:02.403329+0000","last_became_active":"2023-03-30T08:10:52.870678+0000","last_became_peered":"2023-03-30T08:10:52.870678+0000","last_unstale":"2023-03-30T08:11:02.403329+0000","last_undegraded":"2023-03-30T08:11:02.403329+0000","last_fullsized":"2023-03-30T08:11:02.403329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:51.162618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039910+0000","last_change":"2023-03-30T08:10:57.940745+0000","last_active":"2023-03-30T08:11:03.039910+0000","last_peered":"2023-03-30T08:11:03.039910+0000","last_clean":"2023-03-30T08:11:03.039910+0000","last_became_active":"2023-03-30T08:10:57.940137+0000","last_became_peered":"2023-03-30T08:10:57.940137+0000","last_unstale":"2023-03-30T08:11:03.039910+0000","last_undegraded":"2023-03-30T08:11:03.039910+0000","last_fullsized":"2023-03-30T08:11:03.039910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:39.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.364288+0000","last_change":"2023-03-30T08:11:02.420407+0000","last_active":"2023-03-30T08:11:03.364288+0000","last_peered":"2023-03-30T08:11:03.364288+0000","last_clean":"2023-03-30T08:11:03.364288+0000","last_became_active":"2023-03-30T08:11:02.420015+0000","last_became_peered":"2023-03-30T08:11:02.420015+0000","last_unstale":"2023-03-30T08:11:03.364288+0000","last_undegraded":"2023-03-30T08:11:03.364288+0000","last_fullsized":"2023-03-30T08:11:03.364288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:28:34.576988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396868+0000","last_change":"2023-03-30T08:10:58.390779+0000","last_active":"2023-03-30T08:11:02.396868+0000","last_peered":"2023-03-30T08:11:02.396868+0000","last_clean":"2023-03-30T08:11:02.396868+0000","last_became_active":"2023-03-30T08:10:58.389965+0000","last_became_peered":"2023-03-30T08:10:58.389965+0000","last_unstale":"2023-03-30T08:11:02.396868+0000","last_undegraded":"2023-03-30T08:11:02.396868+0000","last_fullsized":"2023-03-30T08:11:02.396868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394961+0000","last_change":"2023-03-30T08:10:52.871548+0000","last_active":"2023-03-30T08:11:02.394961+0000","last_peered":"2023-03-30T08:11:02.394961+0000","last_clean":"2023-03-30T08:11:02.394961+0000","last_became_active":"2023-03-30T08:10:52.871152+0000","last_became_peered":"2023-03-30T08:10:52.871152+0000","last_unstale":"2023-03-30T08:11:02.394961+0000","last_undegraded":"2023-03-30T08:11:02.394961+0000","last_fullsized":"2023-03-30T08:11:02.394961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412264+0000","last_change":"2023-03-30T08:10:57.937918+0000","last_active":"2023-03-30T08:11:02.412264+0000","last_peered":"2023-03-30T08:11:02.412264+0000","last_clean":"2023-03-30T08:11:02.412264+0000","last_became_active":"2023-03-30T08:10:57.937687+0000","last_became_peered":"2023-03-30T08:10:57.937687+0000","last_unstale":"2023-03-30T08:11:02.412264+0000","last_undegraded":"2023-03-30T08:11:02.412264+0000","last_fullsized":"2023-03-30T08:11:02.412264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:12:08.652227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.959598+0000","last_change":"2023-03-30T08:11:02.429990+0000","last_active":"2023-03-30T08:11:02.959598+0000","last_peered":"2023-03-30T08:11:02.959598+0000","last_clean":"2023-03-30T08:11:02.959598+0000","last_became_active":"2023-03-30T08:11:02.429585+0000","last_became_peered":"2023-03-30T08:11:02.429585+0000","last_unstale":"2023-03-30T08:11:02.959598+0000","last_undegraded":"2023-03-30T08:11:02.959598+0000","last_fullsized":"2023-03-30T08:11:02.959598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:11:07.869574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406439+0000","last_change":"2023-03-30T08:10:58.406667+0000","last_active":"2023-03-30T08:11:02.406439+0000","last_peered":"2023-03-30T08:11:02.406439+0000","last_clean":"2023-03-30T08:11:02.406439+0000","last_became_active":"2023-03-30T08:10:58.406362+0000","last_became_peered":"2023-03-30T08:10:58.406362+0000","last_unstale":"2023-03-30T08:11:02.406439+0000","last_undegraded":"2023-03-30T08:11:02.406439+0000","last_fullsized":"2023-03-30T08:11:02.406439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:53.625868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.415949+0000","last_change":"2023-03-30T08:10:52.921525+0000","last_active":"2023-03-30T08:11:02.415949+0000","last_peered":"2023-03-30T08:11:02.415949+0000","last_clean":"2023-03-30T08:11:02.415949+0000","last_became_active":"2023-03-30T08:10:52.920885+0000","last_became_peered":"2023-03-30T08:10:52.920885+0000","last_unstale":"2023-03-30T08:11:02.415949+0000","last_undegraded":"2023-03-30T08:11:02.415949+0000","last_fullsized":"2023-03-30T08:11:02.415949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:38:27.041880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396249+0000","last_change":"2023-03-30T08:10:57.929596+0000","last_active":"2023-03-30T08:11:02.396249+0000","last_peered":"2023-03-30T08:11:02.396249+0000","last_clean":"2023-03-30T08:11:02.396249+0000","last_became_active":"2023-03-30T08:10:57.929334+0000","last_became_peered":"2023-03-30T08:10:57.929334+0000","last_unstale":"2023-03-30T08:11:02.396249+0000","last_undegraded":"2023-03-30T08:11:02.396249+0000","last_fullsized":"2023-03-30T08:11:02.396249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:39.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.365879+0000","last_change":"2023-03-30T08:11:02.420714+0000","last_active":"2023-03-30T08:11:03.365879+0000","last_peered":"2023-03-30T08:11:03.365879+0000","last_clean":"2023-03-30T08:11:03.365879+0000","last_became_active":"2023-03-30T08:11:02.419661+0000","last_became_peered":"2023-03-30T08:11:02.419661+0000","last_unstale":"2023-03-30T08:11:03.365879+0000","last_undegraded":"2023-03-30T08:11:03.365879+0000","last_fullsized":"2023-03-30T08:11:03.365879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:50:58.130125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396109+0000","last_change":"2023-03-30T08:10:58.398687+0000","last_active":"2023-03-30T08:11:02.396109+0000","last_peered":"2023-03-30T08:11:02.396109+0000","last_clean":"2023-03-30T08:11:02.396109+0000","last_became_active":"2023-03-30T08:10:58.398357+0000","last_became_peered":"2023-03-30T08:10:58.398357+0000","last_unstale":"2023-03-30T08:11:02.396109+0000","last_undegraded":"2023-03-30T08:11:02.396109+0000","last_fullsized":"2023-03-30T08:11:02.396109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:40:05.484662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396668+0000","last_change":"2023-03-30T08:10:52.921563+0000","last_active":"2023-03-30T08:11:02.396668+0000","last_peered":"2023-03-30T08:11:02.396668+0000","last_clean":"2023-03-30T08:11:02.396668+0000","last_became_active":"2023-03-30T08:10:52.921234+0000","last_became_peered":"2023-03-30T08:10:52.921234+0000","last_unstale":"2023-03-30T08:11:02.396668+0000","last_undegraded":"2023-03-30T08:11:02.396668+0000","last_fullsized":"2023-03-30T08:11:02.396668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399823+0000","last_change":"2023-03-30T08:10:57.938023+0000","last_active":"2023-03-30T08:11:02.399823+0000","last_peered":"2023-03-30T08:11:02.399823+0000","last_clean":"2023-03-30T08:11:02.399823+0000","last_became_active":"2023-03-30T08:10:57.937727+0000","last_became_peered":"2023-03-30T08:10:57.937727+0000","last_unstale":"2023-03-30T08:11:02.399823+0000","last_undegraded":"2023-03-30T08:11:02.399823+0000","last_fullsized":"2023-03-30T08:11:02.399823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:38.146109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039222+0000","last_change":"2023-03-30T08:11:02.421176+0000","last_active":"2023-03-30T08:11:03.039222+0000","last_peered":"2023-03-30T08:11:03.039222+0000","last_clean":"2023-03-30T08:11:03.039222+0000","last_became_active":"2023-03-30T08:11:02.420282+0000","last_became_peered":"2023-03-30T08:11:02.420282+0000","last_unstale":"2023-03-30T08:11:03.039222+0000","last_undegraded":"2023-03-30T08:11:03.039222+0000","last_fullsized":"2023-03-30T08:11:03.039222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:49:16.476438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395271+0000","last_change":"2023-03-30T08:10:58.393615+0000","last_active":"2023-03-30T08:11:02.395271+0000","last_peered":"2023-03-30T08:11:02.395271+0000","last_clean":"2023-03-30T08:11:02.395271+0000","last_became_active":"2023-03-30T08:10:58.393279+0000","last_became_peered":"2023-03-30T08:10:58.393279+0000","last_unstale":"2023-03-30T08:11:02.395271+0000","last_undegraded":"2023-03-30T08:11:02.395271+0000","last_fullsized":"2023-03-30T08:11:02.395271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396015+0000","last_change":"2023-03-30T08:10:57.940319+0000","last_active":"2023-03-30T08:11:02.396015+0000","last_peered":"2023-03-30T08:11:02.396015+0000","last_clean":"2023-03-30T08:11:02.396015+0000","last_became_active":"2023-03-30T08:10:57.940037+0000","last_became_peered":"2023-03-30T08:10:57.940037+0000","last_unstale":"2023-03-30T08:11:02.396015+0000","last_undegraded":"2023-03-30T08:11:02.396015+0000","last_fullsized":"2023-03-30T08:11:02.396015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:53:42.965405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398522+0000","last_change":"2023-03-30T08:10:52.866272+0000","last_active":"2023-03-30T08:11:02.398522+0000","last_peered":"2023-03-30T08:11:02.398522+0000","last_clean":"2023-03-30T08:11:02.398522+0000","last_became_active":"2023-03-30T08:10:52.865919+0000","last_became_peered":"2023-03-30T08:10:52.865919+0000","last_unstale":"2023-03-30T08:11:02.398522+0000","last_undegraded":"2023-03-30T08:11:02.398522+0000","last_fullsized":"2023-03-30T08:11:02.398522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039424+0000","last_change":"2023-03-30T08:11:02.429404+0000","last_active":"2023-03-30T08:11:03.039424+0000","last_peered":"2023-03-30T08:11:03.039424+0000","last_clean":"2023-03-30T08:11:03.039424+0000","last_became_active":"2023-03-30T08:11:02.424334+0000","last_became_peered":"2023-03-30T08:11:02.424334+0000","last_unstale":"2023-03-30T08:11:03.039424+0000","last_undegraded":"2023-03-30T08:11:03.039424+0000","last_fullsized":"2023-03-30T08:11:03.039424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:24:14.599802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395078+0000","last_change":"2023-03-30T08:10:58.400056+0000","last_active":"2023-03-30T08:11:02.395078+0000","last_peered":"2023-03-30T08:11:02.395078+0000","last_clean":"2023-03-30T08:11:02.395078+0000","last_became_active":"2023-03-30T08:10:58.399774+0000","last_became_peered":"2023-03-30T08:10:58.399774+0000","last_unstale":"2023-03-30T08:11:02.395078+0000","last_undegraded":"2023-03-30T08:11:02.395078+0000","last_fullsized":"2023-03-30T08:11:02.395078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394296+0000","last_change":"2023-03-30T08:10:57.938541+0000","last_active":"2023-03-30T08:11:02.394296+0000","last_peered":"2023-03-30T08:11:02.394296+0000","last_clean":"2023-03-30T08:11:02.394296+0000","last_became_active":"2023-03-30T08:10:57.938279+0000","last_became_peered":"2023-03-30T08:10:57.938279+0000","last_unstale":"2023-03-30T08:11:02.394296+0000","last_undegraded":"2023-03-30T08:11:02.394296+0000","last_fullsized":"2023-03-30T08:11:02.394296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:06.629874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.411865+0000","last_change":"2023-03-30T08:10:52.920796+0000","last_active":"2023-03-30T08:11:02.411865+0000","last_peered":"2023-03-30T08:11:02.411865+0000","last_clean":"2023-03-30T08:11:02.411865+0000","last_became_active":"2023-03-30T08:10:52.920327+0000","last_became_peered":"2023-03-30T08:10:52.920327+0000","last_unstale":"2023-03-30T08:11:02.411865+0000","last_undegraded":"2023-03-30T08:11:02.411865+0000","last_fullsized":"2023-03-30T08:11:02.411865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:17.416386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857569+0000","last_change":"2023-03-30T08:11:02.426961+0000","last_active":"2023-03-30T08:11:02.857569+0000","last_peered":"2023-03-30T08:11:02.857569+0000","last_clean":"2023-03-30T08:11:02.857569+0000","last_became_active":"2023-03-30T08:11:02.426542+0000","last_became_peered":"2023-03-30T08:11:02.426542+0000","last_unstale":"2023-03-30T08:11:02.857569+0000","last_undegraded":"2023-03-30T08:11:02.857569+0000","last_fullsized":"2023-03-30T08:11:02.857569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:35:19.751044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406165+0000","last_change":"2023-03-30T08:10:58.392027+0000","last_active":"2023-03-30T08:11:02.406165+0000","last_peered":"2023-03-30T08:11:02.406165+0000","last_clean":"2023-03-30T08:11:02.406165+0000","last_became_active":"2023-03-30T08:10:58.391260+0000","last_became_peered":"2023-03-30T08:10:58.391260+0000","last_unstale":"2023-03-30T08:11:02.406165+0000","last_undegraded":"2023-03-30T08:11:02.406165+0000","last_fullsized":"2023-03-30T08:11:02.406165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.405859+0000","last_change":"2023-03-30T08:10:57.943504+0000","last_active":"2023-03-30T08:11:02.405859+0000","last_peered":"2023-03-30T08:11:02.405859+0000","last_clean":"2023-03-30T08:11:02.405859+0000","last_became_active":"2023-03-30T08:10:57.943209+0000","last_became_peered":"2023-03-30T08:10:57.943209+0000","last_unstale":"2023-03-30T08:11:02.405859+0000","last_undegraded":"2023-03-30T08:11:02.405859+0000","last_fullsized":"2023-03-30T08:11:02.405859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:12:08.652227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413143+0000","last_change":"2023-03-30T08:10:52.866412+0000","last_active":"2023-03-30T08:11:02.413143+0000","last_peered":"2023-03-30T08:11:02.413143+0000","last_clean":"2023-03-30T08:11:02.413143+0000","last_became_active":"2023-03-30T08:10:52.866055+0000","last_became_peered":"2023-03-30T08:10:52.866055+0000","last_unstale":"2023-03-30T08:11:02.413143+0000","last_undegraded":"2023-03-30T08:11:02.413143+0000","last_fullsized":"2023-03-30T08:11:02.413143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:39.045010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366582+0000","last_change":"2023-03-30T08:11:02.425350+0000","last_active":"2023-03-30T08:11:03.366582+0000","last_peered":"2023-03-30T08:11:03.366582+0000","last_clean":"2023-03-30T08:11:03.366582+0000","last_became_active":"2023-03-30T08:11:02.424984+0000","last_became_peered":"2023-03-30T08:11:02.424984+0000","last_unstale":"2023-03-30T08:11:03.366582+0000","last_undegraded":"2023-03-30T08:11:03.366582+0000","last_fullsized":"2023-03-30T08:11:03.366582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:24:06.284671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.405496+0000","last_change":"2023-03-30T08:10:58.385718+0000","last_active":"2023-03-30T08:11:02.405496+0000","last_peered":"2023-03-30T08:11:02.405496+0000","last_clean":"2023-03-30T08:11:02.405496+0000","last_became_active":"2023-03-30T08:10:58.385408+0000","last_became_peered":"2023-03-30T08:10:58.385408+0000","last_unstale":"2023-03-30T08:11:02.405496+0000","last_undegraded":"2023-03-30T08:11:02.405496+0000","last_fullsized":"2023-03-30T08:11:02.405496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:14:52.425655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403314+0000","last_change":"2023-03-30T08:10:57.937910+0000","last_active":"2023-03-30T08:11:02.403314+0000","last_peered":"2023-03-30T08:11:02.403314+0000","last_clean":"2023-03-30T08:11:02.403314+0000","last_became_active":"2023-03-30T08:10:57.937536+0000","last_became_peered":"2023-03-30T08:10:57.937536+0000","last_unstale":"2023-03-30T08:11:02.403314+0000","last_undegraded":"2023-03-30T08:11:02.403314+0000","last_fullsized":"2023-03-30T08:11:02.403314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:43:19.460541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399212+0000","last_change":"2023-03-30T08:10:52.868170+0000","last_active":"2023-03-30T08:11:02.399212+0000","last_peered":"2023-03-30T08:11:02.399212+0000","last_clean":"2023-03-30T08:11:02.399212+0000","last_became_active":"2023-03-30T08:10:52.867790+0000","last_became_peered":"2023-03-30T08:10:52.867790+0000","last_unstale":"2023-03-30T08:11:02.399212+0000","last_undegraded":"2023-03-30T08:11:02.399212+0000","last_fullsized":"2023-03-30T08:11:02.399212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413220+0000","last_change":"2023-03-30T08:10:45.713084+0000","last_active":"2023-03-30T08:11:02.413220+0000","last_peered":"2023-03-30T08:11:02.413220+0000","last_clean":"2023-03-30T08:11:02.413220+0000","last_became_active":"2023-03-30T08:10:45.711645+0000","last_became_peered":"2023-03-30T08:10:45.711645+0000","last_unstale":"2023-03-30T08:11:02.413220+0000","last_undegraded":"2023-03-30T08:11:02.413220+0000","last_fullsized":"2023-03-30T08:11:02.413220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_clean_scrub_stamp":"2023-03-30T08:10:44.620691+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:58:12.738262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853836+0000","last_change":"2023-03-30T08:11:02.435412+0000","last_active":"2023-03-30T08:11:02.853836+0000","last_peered":"2023-03-30T08:11:02.853836+0000","last_clean":"2023-03-30T08:11:02.853836+0000","last_became_active":"2023-03-30T08:11:02.435007+0000","last_became_peered":"2023-03-30T08:11:02.435007+0000","last_unstale":"2023-03-30T08:11:02.853836+0000","last_undegraded":"2023-03-30T08:11:02.853836+0000","last_fullsized":"2023-03-30T08:11:02.853836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:51:55.638235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394980+0000","last_change":"2023-03-30T08:10:58.385689+0000","last_active":"2023-03-30T08:11:02.394980+0000","last_peered":"2023-03-30T08:11:02.394980+0000","last_clean":"2023-03-30T08:11:02.394980+0000","last_became_active":"2023-03-30T08:10:58.385413+0000","last_became_peered":"2023-03-30T08:10:58.385413+0000","last_unstale":"2023-03-30T08:11:02.394980+0000","last_undegraded":"2023-03-30T08:11:02.394980+0000","last_fullsized":"2023-03-30T08:11:02.394980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:58:27.992306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.397069+0000","last_change":"2023-03-30T08:10:57.936928+0000","last_active":"2023-03-30T08:11:02.397069+0000","last_peered":"2023-03-30T08:11:02.397069+0000","last_clean":"2023-03-30T08:11:02.397069+0000","last_became_active":"2023-03-30T08:10:57.935798+0000","last_became_peered":"2023-03-30T08:10:57.935798+0000","last_unstale":"2023-03-30T08:11:02.397069+0000","last_undegraded":"2023-03-30T08:11:02.397069+0000","last_fullsized":"2023-03-30T08:11:02.397069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:05:18.197097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.960953+0000","last_change":"2023-03-30T08:11:02.423183+0000","last_active":"2023-03-30T08:11:02.960953+0000","last_peered":"2023-03-30T08:11:02.960953+0000","last_clean":"2023-03-30T08:11:02.960953+0000","last_became_active":"2023-03-30T08:11:02.422749+0000","last_became_peered":"2023-03-30T08:11:02.422749+0000","last_unstale":"2023-03-30T08:11:02.960953+0000","last_undegraded":"2023-03-30T08:11:02.960953+0000","last_fullsized":"2023-03-30T08:11:02.960953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:00:38.556877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395463+0000","last_change":"2023-03-30T08:10:58.385022+0000","last_active":"2023-03-30T08:11:02.395463+0000","last_peered":"2023-03-30T08:11:02.395463+0000","last_clean":"2023-03-30T08:11:02.395463+0000","last_became_active":"2023-03-30T08:10:58.384750+0000","last_became_peered":"2023-03-30T08:10:58.384750+0000","last_unstale":"2023-03-30T08:11:02.395463+0000","last_undegraded":"2023-03-30T08:11:02.395463+0000","last_fullsized":"2023-03-30T08:11:02.395463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:56:41.526064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395470+0000","last_change":"2023-03-30T08:10:57.939974+0000","last_active":"2023-03-30T08:11:02.395470+0000","last_peered":"2023-03-30T08:11:02.395470+0000","last_clean":"2023-03-30T08:11:02.395470+0000","last_became_active":"2023-03-30T08:10:57.938857+0000","last_became_peered":"2023-03-30T08:10:57.938857+0000","last_unstale":"2023-03-30T08:11:02.395470+0000","last_undegraded":"2023-03-30T08:11:02.395470+0000","last_fullsized":"2023-03-30T08:11:02.395470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:04:22.947813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366491+0000","last_change":"2023-03-30T08:11:02.427807+0000","last_active":"2023-03-30T08:11:03.366491+0000","last_peered":"2023-03-30T08:11:03.366491+0000","last_clean":"2023-03-30T08:11:03.366491+0000","last_became_active":"2023-03-30T08:11:02.427234+0000","last_became_peered":"2023-03-30T08:11:02.427234+0000","last_unstale":"2023-03-30T08:11:03.366491+0000","last_undegraded":"2023-03-30T08:11:03.366491+0000","last_fullsized":"2023-03-30T08:11:03.366491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:40.748097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394764+0000","last_change":"2023-03-30T08:10:58.396674+0000","last_active":"2023-03-30T08:11:02.394764+0000","last_peered":"2023-03-30T08:11:02.394764+0000","last_clean":"2023-03-30T08:11:02.394764+0000","last_became_active":"2023-03-30T08:10:58.396428+0000","last_became_peered":"2023-03-30T08:10:58.396428+0000","last_unstale":"2023-03-30T08:11:02.394764+0000","last_undegraded":"2023-03-30T08:11:02.394764+0000","last_fullsized":"2023-03-30T08:11:02.394764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:38:03.047478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403474+0000","last_change":"2023-03-30T08:10:57.941837+0000","last_active":"2023-03-30T08:11:02.403474+0000","last_peered":"2023-03-30T08:11:02.403474+0000","last_clean":"2023-03-30T08:11:02.403474+0000","last_became_active":"2023-03-30T08:10:57.941547+0000","last_became_peered":"2023-03-30T08:10:57.941547+0000","last_unstale":"2023-03-30T08:11:02.403474+0000","last_undegraded":"2023-03-30T08:11:02.403474+0000","last_fullsized":"2023-03-30T08:11:02.403474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:02.973950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853079+0000","last_change":"2023-03-30T08:11:02.414849+0000","last_active":"2023-03-30T08:11:02.853079+0000","last_peered":"2023-03-30T08:11:02.853079+0000","last_clean":"2023-03-30T08:11:02.853079+0000","last_became_active":"2023-03-30T08:11:02.414475+0000","last_became_peered":"2023-03-30T08:11:02.414475+0000","last_unstale":"2023-03-30T08:11:02.853079+0000","last_undegraded":"2023-03-30T08:11:02.853079+0000","last_fullsized":"2023-03-30T08:11:02.853079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:51:55.638235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395259+0000","last_change":"2023-03-30T08:10:58.390202+0000","last_active":"2023-03-30T08:11:02.395259+0000","last_peered":"2023-03-30T08:11:02.395259+0000","last_clean":"2023-03-30T08:11:02.395259+0000","last_became_active":"2023-03-30T08:10:58.389111+0000","last_became_peered":"2023-03-30T08:10:58.389111+0000","last_unstale":"2023-03-30T08:11:02.395259+0000","last_undegraded":"2023-03-30T08:11:02.395259+0000","last_fullsized":"2023-03-30T08:11:02.395259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:06:23.251839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.404718+0000","last_change":"2023-03-30T08:10:57.943339+0000","last_active":"2023-03-30T08:11:02.404718+0000","last_peered":"2023-03-30T08:11:02.404718+0000","last_clean":"2023-03-30T08:11:02.404718+0000","last_became_active":"2023-03-30T08:10:57.943025+0000","last_became_peered":"2023-03-30T08:10:57.943025+0000","last_unstale":"2023-03-30T08:11:02.404718+0000","last_undegraded":"2023-03-30T08:11:02.404718+0000","last_fullsized":"2023-03-30T08:11:02.404718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:39.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857288+0000","last_change":"2023-03-30T08:11:02.430259+0000","last_active":"2023-03-30T08:11:02.857288+0000","last_peered":"2023-03-30T08:11:02.857288+0000","last_clean":"2023-03-30T08:11:02.857288+0000","last_became_active":"2023-03-30T08:11:02.429913+0000","last_became_peered":"2023-03-30T08:11:02.429913+0000","last_unstale":"2023-03-30T08:11:02.857288+0000","last_undegraded":"2023-03-30T08:11:02.857288+0000","last_fullsized":"2023-03-30T08:11:02.857288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:57:50.469768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406365+0000","last_change":"2023-03-30T08:10:58.399947+0000","last_active":"2023-03-30T08:11:02.406365+0000","last_peered":"2023-03-30T08:11:02.406365+0000","last_clean":"2023-03-30T08:11:02.406365+0000","last_became_active":"2023-03-30T08:10:58.399634+0000","last_became_peered":"2023-03-30T08:10:58.399634+0000","last_unstale":"2023-03-30T08:11:02.406365+0000","last_undegraded":"2023-03-30T08:11:02.406365+0000","last_fullsized":"2023-03-30T08:11:02.406365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:58:27.992306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399443+0000","last_change":"2023-03-30T08:10:57.934972+0000","last_active":"2023-03-30T08:11:02.399443+0000","last_peered":"2023-03-30T08:11:02.399443+0000","last_clean":"2023-03-30T08:11:02.399443+0000","last_became_active":"2023-03-30T08:10:57.934655+0000","last_became_peered":"2023-03-30T08:10:57.934655+0000","last_unstale":"2023-03-30T08:11:02.399443+0000","last_undegraded":"2023-03-30T08:11:02.399443+0000","last_fullsized":"2023-03-30T08:11:02.399443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:49:48.774880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857279+0000","last_change":"2023-03-30T08:11:02.419444+0000","last_active":"2023-03-30T08:11:02.857279+0000","last_peered":"2023-03-30T08:11:02.857279+0000","last_clean":"2023-03-30T08:11:02.857279+0000","last_became_active":"2023-03-30T08:11:02.419054+0000","last_became_peered":"2023-03-30T08:11:02.419054+0000","last_unstale":"2023-03-30T08:11:02.857279+0000","last_undegraded":"2023-03-30T08:11:02.857279+0000","last_fullsized":"2023-03-30T08:11:02.857279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:35:06.686651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403308+0000","last_change":"2023-03-30T08:10:58.375670+0000","last_active":"2023-03-30T08:11:02.403308+0000","last_peered":"2023-03-30T08:11:02.403308+0000","last_clean":"2023-03-30T08:11:02.403308+0000","last_became_active":"2023-03-30T08:10:58.375401+0000","last_became_peered":"2023-03-30T08:10:58.375401+0000","last_unstale":"2023-03-30T08:11:02.403308+0000","last_undegraded":"2023-03-30T08:11:02.403308+0000","last_fullsized":"2023-03-30T08:11:02.403308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:22:19.993012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.415805+0000","last_change":"2023-03-30T08:10:57.934773+0000","last_active":"2023-03-30T08:11:02.415805+0000","last_peered":"2023-03-30T08:11:02.415805+0000","last_clean":"2023-03-30T08:11:02.415805+0000","last_became_active":"2023-03-30T08:10:57.934496+0000","last_became_peered":"2023-03-30T08:10:57.934496+0000","last_unstale":"2023-03-30T08:11:02.415805+0000","last_undegraded":"2023-03-30T08:11:02.415805+0000","last_fullsized":"2023-03-30T08:11:02.415805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:39:29.317281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857187+0000","last_change":"2023-03-30T08:11:02.431555+0000","last_active":"2023-03-30T08:11:02.857187+0000","last_peered":"2023-03-30T08:11:02.857187+0000","last_clean":"2023-03-30T08:11:02.857187+0000","last_became_active":"2023-03-30T08:11:02.431128+0000","last_became_peered":"2023-03-30T08:11:02.431128+0000","last_unstale":"2023-03-30T08:11:02.857187+0000","last_undegraded":"2023-03-30T08:11:02.857187+0000","last_fullsized":"2023-03-30T08:11:02.857187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:57.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394896+0000","last_change":"2023-03-30T08:10:58.373263+0000","last_active":"2023-03-30T08:11:02.394896+0000","last_peered":"2023-03-30T08:11:02.394896+0000","last_clean":"2023-03-30T08:11:02.394896+0000","last_became_active":"2023-03-30T08:10:58.373002+0000","last_became_peered":"2023-03-30T08:10:58.373002+0000","last_unstale":"2023-03-30T08:11:02.394896+0000","last_undegraded":"2023-03-30T08:11:02.394896+0000","last_fullsized":"2023-03-30T08:11:02.394896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:39:17.667535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416575+0000","last_change":"2023-03-30T08:10:57.948558+0000","last_active":"2023-03-30T08:11:02.416575+0000","last_peered":"2023-03-30T08:11:02.416575+0000","last_clean":"2023-03-30T08:11:02.416575+0000","last_became_active":"2023-03-30T08:10:57.948285+0000","last_became_peered":"2023-03-30T08:10:57.948285+0000","last_unstale":"2023-03-30T08:11:02.416575+0000","last_undegraded":"2023-03-30T08:11:02.416575+0000","last_fullsized":"2023-03-30T08:11:02.416575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:35:11.040783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857020+0000","last_change":"2023-03-30T08:11:02.428125+0000","last_active":"2023-03-30T08:11:02.857020+0000","last_peered":"2023-03-30T08:11:02.857020+0000","last_clean":"2023-03-30T08:11:02.857020+0000","last_became_active":"2023-03-30T08:11:02.427821+0000","last_became_peered":"2023-03-30T08:11:02.427821+0000","last_unstale":"2023-03-30T08:11:02.857020+0000","last_undegraded":"2023-03-30T08:11:02.857020+0000","last_fullsized":"2023-03-30T08:11:02.857020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:19:49.490189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398351+0000","last_change":"2023-03-30T08:10:58.396669+0000","last_active":"2023-03-30T08:11:02.398351+0000","last_peered":"2023-03-30T08:11:02.398351+0000","last_clean":"2023-03-30T08:11:02.398351+0000","last_became_active":"2023-03-30T08:10:58.396369+0000","last_became_peered":"2023-03-30T08:10:58.396369+0000","last_unstale":"2023-03-30T08:11:02.398351+0000","last_undegraded":"2023-03-30T08:11:02.398351+0000","last_fullsized":"2023-03-30T08:11:02.398351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416902+0000","last_change":"2023-03-30T08:10:57.947747+0000","last_active":"2023-03-30T08:11:02.416902+0000","last_peered":"2023-03-30T08:11:02.416902+0000","last_clean":"2023-03-30T08:11:02.416902+0000","last_became_active":"2023-03-30T08:10:57.947479+0000","last_became_peered":"2023-03-30T08:10:57.947479+0000","last_unstale":"2023-03-30T08:11:02.416902+0000","last_undegraded":"2023-03-30T08:11:02.416902+0000","last_fullsized":"2023-03-30T08:11:02.416902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:58:21.827874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.854114+0000","last_change":"2023-03-30T08:11:02.428227+0000","last_active":"2023-03-30T08:11:02.854114+0000","last_peered":"2023-03-30T08:11:02.854114+0000","last_clean":"2023-03-30T08:11:02.854114+0000","last_became_active":"2023-03-30T08:11:02.427865+0000","last_became_peered":"2023-03-30T08:11:02.427865+0000","last_unstale":"2023-03-30T08:11:02.854114+0000","last_undegraded":"2023-03-30T08:11:02.854114+0000","last_fullsized":"2023-03-30T08:11:02.854114+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:57:54.590144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366556+0000","last_change":"2023-03-30T08:11:02.425154+0000","last_active":"2023-03-30T08:11:03.366556+0000","last_peered":"2023-03-30T08:11:03.366556+0000","last_clean":"2023-03-30T08:11:03.366556+0000","last_became_active":"2023-03-30T08:11:02.424719+0000","last_became_peered":"2023-03-30T08:11:02.424719+0000","last_unstale":"2023-03-30T08:11:03.366556+0000","last_undegraded":"2023-03-30T08:11:03.366556+0000","last_fullsized":"2023-03-30T08:11:03.366556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:31:01.730540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403168+0000","last_change":"2023-03-30T08:10:57.943082+0000","last_active":"2023-03-30T08:11:02.403168+0000","last_peered":"2023-03-30T08:11:02.403168+0000","last_clean":"2023-03-30T08:11:02.403168+0000","last_became_active":"2023-03-30T08:10:57.942820+0000","last_became_peered":"2023-03-30T08:10:57.942820+0000","last_unstale":"2023-03-30T08:11:02.403168+0000","last_undegraded":"2023-03-30T08:11:02.403168+0000","last_fullsized":"2023-03-30T08:11:02.403168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:53:52.935025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412130+0000","last_change":"2023-03-30T08:10:58.394733+0000","last_active":"2023-03-30T08:11:02.412130+0000","last_peered":"2023-03-30T08:11:02.412130+0000","last_clean":"2023-03-30T08:11:02.412130+0000","last_became_active":"2023-03-30T08:10:58.394491+0000","last_became_peered":"2023-03-30T08:10:58.394491+0000","last_unstale":"2023-03-30T08:11:02.412130+0000","last_undegraded":"2023-03-30T08:11:02.412130+0000","last_fullsized":"2023-03-30T08:11:02.412130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:53.625868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.365349+0000","last_change":"2023-03-30T08:11:02.422104+0000","last_active":"2023-03-30T08:11:03.365349+0000","last_peered":"2023-03-30T08:11:03.365349+0000","last_clean":"2023-03-30T08:11:03.365349+0000","last_became_active":"2023-03-30T08:11:02.421521+0000","last_became_peered":"2023-03-30T08:11:02.421521+0000","last_unstale":"2023-03-30T08:11:03.365349+0000","last_undegraded":"2023-03-30T08:11:03.365349+0000","last_fullsized":"2023-03-30T08:11:03.365349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:40.748097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.414704+0000","last_change":"2023-03-30T08:10:57.942911+0000","last_active":"2023-03-30T08:11:02.414704+0000","last_peered":"2023-03-30T08:11:02.414704+0000","last_clean":"2023-03-30T08:11:02.414704+0000","last_became_active":"2023-03-30T08:10:57.942621+0000","last_became_peered":"2023-03-30T08:10:57.942621+0000","last_unstale":"2023-03-30T08:11:02.414704+0000","last_undegraded":"2023-03-30T08:11:02.414704+0000","last_fullsized":"2023-03-30T08:11:02.414704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:37:16.892431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406251+0000","last_change":"2023-03-30T08:10:58.401562+0000","last_active":"2023-03-30T08:11:02.406251+0000","last_peered":"2023-03-30T08:11:02.406251+0000","last_clean":"2023-03-30T08:11:02.406251+0000","last_became_active":"2023-03-30T08:10:58.400749+0000","last_became_peered":"2023-03-30T08:10:58.400749+0000","last_unstale":"2023-03-30T08:11:02.406251+0000","last_undegraded":"2023-03-30T08:11:02.406251+0000","last_fullsized":"2023-03-30T08:11:02.406251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406724+0000","last_change":"2023-03-30T08:10:57.943258+0000","last_active":"2023-03-30T08:11:02.406724+0000","last_peered":"2023-03-30T08:11:02.406724+0000","last_clean":"2023-03-30T08:11:02.406724+0000","last_became_active":"2023-03-30T08:10:57.942778+0000","last_became_peered":"2023-03-30T08:10:57.942778+0000","last_unstale":"2023-03-30T08:11:02.406724+0000","last_undegraded":"2023-03-30T08:11:02.406724+0000","last_fullsized":"2023-03-30T08:11:02.406724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:06.629874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399677+0000","last_change":"2023-03-30T08:10:58.395671+0000","last_active":"2023-03-30T08:11:02.399677+0000","last_peered":"2023-03-30T08:11:02.399677+0000","last_clean":"2023-03-30T08:11:02.399677+0000","last_became_active":"2023-03-30T08:10:58.395300+0000","last_became_peered":"2023-03-30T08:10:58.395300+0000","last_unstale":"2023-03-30T08:11:02.399677+0000","last_undegraded":"2023-03-30T08:11:02.399677+0000","last_fullsized":"2023-03-30T08:11:02.399677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.364731+0000","last_change":"2023-03-30T08:11:02.425902+0000","last_active":"2023-03-30T08:11:03.364731+0000","last_peered":"2023-03-30T08:11:03.364731+0000","last_clean":"2023-03-30T08:11:03.364731+0000","last_became_active":"2023-03-30T08:11:02.425557+0000","last_became_peered":"2023-03-30T08:11:02.425557+0000","last_unstale":"2023-03-30T08:11:03.364731+0000","last_undegraded":"2023-03-30T08:11:03.364731+0000","last_fullsized":"2023-03-30T08:11:03.364731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:01:41.681380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416216+0000","last_change":"2023-03-30T08:10:57.942208+0000","last_active":"2023-03-30T08:11:02.416216+0000","last_peered":"2023-03-30T08:11:02.416216+0000","last_clean":"2023-03-30T08:11:02.416216+0000","last_became_active":"2023-03-30T08:10:57.941842+0000","last_became_peered":"2023-03-30T08:10:57.941842+0000","last_unstale":"2023-03-30T08:11:02.416216+0000","last_undegraded":"2023-03-30T08:11:02.416216+0000","last_fullsized":"2023-03-30T08:11:02.416216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:49:48.774880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.411403+0000","last_change":"2023-03-30T08:10:58.390960+0000","last_active":"2023-03-30T08:11:02.411403+0000","last_peered":"2023-03-30T08:11:02.411403+0000","last_clean":"2023-03-30T08:11:02.411403+0000","last_became_active":"2023-03-30T08:10:58.390668+0000","last_became_peered":"2023-03-30T08:10:58.390668+0000","last_unstale":"2023-03-30T08:11:02.411403+0000","last_undegraded":"2023-03-30T08:11:02.411403+0000","last_fullsized":"2023-03-30T08:11:02.411403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:06:29.606761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.367121+0000","last_change":"2023-03-30T08:11:02.415367+0000","last_active":"2023-03-30T08:11:03.367121+0000","last_peered":"2023-03-30T08:11:03.367121+0000","last_clean":"2023-03-30T08:11:03.367121+0000","last_became_active":"2023-03-30T08:11:02.414945+0000","last_became_peered":"2023-03-30T08:11:02.414945+0000","last_unstale":"2023-03-30T08:11:03.367121+0000","last_undegraded":"2023-03-30T08:11:03.367121+0000","last_fullsized":"2023-03-30T08:11:03.367121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:49.266964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403049+0000","last_change":"2023-03-30T08:10:58.390221+0000","last_active":"2023-03-30T08:11:02.403049+0000","last_peered":"2023-03-30T08:11:02.403049+0000","last_clean":"2023-03-30T08:11:02.403049+0000","last_became_active":"2023-03-30T08:10:58.389916+0000","last_became_peered":"2023-03-30T08:10:58.389916+0000","last_unstale":"2023-03-30T08:11:02.403049+0000","last_undegraded":"2023-03-30T08:11:02.403049+0000","last_fullsized":"2023-03-30T08:11:02.403049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:33:09.992519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399692+0000","last_change":"2023-03-30T08:10:58.390234+0000","last_active":"2023-03-30T08:11:02.399692+0000","last_peered":"2023-03-30T08:11:02.399692+0000","last_clean":"2023-03-30T08:11:02.399692+0000","last_became_active":"2023-03-30T08:10:58.388988+0000","last_became_peered":"2023-03-30T08:10:58.388988+0000","last_unstale":"2023-03-30T08:11:02.399692+0000","last_undegraded":"2023-03-30T08:11:02.399692+0000","last_fullsized":"2023-03-30T08:11:02.399692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395321+0000","last_change":"2023-03-30T08:10:58.389994+0000","last_active":"2023-03-30T08:11:02.395321+0000","last_peered":"2023-03-30T08:11:02.395321+0000","last_clean":"2023-03-30T08:11:02.395321+0000","last_became_active":"2023-03-30T08:10:58.389699+0000","last_became_peered":"2023-03-30T08:10:58.389699+0000","last_unstale":"2023-03-30T08:11:02.395321+0000","last_undegraded":"2023-03-30T08:11:02.395321+0000","last_fullsized":"2023-03-30T08:11:02.395321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:43:02.347422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.404578+0000","last_change":"2023-03-30T08:10:58.390408+0000","last_active":"2023-03-30T08:11:02.404578+0000","last_peered":"2023-03-30T08:11:02.404578+0000","last_clean":"2023-03-30T08:11:02.404578+0000","last_became_active":"2023-03-30T08:10:58.389982+0000","last_became_peered":"2023-03-30T08:10:58.389982+0000","last_unstale":"2023-03-30T08:11:02.404578+0000","last_undegraded":"2023-03-30T08:11:02.404578+0000","last_fullsized":"2023-03-30T08:11:02.404578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396569+0000","last_change":"2023-03-30T08:10:58.397943+0000","last_active":"2023-03-30T08:11:02.396569+0000","last_peered":"2023-03-30T08:11:02.396569+0000","last_clean":"2023-03-30T08:11:02.396569+0000","last_became_active":"2023-03-30T08:10:58.397652+0000","last_became_peered":"2023-03-30T08:10:58.397652+0000","last_unstale":"2023-03-30T08:11:02.396569+0000","last_undegraded":"2023-03-30T08:11:02.396569+0000","last_fullsized":"2023-03-30T08:11:02.396569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399691+0000","last_change":"2023-03-30T08:10:58.396929+0000","last_active":"2023-03-30T08:11:02.399691+0000","last_peered":"2023-03-30T08:11:02.399691+0000","last_clean":"2023-03-30T08:11:02.399691+0000","last_became_active":"2023-03-30T08:10:58.396575+0000","last_became_peered":"2023-03-30T08:10:58.396575+0000","last_unstale":"2023-03-30T08:11:02.399691+0000","last_undegraded":"2023-03-30T08:11:02.399691+0000","last_fullsized":"2023-03-30T08:11:02.399691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394877+0000","last_change":"2023-03-30T08:10:58.394396+0000","last_active":"2023-03-30T08:11:02.394877+0000","last_peered":"2023-03-30T08:11:02.394877+0000","last_clean":"2023-03-30T08:11:02.394877+0000","last_became_active":"2023-03-30T08:10:58.394147+0000","last_became_peered":"2023-03-30T08:10:58.394147+0000","last_unstale":"2023-03-30T08:11:02.394877+0000","last_undegraded":"2023-03-30T08:11:02.394877+0000","last_fullsized":"2023-03-30T08:11:02.394877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394856+0000","last_change":"2023-03-30T08:10:58.387684+0000","last_active":"2023-03-30T08:11:02.394856+0000","last_peered":"2023-03-30T08:11:02.394856+0000","last_clean":"2023-03-30T08:11:02.394856+0000","last_became_active":"2023-03-30T08:10:58.387427+0000","last_became_peered":"2023-03-30T08:10:58.387427+0000","last_unstale":"2023-03-30T08:11:02.394856+0000","last_undegraded":"2023-03-30T08:11:02.394856+0000","last_fullsized":"2023-03-30T08:11:02.394856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413072+0000","last_change":"2023-03-30T08:10:58.403140+0000","last_active":"2023-03-30T08:11:02.413072+0000","last_peered":"2023-03-30T08:11:02.413072+0000","last_clean":"2023-03-30T08:11:02.413072+0000","last_became_active":"2023-03-30T08:10:58.402888+0000","last_became_peered":"2023-03-30T08:10:58.402888+0000","last_unstale":"2023-03-30T08:11:02.413072+0000","last_undegraded":"2023-03-30T08:11:02.413072+0000","last_fullsized":"2023-03-30T08:11:02.413072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399593+0000","last_change":"2023-03-30T08:10:58.401396+0000","last_active":"2023-03-30T08:11:02.399593+0000","last_peered":"2023-03-30T08:11:02.399593+0000","last_clean":"2023-03-30T08:11:02.399593+0000","last_became_active":"2023-03-30T08:10:58.399503+0000","last_became_peered":"2023-03-30T08:10:58.399503+0000","last_unstale":"2023-03-30T08:11:02.399593+0000","last_undegraded":"2023-03-30T08:11:02.399593+0000","last_fullsized":"2023-03-30T08:11:02.399593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406636+0000","last_change":"2023-03-30T08:10:58.390937+0000","last_active":"2023-03-30T08:11:02.406636+0000","last_peered":"2023-03-30T08:11:02.406636+0000","last_clean":"2023-03-30T08:11:02.406636+0000","last_became_active":"2023-03-30T08:10:58.389638+0000","last_became_peered":"2023-03-30T08:10:58.389638+0000","last_unstale":"2023-03-30T08:11:02.406636+0000","last_undegraded":"2023-03-30T08:11:02.406636+0000","last_fullsized":"2023-03-30T08:11:02.406636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416142+0000","last_change":"2023-03-30T08:10:58.404544+0000","last_active":"2023-03-30T08:11:02.416142+0000","last_peered":"2023-03-30T08:11:02.416142+0000","last_clean":"2023-03-30T08:11:02.416142+0000","last_became_active":"2023-03-30T08:10:58.404283+0000","last_became_peered":"2023-03-30T08:10:58.404283+0000","last_unstale":"2023-03-30T08:11:02.416142+0000","last_undegraded":"2023-03-30T08:11:02.416142+0000","last_fullsized":"2023-03-30T08:11:02.416142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395184+0000","last_change":"2023-03-30T08:10:58.388172+0000","last_active":"2023-03-30T08:11:02.395184+0000","last_peered":"2023-03-30T08:11:02.395184+0000","last_clean":"2023-03-30T08:11:02.395184+0000","last_became_active":"2023-03-30T08:10:58.384720+0000","last_became_peered":"2023-03-30T08:10:58.384720+0000","last_unstale":"2023-03-30T08:11:02.395184+0000","last_undegraded":"2023-03-30T08:11:02.395184+0000","last_fullsized":"2023-03-30T08:11:02.395184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:50:54.652580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.418243+0000","last_change":"2023-03-30T08:10:58.392445+0000","last_active":"2023-03-30T08:11:02.418243+0000","last_peered":"2023-03-30T08:11:02.418243+0000","last_clean":"2023-03-30T08:11:02.418243+0000","last_became_active":"2023-03-30T08:10:58.392143+0000","last_became_peered":"2023-03-30T08:10:58.392143+0000","last_unstale":"2023-03-30T08:11:02.418243+0000","last_undegraded":"2023-03-30T08:11:02.418243+0000","last_fullsized":"2023-03-30T08:11:02.418243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:07.646179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394615+0000","last_change":"2023-03-30T08:10:58.394487+0000","last_active":"2023-03-30T08:11:02.394615+0000","last_peered":"2023-03-30T08:11:02.394615+0000","last_clean":"2023-03-30T08:11:02.394615+0000","last_became_active":"2023-03-30T08:10:58.394174+0000","last_became_peered":"2023-03-30T08:10:58.394174+0000","last_unstale":"2023-03-30T08:11:02.394615+0000","last_undegraded":"2023-03-30T08:11:02.394615+0000","last_fullsized":"2023-03-30T08:11:02.394615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:38:08.997913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406092+0000","last_change":"2023-03-30T08:10:58.407760+0000","last_active":"2023-03-30T08:11:02.406092+0000","last_peered":"2023-03-30T08:11:02.406092+0000","last_clean":"2023-03-30T08:11:02.406092+0000","last_became_active":"2023-03-30T08:10:58.407549+0000","last_became_peered":"2023-03-30T08:10:58.407549+0000","last_unstale":"2023-03-30T08:11:02.406092+0000","last_undegraded":"2023-03-30T08:11:02.406092+0000","last_fullsized":"2023-03-30T08:11:02.406092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395205+0000","last_change":"2023-03-30T08:10:58.397788+0000","last_active":"2023-03-30T08:11:02.395205+0000","last_peered":"2023-03-30T08:11:02.395205+0000","last_clean":"2023-03-30T08:11:02.395205+0000","last_became_active":"2023-03-30T08:10:58.397456+0000","last_became_peered":"2023-03-30T08:10:58.397456+0000","last_unstale":"2023-03-30T08:11:02.395205+0000","last_undegraded":"2023-03-30T08:11:02.395205+0000","last_fullsized":"2023-03-30T08:11:02.395205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:38:35.434847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.414622+0000","last_change":"2023-03-30T08:10:58.391637+0000","last_active":"2023-03-30T08:11:02.414622+0000","last_peered":"2023-03-30T08:11:02.414622+0000","last_clean":"2023-03-30T08:11:02.414622+0000","last_became_active":"2023-03-30T08:10:58.391241+0000","last_became_peered":"2023-03-30T08:10:58.391241+0000","last_unstale":"2023-03-30T08:11:02.414622+0000","last_undegraded":"2023-03-30T08:11:02.414622+0000","last_fullsized":"2023-03-30T08:11:02.414622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:40:05.484662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398410+0000","last_change":"2023-03-30T08:10:58.392474+0000","last_active":"2023-03-30T08:11:02.398410+0000","last_peered":"2023-03-30T08:11:02.398410+0000","last_clean":"2023-03-30T08:11:02.398410+0000","last_became_active":"2023-03-30T08:10:58.392054+0000","last_became_peered":"2023-03-30T08:10:58.392054+0000","last_unstale":"2023-03-30T08:11:02.398410+0000","last_undegraded":"2023-03-30T08:11:02.398410+0000","last_fullsized":"2023-03-30T08:11:02.398410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412024+0000","last_change":"2023-03-30T08:10:58.397632+0000","last_active":"2023-03-30T08:11:02.412024+0000","last_peered":"2023-03-30T08:11:02.412024+0000","last_clean":"2023-03-30T08:11:02.412024+0000","last_became_active":"2023-03-30T08:10:58.392721+0000","last_became_peered":"2023-03-30T08:10:58.392721+0000","last_unstale":"2023-03-30T08:11:02.412024+0000","last_undegraded":"2023-03-30T08:11:02.412024+0000","last_fullsized":"2023-03-30T08:11:02.412024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:39.162414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412163+0000","last_change":"2023-03-30T08:10:58.399202+0000","last_active":"2023-03-30T08:11:02.412163+0000","last_peered":"2023-03-30T08:11:02.412163+0000","last_clean":"2023-03-30T08:11:02.412163+0000","last_became_active":"2023-03-30T08:10:58.398999+0000","last_became_peered":"2023-03-30T08:10:58.398999+0000","last_unstale":"2023-03-30T08:11:02.412163+0000","last_undegraded":"2023-03-30T08:11:02.412163+0000","last_fullsized":"2023-03-30T08:11:02.412163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:49:49.791186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394623+0000","last_change":"2023-03-30T08:10:58.374475+0000","last_active":"2023-03-30T08:11:02.394623+0000","last_peered":"2023-03-30T08:11:02.394623+0000","last_clean":"2023-03-30T08:11:02.394623+0000","last_became_active":"2023-03-30T08:10:58.373968+0000","last_became_peered":"2023-03-30T08:10:58.373968+0000","last_unstale":"2023-03-30T08:11:02.394623+0000","last_undegraded":"2023-03-30T08:11:02.394623+0000","last_fullsized":"2023-03-30T08:11:02.394623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:37:34.381037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.401841+0000","last_change":"2023-03-30T08:10:58.399051+0000","last_active":"2023-03-30T08:11:02.401841+0000","last_peered":"2023-03-30T08:11:02.401841+0000","last_clean":"2023-03-30T08:11:02.401841+0000","last_became_active":"2023-03-30T08:10:58.398767+0000","last_became_peered":"2023-03-30T08:10:58.398767+0000","last_unstale":"2023-03-30T08:11:02.401841+0000","last_undegraded":"2023-03-30T08:11:02.401841+0000","last_fullsized":"2023-03-30T08:11:02.401841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:35:55.226695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.405995+0000","last_change":"2023-03-30T08:10:58.409451+0000","last_active":"2023-03-30T08:11:02.405995+0000","last_peered":"2023-03-30T08:11:02.405995+0000","last_clean":"2023-03-30T08:11:02.405995+0000","last_became_active":"2023-03-30T08:10:58.409195+0000","last_became_peered":"2023-03-30T08:10:58.409195+0000","last_unstale":"2023-03-30T08:11:02.405995+0000","last_undegraded":"2023-03-30T08:11:02.405995+0000","last_fullsized":"2023-03-30T08:11:02.405995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398208+0000","last_change":"2023-03-30T08:10:58.397829+0000","last_active":"2023-03-30T08:11:02.398208+0000","last_peered":"2023-03-30T08:11:02.398208+0000","last_clean":"2023-03-30T08:11:02.398208+0000","last_became_active":"2023-03-30T08:10:58.397472+0000","last_became_peered":"2023-03-30T08:10:58.397472+0000","last_unstale":"2023-03-30T08:11:02.398208+0000","last_undegraded":"2023-03-30T08:11:02.398208+0000","last_fullsized":"2023-03-30T08:11:02.398208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:53.625868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.414543+0000","last_change":"2023-03-30T08:10:58.391590+0000","last_active":"2023-03-30T08:11:02.414543+0000","last_peered":"2023-03-30T08:11:02.414543+0000","last_clean":"2023-03-30T08:11:02.414543+0000","last_became_active":"2023-03-30T08:10:58.390836+0000","last_became_peered":"2023-03-30T08:10:58.390836+0000","last_unstale":"2023-03-30T08:11:02.414543+0000","last_undegraded":"2023-03-30T08:11:02.414543+0000","last_fullsized":"2023-03-30T08:11:02.414543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394825+0000","last_change":"2023-03-30T08:10:58.384402+0000","last_active":"2023-03-30T08:11:02.394825+0000","last_peered":"2023-03-30T08:11:02.394825+0000","last_clean":"2023-03-30T08:11:02.394825+0000","last_became_active":"2023-03-30T08:10:58.384149+0000","last_became_peered":"2023-03-30T08:10:58.384149+0000","last_unstale":"2023-03-30T08:11:02.394825+0000","last_undegraded":"2023-03-30T08:11:02.394825+0000","last_fullsized":"2023-03-30T08:11:02.394825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:49:19.304132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406516+0000","last_change":"2023-03-30T08:10:58.401419+0000","last_active":"2023-03-30T08:11:02.406516+0000","last_peered":"2023-03-30T08:11:02.406516+0000","last_clean":"2023-03-30T08:11:02.406516+0000","last_became_active":"2023-03-30T08:10:58.401118+0000","last_became_peered":"2023-03-30T08:10:58.401118+0000","last_unstale":"2023-03-30T08:11:02.406516+0000","last_undegraded":"2023-03-30T08:11:02.406516+0000","last_fullsized":"2023-03-30T08:11:02.406516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:40:05.484662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403459+0000","last_change":"2023-03-30T08:10:58.397292+0000","last_active":"2023-03-30T08:11:02.403459+0000","last_peered":"2023-03-30T08:11:02.403459+0000","last_clean":"2023-03-30T08:11:02.403459+0000","last_became_active":"2023-03-30T08:10:58.396977+0000","last_became_peered":"2023-03-30T08:10:58.396977+0000","last_unstale":"2023-03-30T08:11:02.403459+0000","last_undegraded":"2023-03-30T08:11:02.403459+0000","last_fullsized":"2023-03-30T08:11:02.403459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:04:09.104430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394458+0000","last_change":"2023-03-30T08:10:58.406332+0000","last_active":"2023-03-30T08:11:02.394458+0000","last_peered":"2023-03-30T08:11:02.394458+0000","last_clean":"2023-03-30T08:11:02.394458+0000","last_became_active":"2023-03-30T08:10:58.406011+0000","last_became_peered":"2023-03-30T08:10:58.406011+0000","last_unstale":"2023-03-30T08:11:02.394458+0000","last_undegraded":"2023-03-30T08:11:02.394458+0000","last_fullsized":"2023-03-30T08:11:02.394458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:14:36.034697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.401759+0000","last_change":"2023-03-30T08:10:58.397437+0000","last_active":"2023-03-30T08:11:02.401759+0000","last_peered":"2023-03-30T08:11:02.401759+0000","last_clean":"2023-03-30T08:11:02.401759+0000","last_became_active":"2023-03-30T08:10:58.396808+0000","last_became_peered":"2023-03-30T08:10:58.396808+0000","last_unstale":"2023-03-30T08:11:02.401759+0000","last_undegraded":"2023-03-30T08:11:02.401759+0000","last_fullsized":"2023-03-30T08:11:02.401759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.418290+0000","last_change":"2023-03-30T08:10:58.392929+0000","last_active":"2023-03-30T08:11:02.418290+0000","last_peered":"2023-03-30T08:11:02.418290+0000","last_clean":"2023-03-30T08:11:02.418290+0000","last_became_active":"2023-03-30T08:10:58.392655+0000","last_became_peered":"2023-03-30T08:10:58.392655+0000","last_unstale":"2023-03-30T08:11:02.418290+0000","last_undegraded":"2023-03-30T08:11:02.418290+0000","last_fullsized":"2023-03-30T08:11:02.418290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:54.421859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4455,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8108,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363732,"statfs":{"total":96636764160,"available":96628461568,"internally_reserved":0,"allocated":299008,"data_stored":122842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7589999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.968}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.742}]}]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9292,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362548,"statfs":{"total":96636764160,"available":96627249152,"internally_reserved":0,"allocated":921600,"data_stored":717083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":307200,"data_stored":123494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8256,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363584,"statfs":{"total":96636764160,"available":96628310016,"internally_reserved":0,"allocated":319488,"data_stored":126555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":122932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.853}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6020000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0310000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8108,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363732,"statfs":{"total":96636764160,"available":96628461568,"internally_reserved":0,"allocated":299008,"data_stored":122842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8236,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363604,"statfs":{"total":96636764160,"available":96628330496,"internally_reserved":0,"allocated":299008,"data_stored":122842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9264,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362576,"statfs":{"total":96636764160,"available":96627277824,"internally_reserved":0,"allocated":892928,"data_stored":712449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.698}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.802}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-30T08:11:18.707 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-30T08:11:18.707 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-03-30T08:11:18.707 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-03-30T08:11:18.708 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-03-30T08:11:18.708 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-03-30T08:11:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.904+0000 7f69c063e700 1 Processor -- start 2023-03-30T08:11:18.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.904+0000 7f69c063e700 1 -- start start 2023-03-30T08:11:18.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69c063e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f69b80cceb0 0x7f69b815cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69c063e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69b806d220 0x7f69b806d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69c063e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b815d480 con 0x7f69b80c9190 2023-03-30T08:11:18.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69c063e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b806c190 con 0x7f69b80cceb0 2023-03-30T08:11:18.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69c063e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b806c4f0 con 0x7f69b806d220 2023-03-30T08:11:18.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69bdbd9700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f69b80c9190 0x7f69b8158820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43622/0 (socket says 172.21.15.87:43622) 2023-03-30T08:11:18.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69bdbd9700 1 -- 172.21.15.87:0/177748477 learned_addr learned my addr 172.21.15.87:0/177748477 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:18.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69be3da700 1 --2- 172.21.15.87:0/177748477 >> v2:172.21.15.87:3300/0 conn(0x7f69b80cceb0 0x7f69b815cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69bebdb700 1 --2- 172.21.15.87:0/177748477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69b806d220 0x7f69b806d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69bd3d8700 1 -- 172.21.15.87:0/177748477 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776266669 0 0) 0x7f69a8001110 con 0x7f69b80c9190 2023-03-30T08:11:18.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69bd3d8700 1 -- 172.21.15.87:0/177748477 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69a40035d0 con 0x7f69b80c9190 2023-03-30T08:11:18.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69bebdb700 1 -- 172.21.15.87:0/177748477 >> v2:172.21.15.87:3300/0 conn(0x7f69b80cceb0 msgr2=0x7f69b815cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:18.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69bebdb700 1 --2- 172.21.15.87:0/177748477 >> v2:172.21.15.87:3300/0 conn(0x7f69b80cceb0 0x7f69b815cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69bebdb700 1 -- 172.21.15.87:0/177748477 >> v1:172.21.15.87:6789/0 conn(0x7f69b80c9190 legacy=0x7f69b8158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69bebdb700 1 -- 172.21.15.87:0/177748477 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b806cd90 con 0x7f69b806d220 2023-03-30T08:11:18.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69bebdb700 1 --2- 172.21.15.87:0/177748477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69b806d220 0x7f69b806d6a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009850 tx=0x7f69b0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dce5f24f857a2c8e server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:18.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69bd3d8700 1 -- 172.21.15.87:0/177748477 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b000f8a0 con 0x7f69b806d220 2023-03-30T08:11:18.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69bd3d8700 1 -- 172.21.15.87:0/177748477 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b000fa00 con 0x7f69b806d220 2023-03-30T08:11:18.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.908+0000 7f69bd3d8700 1 -- 172.21.15.87:0/177748477 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b000fd70 con 0x7f69b806d220 2023-03-30T08:11:18.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.912+0000 7f69c063e700 1 -- 172.21.15.87:0/177748477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69b806d220 msgr2=0x7f69b806d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.912+0000 7f69c063e700 1 --2- 172.21.15.87:0/177748477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69b806d220 0x7f69b806d6a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009850 tx=0x7f69b0009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:18.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.912+0000 7f69c063e700 1 -- 172.21.15.87:0/177748477 shutdown_connections 2023-03-30T08:11:18.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.912+0000 7f69c063e700 1 --2- 172.21.15.87:0/177748477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69b806d220 0x7f69b806d6a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.912+0000 7f69c063e700 1 --2- 172.21.15.87:0/177748477 >> v2:172.21.15.87:3300/0 conn(0x7f69b80cceb0 0x7f69b815cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.912+0000 7f69c063e700 1 -- 172.21.15.87:0/177748477 >> 172.21.15.87:0/177748477 conn(0x7f69b80ce960 msgr2=0x7f69b80ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:18.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.912+0000 7f69c063e700 1 -- 172.21.15.87:0/177748477 shutdown_connections 2023-03-30T08:11:18.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.912+0000 7f69c063e700 1 -- 172.21.15.87:0/177748477 wait complete. 2023-03-30T08:11:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69c063e700 1 Processor -- start 2023-03-30T08:11:18.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69c063e700 1 -- start start 2023-03-30T08:11:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69c063e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69b806d220 0x7f69b814c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69c063e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c9190 0x7f69b8140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69c063e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b80cceb0 0x7f69b8140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69c063e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b8150d10 con 0x7f69b80cceb0 2023-03-30T08:11:18.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69c063e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b80c2770 con 0x7f69b80c9190 2023-03-30T08:11:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69c063e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b8150f60 con 0x7f69b806d220 2023-03-30T08:11:18.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69bebdb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b80cceb0 0x7f69b8140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69bebdb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b80cceb0 0x7f69b8140970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56596/0 (socket says 172.21.15.87:56596) 2023-03-30T08:11:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69bebdb700 1 -- 172.21.15.87:0/1454293616 learned_addr learned my addr 172.21.15.87:0/1454293616 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69be3da700 1 --2- 172.21.15.87:0/1454293616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69b806d220 0x7f69b814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69bebdb700 1 -- 172.21.15.87:0/1454293616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69b806d220 msgr2=0x7f69b814c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69bebdb700 1 --2- 172.21.15.87:0/1454293616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69b806d220 0x7f69b814c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69bebdb700 1 -- 172.21.15.87:0/1454293616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c9190 msgr2=0x7f69b8140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69bdbd9700 1 --2- 172.21.15.87:0/1454293616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c9190 0x7f69b8140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69bebdb700 1 --2- 172.21.15.87:0/1454293616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c9190 0x7f69b8140430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69bebdb700 1 -- 172.21.15.87:0/1454293616 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b00094b0 con 0x7f69b80cceb0 2023-03-30T08:11:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.916+0000 7f69bebdb700 1 --2- 172.21.15.87:0/1454293616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b80cceb0 0x7f69b8140970 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f69b806c630 tx=0x7f69b0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.920+0000 7f69aeffd700 1 -- 172.21.15.87:0/1454293616 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b0003ad0 con 0x7f69b80cceb0 2023-03-30T08:11:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.920+0000 7f69aeffd700 1 -- 172.21.15.87:0/1454293616 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b0003c30 con 0x7f69b80cceb0 2023-03-30T08:11:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.920+0000 7f69aeffd700 1 -- 172.21.15.87:0/1454293616 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b0004590 con 0x7f69b80cceb0 2023-03-30T08:11:18.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.920+0000 7f69c063e700 1 -- 172.21.15.87:0/1454293616 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b806c740 con 0x7f69b80cceb0 2023-03-30T08:11:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.920+0000 7f69c063e700 1 -- 172.21.15.87:0/1454293616 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b80cd430 con 0x7f69b80cceb0 2023-03-30T08:11:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.920+0000 7f69c063e700 1 -- 172.21.15.87:0/1454293616 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b806ca20 con 0x7f69b80cceb0 2023-03-30T08:11:18.925 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.920+0000 7f69aeffd700 1 -- 172.21.15.87:0/1454293616 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f69b000e3c0 con 0x7f69b80cceb0 2023-03-30T08:11:18.926 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.920+0000 7f69aeffd700 1 --2- 172.21.15.87:0/1454293616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f699c0653f0 0x7f699c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:18.927 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.924+0000 7f69aeffd700 1 -- 172.21.15.87:0/1454293616 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f69b0083a60 con 0x7f69b80cceb0 2023-03-30T08:11:18.927 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.924+0000 7f69be3da700 1 --2- 172.21.15.87:0/1454293616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f699c0653f0 0x7f699c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:18.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.924+0000 7f69be3da700 1 --2- 172.21.15.87:0/1454293616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f699c0653f0 0x7f699c0678a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f69b40073f0 tx=0x7f69b400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:18.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:18.928+0000 7f69aeffd700 1 -- 172.21.15.87:0/1454293616 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f69b0051420 con 0x7f69b80cceb0 2023-03-30T08:11:19.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.136+0000 7f69c063e700 1 -- 172.21.15.87:0/1454293616 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f69b8073ee0 con 0x7f69b80cceb0 2023-03-30T08:11:19.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.140+0000 7f69aeffd700 1 -- 172.21.15.87:0/1454293616 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+162141 (secure 0 0 0) 0x7f69b0054a40 con 0x7f69b80cceb0 2023-03-30T08:11:19.146 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:19.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.144+0000 7f69c063e700 1 -- 172.21.15.87:0/1454293616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f699c0653f0 msgr2=0x7f699c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:19.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.144+0000 7f69c063e700 1 --2- 172.21.15.87:0/1454293616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f699c0653f0 0x7f699c0678a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f69b40073f0 tx=0x7f69b400b040 comp rx=0 tx=0).stop 2023-03-30T08:11:19.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.144+0000 7f69c063e700 1 -- 172.21.15.87:0/1454293616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b80cceb0 msgr2=0x7f69b8140970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:19.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.144+0000 7f69c063e700 1 --2- 172.21.15.87:0/1454293616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b80cceb0 0x7f69b8140970 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f69b806c630 tx=0x7f69b0004770 comp rx=0 tx=0).stop 2023-03-30T08:11:19.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.144+0000 7f69c063e700 1 -- 172.21.15.87:0/1454293616 shutdown_connections 2023-03-30T08:11:19.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.144+0000 7f69c063e700 1 --2- 172.21.15.87:0/1454293616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f699c0653f0 0x7f699c0678a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.144+0000 7f69c063e700 1 --2- 172.21.15.87:0/1454293616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69b80cceb0 0x7f69b8140970 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.144+0000 7f69c063e700 1 --2- 172.21.15.87:0/1454293616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69b80c9190 0x7f69b8140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.144+0000 7f69c063e700 1 --2- 172.21.15.87:0/1454293616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69b806d220 0x7f69b814c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.144+0000 7f69c063e700 1 -- 172.21.15.87:0/1454293616 >> 172.21.15.87:0/1454293616 conn(0x7f69b80ce960 msgr2=0x7f69b80c95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:19.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.148+0000 7f69c063e700 1 -- 172.21.15.87:0/1454293616 shutdown_connections 2023-03-30T08:11:19.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.148+0000 7f69c063e700 1 -- 172.21.15.87:0/1454293616 wait complete. 2023-03-30T08:11:19.173 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":5,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":33667},{"type":"v1","addr":"172.21.15.87:6833","nonce":33667}]},"active_addr":"172.21.15.87:6833/33667","active_change":"2023-03-30T08:10:37.861548+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":2497678769}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":3531983724}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":3658427802}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":1911576732}]}]} 2023-03-30T08:11:19.178 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-03-30T08:11:19.178 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-03-30T08:11:19.178 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:19.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.336+0000 7fc684971700 1 Processor -- start 2023-03-30T08:11:19.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.336+0000 7fc684971700 1 -- start start 2023-03-30T08:11:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.336+0000 7fc684971700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc680163dc0 0x7fc6800c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.336+0000 7fc684971700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc680164190 0x7fc6800c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc684971700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6800aea30 0x7fc6800ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:19.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc684971700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68006d810 con 0x7fc680164190 2023-03-30T08:11:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc684971700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6800cc1d0 con 0x7fc680163dc0 2023-03-30T08:11:19.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc684971700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc680069f00 con 0x7fc6800aea30 2023-03-30T08:11:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc67659c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc680164190 0x7fc6800c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc67f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6800aea30 0x7fc6800ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc67659c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc680164190 0x7fc6800c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56610/0 (socket says 172.21.15.87:56610) 2023-03-30T08:11:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc67659c700 1 -- 172.21.15.87:0/3811350718 learned_addr learned my addr 172.21.15.87:0/3811350718 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc67ed9d700 1 --2- 172.21.15.87:0/3811350718 >> v2:172.21.15.115:3300/0 conn(0x7fc680163dc0 0x7fc6800c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:19.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc67659c700 1 -- 172.21.15.87:0/3811350718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6800aea30 msgr2=0x7fc6800ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc67659c700 1 --2- 172.21.15.87:0/3811350718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6800aea30 0x7fc6800ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc67659c700 1 -- 172.21.15.87:0/3811350718 >> v2:172.21.15.115:3300/0 conn(0x7fc680163dc0 msgr2=0x7fc6800c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc67659c700 1 --2- 172.21.15.87:0/3811350718 >> v2:172.21.15.115:3300/0 conn(0x7fc680163dc0 0x7fc6800c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc67659c700 1 -- 172.21.15.87:0/3811350718 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68006cf70 con 0x7fc680164190 2023-03-30T08:11:19.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc67659c700 1 --2- 172.21.15.87:0/3811350718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc680164190 0x7fc6800c9b00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc6800cba30 tx=0x7fc668009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f347e8fe1f609f server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc67e59c700 1 -- 172.21.15.87:0/3811350718 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc668011830 con 0x7fc680164190 2023-03-30T08:11:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc67e59c700 1 -- 172.21.15.87:0/3811350718 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc668011990 con 0x7fc680164190 2023-03-30T08:11:19.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc67e59c700 1 -- 172.21.15.87:0/3811350718 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc668011d20 con 0x7fc680164190 2023-03-30T08:11:19.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc684971700 1 -- 172.21.15.87:0/3811350718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc680164190 msgr2=0x7fc6800c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:19.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc684971700 1 --2- 172.21.15.87:0/3811350718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc680164190 0x7fc6800c9b00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc6800cba30 tx=0x7fc668009bf0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc684971700 1 -- 172.21.15.87:0/3811350718 shutdown_connections 2023-03-30T08:11:19.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc684971700 1 --2- 172.21.15.87:0/3811350718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc6800aea30 0x7fc6800ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc684971700 1 --2- 172.21.15.87:0/3811350718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc680164190 0x7fc6800c9b00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc684971700 1 --2- 172.21.15.87:0/3811350718 >> v2:172.21.15.115:3300/0 conn(0x7fc680163dc0 0x7fc6800c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.340+0000 7fc684971700 1 -- 172.21.15.87:0/3811350718 >> 172.21.15.87:0/3811350718 conn(0x7fc6800cf410 msgr2=0x7fc6800cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:19.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.344+0000 7fc684971700 1 -- 172.21.15.87:0/3811350718 shutdown_connections 2023-03-30T08:11:19.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.344+0000 7fc684971700 1 -- 172.21.15.87:0/3811350718 wait complete. 2023-03-30T08:11:19.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.344+0000 7fc684971700 1 Processor -- start 2023-03-30T08:11:19.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.344+0000 7fc684971700 1 -- start start 2023-03-30T08:11:19.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc684971700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6800aea30 0x7fc680157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:19.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc684971700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc680163dc0 0x7fc6801f9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:19.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc684971700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc680164190 0x7fc6801f9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:19.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc684971700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800b1b30 con 0x7fc680163dc0 2023-03-30T08:11:19.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc684971700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6801fa390 con 0x7fc6800aea30 2023-03-30T08:11:19.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc684971700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68015adb0 con 0x7fc680164190 2023-03-30T08:11:19.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc67659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc680163dc0 0x7fc6801f9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:19.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc67659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc680163dc0 0x7fc6801f9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56612/0 (socket says 172.21.15.87:56612) 2023-03-30T08:11:19.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc67659c700 1 -- 172.21.15.87:0/2063737556 learned_addr learned my addr 172.21.15.87:0/2063737556 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:19.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc67ed9d700 1 --2- 172.21.15.87:0/2063737556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6800aea30 0x7fc680157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:19.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc67f59e700 1 --2- 172.21.15.87:0/2063737556 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc680164190 0x7fc6801f9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:19.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc67659c700 1 -- 172.21.15.87:0/2063737556 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc680164190 msgr2=0x7fc6801f9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:19.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc67659c700 1 --2- 172.21.15.87:0/2063737556 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc680164190 0x7fc6801f9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc67659c700 1 -- 172.21.15.87:0/2063737556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6800aea30 msgr2=0x7fc680157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:19.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc67659c700 1 --2- 172.21.15.87:0/2063737556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6800aea30 0x7fc680157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc67659c700 1 -- 172.21.15.87:0/2063737556 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc668009570 con 0x7fc680163dc0 2023-03-30T08:11:19.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc67659c700 1 --2- 172.21.15.87:0/2063737556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc680163dc0 0x7fc6801f9540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc668000c00 tx=0x7fc668004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:19.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc677fff700 1 -- 172.21.15.87:0/2063737556 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc668004590 con 0x7fc680163dc0 2023-03-30T08:11:19.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc677fff700 1 -- 172.21.15.87:0/2063737556 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66801e070 con 0x7fc680163dc0 2023-03-30T08:11:19.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc684971700 1 -- 172.21.15.87:0/2063737556 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68006d530 con 0x7fc680163dc0 2023-03-30T08:11:19.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc677fff700 1 -- 172.21.15.87:0/2063737556 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc668003900 con 0x7fc680163dc0 2023-03-30T08:11:19.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc684971700 1 -- 172.21.15.87:0/2063737556 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68006d250 con 0x7fc680163dc0 2023-03-30T08:11:19.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.348+0000 7fc684971700 1 -- 172.21.15.87:0/2063737556 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68006cc40 con 0x7fc680163dc0 2023-03-30T08:11:19.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.352+0000 7fc677fff700 1 -- 172.21.15.87:0/2063737556 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc668003a60 con 0x7fc680163dc0 2023-03-30T08:11:19.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.352+0000 7fc677fff700 1 --2- 172.21.15.87:0/2063737556 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc6600653f0 0x7fc6600678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:19.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.352+0000 7fc677fff700 1 -- 172.21.15.87:0/2063737556 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc668083780 con 0x7fc680163dc0 2023-03-30T08:11:19.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.352+0000 7fc67ed9d700 1 --2- 172.21.15.87:0/2063737556 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc6600653f0 0x7fc6600678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:19.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.352+0000 7fc67ed9d700 1 --2- 172.21.15.87:0/2063737556 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc6600653f0 0x7fc6600678a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc670009b80 tx=0x7fc670008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:19.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.356+0000 7fc677fff700 1 -- 172.21.15.87:0/2063737556 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fc6680511a0 con 0x7fc680163dc0 2023-03-30T08:11:19.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.524+0000 7fc684971700 1 -- 172.21.15.87:0/2063737556 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6800733a0 con 0x7fc680163dc0 2023-03-30T08:11:19.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.528+0000 7fc677fff700 1 -- 172.21.15.87:0/2063737556 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19652 (secure 0 0 0) 0x7fc6680547c0 con 0x7fc680163dc0 2023-03-30T08:11:19.532 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:19.533 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":28,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:02.841070+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.532+0000 7fc684971700 1 -- 172.21.15.87:0/2063737556 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc6600653f0 msgr2=0x7fc6600678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.532+0000 7fc684971700 1 --2- 172.21.15.87:0/2063737556 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc6600653f0 0x7fc6600678a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc670009b80 tx=0x7fc670008040 comp rx=0 tx=0).stop 2023-03-30T08:11:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.532+0000 7fc684971700 1 -- 172.21.15.87:0/2063737556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc680163dc0 msgr2=0x7fc6801f9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:19.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.532+0000 7fc684971700 1 --2- 172.21.15.87:0/2063737556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc680163dc0 0x7fc6801f9540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc668000c00 tx=0x7fc668004770 comp rx=0 tx=0).stop 2023-03-30T08:11:19.537 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.532+0000 7fc684971700 1 -- 172.21.15.87:0/2063737556 shutdown_connections 2023-03-30T08:11:19.537 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.532+0000 7fc684971700 1 --2- 172.21.15.87:0/2063737556 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc6600653f0 0x7fc6600678a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.537 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.532+0000 7fc684971700 1 --2- 172.21.15.87:0/2063737556 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc680164190 0x7fc6801f9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.537 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.532+0000 7fc684971700 1 --2- 172.21.15.87:0/2063737556 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc680163dc0 0x7fc6801f9540 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.537 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.532+0000 7fc684971700 1 --2- 172.21.15.87:0/2063737556 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6800aea30 0x7fc680157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.537 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.532+0000 7fc684971700 1 -- 172.21.15.87:0/2063737556 >> 172.21.15.87:0/2063737556 conn(0x7fc6800cf410 msgr2=0x7fc6800cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:19.538 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.532+0000 7fc684971700 1 -- 172.21.15.87:0/2063737556 shutdown_connections 2023-03-30T08:11:19.538 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.532+0000 7fc684971700 1 -- 172.21.15.87:0/2063737556 wait complete. 2023-03-30T08:11:19.558 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-03-30T08:11:19.559 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:19.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.716+0000 7fcc9e910700 1 Processor -- start 2023-03-30T08:11:19.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.716+0000 7fcc9e910700 1 -- start start 2023-03-30T08:11:19.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.716+0000 7fcc9e910700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc980b8380 0x7fcc980d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:19.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.716+0000 7fcc9e910700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcc980d27e0 0x7fcc98069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:19.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.716+0000 7fcc9e910700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc98160ef0 con 0x7fcc981609f0 2023-03-30T08:11:19.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.716+0000 7fcc9e910700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc980cd6a0 con 0x7fcc980d27e0 2023-03-30T08:11:19.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.716+0000 7fcc9e910700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc980cd3a0 con 0x7fcc980b8380 2023-03-30T08:11:19.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9e10f700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fcc981609f0 0x7fcc9806b1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48438/0 (socket says 172.21.15.87:48438) 2023-03-30T08:11:19.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9e10f700 1 -- 172.21.15.87:0/4109800512 learned_addr learned my addr 172.21.15.87:0/4109800512 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:19.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9d90e700 1 --2- 172.21.15.87:0/4109800512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc980b8380 0x7fcc980d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:19.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9d10d700 1 --2- 172.21.15.87:0/4109800512 >> v2:172.21.15.115:3300/0 conn(0x7fcc980d27e0 0x7fcc98069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:19.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9c90c700 1 -- 172.21.15.87:0/4109800512 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616180198 0 0) 0x7fcc98160ef0 con 0x7fcc981609f0 2023-03-30T08:11:19.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9c90c700 1 -- 172.21.15.87:0/4109800512 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc840035d0 con 0x7fcc981609f0 2023-03-30T08:11:19.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9d90e700 1 -- 172.21.15.87:0/4109800512 >> v2:172.21.15.115:3300/0 conn(0x7fcc980d27e0 msgr2=0x7fcc98069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:19.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9d90e700 1 --2- 172.21.15.87:0/4109800512 >> v2:172.21.15.115:3300/0 conn(0x7fcc980d27e0 0x7fcc98069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9d90e700 1 -- 172.21.15.87:0/4109800512 >> v1:172.21.15.87:6789/0 conn(0x7fcc981609f0 legacy=0x7fcc9806b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:19.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9d90e700 1 -- 172.21.15.87:0/4109800512 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc980cef00 con 0x7fcc980b8380 2023-03-30T08:11:19.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9c90c700 1 -- 172.21.15.87:0/4109800512 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2608161285 0 0) 0x7fcc840035d0 con 0x7fcc981609f0 2023-03-30T08:11:19.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9d90e700 1 --2- 172.21.15.87:0/4109800512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc980b8380 0x7fcc980d2200 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009850 tx=0x7fcc94009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3be029db0461f96 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9c90c700 1 -- 172.21.15.87:0/4109800512 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc900019f0 con 0x7fcc980b8380 2023-03-30T08:11:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9c90c700 1 -- 172.21.15.87:0/4109800512 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc94004030 con 0x7fcc980b8380 2023-03-30T08:11:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9c90c700 1 -- 172.21.15.87:0/4109800512 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc940043e0 con 0x7fcc980b8380 2023-03-30T08:11:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9e910700 1 -- 172.21.15.87:0/4109800512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc980b8380 msgr2=0x7fcc980d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9e910700 1 --2- 172.21.15.87:0/4109800512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc980b8380 0x7fcc980d2200 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009850 tx=0x7fcc94009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9e910700 1 -- 172.21.15.87:0/4109800512 shutdown_connections 2023-03-30T08:11:19.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9e910700 1 --2- 172.21.15.87:0/4109800512 >> v2:172.21.15.115:3300/0 conn(0x7fcc980d27e0 0x7fcc98069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9e910700 1 --2- 172.21.15.87:0/4109800512 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc980b8380 0x7fcc980d2200 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.720+0000 7fcc9e910700 1 -- 172.21.15.87:0/4109800512 >> 172.21.15.87:0/4109800512 conn(0x7fcc980b53f0 msgr2=0x7fcc980cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.724+0000 7fcc9e910700 1 -- 172.21.15.87:0/4109800512 shutdown_connections 2023-03-30T08:11:19.728 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.724+0000 7fcc9e910700 1 -- 172.21.15.87:0/4109800512 wait complete. 2023-03-30T08:11:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.724+0000 7fcc9e910700 1 Processor -- start 2023-03-30T08:11:19.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.724+0000 7fcc9e910700 1 -- start start 2023-03-30T08:11:19.731 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.724+0000 7fcc9e910700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc980b8380 0x7fcc980c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:19.731 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.724+0000 7fcc9e910700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc981609f0 0x7fcc9815e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:19.731 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.724+0000 7fcc9e910700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc9815ed60 0x7fcc980b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:19.731 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.724+0000 7fcc9e910700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc980c7830 con 0x7fcc981609f0 2023-03-30T08:11:19.731 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.724+0000 7fcc9e910700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc980c8650 con 0x7fcc9815ed60 2023-03-30T08:11:19.731 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.724+0000 7fcc9e910700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98150b20 con 0x7fcc980b8380 2023-03-30T08:11:19.732 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc9d10d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc981609f0 0x7fcc9815e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:19.732 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc9d10d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc981609f0 0x7fcc9815e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51800/0 (socket says 172.21.15.87:51800) 2023-03-30T08:11:19.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc9d10d700 1 -- 172.21.15.87:0/3369579697 learned_addr learned my addr 172.21.15.87:0/3369579697 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:19.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc9e10f700 1 --2- 172.21.15.87:0/3369579697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc9815ed60 0x7fcc980b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:19.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc9d90e700 1 --2- 172.21.15.87:0/3369579697 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc980b8380 0x7fcc980c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:19.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc9d10d700 1 -- 172.21.15.87:0/3369579697 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc980b8380 msgr2=0x7fcc980c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:19.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc9d10d700 1 --2- 172.21.15.87:0/3369579697 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc980b8380 0x7fcc980c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc9d10d700 1 -- 172.21.15.87:0/3369579697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc9815ed60 msgr2=0x7fcc980b62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:19.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc9d10d700 1 --2- 172.21.15.87:0/3369579697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc9815ed60 0x7fcc980b62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc9d10d700 1 -- 172.21.15.87:0/3369579697 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc940094b0 con 0x7fcc981609f0 2023-03-30T08:11:19.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc9d10d700 1 --2- 172.21.15.87:0/3369579697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc981609f0 0x7fcc9815e820 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800e9d0 tx=0x7fcc8800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:19.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc8e7fc700 1 -- 172.21.15.87:0/3369579697 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc88009720 con 0x7fcc981609f0 2023-03-30T08:11:19.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc8e7fc700 1 -- 172.21.15.87:0/3369579697 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8800ee70 con 0x7fcc981609f0 2023-03-30T08:11:19.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc9e910700 1 -- 172.21.15.87:0/3369579697 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc980cf480 con 0x7fcc981609f0 2023-03-30T08:11:19.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc8e7fc700 1 -- 172.21.15.87:0/3369579697 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800ca70 con 0x7fcc981609f0 2023-03-30T08:11:19.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc9e910700 1 -- 172.21.15.87:0/3369579697 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc980cf1a0 con 0x7fcc981609f0 2023-03-30T08:11:19.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.728+0000 7fcc9e910700 1 -- 172.21.15.87:0/3369579697 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc980b8750 con 0x7fcc981609f0 2023-03-30T08:11:19.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.732+0000 7fcc8e7fc700 1 -- 172.21.15.87:0/3369579697 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fcc8800cbd0 con 0x7fcc981609f0 2023-03-30T08:11:19.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.732+0000 7fcc8e7fc700 1 --2- 172.21.15.87:0/3369579697 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcc7c0653f0 0x7fcc7c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:19.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.732+0000 7fcc8e7fc700 1 -- 172.21.15.87:0/3369579697 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcc88082ae0 con 0x7fcc981609f0 2023-03-30T08:11:19.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.732+0000 7fcc9d90e700 1 --2- 172.21.15.87:0/3369579697 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcc7c0653f0 0x7fcc7c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:19.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.732+0000 7fcc9d90e700 1 --2- 172.21.15.87:0/3369579697 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcc7c0653f0 0x7fcc7c0678a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcc940090b0 tx=0x7fcc94008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:19.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.736+0000 7fcc8e7fc700 1 -- 172.21.15.87:0/3369579697 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fcc88053ea0 con 0x7fcc981609f0 2023-03-30T08:11:19.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.908+0000 7fcc9e910700 1 -- 172.21.15.87:0/3369579697 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc98072cf0 con 0x7fcc981609f0 2023-03-30T08:11:19.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.912+0000 7fcc8e7fc700 1 -- 172.21.15.87:0/3369579697 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19652 (secure 0 0 0) 0x7fcc88053a90 con 0x7fcc981609f0 2023-03-30T08:11:19.916 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:19.916 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":28,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:02.841070+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:19.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.912+0000 7fcc9e910700 1 -- 172.21.15.87:0/3369579697 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcc7c0653f0 msgr2=0x7fcc7c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:19.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.912+0000 7fcc9e910700 1 --2- 172.21.15.87:0/3369579697 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcc7c0653f0 0x7fcc7c0678a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcc940090b0 tx=0x7fcc94008030 comp rx=0 tx=0).stop 2023-03-30T08:11:19.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.916+0000 7fcc9e910700 1 -- 172.21.15.87:0/3369579697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc981609f0 msgr2=0x7fcc9815e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:19.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.916+0000 7fcc9e910700 1 --2- 172.21.15.87:0/3369579697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc981609f0 0x7fcc9815e820 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800e9d0 tx=0x7fcc8800ece0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.916+0000 7fcc9e910700 1 -- 172.21.15.87:0/3369579697 shutdown_connections 2023-03-30T08:11:19.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.916+0000 7fcc9e910700 1 --2- 172.21.15.87:0/3369579697 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcc7c0653f0 0x7fcc7c0678a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.916+0000 7fcc9e910700 1 --2- 172.21.15.87:0/3369579697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc9815ed60 0x7fcc980b62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.916+0000 7fcc9e910700 1 --2- 172.21.15.87:0/3369579697 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcc981609f0 0x7fcc9815e820 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.916+0000 7fcc9e910700 1 --2- 172.21.15.87:0/3369579697 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc980b8380 0x7fcc980c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.916+0000 7fcc9e910700 1 -- 172.21.15.87:0/3369579697 >> 172.21.15.87:0/3369579697 conn(0x7fcc980b53f0 msgr2=0x7fcc980b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.916+0000 7fcc9e910700 1 -- 172.21.15.87:0/3369579697 shutdown_connections 2023-03-30T08:11:19.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:19.916+0000 7fcc9e910700 1 -- 172.21.15.87:0/3369579697 wait complete. 2023-03-30T08:11:19.938 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-03-30T08:11:19.939 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-03-30T08:11:19.939 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-03-30T08:11:19.940 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-03-30T08:11:19.940 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-03-30T08:11:19.941 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-03-30T08:11:19.941 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-03-30T08:11:19.942 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-03-30T08:11:20.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.160+0000 7f222ed3e700 1 Processor -- start 2023-03-30T08:11:20.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.160+0000 7f66abccf700 1 Processor -- start 2023-03-30T08:11:20.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.160+0000 7f222ed3e700 1 -- start start 2023-03-30T08:11:20.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.160+0000 7f66abccf700 1 -- start start 2023-03-30T08:11:20.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.160+0000 7f264d839700 1 Processor -- start 2023-03-30T08:11:20.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.160+0000 7f264d839700 1 -- start start 2023-03-30T08:11:20.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f264d839700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f264806a3e0 0x7f26480aead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f264d839700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264806a9a0 con 0x7f26480af010 2023-03-30T08:11:20.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f264d839700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264806ac80 con 0x7f26480add40 2023-03-30T08:11:20.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f264d839700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264806b5c0 con 0x7f264806a3e0 2023-03-30T08:11:20.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f222ed3e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2228160730 0x7f22280c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f222ed3e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f22280ccc90 0x7f22280cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f222ed3e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22280c9ec0 con 0x7f22280c3d10 2023-03-30T08:11:20.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f222ed3e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22280cd650 con 0x7f22280ccc90 2023-03-30T08:11:20.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f222ed3e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2228160b00 con 0x7f2228160730 2023-03-30T08:11:20.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f264d038700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f26480af010 0x7f26480c9100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48448/0 (socket says 172.21.15.87:48448) 2023-03-30T08:11:20.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f264d038700 1 -- 172.21.15.87:0/3930628458 learned_addr learned my addr 172.21.15.87:0/3930628458 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:20.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f2647fff700 1 --2- 172.21.15.87:0/3930628458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f264806a3e0 0x7f26480aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.171 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f66abccf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66a415c340 0x7f66a415c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.171 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f66abccf700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f66a40adc30 0x7f66a406b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.171 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f66abccf700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a406c790 con 0x7f66a40ac080 2023-03-30T08:11:20.171 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f66abccf700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a406b6f0 con 0x7f66a40adc30 2023-03-30T08:11:20.171 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f66abccf700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40c9ee0 con 0x7f66a415c340 2023-03-30T08:11:20.172 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f2227fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f22280c3d10 0x7f2228069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:40880/0 (socket says 172.21.15.87:40880) 2023-03-30T08:11:20.172 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f2227fff700 1 -- 172.21.15.87:0/959730641 learned_addr learned my addr 172.21.15.87:0/959730641 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:20.172 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f222d2db700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f22280ccc90 0x7f22280cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.172 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f6e84d64700 1 Processor -- start 2023-03-30T08:11:20.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f222cada700 1 --2- 172.21.15.87:0/959730641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2228160730 0x7f22280c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f66a926a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f66a40adc30 0x7f66a406b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f66a9a6b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66a415c340 0x7f66a415c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f66aa26c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f66a40ac080 0x7f66a4069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48458/0 (socket says 172.21.15.87:48458) 2023-03-30T08:11:20.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f66aa26c700 1 -- 172.21.15.87:0/1091029198 learned_addr learned my addr 172.21.15.87:0/1091029198 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:20.174 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629109467 0 0) 0x7f264806ac80 con 0x7f26480add40 2023-03-30T08:11:20.174 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26300035d0 con 0x7f26480add40 2023-03-30T08:11:20.174 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f222cada700 1 -- 172.21.15.87:0/959730641 >> v2:172.21.15.87:3300/0 conn(0x7f22280ccc90 msgr2=0x7f22280cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.174 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f222cada700 1 --2- 172.21.15.87:0/959730641 >> v2:172.21.15.87:3300/0 conn(0x7f22280ccc90 0x7f22280cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f222cada700 1 -- 172.21.15.87:0/959730641 >> v1:172.21.15.115:6789/0 conn(0x7f22280c3d10 legacy=0x7f2228069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f222cada700 1 -- 172.21.15.87:0/959730641 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22280c5210 con 0x7f2228160730 2023-03-30T08:11:20.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237632310 0 0) 0x7f264806a9a0 con 0x7f26480af010 2023-03-30T08:11:20.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f264806ac80 con 0x7f26480af010 2023-03-30T08:11:20.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f6e84d64700 1 -- start start 2023-03-30T08:11:20.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 <== mon.1 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1279329685 0 0) 0x7f26300035d0 con 0x7f26480add40 2023-03-30T08:11:20.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f264806a3e0 msgr2=0x7f26480aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f26477fe700 1 --2- 172.21.15.87:0/3930628458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f264806a3e0 0x7f26480aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 >> v1:172.21.15.87:6789/0 conn(0x7f26480af010 legacy=0x7f26480c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2648089830 con 0x7f26480add40 2023-03-30T08:11:20.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 <== mon.1 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f263c001670 con 0x7f26480add40 2023-03-30T08:11:20.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f66a926a700 1 -- 172.21.15.87:0/1091029198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66a415c340 msgr2=0x7f66a415c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f66a926a700 1 --2- 172.21.15.87:0/1091029198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66a415c340 0x7f66a415c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f66a926a700 1 -- 172.21.15.87:0/1091029198 >> v1:172.21.15.87:6789/0 conn(0x7f66a40ac080 legacy=0x7f66a4069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f66a926a700 1 -- 172.21.15.87:0/1091029198 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a40ca180 con 0x7f66a40adc30 2023-03-30T08:11:20.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f222cada700 1 --2- 172.21.15.87:0/959730641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2228160730 0x7f22280c4c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f221c009850 tx=0x7f221c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50c92f8b4d7d7a4a server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 >> v1:172.21.15.115:6789/0 conn(0x7f26480add40 legacy=0x7f2648069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f26477fe700 1 --2- 172.21.15.87:0/3930628458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2630003bb0 0x7f2630003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f26477fe700 1 --2- 172.21.15.87:0/3930628458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2630004870 0x7f2630004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.164+0000 7f26477fe700 1 --2- 172.21.15.87:0/3930628458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f264806a3e0 0x7f2630005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264806b5c0 con 0x7f2630003bb0 2023-03-30T08:11:20.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263000bae0 con 0x7f2630004870 2023-03-30T08:11:20.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263000bca0 con 0x7f264806a3e0 2023-03-30T08:11:20.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7fb9fc965700 1 Processor -- start 2023-03-30T08:11:20.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f22277fe700 1 -- 172.21.15.87:0/959730641 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c011830 con 0x7f2228160730 2023-03-30T08:11:20.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f22277fe700 1 -- 172.21.15.87:0/959730641 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221c011990 con 0x7f2228160730 2023-03-30T08:11:20.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f22277fe700 1 -- 172.21.15.87:0/959730641 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c011d40 con 0x7f2228160730 2023-03-30T08:11:20.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f66a926a700 1 --2- 172.21.15.87:0/1091029198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a40adc30 0x7f66a406b1b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f66a0009850 tx=0x7f66a0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf7cd608db9fdeec server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e84d64700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6e7803e7b0 0x7f6e780553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e84d64700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e78038950 con 0x7f6e7800eff0 2023-03-30T08:11:20.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e84d64700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e780e6fe0 con 0x7f6e78058ba0 2023-03-30T08:11:20.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e84d64700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e780e72c0 con 0x7f6e7803e7b0 2023-03-30T08:11:20.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f264c837700 1 --2- 172.21.15.87:0/3930628458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2630003bb0 0x7f2630003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f264d038700 1 --2- 172.21.15.87:0/3930628458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f264806a3e0 0x7f2630005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f66a8a69700 1 -- 172.21.15.87:0/1091029198 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0011830 con 0x7f66a40adc30 2023-03-30T08:11:20.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f66a8a69700 1 -- 172.21.15.87:0/1091029198 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a0011990 con 0x7f66a40adc30 2023-03-30T08:11:20.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f66a8a69700 1 -- 172.21.15.87:0/1091029198 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0011d40 con 0x7f66a40adc30 2023-03-30T08:11:20.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f222ed3e700 1 -- 172.21.15.87:0/959730641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2228160730 msgr2=0x7f22280c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f222ed3e700 1 --2- 172.21.15.87:0/959730641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2228160730 0x7f22280c4c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f221c009850 tx=0x7f221c009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:20.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e7ffff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f6e7800eff0 0x7f6e78056fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48460/0 (socket says 172.21.15.87:48460) 2023-03-30T08:11:20.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e7ffff700 1 -- 172.21.15.87:0/604109352 learned_addr learned my addr 172.21.15.87:0/604109352 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:20.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e7f7fe700 1 --2- 172.21.15.87:0/604109352 >> v2:172.21.15.115:3300/0 conn(0x7f6e7803e7b0 0x7f6e780553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f264c837700 1 -- 172.21.15.87:0/3930628458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f264806a3e0 msgr2=0x7f2630005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f264c837700 1 --2- 172.21.15.87:0/3930628458 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f264806a3e0 0x7f2630005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f264c837700 1 -- 172.21.15.87:0/3930628458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2630004870 msgr2=0x7f2630004ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-30T08:11:20.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f264c837700 1 --2- 172.21.15.87:0/3930628458 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2630004870 0x7f2630004ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f264c837700 1 -- 172.21.15.87:0/3930628458 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300035d0 con 0x7f2630003bb0 2023-03-30T08:11:20.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f66abccf700 1 -- 172.21.15.87:0/1091029198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a40adc30 msgr2=0x7f66a406b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f66abccf700 1 --2- 172.21.15.87:0/1091029198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a40adc30 0x7f66a406b1b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f66a0009850 tx=0x7f66a0009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:20.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7fb9fc965700 1 -- start start 2023-03-30T08:11:20.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f66abccf700 1 -- 172.21.15.87:0/1091029198 shutdown_connections 2023-03-30T08:11:20.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f66abccf700 1 --2- 172.21.15.87:0/1091029198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a40adc30 0x7f66a406b1b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f66abccf700 1 --2- 172.21.15.87:0/1091029198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66a415c340 0x7f66a415c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f66abccf700 1 -- 172.21.15.87:0/1091029198 >> 172.21.15.87:0/1091029198 conn(0x7f66a40cf410 msgr2=0x7f66a40cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7fb9fc965700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f003b250 0x7fb9f00ed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7fb9fc965700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f00077c0 con 0x7fb9f0055690 2023-03-30T08:11:20.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7fb9fc965700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f0053840 con 0x7fb9f0038430 2023-03-30T08:11:20.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7fb9fc965700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f0038800 con 0x7fb9f003b250 2023-03-30T08:11:20.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e7e7fc700 1 -- 172.21.15.87:0/604109352 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987752950 0 0) 0x7f6e780e6fe0 con 0x7f6e78058ba0 2023-03-30T08:11:20.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e7e7fc700 1 -- 172.21.15.87:0/604109352 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e700035d0 con 0x7f6e78058ba0 2023-03-30T08:11:20.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f66abccf700 1 -- 172.21.15.87:0/1091029198 shutdown_connections 2023-03-30T08:11:20.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f66abccf700 1 -- 172.21.15.87:0/1091029198 wait complete. 2023-03-30T08:11:20.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f222ed3e700 1 -- 172.21.15.87:0/959730641 shutdown_connections 2023-03-30T08:11:20.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f222ed3e700 1 --2- 172.21.15.87:0/959730641 >> v2:172.21.15.87:3300/0 conn(0x7f22280ccc90 0x7f22280cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f222ed3e700 1 --2- 172.21.15.87:0/959730641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2228160730 0x7f22280c4c00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f222ed3e700 1 -- 172.21.15.87:0/959730641 >> 172.21.15.87:0/959730641 conn(0x7f22280cb1c0 msgr2=0x7f22280cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f264c837700 1 --2- 172.21.15.87:0/3930628458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2630003bb0 0x7f2630003fa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f263c001eb0 tx=0x7f26300058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a42e843b45c4b server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e7e7fc700 1 -- 172.21.15.87:0/604109352 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042903810 0 0) 0x7f6e78038950 con 0x7f6e7800eff0 2023-03-30T08:11:20.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e7e7fc700 1 -- 172.21.15.87:0/604109352 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e780e6fe0 con 0x7f6e7800eff0 2023-03-30T08:11:20.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7fb9f6d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f003b250 0x7fb9f00ed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7fb9f6d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f003b250 0x7fb9f00ed4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:33900/0 (socket says 172.21.15.87:33900) 2023-03-30T08:11:20.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7fb9f6d9d700 1 -- 172.21.15.87:0/1660515230 learned_addr learned my addr 172.21.15.87:0/1660515230 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e7f7fe700 1 -- 172.21.15.87:0/604109352 >> v1:172.21.15.115:6789/0 conn(0x7f6e78058ba0 legacy=0x7f6e7800e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e7f7fe700 1 -- 172.21.15.87:0/604109352 >> v1:172.21.15.87:6789/0 conn(0x7f6e7800eff0 legacy=0x7f6e78056fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e7f7fe700 1 -- 172.21.15.87:0/604109352 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e78053860 con 0x7f6e7803e7b0 2023-03-30T08:11:20.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7fb9f6d9d700 1 -- 172.21.15.87:0/1660515230 >> v1:172.21.15.115:6789/0 conn(0x7fb9f0038430 legacy=0x7fb9f0006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7fb9f6d9d700 1 -- 172.21.15.87:0/1660515230 >> v1:172.21.15.87:6789/0 conn(0x7fb9f0055690 legacy=0x7fb9f003ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7fb9f6d9d700 1 -- 172.21.15.87:0/1660515230 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f0053b20 con 0x7fb9f003b250 2023-03-30T08:11:20.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e7f7fe700 1 --2- 172.21.15.87:0/604109352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e7803e7b0 0x7f6e780553c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e80000b60 tx=0x7f6e8004e9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d05f4cca7fdb3843 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7fb9f6d9d700 1 --2- 172.21.15.87:0/1660515230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f003b250 0x7fb9f00ed4a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009940 tx=0x7fb9ec009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6671437e1248adbf server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.168+0000 7f6e7e7fc700 1 -- 172.21.15.87:0/604109352 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8008d070 con 0x7f6e7803e7b0 2023-03-30T08:11:20.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f6e7e7fc700 1 -- 172.21.15.87:0/604109352 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e80067770 con 0x7f6e7803e7b0 2023-03-30T08:11:20.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f6e7e7fc700 1 -- 172.21.15.87:0/604109352 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80072420 con 0x7f6e7803e7b0 2023-03-30T08:11:20.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c00cbb0 con 0x7f2630003bb0 2023-03-30T08:11:20.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c00cd10 con 0x7f2630003bb0 2023-03-30T08:11:20.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f26477fe700 1 -- 172.21.15.87:0/3930628458 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c011780 con 0x7f2630003bb0 2023-03-30T08:11:20.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7fb9f559a700 1 -- 172.21.15.87:0/1660515230 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00ba60 con 0x7fb9f003b250 2023-03-30T08:11:20.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7fb9f559a700 1 -- 172.21.15.87:0/1660515230 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec009e90 con 0x7fb9f003b250 2023-03-30T08:11:20.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f222ed3e700 1 -- 172.21.15.87:0/959730641 shutdown_connections 2023-03-30T08:11:20.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f222ed3e700 1 -- 172.21.15.87:0/959730641 wait complete. 2023-03-30T08:11:20.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f6e84d64700 1 -- 172.21.15.87:0/604109352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e7803e7b0 msgr2=0x7f6e780553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f6e84d64700 1 --2- 172.21.15.87:0/604109352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e7803e7b0 0x7f6e780553c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e80000b60 tx=0x7f6e8004e9e0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7fb9f559a700 1 -- 172.21.15.87:0/1660515230 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00bde0 con 0x7fb9f003b250 2023-03-30T08:11:20.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f264d839700 1 -- 172.21.15.87:0/3930628458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2630003bb0 msgr2=0x7f2630003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f264d839700 1 --2- 172.21.15.87:0/3930628458 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2630003bb0 0x7f2630003fa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f263c001eb0 tx=0x7f26300058a0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f6e84d64700 1 -- 172.21.15.87:0/604109352 shutdown_connections 2023-03-30T08:11:20.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f6e84d64700 1 --2- 172.21.15.87:0/604109352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e7803e7b0 0x7f6e780553c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f6e84d64700 1 -- 172.21.15.87:0/604109352 >> 172.21.15.87:0/604109352 conn(0x7f6e78059170 msgr2=0x7f6e78059570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f264d038700 1 -- 172.21.15.87:0/3930628458 reap_dead start 2023-03-30T08:11:20.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f66abccf700 1 Processor -- start 2023-03-30T08:11:20.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f6e84d64700 1 -- 172.21.15.87:0/604109352 shutdown_connections 2023-03-30T08:11:20.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7fb9fc965700 1 -- 172.21.15.87:0/1660515230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f003b250 msgr2=0x7fb9f00ed4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.199 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7fb9fc965700 1 --2- 172.21.15.87:0/1660515230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f003b250 0x7fb9f00ed4a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009940 tx=0x7fb9ec009c50 comp rx=0 tx=0).stop 2023-03-30T08:11:20.199 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f66abccf700 1 -- start start 2023-03-30T08:11:20.199 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f66abccf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66a40ac080 0x7f66a41f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.199 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f6e84d64700 1 -- 172.21.15.87:0/604109352 wait complete. 2023-03-30T08:11:20.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f6e84d64700 1 Processor -- start 2023-03-30T08:11:20.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f264d839700 1 -- 172.21.15.87:0/3930628458 shutdown_connections 2023-03-30T08:11:20.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f264d839700 1 -- 172.21.15.87:0/3930628458 >> 172.21.15.87:0/3930628458 conn(0x7f26480cf410 msgr2=0x7f26480cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7fb9fc965700 1 -- 172.21.15.87:0/1660515230 shutdown_connections 2023-03-30T08:11:20.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7fb9fc965700 1 --2- 172.21.15.87:0/1660515230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f003b250 0x7fb9f00ed4a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7fb9fc965700 1 -- 172.21.15.87:0/1660515230 >> 172.21.15.87:0/1660515230 conn(0x7fb9f0055b40 msgr2=0x7fb9f0055f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f222ed3e700 1 Processor -- start 2023-03-30T08:11:20.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f66abccf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66a40adc30 0x7f66a4159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7fb9fc965700 1 -- 172.21.15.87:0/1660515230 shutdown_connections 2023-03-30T08:11:20.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7fb9fc965700 1 -- 172.21.15.87:0/1660515230 wait complete. 2023-03-30T08:11:20.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f66a9a6b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66a40ac080 0x7f66a41f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66a9a6b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66a40ac080 0x7f66a41f4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:33914/0 (socket says 172.21.15.87:33914) 2023-03-30T08:11:20.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66a926a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66a40adc30 0x7f66a4159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66a926a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66a40adc30 0x7f66a4159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51836/0 (socket says 172.21.15.87:51836) 2023-03-30T08:11:20.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66a9a6b700 1 -- 172.21.15.87:0/2507762813 learned_addr learned my addr 172.21.15.87:0/2507762813 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66abccf700 1 --2- 172.21.15.87:0/2507762813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a415c340 0x7f66a415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7fc84d85a700 1 Processor -- start 2023-03-30T08:11:20.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f6e84d64700 1 -- start start 2023-03-30T08:11:20.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f6e84d64700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e7800eff0 0x7f6e7817f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f6e84d64700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7803e7b0 0x7f6e7803d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f264d839700 1 -- 172.21.15.87:0/3930628458 shutdown_connections 2023-03-30T08:11:20.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66abccf700 1 -- 172.21.15.87:0/2507762813 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a415b430 con 0x7f66a40adc30 2023-03-30T08:11:20.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66abccf700 1 -- 172.21.15.87:0/2507762813 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40ae430 con 0x7f66a415c340 2023-03-30T08:11:20.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66abccf700 1 -- 172.21.15.87:0/2507762813 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a415a820 con 0x7f66a40ac080 2023-03-30T08:11:20.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7fc84d85a700 1 -- start start 2023-03-30T08:11:20.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.172+0000 7f222ed3e700 1 -- start start 2023-03-30T08:11:20.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f222ed3e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22280c3d10 0x7f222815b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f222ed3e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22280ccc90 0x7f222815c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f222cada700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22280c3d10 0x7f222815b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f222cada700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22280c3d10 0x7f222815b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34158/0 (socket says 172.21.15.87:34158) 2023-03-30T08:11:20.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f222cada700 1 -- 172.21.15.87:0/3033971063 learned_addr learned my addr 172.21.15.87:0/3033971063 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f2227fff700 1 --2- 172.21.15.87:0/3033971063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22280ccc90 0x7f222815c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f222ed3e700 1 --2- 172.21.15.87:0/3033971063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2228160730 0x7f222815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f222d2db700 1 --2- 172.21.15.87:0/3033971063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2228160730 0x7f222815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f222ed3e700 1 -- 172.21.15.87:0/3033971063 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222815cec0 con 0x7f22280ccc90 2023-03-30T08:11:20.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f222ed3e700 1 -- 172.21.15.87:0/3033971063 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222815d1a0 con 0x7f22280c3d10 2023-03-30T08:11:20.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f222ed3e700 1 -- 172.21.15.87:0/3033971063 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222815d480 con 0x7f2228160730 2023-03-30T08:11:20.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66aa26c700 1 --2- 172.21.15.87:0/2507762813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a415c340 0x7f66a415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66a9a6b700 1 -- 172.21.15.87:0/2507762813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a415c340 msgr2=0x7f66a415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66a9a6b700 1 --2- 172.21.15.87:0/2507762813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66a415c340 0x7f66a415a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66a9a6b700 1 -- 172.21.15.87:0/2507762813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66a40adc30 msgr2=0x7f66a4159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66a9a6b700 1 --2- 172.21.15.87:0/2507762813 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66a40adc30 0x7f66a4159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66a9a6b700 1 -- 172.21.15.87:0/2507762813 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a00094b0 con 0x7f66a40ac080 2023-03-30T08:11:20.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66a9a6b700 1 --2- 172.21.15.87:0/2507762813 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66a40ac080 0x7f66a41f4a40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f669400e9d0 tx=0x7f669400ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f669a7fc700 1 -- 172.21.15.87:0/2507762813 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694009720 con 0x7f66a40ac080 2023-03-30T08:11:20.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f669a7fc700 1 -- 172.21.15.87:0/2507762813 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6694017c60 con 0x7f66a40ac080 2023-03-30T08:11:20.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f669a7fc700 1 -- 172.21.15.87:0/2507762813 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400c640 con 0x7f66a40ac080 2023-03-30T08:11:20.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7fc84d85a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc848164190 0x7fc8480c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7fb9fc965700 1 Processor -- start 2023-03-30T08:11:20.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7fc84d85a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc848069f00 con 0x7fc8480aea30 2023-03-30T08:11:20.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7fc84d85a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84806cf70 con 0x7fc848163dc0 2023-03-30T08:11:20.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7fc84d85a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84806d810 con 0x7fc848164190 2023-03-30T08:11:20.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7fc84d059700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc8480aea30 0x7fc84806a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48480/0 (socket says 172.21.15.87:48480) 2023-03-30T08:11:20.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7fc84d059700 1 -- 172.21.15.87:0/3520920312 learned_addr learned my addr 172.21.15.87:0/3520920312 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:20.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f264d839700 1 -- 172.21.15.87:0/3930628458 wait complete. 2023-03-30T08:11:20.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f264d839700 1 Processor -- start 2023-03-30T08:11:20.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f66abccf700 1 -- 172.21.15.87:0/2507762813 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a406c420 con 0x7f66a40ac080 2023-03-30T08:11:20.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f66abccf700 1 -- 172.21.15.87:0/2507762813 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a40ca460 con 0x7f66a40ac080 2023-03-30T08:11:20.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f222cada700 1 -- 172.21.15.87:0/3033971063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2228160730 msgr2=0x7f222815ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f222cada700 1 --2- 172.21.15.87:0/3033971063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2228160730 0x7f222815ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f222cada700 1 -- 172.21.15.87:0/3033971063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22280ccc90 msgr2=0x7f222815c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f222cada700 1 --2- 172.21.15.87:0/3033971063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f22280ccc90 0x7f222815c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f222cada700 1 -- 172.21.15.87:0/3033971063 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c0094b0 con 0x7f22280c3d10 2023-03-30T08:11:20.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f8c3e9b4700 1 Processor -- start 2023-03-30T08:11:20.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7f8c3e9b4700 1 -- start start 2023-03-30T08:11:20.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3e9b4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8c30100630 0x7f8c30053950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3e9b4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8c30100a00 0x7f8c30036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3e9b4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c30036cb0 0x7f8c30037b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3e9b4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c30037150 con 0x7f8c30100630 2023-03-30T08:11:20.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3e9b4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c30006f80 con 0x7f8c30100a00 2023-03-30T08:11:20.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3e9b4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c30052b90 con 0x7f8c30036cb0 2023-03-30T08:11:20.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f66abccf700 1 -- 172.21.15.87:0/2507762813 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66a40ac500 con 0x7f66a40ac080 2023-03-30T08:11:20.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7fb9fc965700 1 -- start start 2023-03-30T08:11:20.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fb9fc965700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f0038430 0x7fb9f00e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3d1b1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8c30100a00 0x7f8c30036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.176+0000 7fc847fff700 1 --2- 172.21.15.87:0/3520920312 >> v2:172.21.15.87:3300/0 conn(0x7fc848164190 0x7fc8480c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fc847fff700 1 -- 172.21.15.87:0/3520920312 >> v1:172.21.15.115:6789/0 conn(0x7fc848163dc0 legacy=0x7fc8480c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fc847fff700 1 -- 172.21.15.87:0/3520920312 >> v1:172.21.15.87:6789/0 conn(0x7fc8480aea30 legacy=0x7fc84806a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fc847fff700 1 -- 172.21.15.87:0/3520920312 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84806d250 con 0x7fc848164190 2023-03-30T08:11:20.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3d1b1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8c30100a00 0x7f8c30036770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34180/0 (socket says 172.21.15.87:34180) 2023-03-30T08:11:20.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fc847fff700 1 --2- 172.21.15.87:0/3520920312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc848164190 0x7fc8480c9cd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc834009850 tx=0x7fc834009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe89d3261ae793dc server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3d1b1700 1 -- 172.21.15.87:0/2481594029 learned_addr learned my addr 172.21.15.87:0/2481594029 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fb9fc965700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f003b250 0x7fb9f017ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3e1b3700 1 --2- 172.21.15.87:0/2481594029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c30036cb0 0x7f8c30037b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f264d839700 1 -- start start 2023-03-30T08:11:20.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f264d839700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26480c7780 0x7f26480c1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f6e7f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e7800eff0 0x7f6e7817f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f6e7f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e7800eff0 0x7f6e7817f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34170/0 (socket says 172.21.15.87:34170) 2023-03-30T08:11:20.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3d1b1700 1 -- 172.21.15.87:0/2481594029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c30036cb0 msgr2=0x7f8c30037b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fb9f659c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f0038430 0x7fb9f00e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fb9fc965700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9f0055690 0x7fb9f00e09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fb9fc965700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f004cf00 con 0x7fb9f003b250 2023-03-30T08:11:20.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fb9fc965700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f004cbb0 con 0x7fb9f0055690 2023-03-30T08:11:20.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fb9fc965700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f017bf60 con 0x7fb9f0038430 2023-03-30T08:11:20.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fb9f659c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f0038430 0x7fb9f00e5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:33962/0 (socket says 172.21.15.87:33962) 2023-03-30T08:11:20.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fb9f659c700 1 -- 172.21.15.87:0/1330516292 learned_addr learned my addr 172.21.15.87:0/1330516292 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3d1b1700 1 --2- 172.21.15.87:0/2481594029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c30036cb0 0x7f8c30037b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f6e7f7fe700 1 -- 172.21.15.87:0/3824595650 learned_addr learned my addr 172.21.15.87:0/3824595650 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3d1b1700 1 -- 172.21.15.87:0/2481594029 >> v2:172.21.15.87:3300/0 conn(0x7f8c30100630 msgr2=0x7f8c30053950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3d1b1700 1 --2- 172.21.15.87:0/2481594029 >> v2:172.21.15.87:3300/0 conn(0x7f8c30100630 0x7f8c30053950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3d1b1700 1 -- 172.21.15.87:0/2481594029 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c30052e70 con 0x7f8c30100a00 2023-03-30T08:11:20.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f222cada700 1 --2- 172.21.15.87:0/3033971063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22280c3d10 0x7f222815b440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f221c0090b0 tx=0x7f221c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f6e84d64700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e78058ba0 0x7f6e7804f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f6e7effd700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7803e7b0 0x7f6e7803d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fc8477fe700 1 -- 172.21.15.87:0/3520920312 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834004230 con 0x7fc848164190 2023-03-30T08:11:20.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fc8477fe700 1 -- 172.21.15.87:0/3520920312 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc834004390 con 0x7fc848164190 2023-03-30T08:11:20.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fc8477fe700 1 -- 172.21.15.87:0/3520920312 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340036c0 con 0x7fc848164190 2023-03-30T08:11:20.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fb9f5d9b700 1 --2- 172.21.15.87:0/1330516292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f003b250 0x7fb9f017ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f6e84d64700 1 -- 172.21.15.87:0/3824595650 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e781869f0 con 0x7f6e7803e7b0 2023-03-30T08:11:20.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f6e84d64700 1 -- 172.21.15.87:0/3824595650 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78185e70 con 0x7f6e7800eff0 2023-03-30T08:11:20.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f6e84d64700 1 -- 172.21.15.87:0/3824595650 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78186150 con 0x7f6e78058ba0 2023-03-30T08:11:20.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f8c3d1b1700 1 --2- 172.21.15.87:0/2481594029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c30100a00 0x7f8c30036770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000dfe0 tx=0x7f8c34009980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bbd8ab422c5eaca server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f6e7ffff700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e78058ba0 0x7f6e7804f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f669a7fc700 1 -- 172.21.15.87:0/2507762813 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6694042b20 con 0x7f66a40ac080 2023-03-30T08:11:20.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fb9f659c700 1 -- 172.21.15.87:0/1330516292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9f0055690 msgr2=0x7fb9f00e09b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-30T08:11:20.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fb9f659c700 1 --2- 172.21.15.87:0/1330516292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9f0055690 0x7fb9f00e09b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fb9f659c700 1 -- 172.21.15.87:0/1330516292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f003b250 msgr2=0x7fb9f017ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fb9f659c700 1 --2- 172.21.15.87:0/1330516292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb9f003b250 0x7fb9f017ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fb9f659c700 1 -- 172.21.15.87:0/1330516292 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec009570 con 0x7fb9f0038430 2023-03-30T08:11:20.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f264d839700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26480c3f30 0x7f26481ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fc84d85a700 1 -- 172.21.15.87:0/3520920312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc848164190 msgr2=0x7fc8480c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7fc84d85a700 1 --2- 172.21.15.87:0/3520920312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc848164190 0x7fc8480c9cd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc834009850 tx=0x7fc834009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:20.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f22257fa700 1 -- 172.21.15.87:0/3033971063 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c006ea0 con 0x7f22280c3d10 2023-03-30T08:11:20.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f22257fa700 1 -- 172.21.15.87:0/3033971063 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221c01f070 con 0x7f22280c3d10 2023-03-30T08:11:20.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f22257fa700 1 -- 172.21.15.87:0/3033971063 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c003900 con 0x7f22280c3d10 2023-03-30T08:11:20.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f222ed3e700 1 -- 172.21.15.87:0/3033971063 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22280c9b50 con 0x7f22280c3d10 2023-03-30T08:11:20.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f222ed3e700 1 -- 172.21.15.87:0/3033971063 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22280c9870 con 0x7f22280c3d10 2023-03-30T08:11:20.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f6e7f7fe700 1 -- 172.21.15.87:0/3824595650 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e78058ba0 msgr2=0x7f6e7804f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f6e7f7fe700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e78058ba0 0x7f6e7804f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f6e7f7fe700 1 -- 172.21.15.87:0/3824595650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7803e7b0 msgr2=0x7f6e7803d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f6e7f7fe700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7803e7b0 0x7f6e7803d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.180+0000 7f6e7f7fe700 1 -- 172.21.15.87:0/3824595650 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7803eb80 con 0x7f6e7800eff0 2023-03-30T08:11:20.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f6e7effd700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e7803e7b0 0x7f6e7803d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:20.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7fc84d85a700 1 -- 172.21.15.87:0/3520920312 shutdown_connections 2023-03-30T08:11:20.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7fc84d85a700 1 --2- 172.21.15.87:0/3520920312 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc848164190 0x7fc8480c9cd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7fc84d85a700 1 -- 172.21.15.87:0/3520920312 >> 172.21.15.87:0/3520920312 conn(0x7fc8480cf410 msgr2=0x7fc8480cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f264d839700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26481efd80 0x7f26480c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f264d839700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26480ae110 con 0x7f26480c3f30 2023-03-30T08:11:20.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f264d839700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264806aff0 con 0x7f26480c7780 2023-03-30T08:11:20.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f264d839700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2648207510 con 0x7f26481efd80 2023-03-30T08:11:20.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f264c837700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26480c7780 0x7f26480c1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f264c837700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26480c7780 0x7f26480c1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34194/0 (socket says 172.21.15.87:34194) 2023-03-30T08:11:20.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f264c837700 1 -- 172.21.15.87:0/4037276581 learned_addr learned my addr 172.21.15.87:0/4037276581 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f264d038700 1 --2- 172.21.15.87:0/4037276581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26481efd80 0x7f26480c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f2647fff700 1 --2- 172.21.15.87:0/4037276581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26480c3f30 0x7f26481ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f6e7f7fe700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e7800eff0 0x7f6e7817f770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6e80063a20 tx=0x7f6e800730a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7fc84d85a700 1 -- 172.21.15.87:0/3520920312 shutdown_connections 2023-03-30T08:11:20.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7fb9f659c700 1 --2- 172.21.15.87:0/1330516292 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f0038430 0x7fb9f00e5900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800c500 tx=0x7fb9e800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f8c3c9b0700 1 -- 172.21.15.87:0/2481594029 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3400c040 con 0x7f8c30100a00 2023-03-30T08:11:20.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f2647fff700 1 -- 172.21.15.87:0/4037276581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26481efd80 msgr2=0x7f26480c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f2647fff700 1 --2- 172.21.15.87:0/4037276581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26481efd80 0x7f26480c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f2647fff700 1 -- 172.21.15.87:0/4037276581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26480c7780 msgr2=0x7f26480c1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f2647fff700 1 --2- 172.21.15.87:0/4037276581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26480c7780 0x7f26480c1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f6e6bfff700 1 -- 172.21.15.87:0/3824595650 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80072ce0 con 0x7f6e7800eff0 2023-03-30T08:11:20.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f6e6bfff700 1 -- 172.21.15.87:0/3824595650 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e800678e0 con 0x7f6e7800eff0 2023-03-30T08:11:20.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f6e6bfff700 1 -- 172.21.15.87:0/3824595650 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80066f70 con 0x7f6e7800eff0 2023-03-30T08:11:20.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f2647fff700 1 -- 172.21.15.87:0/4037276581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26480aead0 con 0x7f26480c3f30 2023-03-30T08:11:20.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f669a7fc700 1 --2- 172.21.15.87:0/2507762813 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f66880653f0 0x7f66880678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f669a7fc700 1 -- 172.21.15.87:0/2507762813 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f669408af20 con 0x7f66a40ac080 2023-03-30T08:11:20.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f669a7fc700 1 --2- 172.21.15.87:0/2507762813 >> [v2:172.21.15.87:6809/33777,v1:172.21.15.87:6811/33777] conn(0x7f668806f040 0x7f6688071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f669a7fc700 1 -- 172.21.15.87:0/2507762813 --> [v2:172.21.15.87:6809/33777,v1:172.21.15.87:6811/33777] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6688071b40 con 0x7f668806f040 2023-03-30T08:11:20.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f669a7fc700 1 -- 172.21.15.87:0/2507762813 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f669408b290 con 0x7f66a40ac080 2023-03-30T08:11:20.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f222ed3e700 1 -- 172.21.15.87:0/3033971063 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2208000fc0 con 0x7f22280c3d10 2023-03-30T08:11:20.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f6e84d64700 1 -- 172.21.15.87:0/3824595650 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e78053b40 con 0x7f6e7800eff0 2023-03-30T08:11:20.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7fc84d85a700 1 -- 172.21.15.87:0/3520920312 wait complete. 2023-03-30T08:11:20.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7fb9e6ffd700 1 -- 172.21.15.87:0/1330516292 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e80052d0 con 0x7fb9f0038430 2023-03-30T08:11:20.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f6e84d64700 1 -- 172.21.15.87:0/3824595650 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e78053e20 con 0x7f6e7800eff0 2023-03-30T08:11:20.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7fb9e6ffd700 1 -- 172.21.15.87:0/1330516292 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e8005430 con 0x7fb9f0038430 2023-03-30T08:11:20.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7fb9fc965700 1 -- 172.21.15.87:0/1330516292 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f0053e00 con 0x7fb9f0038430 2023-03-30T08:11:20.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f66a926a700 1 --2- 172.21.15.87:0/2507762813 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f66880653f0 0x7f66880678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7fb9fc965700 1 -- 172.21.15.87:0/1330516292 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f0007450 con 0x7fb9f0038430 2023-03-30T08:11:20.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f8c3c9b0700 1 -- 172.21.15.87:0/2481594029 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c34011ab0 con 0x7f8c30100a00 2023-03-30T08:11:20.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7fb9e6ffd700 1 -- 172.21.15.87:0/1330516292 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e80055a0 con 0x7fb9f0038430 2023-03-30T08:11:20.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f66aa26c700 1 --2- 172.21.15.87:0/2507762813 >> [v2:172.21.15.87:6809/33777,v1:172.21.15.87:6811/33777] conn(0x7f668806f040 0x7f6688071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f66a926a700 1 --2- 172.21.15.87:0/2507762813 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f66880653f0 0x7f66880678a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f66a00090b0 tx=0x7f66a001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/2481594029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c30100a00 msgr2=0x7f8c30036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f8c3e9b4700 1 --2- 172.21.15.87:0/2481594029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c30100a00 0x7f8c30036770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000dfe0 tx=0x7f8c34009980 comp rx=0 tx=0).stop 2023-03-30T08:11:20.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7fc84d85a700 1 Processor -- start 2023-03-30T08:11:20.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7fc84d85a700 1 -- start start 2023-03-30T08:11:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f2647fff700 1 --2- 172.21.15.87:0/4037276581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26480c3f30 0x7f26481ef840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f263800e820 tx=0x7f263800eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f26457fa700 1 -- 172.21.15.87:0/4037276581 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638013680 con 0x7f26480c3f30 2023-03-30T08:11:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f26457fa700 1 -- 172.21.15.87:0/4037276581 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26380137e0 con 0x7f26480c3f30 2023-03-30T08:11:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f26457fa700 1 -- 172.21.15.87:0/4037276581 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638013b90 con 0x7f26480c3f30 2023-03-30T08:11:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f264d839700 1 -- 172.21.15.87:0/4037276581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26480af450 con 0x7f26480c3f30 2023-03-30T08:11:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.184+0000 7f264d839700 1 -- 172.21.15.87:0/4037276581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26480aec60 con 0x7f26480c3f30 2023-03-30T08:11:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fb9fc965700 1 -- 172.21.15.87:0/1330516292 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb9dc000fc0 con 0x7fb9f0038430 2023-03-30T08:11:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7f264d839700 1 -- 172.21.15.87:0/4037276581 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2628000fc0 con 0x7f26480c3f30 2023-03-30T08:11:20.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7f66aa26c700 1 --2- 172.21.15.87:0/2507762813 >> [v2:172.21.15.87:6809/33777,v1:172.21.15.87:6811/33777] conn(0x7f668806f040 0x7f6688071470 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc84d85a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8480aea30 0x7fc84814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7f22257fa700 1 -- 172.21.15.87:0/3033971063 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f221c003a60 con 0x7f22280c3d10 2023-03-30T08:11:20.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc84d85a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc848163dc0 0x7fc8480c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc84d85a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc848164190 0x7fc8480c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc84d85a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8480c76c0 con 0x7fc848164190 2023-03-30T08:11:20.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc84d85a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc848160580 con 0x7fc8480aea30 2023-03-30T08:11:20.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc84d85a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc848160860 con 0x7fc848163dc0 2023-03-30T08:11:20.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7f6e84d64700 1 -- 172.21.15.87:0/3824595650 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e7804cc80 con 0x7f6e7800eff0 2023-03-30T08:11:20.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc84c858700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8480aea30 0x7fc84814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc84c858700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8480aea30 0x7fc84814e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34208/0 (socket says 172.21.15.87:34208) 2023-03-30T08:11:20.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc84c858700 1 -- 172.21.15.87:0/1464823856 learned_addr learned my addr 172.21.15.87:0/1464823856 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc847fff700 1 --2- 172.21.15.87:0/1464823856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc848163dc0 0x7fc8480c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fd60cd26700 1 Processor -- start 2023-03-30T08:11:20.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7f6e6bfff700 1 -- 172.21.15.87:0/3824595650 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6e800670d0 con 0x7f6e7800eff0 2023-03-30T08:11:20.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fd60cd26700 1 -- start start 2023-03-30T08:11:20.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fb9e6ffd700 1 -- 172.21.15.87:0/1330516292 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fb9e80038e0 con 0x7fb9f0038430 2023-03-30T08:11:20.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc84c858700 1 -- 172.21.15.87:0/1464823856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc848163dc0 msgr2=0x7fc8480c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc84c858700 1 --2- 172.21.15.87:0/1464823856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc848163dc0 0x7fc8480c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc84c858700 1 -- 172.21.15.87:0/1464823856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc848164190 msgr2=0x7fc8480c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc84c858700 1 --2- 172.21.15.87:0/1464823856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc848164190 0x7fc8480c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc84c858700 1 -- 172.21.15.87:0/1464823856 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340094b0 con 0x7fc8480aea30 2023-03-30T08:11:20.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fb9e6ffd700 1 --2- 172.21.15.87:0/1330516292 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb9d8065440 0x7fb9d80678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fc84c858700 1 --2- 172.21.15.87:0/1464823856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8480aea30 0x7fc84814e0f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00c4e0 tx=0x7fc83c00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7f6e6bfff700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6e640654c0 0x7f6e64067970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60cd26700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd608156da0 0x7fd60813fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7fb9e6ffd700 1 -- 172.21.15.87:0/1330516292 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb9e8081e40 con 0x7fb9f0038430 2023-03-30T08:11:20.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fb9e6ffd700 1 --2- 172.21.15.87:0/1330516292 >> [v2:172.21.15.115:6816/33989,v1:172.21.15.115:6817/33989] conn(0x7fb9d806f110 0x7fb9d8071540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fb9e6ffd700 1 -- 172.21.15.87:0/1330516292 --> [v2:172.21.15.115:6816/33989,v1:172.21.15.115:6817/33989] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9d8071c10 con 0x7fb9d806f110 2023-03-30T08:11:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fb9e6ffd700 1 -- 172.21.15.87:0/1330516292 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9e8084550 con 0x7fb9f0038430 2023-03-30T08:11:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/2481594029 shutdown_connections 2023-03-30T08:11:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7f8c3e9b4700 1 --2- 172.21.15.87:0/2481594029 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c30036cb0 0x7f8c30037b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f669a7fc700 1 -- 172.21.15.87:0/2507762813 <== osd.3 v2:172.21.15.87:6809/33777 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6688071b40 con 0x7f668806f040 2023-03-30T08:11:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7f8c3e9b4700 1 --2- 172.21.15.87:0/2481594029 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c30100a00 0x7f8c30036770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7f8c3e9b4700 1 --2- 172.21.15.87:0/2481594029 >> v2:172.21.15.87:3300/0 conn(0x7f8c30100630 0x7f8c30053950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.188+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/2481594029 >> 172.21.15.87:0/2481594029 conn(0x7f8c30051770 msgr2=0x7f8c30051b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fb9f5d9b700 1 --2- 172.21.15.87:0/1330516292 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb9d8065440 0x7fb9d80678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fc8457fa700 1 -- 172.21.15.87:0/1464823856 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c011790 con 0x7fc8480aea30 2023-03-30T08:11:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fc8457fa700 1 -- 172.21.15.87:0/1464823856 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c011910 con 0x7fc8480aea30 2023-03-30T08:11:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fc8457fa700 1 -- 172.21.15.87:0/1464823856 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c011cc0 con 0x7fc8480aea30 2023-03-30T08:11:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd608156da0 0x7fd60813fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd608156da0 0x7fd60813fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34216/0 (socket says 172.21.15.87:34216) 2023-03-30T08:11:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f6e7effd700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6e640654c0 0x7f6e64067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fc84d85a700 1 -- 172.21.15.87:0/1464823856 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84806cc40 con 0x7fc8480aea30 2023-03-30T08:11:20.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f26457fa700 1 -- 172.21.15.87:0/4037276581 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f2638013cf0 con 0x7f26480c3f30 2023-03-30T08:11:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fc84d85a700 1 -- 172.21.15.87:0/1464823856 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84806d530 con 0x7fc8480aea30 2023-03-30T08:11:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fb9f6d9d700 1 --2- 172.21.15.87:0/1330516292 >> [v2:172.21.15.115:6816/33989,v1:172.21.15.115:6817/33989] conn(0x7fb9d806f110 0x7fb9d8071540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f26457fa700 1 --2- 172.21.15.87:0/4037276581 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2634065440 0x7f26340678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f6e6bfff700 1 -- 172.21.15.87:0/3824595650 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6e80099070 con 0x7f6e7800eff0 2023-03-30T08:11:20.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60659c700 1 -- 172.21.15.87:0/2210046215 learned_addr learned my addr 172.21.15.87:0/2210046215 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f6e6bfff700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.87:6808/33775,v1:172.21.15.87:6810/33775] conn(0x7f6e6406f110 0x7f6e64071540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f6e6bfff700 1 -- 172.21.15.87:0/3824595650 --> [v2:172.21.15.87:6808/33775,v1:172.21.15.87:6810/33775] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e64071c10 con 0x7f6e6406f110 2023-03-30T08:11:20.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f6e6bfff700 1 -- 172.21.15.87:0/3824595650 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e800ca4b0 con 0x7f6e7800eff0 2023-03-30T08:11:20.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60cd26700 1 -- 172.21.15.87:0/2210046215 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd608161110 con 0x7fd6080cdaf0 2023-03-30T08:11:20.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60cd26700 1 -- 172.21.15.87:0/2210046215 --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6081601b0 con 0x7fd6081427f0 2023-03-30T08:11:20.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60cd26700 1 -- 172.21.15.87:0/2210046215 --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd608160490 con 0x7fd608156da0 2023-03-30T08:11:20.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f26457fa700 1 -- 172.21.15.87:0/4037276581 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2638082100 con 0x7f26480c3f30 2023-03-30T08:11:20.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fb9f5d9b700 1 --2- 172.21.15.87:0/1330516292 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb9d8065440 0x7fb9d80678f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8069250 tx=0x7fb9f8061920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fb9f6d9d700 1 --2- 172.21.15.87:0/1330516292 >> [v2:172.21.15.115:6816/33989,v1:172.21.15.115:6817/33989] conn(0x7fb9d806f110 0x7fb9d8071540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60559a700 1 -- 172.21.15.87:0/2210046215 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4035025288 0 0) 0x7fd608161110 con 0x7fd6080cdaf0 2023-03-30T08:11:20.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60559a700 1 -- 172.21.15.87:0/2210046215 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f00035d0 con 0x7fd6080cdaf0 2023-03-30T08:11:20.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f6e7ffff700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.87:6808/33775,v1:172.21.15.87:6810/33775] conn(0x7f6e6406f110 0x7f6e64071540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f26457fa700 1 --2- 172.21.15.87:0/4037276581 >> [v2:172.21.15.87:6824/33776,v1:172.21.15.87:6825/33776] conn(0x7f263406f110 0x7f2634071540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f26457fa700 1 -- 172.21.15.87:0/4037276581 --> [v2:172.21.15.87:6824/33776,v1:172.21.15.87:6825/33776] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2634071c10 con 0x7f263406f110 2023-03-30T08:11:20.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f26457fa700 1 -- 172.21.15.87:0/4037276581 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2638082480 con 0x7f26480c3f30 2023-03-30T08:11:20.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fc84d85a700 1 -- 172.21.15.87:0/1464823856 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc828000fc0 con 0x7fc8480aea30 2023-03-30T08:11:20.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f264c837700 1 --2- 172.21.15.87:0/4037276581 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2634065440 0x7f26340678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/2481594029 shutdown_connections 2023-03-30T08:11:20.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/2481594029 wait complete. 2023-03-30T08:11:20.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60559a700 1 -- 172.21.15.87:0/2210046215 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 314215470 0 0) 0x7fd5f00035d0 con 0x7fd6080cdaf0 2023-03-30T08:11:20.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60559a700 1 -- 172.21.15.87:0/2210046215 >> v2:172.21.15.115:3300/0 conn(0x7fd608156da0 msgr2=0x7fd60813fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60559a700 1 --2- 172.21.15.87:0/2210046215 >> v2:172.21.15.115:3300/0 conn(0x7fd608156da0 0x7fd60813fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60559a700 1 -- 172.21.15.87:0/2210046215 >> v1:172.21.15.115:6789/0 conn(0x7fd6081427f0 legacy=0x7fd6080cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60559a700 1 -- 172.21.15.87:0/2210046215 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd608160770 con 0x7fd6080cdaf0 2023-03-30T08:11:20.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60559a700 1 -- 172.21.15.87:0/2210046215 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7fd6000016c0 con 0x7fd6080cdaf0 2023-03-30T08:11:20.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60659c700 1 --2- 172.21.15.87:0/2210046215 >> v2:172.21.15.115:3300/0 conn(0x7fd608156da0 0x7fd60813fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:20.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60559a700 1 -- 172.21.15.87:0/2210046215 >> v1:172.21.15.87:6789/0 conn(0x7fd6080cdaf0 legacy=0x7fd60815cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60559a700 1 --2- 172.21.15.87:0/2210046215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f0003a20 0x7fd5f0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60559a700 1 --2- 172.21.15.87:0/2210046215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f0004870 0x7fd5f0004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60559a700 1 --2- 172.21.15.87:0/2210046215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5f0005270 0x7fd5f000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60559a700 1 -- 172.21.15.87:0/2210046215 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd608160490 con 0x7fd5f0004870 2023-03-30T08:11:20.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60559a700 1 -- 172.21.15.87:0/2210046215 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f000c180 con 0x7fd5f0005270 2023-03-30T08:11:20.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60559a700 1 -- 172.21.15.87:0/2210046215 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f000c340 con 0x7fd5f0003a20 2023-03-30T08:11:20.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f6e7effd700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6e640654c0 0x7f6e64067970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e780dee10 tx=0x7f6e74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd60659c700 1 --2- 172.21.15.87:0/2210046215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f0003a20 0x7fd5f0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7fd605d9b700 1 --2- 172.21.15.87:0/2210046215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f0004870 0x7fd5f0004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f264d038700 1 --2- 172.21.15.87:0/4037276581 >> [v2:172.21.15.87:6824/33776,v1:172.21.15.87:6825/33776] conn(0x7f263406f110 0x7f2634071540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.192+0000 7f264d038700 1 --2- 172.21.15.87:0/4037276581 >> [v2:172.21.15.87:6824/33776,v1:172.21.15.87:6825/33776] conn(0x7f263406f110 0x7f2634071540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fb9e6ffd700 1 -- 172.21.15.87:0/1330516292 <== osd.5 v2:172.21.15.115:6816/33989 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb9d8071c10 con 0x7fb9d806f110 2023-03-30T08:11:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f6e7ffff700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.87:6808/33775,v1:172.21.15.87:6810/33775] conn(0x7f6e6406f110 0x7f6e64071540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60659c700 1 -- 172.21.15.87:0/2210046215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5f0005270 msgr2=0x7fd5f000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60659c700 1 --2- 172.21.15.87:0/2210046215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5f0005270 0x7fd5f000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60659c700 1 -- 172.21.15.87:0/2210046215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f0004870 msgr2=0x7fd5f0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60659c700 1 --2- 172.21.15.87:0/2210046215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f0004870 0x7fd5f0004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60659c700 1 -- 172.21.15.87:0/2210046215 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd608160770 con 0x7fd5f0003a20 2023-03-30T08:11:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60759e700 1 -- 172.21.15.87:0/2210046215 reap_dead start 2023-03-30T08:11:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd605d9b700 1 --2- 172.21.15.87:0/2210046215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f0004870 0x7fd5f0004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f22257fa700 1 --2- 172.21.15.87:0/3033971063 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f220c0654c0 0x7f220c067970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f22257fa700 1 -- 172.21.15.87:0/3033971063 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f221c021070 con 0x7f22280c3d10 2023-03-30T08:11:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f22257fa700 1 --2- 172.21.15.87:0/3033971063 >> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] conn(0x7f220c06f190 0x7f220c0715c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f22257fa700 1 -- 172.21.15.87:0/3033971063 --> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f220c071c90 con 0x7f220c06f190 2023-03-30T08:11:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f22257fa700 1 -- 172.21.15.87:0/3033971063 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f221c084720 con 0x7f22280c3d10 2023-03-30T08:11:20.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60659c700 1 --2- 172.21.15.87:0/2210046215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f0003a20 0x7fd5f0003e10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8009a50 tx=0x7fd5f00058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81d68bf1d1a35908 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f26457fa700 1 -- 172.21.15.87:0/4037276581 <== osd.1 v2:172.21.15.87:6824/33776 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2634071c10 con 0x7f263406f110 2023-03-30T08:11:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60559a700 1 -- 172.21.15.87:0/2210046215 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f800c070 con 0x7fd5f0003a20 2023-03-30T08:11:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60559a700 1 -- 172.21.15.87:0/2210046215 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f800e860 con 0x7fd5f0003a20 2023-03-30T08:11:20.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f222d2db700 1 --2- 172.21.15.87:0/3033971063 >> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] conn(0x7f220c06f190 0x7f220c0715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f8c3e9b4700 1 Processor -- start 2023-03-30T08:11:20.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f222d2db700 1 --2- 172.21.15.87:0/3033971063 >> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] conn(0x7f220c06f190 0x7f220c0715c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f22257fa700 1 -- 172.21.15.87:0/3033971063 <== osd.0 v2:172.21.15.87:6800/33774 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f220c071c90 con 0x7f220c06f190 2023-03-30T08:11:20.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f2227fff700 1 --2- 172.21.15.87:0/3033971063 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f220c0654c0 0x7f220c067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f2227fff700 1 --2- 172.21.15.87:0/3033971063 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f220c0654c0 0x7f220c067970 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2220002370 tx=0x7f2220002300 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f264c837700 1 --2- 172.21.15.87:0/4037276581 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2634065440 0x7f26340678f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f263c000ff0 tx=0x7f263c005040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f6e6bfff700 1 -- 172.21.15.87:0/3824595650 <== osd.2 v2:172.21.15.87:6808/33775 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6e64071c10 con 0x7f6e6406f110 2023-03-30T08:11:20.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7fc8457fa700 1 -- 172.21.15.87:0/1464823856 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc83c012420 con 0x7fc8480aea30 2023-03-30T08:11:20.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7fc8457fa700 1 --2- 172.21.15.87:0/1464823856 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc82c065440 0x7fc82c0678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7fc8457fa700 1 -- 172.21.15.87:0/1464823856 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc83c082fb0 con 0x7fc8480aea30 2023-03-30T08:11:20.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7fc8457fa700 1 --2- 172.21.15.87:0/1464823856 >> [v2:172.21.15.115:6800/33985,v1:172.21.15.115:6801/33985] conn(0x7fc82c06f110 0x7fc82c071540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7fc8457fa700 1 -- 172.21.15.87:0/1464823856 --> [v2:172.21.15.115:6800/33985,v1:172.21.15.115:6801/33985] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc82c071c10 con 0x7fc82c06f110 2023-03-30T08:11:20.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7fc8457fa700 1 -- 172.21.15.87:0/1464823856 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc83c083450 con 0x7fc8480aea30 2023-03-30T08:11:20.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7fc847fff700 1 --2- 172.21.15.87:0/1464823856 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc82c065440 0x7fc82c0678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7fc84d059700 1 --2- 172.21.15.87:0/1464823856 >> [v2:172.21.15.115:6800/33985,v1:172.21.15.115:6801/33985] conn(0x7fc82c06f110 0x7fc82c071540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7fc84d059700 1 --2- 172.21.15.87:0/1464823856 >> [v2:172.21.15.115:6800/33985,v1:172.21.15.115:6801/33985] conn(0x7fc82c06f110 0x7fc82c071540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.204+0000 7fc847fff700 1 --2- 172.21.15.87:0/1464823856 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc82c065440 0x7fc82c0678f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc834009850 tx=0x7fc834008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.204+0000 7fc8457fa700 1 -- 172.21.15.87:0/1464823856 <== osd.4 v2:172.21.15.115:6800/33985 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc82c071c10 con 0x7fc82c06f110 2023-03-30T08:11:20.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f8c3e9b4700 1 -- start start 2023-03-30T08:11:20.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f8c3e9b4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c30036cb0 0x7f8c300fdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f8c3e9b4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c30100630 0x7f8c3004e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7f8c3e9b4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c30100a00 0x7f8c30102270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c3d9b2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c30036cb0 0x7f8c300fdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c3d9b2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c30036cb0 0x7f8c300fdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:34004/0 (socket says 172.21.15.87:34004) 2023-03-30T08:11:20.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c3e9b4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300fee10 con 0x7f8c30100630 2023-03-30T08:11:20.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c3e9b4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3004eb60 con 0x7f8c30100a00 2023-03-30T08:11:20.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c3e9b4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300fe200 con 0x7f8c30036cb0 2023-03-30T08:11:20.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c3d9b2700 1 -- 172.21.15.87:0/1134208711 learned_addr learned my addr 172.21.15.87:0/1134208711 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c3e1b3700 1 --2- 172.21.15.87:0/1134208711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c30100a00 0x7f8c30102270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c3d9b2700 1 -- 172.21.15.87:0/1134208711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c30100a00 msgr2=0x7f8c30102270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c3d9b2700 1 --2- 172.21.15.87:0/1134208711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c30100a00 0x7f8c30102270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c3d9b2700 1 -- 172.21.15.87:0/1134208711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c30100630 msgr2=0x7f8c3004e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c3d9b2700 1 --2- 172.21.15.87:0/1134208711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8c30100630 0x7f8c3004e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c3d9b2700 1 -- 172.21.15.87:0/1134208711 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3400d040 con 0x7f8c30036cb0 2023-03-30T08:11:20.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c3d9b2700 1 --2- 172.21.15.87:0/1134208711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c30036cb0 0x7f8c300fdc20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8c380727f0 tx=0x7f8c3804e9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c2e7fc700 1 -- 172.21.15.87:0/1134208711 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38066f70 con 0x7f8c30036cb0 2023-03-30T08:11:20.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c2e7fc700 1 -- 172.21.15.87:0/1134208711 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c380670d0 con 0x7f8c30036cb0 2023-03-30T08:11:20.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c2e7fc700 1 -- 172.21.15.87:0/1134208711 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38080640 con 0x7f8c30036cb0 2023-03-30T08:11:20.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/1134208711 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c30053430 con 0x7f8c30036cb0 2023-03-30T08:11:20.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/1134208711 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c30053150 con 0x7f8c30036cb0 2023-03-30T08:11:20.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.204+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/1134208711 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c30053e90 con 0x7f8c30036cb0 2023-03-30T08:11:20.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.204+0000 7f8c2e7fc700 1 -- 172.21.15.87:0/1134208711 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f8c380807a0 con 0x7f8c30036cb0 2023-03-30T08:11:20.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.204+0000 7f8c2e7fc700 1 --2- 172.21.15.87:0/1134208711 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8c1c0654c0 0x7f8c1c067970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.204+0000 7f8c2e7fc700 1 -- 172.21.15.87:0/1134208711 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c380eb640 con 0x7f8c30036cb0 2023-03-30T08:11:20.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.204+0000 7f8c2e7fc700 1 --2- 172.21.15.87:0/1134208711 >> [v2:172.21.15.115:6824/33987,v1:172.21.15.115:6825/33987] conn(0x7f8c1c06f190 0x7f8c1c0715c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.204+0000 7f8c2e7fc700 1 -- 172.21.15.87:0/1134208711 --> [v2:172.21.15.115:6824/33987,v1:172.21.15.115:6825/33987] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c1c071c90 con 0x7f8c1c06f190 2023-03-30T08:11:20.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.204+0000 7f8c2e7fc700 1 -- 172.21.15.87:0/1134208711 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c380eb9f0 con 0x7f8c30036cb0 2023-03-30T08:11:20.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.204+0000 7f8c3d1b1700 1 --2- 172.21.15.87:0/1134208711 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8c1c0654c0 0x7f8c1c067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60cd26700 1 -- 172.21.15.87:0/2210046215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f0003a20 msgr2=0x7fd5f0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60cd26700 1 --2- 172.21.15.87:0/2210046215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f0003a20 0x7fd5f0003e10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8009a50 tx=0x7fd5f00058a0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60cd26700 1 -- 172.21.15.87:0/2210046215 shutdown_connections 2023-03-30T08:11:20.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60cd26700 1 --2- 172.21.15.87:0/2210046215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f0003a20 0x7fd5f0003e10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60cd26700 1 -- 172.21.15.87:0/2210046215 >> 172.21.15.87:0/2210046215 conn(0x7fd60806b1c0 msgr2=0x7fd60806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60cd26700 1 -- 172.21.15.87:0/2210046215 shutdown_connections 2023-03-30T08:11:20.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.196+0000 7fd60cd26700 1 -- 172.21.15.87:0/2210046215 wait complete. 2023-03-30T08:11:20.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7fd60cd26700 1 Processor -- start 2023-03-30T08:11:20.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.200+0000 7fd60cd26700 1 -- start start 2023-03-30T08:11:20.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.204+0000 7fd60cd26700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f0003a20 0x7fd6080ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.204+0000 7fd60cd26700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6080b50d0 0x7fd6080b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.204+0000 7fd60cd26700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6080b8320 0x7fd6080b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.204+0000 7f8c3e1b3700 1 --2- 172.21.15.87:0/1134208711 >> [v2:172.21.15.115:6824/33987,v1:172.21.15.115:6825/33987] conn(0x7f8c1c06f190 0x7f8c1c0715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.204+0000 7f8c3d1b1700 1 --2- 172.21.15.87:0/1134208711 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8c1c0654c0 0x7f8c1c067970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c300f9500 tx=0x7f8c34014000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd60659c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f0003a20 0x7fd6080ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd60659c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f0003a20 0x7fd6080ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:34008/0 (socket says 172.21.15.87:34008) 2023-03-30T08:11:20.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7f8c3e1b3700 1 --2- 172.21.15.87:0/1134208711 >> [v2:172.21.15.115:6824/33987,v1:172.21.15.115:6825/33987] conn(0x7f8c1c06f190 0x7f8c1c0715c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd60cd26700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6081fe800 con 0x7fd6080b8320 2023-03-30T08:11:20.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd60759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6080b8320 0x7fd6080b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd60cd26700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080b6d40 con 0x7fd6080b50d0 2023-03-30T08:11:20.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd60cd26700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080b7020 con 0x7fd5f0003a20 2023-03-30T08:11:20.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd60759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6080b8320 0x7fd6080b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51928/0 (socket says 172.21.15.87:51928) 2023-03-30T08:11:20.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd60759e700 1 -- 172.21.15.87:0/1658961545 learned_addr learned my addr 172.21.15.87:0/1658961545 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd605d9b700 1 --2- 172.21.15.87:0/1658961545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6080b50d0 0x7fd6080b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7f8c2e7fc700 1 -- 172.21.15.87:0/1134208711 <== osd.6 v2:172.21.15.115:6824/33987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8c1c071c90 con 0x7f8c1c06f190 2023-03-30T08:11:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd605d9b700 1 -- 172.21.15.87:0/1658961545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f0003a20 msgr2=0x7fd6080ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd605d9b700 1 --2- 172.21.15.87:0/1658961545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f0003a20 0x7fd6080ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd605d9b700 1 -- 172.21.15.87:0/1658961545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6080b8320 msgr2=0x7fd6080b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd605d9b700 1 --2- 172.21.15.87:0/1658961545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6080b8320 0x7fd6080b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd605d9b700 1 -- 172.21.15.87:0/1658961545 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd608160d30 con 0x7fd6080b50d0 2023-03-30T08:11:20.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd605d9b700 1 --2- 172.21.15.87:0/1658961545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6080b50d0 0x7fd6080b7de0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd608063b20 tx=0x7fd5fc00f9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd60759e700 1 --2- 172.21.15.87:0/1658961545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd6080b8320 0x7fd6080b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:20.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd5f6ffd700 1 -- 172.21.15.87:0/1658961545 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0052e0 con 0x7fd6080b50d0 2023-03-30T08:11:20.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd5f6ffd700 1 -- 172.21.15.87:0/1658961545 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc005440 con 0x7fd6080b50d0 2023-03-30T08:11:20.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd60cd26700 1 -- 172.21.15.87:0/1658961545 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd608160a50 con 0x7fd6080b50d0 2023-03-30T08:11:20.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd60659c700 1 --2- 172.21.15.87:0/1658961545 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f0003a20 0x7fd6080ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:20.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd60cd26700 1 -- 172.21.15.87:0/1658961545 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd608142c90 con 0x7fd6080b50d0 2023-03-30T08:11:20.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.208+0000 7fd5f6ffd700 1 -- 172.21.15.87:0/1658961545 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0038e0 con 0x7fd6080b50d0 2023-03-30T08:11:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.212+0000 7fd60cd26700 1 -- 172.21.15.87:0/1658961545 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd5ec000fc0 con 0x7fd6080b50d0 2023-03-30T08:11:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.212+0000 7fd5f6ffd700 1 -- 172.21.15.87:0/1658961545 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd5fc003a40 con 0x7fd6080b50d0 2023-03-30T08:11:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.212+0000 7fd5f6ffd700 1 --2- 172.21.15.87:0/1658961545 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5e80654c0 0x7fd5e8067970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.212+0000 7fd5f6ffd700 1 -- 172.21.15.87:0/1658961545 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd5fc082ae0 con 0x7fd6080b50d0 2023-03-30T08:11:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.216+0000 7fd5f6ffd700 1 --2- 172.21.15.87:0/1658961545 >> [v2:172.21.15.115:6808/33986,v1:172.21.15.115:6809/33986] conn(0x7fd5e806f020 0x7fd5e8071450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.216+0000 7fd5f6ffd700 1 -- 172.21.15.87:0/1658961545 --> [v2:172.21.15.115:6808/33986,v1:172.21.15.115:6809/33986] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd5e8071b20 con 0x7fd5e806f020 2023-03-30T08:11:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.216+0000 7fd5f6ffd700 1 -- 172.21.15.87:0/1658961545 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5fc082e90 con 0x7fd6080b50d0 2023-03-30T08:11:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.216+0000 7fd60659c700 1 --2- 172.21.15.87:0/1658961545 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5e80654c0 0x7fd5e8067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.216+0000 7fd60759e700 1 --2- 172.21.15.87:0/1658961545 >> [v2:172.21.15.115:6808/33986,v1:172.21.15.115:6809/33986] conn(0x7fd5e806f020 0x7fd5e8071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.216+0000 7fd60759e700 1 --2- 172.21.15.87:0/1658961545 >> [v2:172.21.15.115:6808/33986,v1:172.21.15.115:6809/33986] conn(0x7fd5e806f020 0x7fd5e8071450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.216+0000 7fd60659c700 1 --2- 172.21.15.87:0/1658961545 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5e80654c0 0x7fd5e8067970 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8016040 tx=0x7fd5f801e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.220+0000 7fd5f6ffd700 1 -- 172.21.15.87:0/1658961545 <== osd.7 v2:172.21.15.115:6808/33986 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd5e8071b20 con 0x7fd5e806f020 2023-03-30T08:11:20.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.220+0000 7f66abccf700 1 -- 172.21.15.87:0/2507762813 --> [v2:172.21.15.87:6809/33777,v1:172.21.15.87:6811/33777] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f66a40733a0 con 0x7f668806f040 2023-03-30T08:11:20.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.220+0000 7f669a7fc700 1 -- 172.21.15.87:0/2507762813 <== osd.3 v2:172.21.15.87:6809/33777 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f66a40733a0 con 0x7f668806f040 2023-03-30T08:11:20.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.220+0000 7f6687fff700 1 -- 172.21.15.87:0/2507762813 >> [v2:172.21.15.87:6809/33777,v1:172.21.15.87:6811/33777] conn(0x7f668806f040 msgr2=0x7f6688071470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.220+0000 7f6687fff700 1 --2- 172.21.15.87:0/2507762813 >> [v2:172.21.15.87:6809/33777,v1:172.21.15.87:6811/33777] conn(0x7f668806f040 0x7f6688071470 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.220+0000 7f6687fff700 1 -- 172.21.15.87:0/2507762813 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f66880653f0 msgr2=0x7f66880678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.224+0000 7f6687fff700 1 --2- 172.21.15.87:0/2507762813 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f66880653f0 0x7f66880678a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f66a00090b0 tx=0x7f66a001c040 comp rx=0 tx=0).stop 2023-03-30T08:11:20.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.224+0000 7f6687fff700 1 -- 172.21.15.87:0/2507762813 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66a40ac080 msgr2=0x7f66a41f4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.224+0000 7f6687fff700 1 --2- 172.21.15.87:0/2507762813 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66a40ac080 0x7f66a41f4a40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f669400e9d0 tx=0x7f669400ece0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.224+0000 7f66aa26c700 1 -- 172.21.15.87:0/2507762813 reap_dead start 2023-03-30T08:11:20.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.224+0000 7f6687fff700 1 -- 172.21.15.87:0/2507762813 shutdown_connections 2023-03-30T08:11:20.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.224+0000 7f6687fff700 1 -- 172.21.15.87:0/2507762813 >> 172.21.15.87:0/2507762813 conn(0x7f66a40cf410 msgr2=0x7f66a406cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.224+0000 7f6687fff700 1 -- 172.21.15.87:0/2507762813 shutdown_connections 2023-03-30T08:11:20.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.224+0000 7f6687fff700 1 -- 172.21.15.87:0/2507762813 wait complete. 2023-03-30T08:11:20.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.224+0000 7f222ed3e700 1 -- 172.21.15.87:0/3033971063 --> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2208002d90 con 0x7f220c06f190 2023-03-30T08:11:20.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.224+0000 7fb9fc965700 1 -- 172.21.15.87:0/1330516292 --> [v2:172.21.15.115:6816/33989,v1:172.21.15.115:6817/33989] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb9dc002d60 con 0x7fb9d806f110 2023-03-30T08:11:20.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.224+0000 7f22257fa700 1 -- 172.21.15.87:0/3033971063 <== osd.0 v2:172.21.15.87:6800/33774 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2208002d90 con 0x7f220c06f190 2023-03-30T08:11:20.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.224+0000 7fb9e6ffd700 1 -- 172.21.15.87:0/1330516292 <== osd.5 v2:172.21.15.115:6816/33989 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb9dc002d60 con 0x7fb9d806f110 2023-03-30T08:11:20.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7fb9e4ff9700 1 -- 172.21.15.87:0/1330516292 >> [v2:172.21.15.115:6816/33989,v1:172.21.15.115:6817/33989] conn(0x7fb9d806f110 msgr2=0x7fb9d8071540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7fb9e4ff9700 1 --2- 172.21.15.87:0/1330516292 >> [v2:172.21.15.115:6816/33989,v1:172.21.15.115:6817/33989] conn(0x7fb9d806f110 0x7fb9d8071540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7fb9e4ff9700 1 -- 172.21.15.87:0/1330516292 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb9d8065440 msgr2=0x7fb9d80678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7fb9e4ff9700 1 --2- 172.21.15.87:0/1330516292 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb9d8065440 0x7fb9d80678f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8069250 tx=0x7fb9f8061920 comp rx=0 tx=0).stop 2023-03-30T08:11:20.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7fb9e4ff9700 1 -- 172.21.15.87:0/1330516292 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f0038430 msgr2=0x7fb9f00e5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7fb9e4ff9700 1 --2- 172.21.15.87:0/1330516292 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9f0038430 0x7fb9f00e5900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800c500 tx=0x7fb9e800c810 comp rx=0 tx=0).stop 2023-03-30T08:11:20.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7fb9f6d9d700 1 -- 172.21.15.87:0/1330516292 reap_dead start 2023-03-30T08:11:20.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7fb9e4ff9700 1 -- 172.21.15.87:0/1330516292 shutdown_connections 2023-03-30T08:11:20.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7fb9e4ff9700 1 -- 172.21.15.87:0/1330516292 >> 172.21.15.87:0/1330516292 conn(0x7fb9f0055b40 msgr2=0x7fb9f0058ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f222ed3e700 1 -- 172.21.15.87:0/3033971063 >> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] conn(0x7f220c06f190 msgr2=0x7f220c0715c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7fb9e4ff9700 1 -- 172.21.15.87:0/1330516292 shutdown_connections 2023-03-30T08:11:20.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7fb9e4ff9700 1 -- 172.21.15.87:0/1330516292 wait complete. 2023-03-30T08:11:20.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f6e84d64700 1 -- 172.21.15.87:0/3824595650 --> [v2:172.21.15.87:6808/33775,v1:172.21.15.87:6810/33775] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6e78038e60 con 0x7f6e6406f110 2023-03-30T08:11:20.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f222ed3e700 1 --2- 172.21.15.87:0/3033971063 >> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] conn(0x7f220c06f190 0x7f220c0715c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f222ed3e700 1 -- 172.21.15.87:0/3033971063 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f220c0654c0 msgr2=0x7f220c067970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f222ed3e700 1 --2- 172.21.15.87:0/3033971063 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f220c0654c0 0x7f220c067970 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2220002370 tx=0x7f2220002300 comp rx=0 tx=0).stop 2023-03-30T08:11:20.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f222ed3e700 1 -- 172.21.15.87:0/3033971063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22280c3d10 msgr2=0x7f222815b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f222ed3e700 1 --2- 172.21.15.87:0/3033971063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22280c3d10 0x7f222815b440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f221c0090b0 tx=0x7f221c004770 comp rx=0 tx=0).stop 2023-03-30T08:11:20.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f222d2db700 1 -- 172.21.15.87:0/3033971063 reap_dead start 2023-03-30T08:11:20.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f6e6bfff700 1 -- 172.21.15.87:0/3824595650 <== osd.2 v2:172.21.15.87:6808/33775 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6e78038e60 con 0x7f6e6406f110 2023-03-30T08:11:20.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f6e84d64700 1 -- 172.21.15.87:0/3824595650 >> [v2:172.21.15.87:6808/33775,v1:172.21.15.87:6810/33775] conn(0x7f6e6406f110 msgr2=0x7f6e64071540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f6e84d64700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.87:6808/33775,v1:172.21.15.87:6810/33775] conn(0x7f6e6406f110 0x7f6e64071540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f222ed3e700 1 -- 172.21.15.87:0/3033971063 shutdown_connections 2023-03-30T08:11:20.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f222ed3e700 1 -- 172.21.15.87:0/3033971063 >> 172.21.15.87:0/3033971063 conn(0x7f22280cb1c0 msgr2=0x7f222806cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f6e84d64700 1 -- 172.21.15.87:0/3824595650 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6e640654c0 msgr2=0x7f6e64067970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f6e84d64700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6e640654c0 0x7f6e64067970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e780dee10 tx=0x7f6e74009040 comp rx=0 tx=0).stop 2023-03-30T08:11:20.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f6e84d64700 1 -- 172.21.15.87:0/3824595650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e7800eff0 msgr2=0x7f6e7817f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f6e84d64700 1 --2- 172.21.15.87:0/3824595650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e7800eff0 0x7f6e7817f770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6e80063a20 tx=0x7f6e800730a0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f222ed3e700 1 -- 172.21.15.87:0/3033971063 shutdown_connections 2023-03-30T08:11:20.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f264d839700 1 -- 172.21.15.87:0/4037276581 --> [v2:172.21.15.87:6824/33776,v1:172.21.15.87:6825/33776] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2628002d60 con 0x7f263406f110 2023-03-30T08:11:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f6e7ffff700 1 -- 172.21.15.87:0/3824595650 reap_dead start 2023-03-30T08:11:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f222ed3e700 1 -- 172.21.15.87:0/3033971063 wait complete. 2023-03-30T08:11:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f6e84d64700 1 -- 172.21.15.87:0/3824595650 shutdown_connections 2023-03-30T08:11:20.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f6e84d64700 1 -- 172.21.15.87:0/3824595650 >> 172.21.15.87:0/3824595650 conn(0x7f6e78059170 msgr2=0x7f6e78059540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.228+0000 7f6e84d64700 1 -- 172.21.15.87:0/3824595650 shutdown_connections 2023-03-30T08:11:20.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.232+0000 7f6e84d64700 1 -- 172.21.15.87:0/3824595650 wait complete. 2023-03-30T08:11:20.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.232+0000 7f26457fa700 1 -- 172.21.15.87:0/4037276581 <== osd.1 v2:172.21.15.87:6824/33776 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2628002d60 con 0x7f263406f110 2023-03-30T08:11:20.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.232+0000 7f264d839700 1 -- 172.21.15.87:0/4037276581 >> [v2:172.21.15.87:6824/33776,v1:172.21.15.87:6825/33776] conn(0x7f263406f110 msgr2=0x7f2634071540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.232+0000 7f264d839700 1 --2- 172.21.15.87:0/4037276581 >> [v2:172.21.15.87:6824/33776,v1:172.21.15.87:6825/33776] conn(0x7f263406f110 0x7f2634071540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.232+0000 7f264d839700 1 -- 172.21.15.87:0/4037276581 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2634065440 msgr2=0x7f26340678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.232+0000 7f264d839700 1 --2- 172.21.15.87:0/4037276581 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2634065440 0x7f26340678f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f263c000ff0 tx=0x7f263c005040 comp rx=0 tx=0).stop 2023-03-30T08:11:20.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.232+0000 7f264d839700 1 -- 172.21.15.87:0/4037276581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26480c3f30 msgr2=0x7f26481ef840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.232+0000 7f264d839700 1 --2- 172.21.15.87:0/4037276581 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f26480c3f30 0x7f26481ef840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f263800e820 tx=0x7f263800eb30 comp rx=0 tx=0).stop 2023-03-30T08:11:20.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.232+0000 7f264d038700 1 -- 172.21.15.87:0/4037276581 reap_dead start 2023-03-30T08:11:20.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.232+0000 7f264d839700 1 -- 172.21.15.87:0/4037276581 shutdown_connections 2023-03-30T08:11:20.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.232+0000 7f264d839700 1 -- 172.21.15.87:0/4037276581 >> 172.21.15.87:0/4037276581 conn(0x7f26480cf410 msgr2=0x7f26480b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.232+0000 7f264d839700 1 -- 172.21.15.87:0/4037276581 shutdown_connections 2023-03-30T08:11:20.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.232+0000 7f264d839700 1 -- 172.21.15.87:0/4037276581 wait complete. 2023-03-30T08:11:20.299 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.236+0000 7fc84d85a700 1 -- 172.21.15.87:0/1464823856 --> [v2:172.21.15.115:6800/33985,v1:172.21.15.115:6801/33985] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc828002d60 con 0x7fc82c06f110 2023-03-30T08:11:20.299 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.240+0000 7fc8457fa700 1 -- 172.21.15.87:0/1464823856 <== osd.4 v2:172.21.15.115:6800/33985 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc828002d60 con 0x7fc82c06f110 2023-03-30T08:11:20.299 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.240+0000 7fc84d85a700 1 -- 172.21.15.87:0/1464823856 >> [v2:172.21.15.115:6800/33985,v1:172.21.15.115:6801/33985] conn(0x7fc82c06f110 msgr2=0x7fc82c071540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.240+0000 7fc84d85a700 1 --2- 172.21.15.87:0/1464823856 >> [v2:172.21.15.115:6800/33985,v1:172.21.15.115:6801/33985] conn(0x7fc82c06f110 0x7fc82c071540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.240+0000 7fc84d85a700 1 -- 172.21.15.87:0/1464823856 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc82c065440 msgr2=0x7fc82c0678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.240+0000 7fc84d85a700 1 --2- 172.21.15.87:0/1464823856 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc82c065440 0x7fc82c0678f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc834009850 tx=0x7fc834008030 comp rx=0 tx=0).stop 2023-03-30T08:11:20.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.240+0000 7fc84d85a700 1 -- 172.21.15.87:0/1464823856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8480aea30 msgr2=0x7fc84814e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.240+0000 7fc84d85a700 1 --2- 172.21.15.87:0/1464823856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8480aea30 0x7fc84814e0f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00c4e0 tx=0x7fc83c00c7f0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.240+0000 7fc84d059700 1 -- 172.21.15.87:0/1464823856 reap_dead start 2023-03-30T08:11:20.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.240+0000 7fc84d85a700 1 -- 172.21.15.87:0/1464823856 shutdown_connections 2023-03-30T08:11:20.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.240+0000 7fc84d85a700 1 -- 172.21.15.87:0/1464823856 >> 172.21.15.87:0/1464823856 conn(0x7fc8480cf410 msgr2=0x7fc8480af720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.240+0000 7fc84d85a700 1 -- 172.21.15.87:0/1464823856 shutdown_connections 2023-03-30T08:11:20.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.240+0000 7fc84d85a700 1 -- 172.21.15.87:0/1464823856 wait complete. 2023-03-30T08:11:20.302 INFO:teuthology.orchestra.run.smithi087.stdout:60129542154 2023-03-30T08:11:20.302 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-03-30T08:11:20.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.248+0000 7fd60cd26700 1 -- 172.21.15.87:0/1658961545 --> [v2:172.21.15.115:6808/33986,v1:172.21.15.115:6809/33986] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd5ec002d60 con 0x7fd5e806f020 2023-03-30T08:11:20.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.248+0000 7fd5f6ffd700 1 -- 172.21.15.87:0/1658961545 <== osd.7 v2:172.21.15.115:6808/33986 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd5ec002d60 con 0x7fd5e806f020 2023-03-30T08:11:20.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.248+0000 7fd60cd26700 1 -- 172.21.15.87:0/1658961545 >> [v2:172.21.15.115:6808/33986,v1:172.21.15.115:6809/33986] conn(0x7fd5e806f020 msgr2=0x7fd5e8071450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.248+0000 7fd60cd26700 1 --2- 172.21.15.87:0/1658961545 >> [v2:172.21.15.115:6808/33986,v1:172.21.15.115:6809/33986] conn(0x7fd5e806f020 0x7fd5e8071450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.248+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/1134208711 --> [v2:172.21.15.115:6824/33987,v1:172.21.15.115:6825/33987] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8c300fef50 con 0x7f8c1c06f190 2023-03-30T08:11:20.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7fd60cd26700 1 -- 172.21.15.87:0/1658961545 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5e80654c0 msgr2=0x7fd5e8067970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7fd60cd26700 1 --2- 172.21.15.87:0/1658961545 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5e80654c0 0x7fd5e8067970 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8016040 tx=0x7fd5f801e040 comp rx=0 tx=0).stop 2023-03-30T08:11:20.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7fd60cd26700 1 -- 172.21.15.87:0/1658961545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6080b50d0 msgr2=0x7fd6080b7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7fd60cd26700 1 --2- 172.21.15.87:0/1658961545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6080b50d0 0x7fd6080b7de0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd608063b20 tx=0x7fd5fc00f9a0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7fd60759e700 1 -- 172.21.15.87:0/1658961545 reap_dead start 2023-03-30T08:11:20.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7fd60cd26700 1 -- 172.21.15.87:0/1658961545 shutdown_connections 2023-03-30T08:11:20.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7fd60cd26700 1 -- 172.21.15.87:0/1658961545 >> 172.21.15.87:0/1658961545 conn(0x7fd60806b1c0 msgr2=0x7fd60815ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7fd60cd26700 1 -- 172.21.15.87:0/1658961545 shutdown_connections 2023-03-30T08:11:20.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7fd60cd26700 1 -- 172.21.15.87:0/1658961545 wait complete. 2023-03-30T08:11:20.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7f8c2e7fc700 1 -- 172.21.15.87:0/1134208711 <== osd.6 v2:172.21.15.115:6824/33987 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8c280097a0 con 0x7f8c1c06f190 2023-03-30T08:11:20.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/1134208711 >> [v2:172.21.15.115:6824/33987,v1:172.21.15.115:6825/33987] conn(0x7f8c1c06f190 msgr2=0x7f8c1c0715c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7f8c3e9b4700 1 --2- 172.21.15.87:0/1134208711 >> [v2:172.21.15.115:6824/33987,v1:172.21.15.115:6825/33987] conn(0x7f8c1c06f190 0x7f8c1c0715c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/1134208711 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8c1c0654c0 msgr2=0x7f8c1c067970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7f8c3e9b4700 1 --2- 172.21.15.87:0/1134208711 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8c1c0654c0 0x7f8c1c067970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c300f9500 tx=0x7f8c34014000 comp rx=0 tx=0).stop 2023-03-30T08:11:20.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/1134208711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c30036cb0 msgr2=0x7f8c300fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7f8c3e9b4700 1 --2- 172.21.15.87:0/1134208711 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8c30036cb0 0x7f8c300fdc20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8c380727f0 tx=0x7f8c3804e9f0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7f8c3e1b3700 1 -- 172.21.15.87:0/1134208711 reap_dead start 2023-03-30T08:11:20.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/1134208711 shutdown_connections 2023-03-30T08:11:20.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/1134208711 >> 172.21.15.87:0/1134208711 conn(0x7f8c30051770 msgr2=0x7f8c300fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/1134208711 shutdown_connections 2023-03-30T08:11:20.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.252+0000 7f8c3e9b4700 1 -- 172.21.15.87:0/1134208711 wait complete. 2023-03-30T08:11:20.309 INFO:teuthology.orchestra.run.smithi087.stdout:60129542153 2023-03-30T08:11:20.309 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-03-30T08:11:20.310 INFO:teuthology.orchestra.run.smithi087.stdout:60129542154 2023-03-30T08:11:20.310 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-03-30T08:11:20.311 INFO:teuthology.orchestra.run.smithi087.stdout:60129542154 2023-03-30T08:11:20.311 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-03-30T08:11:20.312 INFO:teuthology.orchestra.run.smithi087.stdout:60129542154 2023-03-30T08:11:20.312 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-03-30T08:11:20.313 INFO:teuthology.orchestra.run.smithi087.stdout:60129542153 2023-03-30T08:11:20.314 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-03-30T08:11:20.314 INFO:teuthology.orchestra.run.smithi087.stdout:60129542153 2023-03-30T08:11:20.314 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-03-30T08:11:20.315 INFO:teuthology.orchestra.run.smithi087.stdout:64424509450 2023-03-30T08:11:20.316 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-03-30T08:11:20.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.556+0000 7f55971e6700 1 Processor -- start 2023-03-30T08:11:20.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.556+0000 7f55971e6700 1 -- start start 2023-03-30T08:11:20.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.556+0000 7fd5e81e6700 1 Processor -- start 2023-03-30T08:11:20.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.556+0000 7f55971e6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f55900b08d0 0x7f559006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.556+0000 7f55971e6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f559006b280 0x7f559006c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.556+0000 7f55971e6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55900ca8d0 con 0x7f5590071290 2023-03-30T08:11:20.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.556+0000 7f55971e6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55900c9cc0 con 0x7f55900b08d0 2023-03-30T08:11:20.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.556+0000 7f55971e6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55900c9fa0 con 0x7f559006b280 2023-03-30T08:11:20.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f5594f82700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f55900b08d0 0x7f559006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f558ffff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5590071290 0x7f5590069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48498/0 (socket says 172.21.15.87:48498) 2023-03-30T08:11:20.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f558ffff700 1 -- 172.21.15.87:0/1282776620 learned_addr learned my addr 172.21.15.87:0/1282776620 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:20.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f5595783700 1 --2- 172.21.15.87:0/1282776620 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f559006b280 0x7f559006c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fa7d9cdc700 1 Processor -- start 2023-03-30T08:11:20.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f9af5e66700 1 Processor -- start 2023-03-30T08:11:20.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f5594f82700 1 -- 172.21.15.87:0/1282776620 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f559006b280 msgr2=0x7f559006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f5594f82700 1 --2- 172.21.15.87:0/1282776620 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f559006b280 0x7f559006c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f5594f82700 1 -- 172.21.15.87:0/1282776620 >> v1:172.21.15.87:6789/0 conn(0x7f5590071290 legacy=0x7f5590069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f5594f82700 1 -- 172.21.15.87:0/1282776620 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55900ca280 con 0x7f55900b08d0 2023-03-30T08:11:20.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f5594f82700 1 --2- 172.21.15.87:0/1282776620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55900b08d0 0x7f559006c280 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5588009d90 tx=0x7f558800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f10884b90b4e4a server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f558f7fe700 1 -- 172.21.15.87:0/1282776620 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558800e070 con 0x7f55900b08d0 2023-03-30T08:11:20.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f558f7fe700 1 -- 172.21.15.87:0/1282776620 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558800bb20 con 0x7f55900b08d0 2023-03-30T08:11:20.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f558f7fe700 1 -- 172.21.15.87:0/1282776620 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5588012430 con 0x7f55900b08d0 2023-03-30T08:11:20.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f55971e6700 1 -- 172.21.15.87:0/1282776620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55900b08d0 msgr2=0x7f559006c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f55971e6700 1 --2- 172.21.15.87:0/1282776620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55900b08d0 0x7f559006c280 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5588009d90 tx=0x7f558800b330 comp rx=0 tx=0).stop 2023-03-30T08:11:20.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.556+0000 7fd5e81e6700 1 -- start start 2023-03-30T08:11:20.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fd5e81e6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd5e00aea30 0x7fd5e016b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fd5e81e6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e006b3a0 con 0x7fd5e0164190 2023-03-30T08:11:20.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fd5e81e6700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e0069f00 con 0x7fd5e0163dc0 2023-03-30T08:11:20.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fd5e81e6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e006d810 con 0x7fd5e00aea30 2023-03-30T08:11:20.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fd5e5781700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd5e0164190 0x7fd5e00c9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48506/0 (socket says 172.21.15.87:48506) 2023-03-30T08:11:20.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fd5e5781700 1 -- 172.21.15.87:0/1231623062 learned_addr learned my addr 172.21.15.87:0/1231623062 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:20.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fd5e6783700 1 --2- 172.21.15.87:0/1231623062 >> v2:172.21.15.115:3300/0 conn(0x7fd5e00aea30 0x7fd5e016b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fd5e4f80700 1 -- 172.21.15.87:0/1231623062 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366558451 0 0) 0x7fd5d0001110 con 0x7fd5e0164190 2023-03-30T08:11:20.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fd5e4f80700 1 -- 172.21.15.87:0/1231623062 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5cc0035d0 con 0x7fd5e0164190 2023-03-30T08:11:20.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fd5e4f80700 1 -- 172.21.15.87:0/1231623062 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334559667 0 0) 0x7fd5e0069f00 con 0x7fd5e0163dc0 2023-03-30T08:11:20.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fd5e4f80700 1 -- 172.21.15.87:0/1231623062 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5d0001110 con 0x7fd5e0163dc0 2023-03-30T08:11:20.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fd5e6783700 1 -- 172.21.15.87:0/1231623062 >> v1:172.21.15.115:6789/0 conn(0x7fd5e0163dc0 legacy=0x7fd5e00c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fd5e6783700 1 -- 172.21.15.87:0/1231623062 >> v1:172.21.15.87:6789/0 conn(0x7fd5e0164190 legacy=0x7fd5e00c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fd5e6783700 1 -- 172.21.15.87:0/1231623062 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e00ca3e0 con 0x7fd5e00aea30 2023-03-30T08:11:20.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fa7d9cdc700 1 -- start start 2023-03-30T08:11:20.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f9af5e66700 1 -- start start 2023-03-30T08:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f9af5e66700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ae80e6e60 0x7f9ae804f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f9af5e66700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9ae80512b0 0x7f9ae8036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f9af5e66700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9ae8036cb0 0x7f9ae80060c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f9af5e66700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae8037150 con 0x7f9ae8036cb0 2023-03-30T08:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f9af5e66700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae80486b0 con 0x7f9ae80512b0 2023-03-30T08:11:20.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f9af5e66700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae8033a80 con 0x7f9ae80e6e60 2023-03-30T08:11:20.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f55971e6700 1 -- 172.21.15.87:0/1282776620 shutdown_connections 2023-03-30T08:11:20.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f55971e6700 1 --2- 172.21.15.87:0/1282776620 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f559006b280 0x7f559006c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f9aeffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9ae80512b0 0x7f9ae8036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f9af4e64700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ae80e6e60 0x7f9ae804f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f55971e6700 1 --2- 172.21.15.87:0/1282776620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55900b08d0 0x7f559006c280 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f55971e6700 1 -- 172.21.15.87:0/1282776620 >> 172.21.15.87:0/1282776620 conn(0x7f55900cf410 msgr2=0x7f55900cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7fd5e6783700 1 --2- 172.21.15.87:0/1231623062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5e00aea30 0x7fd5e016b930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009850 tx=0x7fd5dc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b6c15801c400af6 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f55971e6700 1 -- 172.21.15.87:0/1282776620 shutdown_connections 2023-03-30T08:11:20.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f9aeffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9ae80512b0 0x7f9ae8036770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34252/0 (socket says 172.21.15.87:34252) 2023-03-30T08:11:20.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f9aeffff700 1 -- 172.21.15.87:0/502752637 learned_addr learned my addr 172.21.15.87:0/502752637 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.560+0000 7f9af5665700 1 --2- 172.21.15.87:0/502752637 >> v2:172.21.15.87:3300/0 conn(0x7f9ae8036cb0 0x7f9ae80060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fd5e4f80700 1 -- 172.21.15.87:0/1231623062 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc011830 con 0x7fd5e00aea30 2023-03-30T08:11:20.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fa7d9cdc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa7d4152ce0 0x7fa7d40c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9aeffff700 1 -- 172.21.15.87:0/502752637 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ae80e6e60 msgr2=0x7f9ae804f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9aeffff700 1 --2- 172.21.15.87:0/502752637 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ae80e6e60 0x7f9ae804f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9aeffff700 1 -- 172.21.15.87:0/502752637 >> v2:172.21.15.87:3300/0 conn(0x7f9ae8036cb0 msgr2=0x7f9ae80060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9aeffff700 1 --2- 172.21.15.87:0/502752637 >> v2:172.21.15.87:3300/0 conn(0x7f9ae8036cb0 0x7f9ae80060c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9aeffff700 1 -- 172.21.15.87:0/502752637 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8033d60 con 0x7f9ae80512b0 2023-03-30T08:11:20.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fd5e4f80700 1 -- 172.21.15.87:0/1231623062 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5dc011990 con 0x7fd5e00aea30 2023-03-30T08:11:20.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fd5e4f80700 1 -- 172.21.15.87:0/1231623062 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc011d00 con 0x7fd5e00aea30 2023-03-30T08:11:20.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fa7d9cdc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d406b220 0x7fa7d4070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9aeffff700 1 --2- 172.21.15.87:0/502752637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae80512b0 0x7f9ae8036770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8052870 tx=0x7f9adc009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d17d8bd5cce613e server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fa7d9cdc700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d4069cd0 con 0x7fa7d40c9280 2023-03-30T08:11:20.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fa7d9cdc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d41530b0 con 0x7fa7d4152ce0 2023-03-30T08:11:20.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fa7d9cdc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d415c290 con 0x7fa7d406b220 2023-03-30T08:11:20.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fa7d94db700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa7d40c9280 0x7fa7d406cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48522/0 (socket says 172.21.15.87:48522) 2023-03-30T08:11:20.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fa7d94db700 1 -- 172.21.15.87:0/4167454194 learned_addr learned my addr 172.21.15.87:0/4167454194 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:20.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fd5e81e6700 1 -- 172.21.15.87:0/1231623062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5e00aea30 msgr2=0x7fd5e016b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fd5e81e6700 1 --2- 172.21.15.87:0/1231623062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5e00aea30 0x7fd5e016b930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009850 tx=0x7fd5dc009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:20.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fa7d8cda700 1 --2- 172.21.15.87:0/4167454194 >> v2:172.21.15.115:3300/0 conn(0x7fa7d4152ce0 0x7fa7d40c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fa7d3fff700 1 --2- 172.21.15.87:0/4167454194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d406b220 0x7fa7d4070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fa7d37fe700 1 -- 172.21.15.87:0/4167454194 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658216763 0 0) 0x7fa7d4069cd0 con 0x7fa7d40c9280 2023-03-30T08:11:20.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fa7d37fe700 1 -- 172.21.15.87:0/4167454194 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7bc0035d0 con 0x7fa7d40c9280 2023-03-30T08:11:20.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fa7d3fff700 1 -- 172.21.15.87:0/4167454194 >> v2:172.21.15.115:3300/0 conn(0x7fa7d4152ce0 msgr2=0x7fa7d40c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fa7d3fff700 1 --2- 172.21.15.87:0/4167454194 >> v2:172.21.15.115:3300/0 conn(0x7fa7d4152ce0 0x7fa7d40c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fa7d3fff700 1 -- 172.21.15.87:0/4167454194 >> v1:172.21.15.87:6789/0 conn(0x7fa7d40c9280 legacy=0x7fa7d406cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fa7d3fff700 1 -- 172.21.15.87:0/4167454194 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d415cfe0 con 0x7fa7d406b220 2023-03-30T08:11:20.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f55971e6700 1 -- 172.21.15.87:0/1282776620 wait complete. 2023-03-30T08:11:20.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fd5e81e6700 1 -- 172.21.15.87:0/1231623062 shutdown_connections 2023-03-30T08:11:20.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fd5e81e6700 1 --2- 172.21.15.87:0/1231623062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5e00aea30 0x7fd5e016b930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fd5e81e6700 1 -- 172.21.15.87:0/1231623062 >> 172.21.15.87:0/1231623062 conn(0x7fd5e00cf410 msgr2=0x7fd5e00cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f55971e6700 1 Processor -- start 2023-03-30T08:11:20.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fd5e81e6700 1 -- 172.21.15.87:0/1231623062 shutdown_connections 2023-03-30T08:11:20.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9aef7fe700 1 -- 172.21.15.87:0/502752637 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc011830 con 0x7f9ae80512b0 2023-03-30T08:11:20.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9aef7fe700 1 -- 172.21.15.87:0/502752637 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9adc011990 con 0x7f9ae80512b0 2023-03-30T08:11:20.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9aef7fe700 1 -- 172.21.15.87:0/502752637 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc011d20 con 0x7f9ae80512b0 2023-03-30T08:11:20.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9af5e66700 1 -- 172.21.15.87:0/502752637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae80512b0 msgr2=0x7f9ae8036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9af5e66700 1 --2- 172.21.15.87:0/502752637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae80512b0 0x7f9ae8036770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8052870 tx=0x7f9adc009bf0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f184e1a1700 1 Processor -- start 2023-03-30T08:11:20.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9af5e66700 1 -- 172.21.15.87:0/502752637 shutdown_connections 2023-03-30T08:11:20.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9af5e66700 1 --2- 172.21.15.87:0/502752637 >> v2:172.21.15.87:3300/0 conn(0x7f9ae8036cb0 0x7f9ae80060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9af5e66700 1 --2- 172.21.15.87:0/502752637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae80512b0 0x7f9ae8036770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9af5e66700 1 --2- 172.21.15.87:0/502752637 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ae80e6e60 0x7f9ae804f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f9af5e66700 1 -- 172.21.15.87:0/502752637 >> 172.21.15.87:0/502752637 conn(0x7f9ae8051770 msgr2=0x7f9ae8051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f184e1a1700 1 -- start start 2023-03-30T08:11:20.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7f55971e6700 1 -- start start 2023-03-30T08:11:20.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.564+0000 7fd5e81e6700 1 -- 172.21.15.87:0/1231623062 wait complete. 2023-03-30T08:11:20.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f9af5e66700 1 -- 172.21.15.87:0/502752637 shutdown_connections 2023-03-30T08:11:20.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fa7d3fff700 1 --2- 172.21.15.87:0/4167454194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d406b220 0x7fa7d4070260 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009850 tx=0x7fa7c8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=160ddecef906ad1c server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fa7d37fe700 1 -- 172.21.15.87:0/4167454194 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8011830 con 0x7fa7d406b220 2023-03-30T08:11:20.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f55971e6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f559006b280 0x7f559015a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f55971e6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5590071290 0x7f55900c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f55971e6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55900b08d0 0x7f55900c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f55971e6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55900c5a60 con 0x7f55900b08d0 2023-03-30T08:11:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fd5e81e6700 1 Processor -- start 2023-03-30T08:11:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fa7d37fe700 1 -- 172.21.15.87:0/4167454194 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c8011990 con 0x7fa7d406b220 2023-03-30T08:11:20.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fa7d37fe700 1 -- 172.21.15.87:0/4167454194 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8011d40 con 0x7fa7d406b220 2023-03-30T08:11:20.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f184e1a1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1840054800 0x7f1840036770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f184e1a1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f184003a810 0x7f1840036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f184e1a1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18400060c0 con 0x7f1840052280 2023-03-30T08:11:20.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f184e1a1700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18400070b0 con 0x7f1840054800 2023-03-30T08:11:20.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f184e1a1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18400ded00 con 0x7f184003a810 2023-03-30T08:11:20.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f184d19f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1840054800 0x7f1840036770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f184d19f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1840054800 0x7f1840036770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51950/0 (socket says 172.21.15.87:51950) 2023-03-30T08:11:20.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f184d19f700 1 -- 172.21.15.87:0/876741907 learned_addr learned my addr 172.21.15.87:0/876741907 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f55971e6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55900c5cb0 con 0x7f5590071290 2023-03-30T08:11:20.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f55971e6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55900c5f90 con 0x7f559006b280 2023-03-30T08:11:20.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f9af5e66700 1 -- 172.21.15.87:0/502752637 wait complete. 2023-03-30T08:11:20.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f184d9a0700 1 --2- 172.21.15.87:0/876741907 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f184003a810 0x7f1840036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fa7d9cdc700 1 -- 172.21.15.87:0/4167454194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d406b220 msgr2=0x7fa7d4070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fa7d9cdc700 1 --2- 172.21.15.87:0/4167454194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d406b220 0x7fa7d4070260 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009850 tx=0x7fa7c8009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:20.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fa7d9cdc700 1 -- 172.21.15.87:0/4167454194 shutdown_connections 2023-03-30T08:11:20.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fa7d9cdc700 1 --2- 172.21.15.87:0/4167454194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d406b220 0x7fa7d4070260 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fa7d9cdc700 1 --2- 172.21.15.87:0/4167454194 >> v2:172.21.15.115:3300/0 conn(0x7fa7d4152ce0 0x7fa7d40c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fa7d9cdc700 1 -- 172.21.15.87:0/4167454194 >> 172.21.15.87:0/4167454194 conn(0x7fa7d40ce6f0 msgr2=0x7fa7d40ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f5594f82700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f559006b280 0x7f559015a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f558ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5590071290 0x7f55900c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f558ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5590071290 0x7f55900c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34274/0 (socket says 172.21.15.87:34274) 2023-03-30T08:11:20.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f558ffff700 1 -- 172.21.15.87:0/1462181242 learned_addr learned my addr 172.21.15.87:0/1462181242 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f5595783700 1 --2- 172.21.15.87:0/1462181242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55900b08d0 0x7f55900c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fd5e81e6700 1 -- start start 2023-03-30T08:11:20.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f9af5e66700 1 Processor -- start 2023-03-30T08:11:20.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fa7d9cdc700 1 -- 172.21.15.87:0/4167454194 shutdown_connections 2023-03-30T08:11:20.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f184d19f700 1 -- 172.21.15.87:0/876741907 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f184003a810 msgr2=0x7f1840036cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f184d19f700 1 --2- 172.21.15.87:0/876741907 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f184003a810 0x7f1840036cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f184d19f700 1 -- 172.21.15.87:0/876741907 >> v1:172.21.15.115:6789/0 conn(0x7f1840052280 legacy=0x7f184003a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f184d19f700 1 -- 172.21.15.87:0/876741907 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18400062f0 con 0x7f1840054800 2023-03-30T08:11:20.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f558ffff700 1 -- 172.21.15.87:0/1462181242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f559006b280 msgr2=0x7f559015a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fd5e81e6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5e00aea30 0x7fd5e01f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f184d19f700 1 --2- 172.21.15.87:0/876741907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1840054800 0x7f1840036770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1844009910 tx=0x7f1844009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5294465fbf0be80 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f558ffff700 1 --2- 172.21.15.87:0/1462181242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f559006b280 0x7f559015a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f558ffff700 1 -- 172.21.15.87:0/1462181242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55900b08d0 msgr2=0x7f55900c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f558ffff700 1 --2- 172.21.15.87:0/1462181242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55900b08d0 0x7f55900c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f558ffff700 1 -- 172.21.15.87:0/1462181242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5588009a70 con 0x7f5590071290 2023-03-30T08:11:20.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fd5e81e6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e0163dc0 0x7fd5e0157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7f9af5e66700 1 -- start start 2023-03-30T08:11:20.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e5f82700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5e00aea30 0x7fd5e01f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e5f82700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5e00aea30 0x7fd5e01f6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:34050/0 (socket says 172.21.15.87:34050) 2023-03-30T08:11:20.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e5781700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e0163dc0 0x7fd5e0157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e5781700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e0163dc0 0x7fd5e0157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51966/0 (socket says 172.21.15.87:51966) 2023-03-30T08:11:20.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e5f82700 1 -- 172.21.15.87:0/3881183232 learned_addr learned my addr 172.21.15.87:0/3881183232 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f558ffff700 1 --2- 172.21.15.87:0/1462181242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5590071290 0x7f55900c8f80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f558000c520 tx=0x7f558000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e81e6700 1 --2- 172.21.15.87:0/3881183232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5e0164190 0x7fd5e00c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af5e66700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae8036cb0 0x7f9ae80d5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f558d7fa700 1 -- 172.21.15.87:0/1462181242 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5580005d90 con 0x7f5590071290 2023-03-30T08:11:20.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f558d7fa700 1 -- 172.21.15.87:0/1462181242 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55800070d0 con 0x7f5590071290 2023-03-30T08:11:20.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f558d7fa700 1 -- 172.21.15.87:0/1462181242 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5580007440 con 0x7f5590071290 2023-03-30T08:11:20.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af5e66700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ae80512b0 0x7f9ae80e5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af5e66700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ae80e6e60 0x7f9ae80e6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e81e6700 1 -- 172.21.15.87:0/3881183232 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e0158050 con 0x7fd5e0163dc0 2023-03-30T08:11:20.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af5e66700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae80e66d0 con 0x7f9ae80512b0 2023-03-30T08:11:20.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f55971e6700 1 -- 172.21.15.87:0/1462181242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55900b0e20 con 0x7f5590071290 2023-03-30T08:11:20.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f55971e6700 1 -- 172.21.15.87:0/1462181242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55900ca560 con 0x7f5590071290 2023-03-30T08:11:20.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e6783700 1 --2- 172.21.15.87:0/3881183232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5e0164190 0x7fd5e00c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.568+0000 7fa7d9cdc700 1 -- 172.21.15.87:0/4167454194 wait complete. 2023-03-30T08:11:20.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fa7d9cdc700 1 Processor -- start 2023-03-30T08:11:20.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af5e66700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae80d4880 con 0x7f9ae8036cb0 2023-03-30T08:11:20.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af5e66700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae8049fa0 con 0x7f9ae80e6e60 2023-03-30T08:11:20.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af4e64700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae8036cb0 0x7f9ae80d5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af4e64700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae8036cb0 0x7f9ae80d5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34286/0 (socket says 172.21.15.87:34286) 2023-03-30T08:11:20.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af4e64700 1 -- 172.21.15.87:0/2143127730 learned_addr learned my addr 172.21.15.87:0/2143127730 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9aeffff700 1 --2- 172.21.15.87:0/2143127730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ae80512b0 0x7f9ae80e5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e81e6700 1 -- 172.21.15.87:0/3881183232 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00c51a0 con 0x7fd5e0164190 2023-03-30T08:11:20.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e81e6700 1 -- 172.21.15.87:0/3881183232 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00c5480 con 0x7fd5e00aea30 2023-03-30T08:11:20.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af5665700 1 --2- 172.21.15.87:0/2143127730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ae80e6e60 0x7f9ae80e6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af4e64700 1 -- 172.21.15.87:0/2143127730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ae80e6e60 msgr2=0x7f9ae80e6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af4e64700 1 --2- 172.21.15.87:0/2143127730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ae80e6e60 0x7f9ae80e6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af4e64700 1 -- 172.21.15.87:0/2143127730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ae80512b0 msgr2=0x7f9ae80e5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af4e64700 1 --2- 172.21.15.87:0/2143127730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ae80512b0 0x7f9ae80e5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af4e64700 1 -- 172.21.15.87:0/2143127730 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc009570 con 0x7f9ae8036cb0 2023-03-30T08:11:20.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af5665700 1 --2- 172.21.15.87:0/2143127730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ae80e6e60 0x7f9ae80e6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:20.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f55971e6700 1 -- 172.21.15.87:0/1462181242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5570005310 con 0x7f5590071290 2023-03-30T08:11:20.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af4e64700 1 --2- 172.21.15.87:0/2143127730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae8036cb0 0x7f9ae80d5600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9af00696d0 tx=0x7f9af00740f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9aed7fa700 1 -- 172.21.15.87:0/2143127730 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0066f70 con 0x7f9ae8036cb0 2023-03-30T08:11:20.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9aed7fa700 1 -- 172.21.15.87:0/2143127730 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af00670d0 con 0x7f9ae8036cb0 2023-03-30T08:11:20.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f183ffff700 1 -- 172.21.15.87:0/876741907 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184400ba60 con 0x7f1840054800 2023-03-30T08:11:20.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f183ffff700 1 -- 172.21.15.87:0/876741907 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184400bbc0 con 0x7f1840054800 2023-03-30T08:11:20.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f183ffff700 1 -- 172.21.15.87:0/876741907 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844009e60 con 0x7f1840054800 2023-03-30T08:11:20.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af5e66700 1 -- 172.21.15.87:0/2143127730 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae8034320 con 0x7f9ae8036cb0 2023-03-30T08:11:20.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9af5e66700 1 -- 172.21.15.87:0/2143127730 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae8034040 con 0x7f9ae8036cb0 2023-03-30T08:11:20.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f9aed7fa700 1 -- 172.21.15.87:0/2143127730 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af00925f0 con 0x7f9ae8036cb0 2023-03-30T08:11:20.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f6cf5d97700 1 Processor -- start 2023-03-30T08:11:20.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e5f82700 1 -- 172.21.15.87:0/3881183232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5e0164190 msgr2=0x7fd5e00c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e5f82700 1 --2- 172.21.15.87:0/3881183232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5e0164190 0x7fd5e00c4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e5f82700 1 -- 172.21.15.87:0/3881183232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e0163dc0 msgr2=0x7fd5e0157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e5f82700 1 --2- 172.21.15.87:0/3881183232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e0163dc0 0x7fd5e0157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e5f82700 1 -- 172.21.15.87:0/3881183232 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc0094b0 con 0x7fd5e00aea30 2023-03-30T08:11:20.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f184e1a1700 1 -- 172.21.15.87:0/876741907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1840054800 msgr2=0x7f1840036770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f184e1a1700 1 --2- 172.21.15.87:0/876741907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1840054800 0x7f1840036770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1844009910 tx=0x7f1844009c20 comp rx=0 tx=0).stop 2023-03-30T08:11:20.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7fd5e5f82700 1 --2- 172.21.15.87:0/3881183232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5e00aea30 0x7fd5e01f6bb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800cc50 tx=0x7fd5d800cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f30cf41e700 1 Processor -- start 2023-03-30T08:11:20.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fd5d67fc700 1 -- 172.21.15.87:0/3881183232 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8003c20 con 0x7fd5e00aea30 2023-03-30T08:11:20.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fd5d67fc700 1 -- 172.21.15.87:0/3881183232 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d8003d80 con 0x7fd5e00aea30 2023-03-30T08:11:20.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f30cf41e700 1 -- start start 2023-03-30T08:11:20.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f9af5e66700 1 -- 172.21.15.87:0/2143127730 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad0005310 con 0x7f9ae8036cb0 2023-03-30T08:11:20.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.572+0000 7f6cf5d97700 1 -- start start 2023-03-30T08:11:20.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fd5d67fc700 1 -- 172.21.15.87:0/3881183232 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d800ab10 con 0x7fd5e00aea30 2023-03-30T08:11:20.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f6cf5d97700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6ce80dea70 0x7f6ce8053da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f6cf5d97700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce80073d0 con 0x7f6ce80dee40 2023-03-30T08:11:20.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f6cf5d97700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce8052fe0 con 0x7f6ce80372d0 2023-03-30T08:11:20.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f6cf5d97700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce80532c0 con 0x7f6ce80dea70 2023-03-30T08:11:20.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f558d7fa700 1 -- 172.21.15.87:0/1462181242 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f55800075a0 con 0x7f5590071290 2023-03-30T08:11:20.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d9cdc700 1 -- start start 2023-03-30T08:11:20.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fd5e81e6700 1 -- 172.21.15.87:0/3881183232 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e006d250 con 0x7fd5e00aea30 2023-03-30T08:11:20.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f184e1a1700 1 -- 172.21.15.87:0/876741907 shutdown_connections 2023-03-30T08:11:20.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f184e1a1700 1 --2- 172.21.15.87:0/876741907 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f184003a810 0x7f1840036cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f184e1a1700 1 --2- 172.21.15.87:0/876741907 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1840054800 0x7f1840036770 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f184e1a1700 1 -- 172.21.15.87:0/876741907 >> 172.21.15.87:0/876741907 conn(0x7f1840051770 msgr2=0x7f1840051b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d9cdc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d40c9280 0x7fa7d40c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fd5e81e6700 1 -- 172.21.15.87:0/3881183232 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e006cf70 con 0x7fd5e00aea30 2023-03-30T08:11:20.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f6cf4d95700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6ce80dea70 0x7f6ce8053da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f6cf4d95700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6ce80dea70 0x7f6ce8053da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34298/0 (socket says 172.21.15.87:34298) 2023-03-30T08:11:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f6cf4d95700 1 -- 172.21.15.87:0/376145425 learned_addr learned my addr 172.21.15.87:0/376145425 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f184e1a1700 1 -- 172.21.15.87:0/876741907 shutdown_connections 2023-03-30T08:11:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d9cdc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d4152ce0 0x7fa7d40b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f184e1a1700 1 -- 172.21.15.87:0/876741907 wait complete. 2023-03-30T08:11:20.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f6cf4d95700 1 -- 172.21.15.87:0/376145425 >> v1:172.21.15.115:6789/0 conn(0x7f6ce80372d0 legacy=0x7f6ce8037f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f6cf4d95700 1 -- 172.21.15.87:0/376145425 >> v1:172.21.15.87:6789/0 conn(0x7f6ce80dee40 legacy=0x7f6ce8036bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f30cf41e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f30c0036d40 0x7f30c00f1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f30cf41e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c0053cb0 con 0x7f30c0051170 2023-03-30T08:11:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f30cf41e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c004f910 con 0x7f30c00e6d20 2023-03-30T08:11:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f30cf41e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c0048570 con 0x7f30c0036d40 2023-03-30T08:11:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f558d7fa700 1 --2- 172.21.15.87:0/1462181242 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f557c0654c0 0x7f557c067970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f558d7fa700 1 -- 172.21.15.87:0/1462181242 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5580081e40 con 0x7f5590071290 2023-03-30T08:11:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d9cdc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d40b3b00 0x7fa7d4070240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d4152ce0 0x7fa7d40b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d94db700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d40b3b00 0x7fa7d4070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d94db700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d40b3b00 0x7fa7d4070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51982/0 (socket says 172.21.15.87:51982) 2023-03-30T08:11:20.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d4152ce0 0x7fa7d40b35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34310/0 (socket says 172.21.15.87:34310) 2023-03-30T08:11:20.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d9cdc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40b1e40 con 0x7fa7d40b3b00 2023-03-30T08:11:20.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d9cdc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40c80d0 con 0x7fa7d4152ce0 2023-03-30T08:11:20.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d9cdc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d4071000 con 0x7fa7d40c9280 2023-03-30T08:11:20.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d94db700 1 -- 172.21.15.87:0/1409463694 learned_addr learned my addr 172.21.15.87:0/1409463694 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f6cf4d95700 1 -- 172.21.15.87:0/376145425 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce80535a0 con 0x7f6ce80dea70 2023-03-30T08:11:20.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f30cd9bb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f30c0036d40 0x7f30c00f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f30cd9bb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f30c0036d40 0x7f30c00f1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34326/0 (socket says 172.21.15.87:34326) 2023-03-30T08:11:20.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f30cd9bb700 1 -- 172.21.15.87:0/3735111850 learned_addr learned my addr 172.21.15.87:0/3735111850 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f5594f82700 1 --2- 172.21.15.87:0/1462181242 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f557c0654c0 0x7f557c067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f6cf4d95700 1 --2- 172.21.15.87:0/376145425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce80dea70 0x7f6ce8053da0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4008910 tx=0x7f6ce400d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cac70fba7ac199 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fd5e81e6700 1 -- 172.21.15.87:0/3881183232 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e006d530 con 0x7fd5e00aea30 2023-03-30T08:11:20.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f30cd9bb700 1 -- 172.21.15.87:0/3735111850 >> v1:172.21.15.115:6789/0 conn(0x7f30c00e6d20 legacy=0x7f30c004f200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-30T08:11:20.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f30cd9bb700 1 -- 172.21.15.87:0/3735111850 >> v1:172.21.15.87:6789/0 conn(0x7f30c0051170 legacy=0x7f30c0036630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-30T08:11:20.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f30cd9bb700 1 -- 172.21.15.87:0/3735111850 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c0033940 con 0x7f30c0036d40 2023-03-30T08:11:20.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d94db700 1 -- 172.21.15.87:0/1409463694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d40c9280 msgr2=0x7fa7d40c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d8cda700 1 --2- 172.21.15.87:0/1409463694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d40c9280 0x7fa7d40c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7f75c6a45700 1 Processor -- start 2023-03-30T08:11:20.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f5594f82700 1 --2- 172.21.15.87:0/1462181242 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f557c0654c0 0x7f557c067970 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5588014040 tx=0x7f5588011000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d94db700 1 --2- 172.21.15.87:0/1409463694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d40c9280 0x7fa7d40c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d94db700 1 -- 172.21.15.87:0/1409463694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d4152ce0 msgr2=0x7fa7d40b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d94db700 1 --2- 172.21.15.87:0/1409463694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d4152ce0 0x7fa7d40b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.576+0000 7fa7d94db700 1 -- 172.21.15.87:0/1409463694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c80094b0 con 0x7fa7d40b3b00 2023-03-30T08:11:20.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7fa7d8cda700 1 --2- 172.21.15.87:0/1409463694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d40c9280 0x7fa7d40c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:20.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f75c6a45700 1 -- start start 2023-03-30T08:11:20.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7fa7d94db700 1 --2- 172.21.15.87:0/1409463694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d40b3b00 0x7fa7d4070240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4005930 tx=0x7fa7c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7fd5d67fc700 1 -- 172.21.15.87:0/3881183232 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd5d800ac70 con 0x7fd5e00aea30 2023-03-30T08:11:20.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f30cd9bb700 1 --2- 172.21.15.87:0/3735111850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30c0036d40 0x7f30c00f1760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009910 tx=0x7f30c4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a97b430710f9682 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f184e1a1700 1 Processor -- start 2023-03-30T08:11:20.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7fa7d17fa700 1 -- 172.21.15.87:0/1409463694 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4005d90 con 0x7fa7d40b3b00 2023-03-30T08:11:20.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7fa7d17fa700 1 -- 172.21.15.87:0/1409463694 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c40070d0 con 0x7fa7d40b3b00 2023-03-30T08:11:20.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f75c6a45700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f75b8036770 0x7f75b8036b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f75c6a45700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b80e0af0 con 0x7f75b8037b40 2023-03-30T08:11:20.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f75c6a45700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b8050f00 con 0x7f75b80e12a0 2023-03-30T08:11:20.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f75c6a45700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b80e45f0 con 0x7f75b8036770 2023-03-30T08:11:20.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7fd5d67fc700 1 --2- 172.21.15.87:0/3881183232 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5c4065440 0x7fd5c40678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7fd5d67fc700 1 -- 172.21.15.87:0/3881183232 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd5d8082bb0 con 0x7fd5e00aea30 2023-03-30T08:11:20.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7fa7d17fa700 1 -- 172.21.15.87:0/1409463694 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4007440 con 0x7fa7d40b3b00 2023-03-30T08:11:20.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7fa7d9cdc700 1 -- 172.21.15.87:0/1409463694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d415c7e0 con 0x7fa7d40b3b00 2023-03-30T08:11:20.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7fa7d9cdc700 1 -- 172.21.15.87:0/1409463694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d415c500 con 0x7fa7d40b3b00 2023-03-30T08:11:20.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f75c6244700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f75b8036770 0x7f75b8036b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f75c6244700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f75b8036770 0x7f75b8036b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34328/0 (socket says 172.21.15.87:34328) 2023-03-30T08:11:20.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f75c6244700 1 -- 172.21.15.87:0/1005247344 learned_addr learned my addr 172.21.15.87:0/1005247344 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7fd5e5781700 1 --2- 172.21.15.87:0/3881183232 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5c4065440 0x7fd5c40678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f184e1a1700 1 -- start start 2023-03-30T08:11:20.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7fa7d9cdc700 1 -- 172.21.15.87:0/1409463694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d415cac0 con 0x7fa7d40b3b00 2023-03-30T08:11:20.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f184e1a1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f184003a810 0x7f18400d4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f184e1a1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1840052280 0x7f18400d6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f75c6244700 1 -- 172.21.15.87:0/1005247344 >> v1:172.21.15.115:6789/0 conn(0x7f75b80e12a0 legacy=0x7f75b80e1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f75c6244700 1 -- 172.21.15.87:0/1005247344 >> v1:172.21.15.87:6789/0 conn(0x7f75b8037b40 legacy=0x7f75b80e4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:20.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f75c6244700 1 -- 172.21.15.87:0/1005247344 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b80370c0 con 0x7f75b8036770 2023-03-30T08:11:20.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f184e1a1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1840054800 0x7f18400ea940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7fd5e5781700 1 --2- 172.21.15.87:0/3881183232 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5c4065440 0x7fd5c40678f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00ca120 tx=0x7fd5d0007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f75c6244700 1 --2- 172.21.15.87:0/1005247344 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75b8036770 0x7f75b8036b80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f75c0068010 tx=0x7f75c004e9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e87785e35c139d34 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f184e1a1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18400de4c0 con 0x7f1840052280 2023-03-30T08:11:20.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f184d19f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f184003a810 0x7f18400d4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f184e1a1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18400e01e0 con 0x7f1840054800 2023-03-30T08:11:20.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f184d19f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f184003a810 0x7f18400d4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:34080/0 (socket says 172.21.15.87:34080) 2023-03-30T08:11:20.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f184d19f700 1 -- 172.21.15.87:0/3359887714 learned_addr learned my addr 172.21.15.87:0/3359887714 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f184e1a1700 1 -- 172.21.15.87:0/3359887714 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18400e04c0 con 0x7f184003a810 2023-03-30T08:11:20.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.580+0000 7f184d9a0700 1 --2- 172.21.15.87:0/3359887714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1840054800 0x7f18400ea940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f558d7fa700 1 -- 172.21.15.87:0/1462181242 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f558004f860 con 0x7f5590071290 2023-03-30T08:11:20.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f6cef7fe700 1 -- 172.21.15.87:0/376145425 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4010070 con 0x7f6ce80dea70 2023-03-30T08:11:20.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f6cef7fe700 1 -- 172.21.15.87:0/376145425 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce400da40 con 0x7f6ce80dea70 2023-03-30T08:11:20.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f6cef7fe700 1 -- 172.21.15.87:0/376145425 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce400ddd0 con 0x7f6ce80dea70 2023-03-30T08:11:20.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f184c99e700 1 --2- 172.21.15.87:0/3359887714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1840052280 0x7f18400d6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f184d19f700 1 -- 172.21.15.87:0/3359887714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1840054800 msgr2=0x7f18400ea940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f184d19f700 1 --2- 172.21.15.87:0/3359887714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1840054800 0x7f18400ea940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f184d19f700 1 -- 172.21.15.87:0/3359887714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1840052280 msgr2=0x7f18400d6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f184d19f700 1 --2- 172.21.15.87:0/3359887714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1840052280 0x7f18400d6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f184d19f700 1 -- 172.21.15.87:0/3359887714 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844009570 con 0x7f184003a810 2023-03-30T08:11:20.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f184c99e700 1 --2- 172.21.15.87:0/3359887714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1840052280 0x7f18400d6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:20.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f184d19f700 1 --2- 172.21.15.87:0/3359887714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f184003a810 0x7f18400d4d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1844000c00 tx=0x7f1844004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f75c4a41700 1 -- 172.21.15.87:0/1005247344 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c008d070 con 0x7f75b8036770 2023-03-30T08:11:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f75c4a41700 1 -- 172.21.15.87:0/1005247344 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c00678a0 con 0x7f75b8036770 2023-03-30T08:11:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f75c4a41700 1 -- 172.21.15.87:0/1005247344 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0072400 con 0x7f75b8036770 2023-03-30T08:11:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f75c6a45700 1 -- 172.21.15.87:0/1005247344 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75b8036770 msgr2=0x7f75b8036b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f75c6a45700 1 --2- 172.21.15.87:0/1005247344 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75b8036770 0x7f75b8036b80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f75c0068010 tx=0x7f75c004e9e0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f75c6a45700 1 -- 172.21.15.87:0/1005247344 shutdown_connections 2023-03-30T08:11:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f75c6a45700 1 --2- 172.21.15.87:0/1005247344 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75b8036770 0x7f75b8036b80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f75c6a45700 1 -- 172.21.15.87:0/1005247344 >> 172.21.15.87:0/1005247344 conn(0x7f75b8051770 msgr2=0x7f75b8051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7fa7d17fa700 1 -- 172.21.15.87:0/1409463694 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa7c40075a0 con 0x7fa7d40b3b00 2023-03-30T08:11:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f30bffff700 1 -- 172.21.15.87:0/3735111850 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4004230 con 0x7f30c0036d40 2023-03-30T08:11:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f75c6a45700 1 -- 172.21.15.87:0/1005247344 shutdown_connections 2023-03-30T08:11:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f75c6a45700 1 -- 172.21.15.87:0/1005247344 wait complete. 2023-03-30T08:11:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f30bffff700 1 -- 172.21.15.87:0/3735111850 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c4004390 con 0x7f30c0036d40 2023-03-30T08:11:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f30bffff700 1 -- 172.21.15.87:0/3735111850 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4009e60 con 0x7f30c0036d40 2023-03-30T08:11:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f6cf5d97700 1 -- 172.21.15.87:0/376145425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce80dea70 msgr2=0x7f6ce8053da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f6cf5d97700 1 --2- 172.21.15.87:0/376145425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce80dea70 0x7f6ce8053da0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4008910 tx=0x7f6ce400d330 comp rx=0 tx=0).stop 2023-03-30T08:11:20.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f6cf5d97700 1 -- 172.21.15.87:0/376145425 shutdown_connections 2023-03-30T08:11:20.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f6cf5d97700 1 --2- 172.21.15.87:0/376145425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce80dea70 0x7f6ce8053da0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f6cf5d97700 1 -- 172.21.15.87:0/376145425 >> 172.21.15.87:0/376145425 conn(0x7f6ce8051bc0 msgr2=0x7f6ce8051fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f6cf5d97700 1 -- 172.21.15.87:0/376145425 shutdown_connections 2023-03-30T08:11:20.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f30cf41e700 1 -- 172.21.15.87:0/3735111850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30c0036d40 msgr2=0x7f30c00f1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f30cf41e700 1 --2- 172.21.15.87:0/3735111850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30c0036d40 0x7f30c00f1760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009910 tx=0x7f30c4009c20 comp rx=0 tx=0).stop 2023-03-30T08:11:20.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7fa7d17fa700 1 --2- 172.21.15.87:0/1409463694 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa7c00654c0 0x7fa7c0067970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7fa7d17fa700 1 -- 172.21.15.87:0/1409463694 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa7c40827f0 con 0x7fa7d40b3b00 2023-03-30T08:11:20.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f30cf41e700 1 -- 172.21.15.87:0/3735111850 shutdown_connections 2023-03-30T08:11:20.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f30cf41e700 1 --2- 172.21.15.87:0/3735111850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30c0036d40 0x7f30c00f1760 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f30cf41e700 1 -- 172.21.15.87:0/3735111850 >> 172.21.15.87:0/3735111850 conn(0x7f30c0051630 msgr2=0x7f30c0051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f30cf41e700 1 -- 172.21.15.87:0/3735111850 shutdown_connections 2023-03-30T08:11:20.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7fa7d8cda700 1 --2- 172.21.15.87:0/1409463694 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa7c00654c0 0x7fa7c0067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f9aed7fa700 1 -- 172.21.15.87:0/2143127730 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f9af0092750 con 0x7f9ae8036cb0 2023-03-30T08:11:20.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c6a45700 1 Processor -- start 2023-03-30T08:11:20.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f6cf5d97700 1 -- 172.21.15.87:0/376145425 wait complete. 2023-03-30T08:11:20.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c6a45700 1 -- start start 2023-03-30T08:11:20.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c6a45700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75b8036770 0x7f75b8048820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c6a45700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75b8037b40 0x7f75b80d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f9aed7fa700 1 --2- 172.21.15.87:0/2143127730 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ad40653f0 0x7f9ad40678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f9aed7fa700 1 -- 172.21.15.87:0/2143127730 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9af00fc820 con 0x7f9ae8036cb0 2023-03-30T08:11:20.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f9aeffff700 1 --2- 172.21.15.87:0/2143127730 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ad40653f0 0x7f9ad40678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f6cf5d97700 1 Processor -- start 2023-03-30T08:11:20.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c6a45700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75b80e12a0 0x7f75b80538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f9aeffff700 1 --2- 172.21.15.87:0/2143127730 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ad40653f0 0x7f9ad40678a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009c30 tx=0x7f9adc01d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c6a45700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b8049980 con 0x7f75b8037b40 2023-03-30T08:11:20.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c6a45700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b8048e00 con 0x7f75b80e12a0 2023-03-30T08:11:20.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7fa7d8cda700 1 --2- 172.21.15.87:0/1409463694 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa7c00654c0 0x7fa7c0067970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc007440 tx=0x7fa7cc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c6a45700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80490e0 con 0x7f75b8036770 2023-03-30T08:11:20.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f9aed7fa700 1 -- 172.21.15.87:0/2143127730 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f9af00ca1f0 con 0x7f9ae8036cb0 2023-03-30T08:11:20.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c5a43700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75b8036770 0x7f75b8048820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c6244700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75b80e12a0 0x7f75b80538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c5a43700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75b8036770 0x7f75b8048820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:34086/0 (socket says 172.21.15.87:34086) 2023-03-30T08:11:20.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c5a43700 1 -- 172.21.15.87:0/1011024129 learned_addr learned my addr 172.21.15.87:0/1011024129 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.584+0000 7f30cf41e700 1 -- 172.21.15.87:0/3735111850 wait complete. 2023-03-30T08:11:20.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f30cf41e700 1 Processor -- start 2023-03-30T08:11:20.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f183dffb700 1 -- 172.21.15.87:0/3359887714 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844004450 con 0x7f184003a810 2023-03-30T08:11:20.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f183dffb700 1 -- 172.21.15.87:0/3359887714 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184401f070 con 0x7f184003a810 2023-03-30T08:11:20.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f183dffb700 1 -- 172.21.15.87:0/3359887714 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844003900 con 0x7f184003a810 2023-03-30T08:11:20.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7fd5d67fc700 1 -- 172.21.15.87:0/3881183232 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fd5d8050520 con 0x7fd5e00aea30 2023-03-30T08:11:20.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f30cf41e700 1 -- start start 2023-03-30T08:11:20.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f184e1a1700 1 -- 172.21.15.87:0/3359887714 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18400068b0 con 0x7f184003a810 2023-03-30T08:11:20.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f184e1a1700 1 -- 172.21.15.87:0/3359887714 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18400065d0 con 0x7f184003a810 2023-03-30T08:11:20.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f6cf5d97700 1 -- start start 2023-03-30T08:11:20.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7fa7d17fa700 1 -- 172.21.15.87:0/1409463694 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fa7c40502a0 con 0x7fa7d40b3b00 2023-03-30T08:11:20.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6cf5d97700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ce80372d0 0x7f6ce81774f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6cf5d97700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce80dea70 0x7f6ce8177a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6cf5d97700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce80dee40 0x7f6ce804cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6cf5d97700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80c6940 con 0x7f6ce80372d0 2023-03-30T08:11:20.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6cf5d97700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce804d950 con 0x7f6ce80dee40 2023-03-30T08:11:20.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6cf5d97700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80c6c00 con 0x7f6ce80dea70 2023-03-30T08:11:20.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6cf4d95700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ce80372d0 0x7f6ce81774f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6ceffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce80dea70 0x7f6ce8177a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6cf4d95700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ce80372d0 0x7f6ce81774f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51996/0 (socket says 172.21.15.87:51996) 2023-03-30T08:11:20.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6cf4d95700 1 -- 172.21.15.87:0/879843496 learned_addr learned my addr 172.21.15.87:0/879843496 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6cf5596700 1 --2- 172.21.15.87:0/879843496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce80dee40 0x7f6ce804cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6ceffff700 1 -- 172.21.15.87:0/879843496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce80dee40 msgr2=0x7f6ce804cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6ceffff700 1 --2- 172.21.15.87:0/879843496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce80dee40 0x7f6ce804cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6ceffff700 1 -- 172.21.15.87:0/879843496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ce80372d0 msgr2=0x7f6ce81774f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6ceffff700 1 --2- 172.21.15.87:0/879843496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ce80372d0 0x7f6ce81774f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6ceffff700 1 -- 172.21.15.87:0/879843496 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce40085f0 con 0x7f6ce80dea70 2023-03-30T08:11:20.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6cf4d95700 1 --2- 172.21.15.87:0/879843496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ce80372d0 0x7f6ce81774f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:20.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f30cf41e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30c0036d40 0x7f30c004d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f30cf41e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30c0051170 0x7f30c00e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f30cd1ba700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30c0036d40 0x7f30c004d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f30cd1ba700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30c0036d40 0x7f30c004d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:34102/0 (socket says 172.21.15.87:34102) 2023-03-30T08:11:20.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c5242700 1 --2- 172.21.15.87:0/1011024129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75b8037b40 0x7f75b80d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c5a43700 1 -- 172.21.15.87:0/1011024129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75b80e12a0 msgr2=0x7f75b80538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.654 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c5a43700 1 --2- 172.21.15.87:0/1011024129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75b80e12a0 0x7f75b80538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.654 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c5a43700 1 -- 172.21.15.87:0/1011024129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75b8037b40 msgr2=0x7f75b80d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.654 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c5a43700 1 --2- 172.21.15.87:0/1011024129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75b8037b40 0x7f75b80d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.654 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c5a43700 1 -- 172.21.15.87:0/1011024129 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b8051150 con 0x7f75b8036770 2023-03-30T08:11:20.654 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75c5a43700 1 --2- 172.21.15.87:0/1011024129 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75b8036770 0x7f75b8048820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00c500 tx=0x7f75bc00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.654 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.588+0000 7f75b67fc700 1 -- 172.21.15.87:0/1011024129 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0052d0 con 0x7f75b8036770 2023-03-30T08:11:20.654 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f18337fe700 1 -- 172.21.15.87:0/3359887714 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1840006b90 con 0x7f184003a810 2023-03-30T08:11:20.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f30cc9b9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30c0051170 0x7f30c00e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f30cc9b9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30c0051170 0x7f30c00e4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52002/0 (socket says 172.21.15.87:52002) 2023-03-30T08:11:20.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f75b67fc700 1 -- 172.21.15.87:0/1011024129 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc005430 con 0x7f75b8036770 2023-03-30T08:11:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f75b67fc700 1 -- 172.21.15.87:0/1011024129 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0055a0 con 0x7f75b8036770 2023-03-30T08:11:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f75c6a45700 1 -- 172.21.15.87:0/1011024129 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b8037fc0 con 0x7f75b8036770 2023-03-30T08:11:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f75c5242700 1 --2- 172.21.15.87:0/1011024129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75b8037b40 0x7f75b80d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f75c6a45700 1 -- 172.21.15.87:0/1011024129 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b8051430 con 0x7f75b8036770 2023-03-30T08:11:20.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6ceffff700 1 --2- 172.21.15.87:0/879843496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce80dea70 0x7f6ce8177a30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00b3e0 tx=0x7f6cdc00b6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f30cd1ba700 1 -- 172.21.15.87:0/3884570383 learned_addr learned my addr 172.21.15.87:0/3884570383 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f30cf41e700 1 --2- 172.21.15.87:0/3884570383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30c00e6d20 0x7f30c00e4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6ced7fa700 1 -- 172.21.15.87:0/879843496 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc00bea0 con 0x7f6ce80dea70 2023-03-30T08:11:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6ced7fa700 1 -- 172.21.15.87:0/879843496 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc011830 con 0x7f6ce80dea70 2023-03-30T08:11:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6ced7fa700 1 -- 172.21.15.87:0/879843496 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc011be0 con 0x7f6ce80dea70 2023-03-30T08:11:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.592+0000 7f6cf5d97700 1 -- 172.21.15.87:0/879843496 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce80542e0 con 0x7f6ce80dea70 2023-03-30T08:11:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.596+0000 7f6cf5d97700 1 -- 172.21.15.87:0/879843496 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce8053880 con 0x7f6ce80dea70 2023-03-30T08:11:20.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.596+0000 7f30cf41e700 1 -- 172.21.15.87:0/3884570383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00e8a90 con 0x7f30c0051170 2023-03-30T08:11:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.596+0000 7f30cf41e700 1 -- 172.21.15.87:0/3884570383 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00ea000 con 0x7f30c00e6d20 2023-03-30T08:11:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.596+0000 7f30cf41e700 1 -- 172.21.15.87:0/3884570383 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00e8d30 con 0x7f30c0036d40 2023-03-30T08:11:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.596+0000 7f30cd1ba700 1 -- 172.21.15.87:0/3884570383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30c00e6d20 msgr2=0x7f30c00e4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.596+0000 7f30cd1ba700 1 --2- 172.21.15.87:0/3884570383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30c00e6d20 0x7f30c00e4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.596+0000 7f30cd1ba700 1 -- 172.21.15.87:0/3884570383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30c0051170 msgr2=0x7f30c00e4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.596+0000 7f30cd1ba700 1 --2- 172.21.15.87:0/3884570383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30c0051170 0x7f30c00e4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.596+0000 7f30cd1ba700 1 -- 172.21.15.87:0/3884570383 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c4009570 con 0x7f30c0036d40 2023-03-30T08:11:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.596+0000 7f30cd1ba700 1 --2- 172.21.15.87:0/3884570383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30c0036d40 0x7f30c004d170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f30c8066b60 tx=0x7f30c8072bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.596+0000 7f183dffb700 1 -- 172.21.15.87:0/3359887714 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f1844003a60 con 0x7f184003a810 2023-03-30T08:11:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.596+0000 7f183dffb700 1 --2- 172.21.15.87:0/3359887714 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f182c0654f0 0x7f182c0679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.596+0000 7f183dffb700 1 -- 172.21.15.87:0/3359887714 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1844021070 con 0x7f184003a810 2023-03-30T08:11:20.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.596+0000 7f184c99e700 1 --2- 172.21.15.87:0/3359887714 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f182c0654f0 0x7f182c0679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.596+0000 7f75c6a45700 1 -- 172.21.15.87:0/1011024129 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b8005530 con 0x7f75b8036770 2023-03-30T08:11:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.600+0000 7f75b67fc700 1 -- 172.21.15.87:0/1011024129 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f75bc0038e0 con 0x7f75b8036770 2023-03-30T08:11:20.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.600+0000 7f6cf5d97700 1 -- 172.21.15.87:0/879843496 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd0005310 con 0x7f6ce80dea70 2023-03-30T08:11:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.600+0000 7f184c99e700 1 --2- 172.21.15.87:0/3359887714 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f182c0654f0 0x7f182c0679a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f18400521b0 tx=0x7f1838009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.600+0000 7f75b67fc700 1 --2- 172.21.15.87:0/1011024129 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75a40654c0 0x7f75a4067970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.600+0000 7f75b67fc700 1 -- 172.21.15.87:0/1011024129 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f75bc081eb0 con 0x7f75b8036770 2023-03-30T08:11:20.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.600+0000 7f75c5242700 1 --2- 172.21.15.87:0/1011024129 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75a40654c0 0x7f75a4067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.600+0000 7f183dffb700 1 -- 172.21.15.87:0/3359887714 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f18440520c0 con 0x7f184003a810 2023-03-30T08:11:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.600+0000 7f30bdffb700 1 -- 172.21.15.87:0/3884570383 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c808d070 con 0x7f30c0036d40 2023-03-30T08:11:20.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.600+0000 7f30bdffb700 1 -- 172.21.15.87:0/3884570383 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c80671d0 con 0x7f30c0036d40 2023-03-30T08:11:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.600+0000 7f30bdffb700 1 -- 172.21.15.87:0/3884570383 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c80723c0 con 0x7f30c0036d40 2023-03-30T08:11:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.600+0000 7f30cf41e700 1 -- 172.21.15.87:0/3884570383 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c0033f00 con 0x7f30c0036d40 2023-03-30T08:11:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.604+0000 7f30cf41e700 1 -- 172.21.15.87:0/3884570383 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c0033c20 con 0x7f30c0036d40 2023-03-30T08:11:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.604+0000 7f30cf41e700 1 -- 172.21.15.87:0/3884570383 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c00341e0 con 0x7f30c0036d40 2023-03-30T08:11:20.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.604+0000 7f6ced7fa700 1 -- 172.21.15.87:0/879843496 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6cdc011d40 con 0x7f6ce80dea70 2023-03-30T08:11:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.608+0000 7f6ced7fa700 1 --2- 172.21.15.87:0/879843496 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6cd40653f0 0x7f6cd40678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.608+0000 7f6ced7fa700 1 -- 172.21.15.87:0/879843496 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6cdc082e80 con 0x7f6ce80dea70 2023-03-30T08:11:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.608+0000 7f6ced7fa700 1 -- 172.21.15.87:0/879843496 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f6cdc0832c0 con 0x7f6ce80dea70 2023-03-30T08:11:20.665 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.608+0000 7f6cf4d95700 1 --2- 172.21.15.87:0/879843496 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6cd40653f0 0x7f6cd40678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.608+0000 7f75c5242700 1 --2- 172.21.15.87:0/1011024129 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75a40654c0 0x7f75a4067970 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f75b80e3e40 tx=0x7f75b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.608+0000 7f75b67fc700 1 -- 172.21.15.87:0/1011024129 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f75bc04f8b0 con 0x7f75b8036770 2023-03-30T08:11:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.608+0000 7f6cf4d95700 1 --2- 172.21.15.87:0/879843496 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6cd40653f0 0x7f6cd40678a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400d370 tx=0x7f6ce4012000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.616+0000 7f30bdffb700 1 -- 172.21.15.87:0/3884570383 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f30c8060870 con 0x7f30c0036d40 2023-03-30T08:11:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.616+0000 7f30bdffb700 1 --2- 172.21.15.87:0/3884570383 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f30ac065440 0x7f30ac0678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.616+0000 7f30bdffb700 1 -- 172.21.15.87:0/3884570383 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f30c80fc060 con 0x7f30c0036d40 2023-03-30T08:11:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.616+0000 7f30bdffb700 1 -- 172.21.15.87:0/3884570383 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f30c80fc420 con 0x7f30c0036d40 2023-03-30T08:11:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.620+0000 7f30cc9b9700 1 --2- 172.21.15.87:0/3884570383 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f30ac065440 0x7f30ac0678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:20.667 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.620+0000 7f30cc9b9700 1 --2- 172.21.15.87:0/3884570383 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f30ac065440 0x7f30ac0678f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f30c004f080 tx=0x7f30b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:20.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.904+0000 7fa7d9cdc700 1 -- 172.21.15.87:0/1409463694 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa7d4072cf0 con 0x7fa7d40b3b00 2023-03-30T08:11:20.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.908+0000 7f55971e6700 1 -- 172.21.15.87:0/1462181242 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5570005890 con 0x7f5590071290 2023-03-30T08:11:20.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.908+0000 7fa7d17fa700 1 -- 172.21.15.87:0/1409463694 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7c40538c0 con 0x7fa7d40b3b00 2023-03-30T08:11:20.914 INFO:teuthology.orchestra.run.smithi087.stdout:60129542152 2023-03-30T08:11:20.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.908+0000 7f558d7fa700 1 -- 172.21.15.87:0/1462181242 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5580017090 con 0x7f5590071290 2023-03-30T08:11:20.914 INFO:teuthology.orchestra.run.smithi087.stdout:60129542153 2023-03-30T08:11:20.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.908+0000 7fd5e81e6700 1 -- 172.21.15.87:0/3881183232 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd5e00733a0 con 0x7fd5e00aea30 2023-03-30T08:11:20.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.908+0000 7fd5d67fc700 1 -- 172.21.15.87:0/3881183232 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd5d8053b40 con 0x7fd5e00aea30 2023-03-30T08:11:20.915 INFO:teuthology.orchestra.run.smithi087.stdout:60129542153 2023-03-30T08:11:20.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fa7baffd700 1 -- 172.21.15.87:0/1409463694 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa7c00654c0 msgr2=0x7fa7c0067970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7f55971e6700 1 -- 172.21.15.87:0/1462181242 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f557c0654c0 msgr2=0x7f557c067970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7f55971e6700 1 --2- 172.21.15.87:0/1462181242 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f557c0654c0 0x7f557c067970 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5588014040 tx=0x7f5588011000 comp rx=0 tx=0).stop 2023-03-30T08:11:20.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7f55971e6700 1 -- 172.21.15.87:0/1462181242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5590071290 msgr2=0x7f55900c8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7f55971e6700 1 --2- 172.21.15.87:0/1462181242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5590071290 0x7f55900c8f80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f558000c520 tx=0x7f558000c830 comp rx=0 tx=0).stop 2023-03-30T08:11:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7f55971e6700 1 -- 172.21.15.87:0/1462181242 shutdown_connections 2023-03-30T08:11:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7f55971e6700 1 --2- 172.21.15.87:0/1462181242 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f557c0654c0 0x7f557c067970 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fa7baffd700 1 --2- 172.21.15.87:0/1409463694 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa7c00654c0 0x7fa7c0067970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc007440 tx=0x7fa7cc00b040 comp rx=0 tx=0).stop 2023-03-30T08:11:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fa7baffd700 1 -- 172.21.15.87:0/1409463694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d40b3b00 msgr2=0x7fa7d4070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fa7baffd700 1 --2- 172.21.15.87:0/1409463694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d40b3b00 0x7fa7d4070240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4005930 tx=0x7fa7c400c880 comp rx=0 tx=0).stop 2023-03-30T08:11:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7f55971e6700 1 --2- 172.21.15.87:0/1462181242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55900b08d0 0x7f55900c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7f55971e6700 1 --2- 172.21.15.87:0/1462181242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5590071290 0x7f55900c8f80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7f55971e6700 1 --2- 172.21.15.87:0/1462181242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f559006b280 0x7f559015a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7f55971e6700 1 -- 172.21.15.87:0/1462181242 >> 172.21.15.87:0/1462181242 conn(0x7f55900cf410 msgr2=0x7f55900af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7f55971e6700 1 -- 172.21.15.87:0/1462181242 shutdown_connections 2023-03-30T08:11:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fa7baffd700 1 -- 172.21.15.87:0/1409463694 shutdown_connections 2023-03-30T08:11:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fa7baffd700 1 --2- 172.21.15.87:0/1409463694 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa7c00654c0 0x7fa7c0067970 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fa7baffd700 1 --2- 172.21.15.87:0/1409463694 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa7d40b3b00 0x7fa7d4070240 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fa7baffd700 1 --2- 172.21.15.87:0/1409463694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d4152ce0 0x7fa7d40b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fa7baffd700 1 --2- 172.21.15.87:0/1409463694 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d40c9280 0x7fa7d40c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fa7baffd700 1 -- 172.21.15.87:0/1409463694 >> 172.21.15.87:0/1409463694 conn(0x7fa7d40ce6f0 msgr2=0x7fa7d406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7f55971e6700 1 -- 172.21.15.87:0/1462181242 wait complete. 2023-03-30T08:11:20.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fa7baffd700 1 -- 172.21.15.87:0/1409463694 shutdown_connections 2023-03-30T08:11:20.920 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fa7baffd700 1 -- 172.21.15.87:0/1409463694 wait complete. 2023-03-30T08:11:20.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fd5e81e6700 1 -- 172.21.15.87:0/3881183232 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5c4065440 msgr2=0x7fd5c40678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fd5e81e6700 1 --2- 172.21.15.87:0/3881183232 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5c4065440 0x7fd5c40678f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00ca120 tx=0x7fd5d0007de0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fd5e81e6700 1 -- 172.21.15.87:0/3881183232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5e00aea30 msgr2=0x7fd5e01f6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fd5e81e6700 1 --2- 172.21.15.87:0/3881183232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5e00aea30 0x7fd5e01f6bb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800cc50 tx=0x7fd5d800cf60 comp rx=0 tx=0).stop 2023-03-30T08:11:20.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fd5e81e6700 1 -- 172.21.15.87:0/3881183232 shutdown_connections 2023-03-30T08:11:20.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fd5e81e6700 1 --2- 172.21.15.87:0/3881183232 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5c4065440 0x7fd5c40678f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fd5e81e6700 1 --2- 172.21.15.87:0/3881183232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5e0164190 0x7fd5e00c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fd5e81e6700 1 --2- 172.21.15.87:0/3881183232 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e0163dc0 0x7fd5e0157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.923 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fd5e81e6700 1 --2- 172.21.15.87:0/3881183232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5e00aea30 0x7fd5e01f6bb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.923 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fd5e81e6700 1 -- 172.21.15.87:0/3881183232 >> 172.21.15.87:0/3881183232 conn(0x7fd5e00cf410 msgr2=0x7fd5e0164590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.923 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fd5e81e6700 1 -- 172.21.15.87:0/3881183232 shutdown_connections 2023-03-30T08:11:20.923 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.912+0000 7fd5e81e6700 1 -- 172.21.15.87:0/3881183232 wait complete. 2023-03-30T08:11:20.923 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.916+0000 7f9af5e66700 1 -- 172.21.15.87:0/2143127730 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9ad0005890 con 0x7f9ae8036cb0 2023-03-30T08:11:20.924 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.916+0000 7f9aed7fa700 1 -- 172.21.15.87:0/2143127730 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9af0097020 con 0x7f9ae8036cb0 2023-03-30T08:11:20.924 INFO:teuthology.orchestra.run.smithi087.stdout:60129542153 2023-03-30T08:11:20.926 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.920+0000 7f18337fe700 1 -- 172.21.15.87:0/3359887714 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f184004c4f0 con 0x7f184003a810 2023-03-30T08:11:20.926 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.920+0000 7f9adaffd700 1 -- 172.21.15.87:0/2143127730 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ad40653f0 msgr2=0x7f9ad40678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.927 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.920+0000 7f9adaffd700 1 --2- 172.21.15.87:0/2143127730 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ad40653f0 0x7f9ad40678a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009c30 tx=0x7f9adc01d040 comp rx=0 tx=0).stop 2023-03-30T08:11:20.927 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.920+0000 7f9adaffd700 1 -- 172.21.15.87:0/2143127730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae8036cb0 msgr2=0x7f9ae80d5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.927 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.920+0000 7f9adaffd700 1 --2- 172.21.15.87:0/2143127730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae8036cb0 0x7f9ae80d5600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9af00696d0 tx=0x7f9af00740f0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.927 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.920+0000 7f9adaffd700 1 -- 172.21.15.87:0/2143127730 shutdown_connections 2023-03-30T08:11:20.927 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.920+0000 7f9adaffd700 1 --2- 172.21.15.87:0/2143127730 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ad40653f0 0x7f9ad40678a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.927 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.920+0000 7f9adaffd700 1 --2- 172.21.15.87:0/2143127730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ae80e6e60 0x7f9ae80e6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.927 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.920+0000 7f9adaffd700 1 --2- 172.21.15.87:0/2143127730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ae80512b0 0x7f9ae80e5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.920+0000 7f9adaffd700 1 --2- 172.21.15.87:0/2143127730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae8036cb0 0x7f9ae80d5600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.920+0000 7f9adaffd700 1 -- 172.21.15.87:0/2143127730 >> 172.21.15.87:0/2143127730 conn(0x7f9ae8051770 msgr2=0x7f9ae8036520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.924+0000 7f9adaffd700 1 -- 172.21.15.87:0/2143127730 shutdown_connections 2023-03-30T08:11:20.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.924+0000 7f9adaffd700 1 -- 172.21.15.87:0/2143127730 wait complete. 2023-03-30T08:11:20.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.924+0000 7f183dffb700 1 -- 172.21.15.87:0/3359887714 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1844015020 con 0x7f184003a810 2023-03-30T08:11:20.929 INFO:teuthology.orchestra.run.smithi087.stdout:60129542152 2023-03-30T08:11:20.930 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.924+0000 7f75c6a45700 1 -- 172.21.15.87:0/1011024129 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f75b8033f80 con 0x7f75b8036770 2023-03-30T08:11:20.930 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.924+0000 7f75b67fc700 1 -- 172.21.15.87:0/1011024129 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75bc052ed0 con 0x7f75b8036770 2023-03-30T08:11:20.931 INFO:teuthology.orchestra.run.smithi087.stdout:64424509448 2023-03-30T08:11:20.932 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f6cf5d97700 1 -- 172.21.15.87:0/879843496 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6cd0005890 con 0x7f6ce80dea70 2023-03-30T08:11:20.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f184e1a1700 1 -- 172.21.15.87:0/3359887714 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f182c0654f0 msgr2=0x7f182c0679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f184e1a1700 1 --2- 172.21.15.87:0/3359887714 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f182c0654f0 0x7f182c0679a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f18400521b0 tx=0x7f1838009040 comp rx=0 tx=0).stop 2023-03-30T08:11:20.933 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f184e1a1700 1 -- 172.21.15.87:0/3359887714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f184003a810 msgr2=0x7f18400d4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f184e1a1700 1 --2- 172.21.15.87:0/3359887714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f184003a810 0x7f18400d4d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1844000c00 tx=0x7f1844004770 comp rx=0 tx=0).stop 2023-03-30T08:11:20.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f6ced7fa700 1 -- 172.21.15.87:0/879843496 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6cdc0542b0 con 0x7f6ce80dea70 2023-03-30T08:11:20.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f184e1a1700 1 -- 172.21.15.87:0/3359887714 shutdown_connections 2023-03-30T08:11:20.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f184e1a1700 1 --2- 172.21.15.87:0/3359887714 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f182c0654f0 0x7f182c0679a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f184e1a1700 1 --2- 172.21.15.87:0/3359887714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1840054800 0x7f18400ea940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f184e1a1700 1 --2- 172.21.15.87:0/3359887714 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1840052280 0x7f18400d6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f184e1a1700 1 --2- 172.21.15.87:0/3359887714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f184003a810 0x7f18400d4d40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f184e1a1700 1 -- 172.21.15.87:0/3359887714 >> 172.21.15.87:0/3359887714 conn(0x7f1840051770 msgr2=0x7f1840048820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f184e1a1700 1 -- 172.21.15.87:0/3359887714 shutdown_connections 2023-03-30T08:11:20.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f75c6a45700 1 -- 172.21.15.87:0/1011024129 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75a40654c0 msgr2=0x7f75a4067970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f184e1a1700 1 -- 172.21.15.87:0/3359887714 wait complete. 2023-03-30T08:11:20.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f75c6a45700 1 --2- 172.21.15.87:0/1011024129 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75a40654c0 0x7f75a4067970 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f75b80e3e40 tx=0x7f75b0009040 comp rx=0 tx=0).stop 2023-03-30T08:11:20.937 INFO:teuthology.orchestra.run.smithi087.stdout:60129542153 2023-03-30T08:11:20.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f75c6a45700 1 -- 172.21.15.87:0/1011024129 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75b8036770 msgr2=0x7f75b8048820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f75c6a45700 1 --2- 172.21.15.87:0/1011024129 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75b8036770 0x7f75b8048820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00c500 tx=0x7f75bc00c810 comp rx=0 tx=0).stop 2023-03-30T08:11:20.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f75c6a45700 1 -- 172.21.15.87:0/1011024129 shutdown_connections 2023-03-30T08:11:20.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f75c6a45700 1 --2- 172.21.15.87:0/1011024129 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75a40654c0 0x7f75a4067970 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f75c6a45700 1 --2- 172.21.15.87:0/1011024129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75b80e12a0 0x7f75b80538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.928+0000 7f75c6a45700 1 --2- 172.21.15.87:0/1011024129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75b8037b40 0x7f75b80d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.932+0000 7f75c6a45700 1 --2- 172.21.15.87:0/1011024129 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75b8036770 0x7f75b8048820 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.932+0000 7f75c6a45700 1 -- 172.21.15.87:0/1011024129 >> 172.21.15.87:0/1011024129 conn(0x7f75b8051770 msgr2=0x7f75b8005950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.932+0000 7f75c6a45700 1 -- 172.21.15.87:0/1011024129 shutdown_connections 2023-03-30T08:11:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.932+0000 7f75c6a45700 1 -- 172.21.15.87:0/1011024129 wait complete. 2023-03-30T08:11:20.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.936+0000 7f30cf41e700 1 -- 172.21.15.87:0/3884570383 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f30c00e8e70 con 0x7f30c0036d40 2023-03-30T08:11:20.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.936+0000 7f30bdffb700 1 -- 172.21.15.87:0/3884570383 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f30c00e8e70 con 0x7f30c0036d40 2023-03-30T08:11:20.941 INFO:teuthology.orchestra.run.smithi087.stdout:60129542152 2023-03-30T08:11:20.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.0 2023-03-30T08:11:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f6cf5d97700 1 -- 172.21.15.87:0/879843496 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6cd40653f0 msgr2=0x7f6cd40678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f6cf5d97700 1 --2- 172.21.15.87:0/879843496 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6cd40653f0 0x7f6cd40678a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400d370 tx=0x7f6ce4012000 comp rx=0 tx=0).stop 2023-03-30T08:11:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f6cf5d97700 1 -- 172.21.15.87:0/879843496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce80dea70 msgr2=0x7f6ce8177a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f6cf5d97700 1 --2- 172.21.15.87:0/879843496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce80dea70 0x7f6ce8177a30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00b3e0 tx=0x7f6cdc00b6f0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f6cf5d97700 1 -- 172.21.15.87:0/879843496 shutdown_connections 2023-03-30T08:11:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f6cf5d97700 1 --2- 172.21.15.87:0/879843496 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6cd40653f0 0x7f6cd40678a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f6cf5d97700 1 --2- 172.21.15.87:0/879843496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ce80dee40 0x7f6ce804cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f6cf5d97700 1 --2- 172.21.15.87:0/879843496 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ce80dea70 0x7f6ce8177a30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f6cf5d97700 1 --2- 172.21.15.87:0/879843496 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ce80372d0 0x7f6ce81774f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f6cf5d97700 1 -- 172.21.15.87:0/879843496 >> 172.21.15.87:0/879843496 conn(0x7f6ce8051bc0 msgr2=0x7f6ce80d94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f6cf5d97700 1 -- 172.21.15.87:0/879843496 shutdown_connections 2023-03-30T08:11:20.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f6cf5d97700 1 -- 172.21.15.87:0/879843496 wait complete. 2023-03-30T08:11:20.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.5 2023-03-30T08:11:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f30cf41e700 1 -- 172.21.15.87:0/3884570383 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f30ac065440 msgr2=0x7f30ac0678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f30cf41e700 1 --2- 172.21.15.87:0/3884570383 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f30ac065440 0x7f30ac0678f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f30c004f080 tx=0x7f30b8008040 comp rx=0 tx=0).stop 2023-03-30T08:11:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f30cf41e700 1 -- 172.21.15.87:0/3884570383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30c0036d40 msgr2=0x7f30c004d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f30cf41e700 1 --2- 172.21.15.87:0/3884570383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30c0036d40 0x7f30c004d170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f30c8066b60 tx=0x7f30c8072bb0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f30cf41e700 1 -- 172.21.15.87:0/3884570383 shutdown_connections 2023-03-30T08:11:20.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f30cf41e700 1 --2- 172.21.15.87:0/3884570383 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f30ac065440 0x7f30ac0678f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f30cf41e700 1 --2- 172.21.15.87:0/3884570383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30c00e6d20 0x7f30c00e4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f30cf41e700 1 --2- 172.21.15.87:0/3884570383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f30c0051170 0x7f30c00e4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f30cf41e700 1 --2- 172.21.15.87:0/3884570383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30c0036d40 0x7f30c004d170 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f30cf41e700 1 -- 172.21.15.87:0/3884570383 >> 172.21.15.87:0/3884570383 conn(0x7f30c0051630 msgr2=0x7f30c0005810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f30cf41e700 1 -- 172.21.15.87:0/3884570383 shutdown_connections 2023-03-30T08:11:20.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:20.940+0000 7f30cf41e700 1 -- 172.21.15.87:0/3884570383 wait complete. 2023-03-30T08:11:20.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.3 2023-03-30T08:11:20.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.1 2023-03-30T08:11:20.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509448 for osd.6 2023-03-30T08:11:20.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.4 2023-03-30T08:11:20.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.2 2023-03-30T08:11:20.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.7 2023-03-30T08:11:21.944 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-03-30T08:11:21.947 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-03-30T08:11:21.949 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-03-30T08:11:21.953 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-03-30T08:11:21.962 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-03-30T08:11:21.962 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-03-30T08:11:21.965 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-03-30T08:11:21.968 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-03-30T08:11:22.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.128+0000 7f9ae4a9b700 1 Processor -- start 2023-03-30T08:11:22.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.128+0000 7f9ae4a9b700 1 -- start start 2023-03-30T08:11:22.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.128+0000 7f9ae4a9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ae006c4f0 0x7f9ae0069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9ae4a9b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae00ca8d0 con 0x7f9ae00b08d0 2023-03-30T08:11:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9ae4a9b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae00aeeb0 con 0x7f9ae006b280 2023-03-30T08:11:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9ae4a9b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00c9cc0 con 0x7f9ae006c4f0 2023-03-30T08:11:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9addd9b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9ae00b08d0 0x7f9ae006a210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48560/0 (socket says 172.21.15.87:48560) 2023-03-30T08:11:22.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9addd9b700 1 -- 172.21.15.87:0/363208036 learned_addr learned my addr 172.21.15.87:0/363208036 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9add59a700 1 -- 172.21.15.87:0/363208036 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159513436 0 0) 0x7f9ae00ca8d0 con 0x7f9ae00b08d0 2023-03-30T08:11:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9ade59c700 1 --2- 172.21.15.87:0/363208036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ae006c4f0 0x7f9ae0069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9add59a700 1 -- 172.21.15.87:0/363208036 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ac80035d0 con 0x7f9ae00b08d0 2023-03-30T08:11:22.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9add59a700 1 -- 172.21.15.87:0/363208036 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1604375885 0 0) 0x7f9ac80035d0 con 0x7f9ae00b08d0 2023-03-30T08:11:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9add59a700 1 -- 172.21.15.87:0/363208036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ae006c4f0 msgr2=0x7f9ae0069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9add59a700 1 --2- 172.21.15.87:0/363208036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ae006c4f0 0x7f9ae0069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9add59a700 1 -- 172.21.15.87:0/363208036 >> v1:172.21.15.115:6789/0 conn(0x7f9ae006b280 legacy=0x7f9ae00af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9add59a700 1 -- 172.21.15.87:0/363208036 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae00c9fa0 con 0x7f9ae00b08d0 2023-03-30T08:11:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9add59a700 1 -- 172.21.15.87:0/363208036 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f9ad80019f0 con 0x7f9ae00b08d0 2023-03-30T08:11:22.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9add59a700 1 -- 172.21.15.87:0/363208036 >> v1:172.21.15.87:6789/0 conn(0x7f9ae00b08d0 legacy=0x7f9ae006a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9add59a700 1 --2- 172.21.15.87:0/363208036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ac8003a50 0x7f9ac8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9add59a700 1 --2- 172.21.15.87:0/363208036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ac8004450 0x7f9ac8004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9add59a700 1 --2- 172.21.15.87:0/363208036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ac80051b0 0x7f9ac800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9add59a700 1 -- 172.21.15.87:0/363208036 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00c9cc0 con 0x7f9ac80051b0 2023-03-30T08:11:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9add59a700 1 -- 172.21.15.87:0/363208036 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac800c0b0 con 0x7f9ac8004450 2023-03-30T08:11:22.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9add59a700 1 -- 172.21.15.87:0/363208036 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac800c270 con 0x7f9ac8003a50 2023-03-30T08:11:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9aded9d700 1 --2- 172.21.15.87:0/363208036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ac80051b0 0x7f9ac800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9addd9b700 1 --2- 172.21.15.87:0/363208036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ac8004450 0x7f9ac8004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.132+0000 7f9ade59c700 1 --2- 172.21.15.87:0/363208036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ac8003a50 0x7f9ac8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9addd9b700 1 -- 172.21.15.87:0/363208036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ac8003a50 msgr2=0x7f9ac8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:22.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9addd9b700 1 --2- 172.21.15.87:0/363208036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ac8003a50 0x7f9ac8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9addd9b700 1 -- 172.21.15.87:0/363208036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ac80051b0 msgr2=0x7f9ac800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9addd9b700 1 --2- 172.21.15.87:0/363208036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ac80051b0 0x7f9ac800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9addd9b700 1 -- 172.21.15.87:0/363208036 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae00c9fa0 con 0x7f9ac8004450 2023-03-30T08:11:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9ade59c700 1 --2- 172.21.15.87:0/363208036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ac8003a50 0x7f9ac8003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:22.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9addd9b700 1 --2- 172.21.15.87:0/363208036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ac8004450 0x7f9ac8004910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800fa70 tx=0x7f9ac80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b93b6af4f2f5da4 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9add59a700 1 -- 172.21.15.87:0/363208036 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad800d040 con 0x7f9ac8004450 2023-03-30T08:11:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9add59a700 1 -- 172.21.15.87:0/363208036 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad80119d0 con 0x7f9ac8004450 2023-03-30T08:11:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9add59a700 1 -- 172.21.15.87:0/363208036 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad800fea0 con 0x7f9ac8004450 2023-03-30T08:11:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9ae4a9b700 1 -- 172.21.15.87:0/363208036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ac8004450 msgr2=0x7f9ac8004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9ae4a9b700 1 --2- 172.21.15.87:0/363208036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ac8004450 0x7f9ac8004910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800fa70 tx=0x7f9ac80058a0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9aded9d700 1 -- 172.21.15.87:0/363208036 reap_dead start 2023-03-30T08:11:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9ae4a9b700 1 -- 172.21.15.87:0/363208036 shutdown_connections 2023-03-30T08:11:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9ae4a9b700 1 -- 172.21.15.87:0/363208036 >> 172.21.15.87:0/363208036 conn(0x7f9ae00cf410 msgr2=0x7f9ae00cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9ae4a9b700 1 -- 172.21.15.87:0/363208036 shutdown_connections 2023-03-30T08:11:22.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.136+0000 7f9ae4a9b700 1 -- 172.21.15.87:0/363208036 wait complete. 2023-03-30T08:11:22.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.140+0000 7f9ae4a9b700 1 Processor -- start 2023-03-30T08:11:22.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.140+0000 7f9ae4a9b700 1 -- start start 2023-03-30T08:11:22.147 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9ae4a9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ac8004450 0x7f9ae0148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.147 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9ae4a9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae00c8880 0x7f9ae00c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.147 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9ae4a9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ae00c7100 0x7f9ae0159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9ae4a9b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae014a030 con 0x7f9ae00c7100 2023-03-30T08:11:22.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9ae4a9b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae0149200 con 0x7f9ae00c8880 2023-03-30T08:11:22.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9ae4a9b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae01493f0 con 0x7f9ac8004450 2023-03-30T08:11:22.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9addd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae00c8880 0x7f9ae00c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9addd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae00c8880 0x7f9ae00c6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34404/0 (socket says 172.21.15.87:34404) 2023-03-30T08:11:22.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9aded9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ae00c7100 0x7f9ae0159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9addd9b700 1 -- 172.21.15.87:0/323657085 learned_addr learned my addr 172.21.15.87:0/323657085 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:22.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9ade59c700 1 --2- 172.21.15.87:0/323657085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ac8004450 0x7f9ae0148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9addd9b700 1 -- 172.21.15.87:0/323657085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ac8004450 msgr2=0x7f9ae0148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9addd9b700 1 --2- 172.21.15.87:0/323657085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ac8004450 0x7f9ae0148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9addd9b700 1 -- 172.21.15.87:0/323657085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ae00c7100 msgr2=0x7f9ae0159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9addd9b700 1 --2- 172.21.15.87:0/323657085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ae00c7100 0x7f9ae0159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9addd9b700 1 -- 172.21.15.87:0/323657085 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae00ca560 con 0x7f9ae00c8880 2023-03-30T08:11:22.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9addd9b700 1 --2- 172.21.15.87:0/323657085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae00c8880 0x7f9ae00c6bc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8011520 tx=0x7f9ad8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9aceffd700 1 -- 172.21.15.87:0/323657085 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8025070 con 0x7f9ae00c8880 2023-03-30T08:11:22.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9aceffd700 1 -- 172.21.15.87:0/323657085 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad8011d50 con 0x7f9ae00c8880 2023-03-30T08:11:22.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9aceffd700 1 -- 172.21.15.87:0/323657085 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad800f4e0 con 0x7f9ae00c8880 2023-03-30T08:11:22.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9ae4a9b700 1 -- 172.21.15.87:0/323657085 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae00ca280 con 0x7f9ae00c8880 2023-03-30T08:11:22.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.144+0000 7f9ae4a9b700 1 -- 172.21.15.87:0/323657085 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae00b0e20 con 0x7f9ae00c8880 2023-03-30T08:11:22.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.148+0000 7f341cd96700 1 Processor -- start 2023-03-30T08:11:22.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.148+0000 7f9ae4a9b700 1 -- 172.21.15.87:0/323657085 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae014a170 con 0x7f9ae00c8880 2023-03-30T08:11:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.148+0000 7f9aceffd700 1 -- 172.21.15.87:0/323657085 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f9ad8015660 con 0x7f9ae00c8880 2023-03-30T08:11:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.148+0000 7f341cd96700 1 -- start start 2023-03-30T08:11:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.148+0000 7f341cd96700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34180b08d0 0x7f341806a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.148+0000 7f341cd96700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f341806b280 0x7f34180af350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.148+0000 7f341cd96700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34180ca8d0 con 0x7f341806c4f0 2023-03-30T08:11:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.148+0000 7f341cd96700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34180aeeb0 con 0x7f341806b280 2023-03-30T08:11:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.148+0000 7f341cd96700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34180c9cc0 con 0x7f34180b08d0 2023-03-30T08:11:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f341659c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f341806c4f0 0x7f3418069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:40962/0 (socket says 172.21.15.87:40962) 2023-03-30T08:11:22.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f341659c700 1 -- 172.21.15.87:0/663301083 learned_addr learned my addr 172.21.15.87:0/663301083 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f3415d9b700 1 --2- 172.21.15.87:0/663301083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34180b08d0 0x7f341806a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f3416d9d700 1 --2- 172.21.15.87:0/663301083 >> v2:172.21.15.87:3300/0 conn(0x7f341806b280 0x7f34180af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f9aceffd700 1 --2- 172.21.15.87:0/323657085 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ac00653f0 0x7f9ac00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f9aceffd700 1 -- 172.21.15.87:0/323657085 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9ad800c070 con 0x7f9ae00c8880 2023-03-30T08:11:22.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f9ade59c700 1 --2- 172.21.15.87:0/323657085 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ac00653f0 0x7f9ac00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f3415d9b700 1 -- 172.21.15.87:0/663301083 >> v2:172.21.15.87:3300/0 conn(0x7f341806b280 msgr2=0x7f34180af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f3415d9b700 1 --2- 172.21.15.87:0/663301083 >> v2:172.21.15.87:3300/0 conn(0x7f341806b280 0x7f34180af350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f3415d9b700 1 -- 172.21.15.87:0/663301083 >> v1:172.21.15.115:6789/0 conn(0x7f341806c4f0 legacy=0x7f3418069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f3415d9b700 1 -- 172.21.15.87:0/663301083 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34180c9fa0 con 0x7f34180b08d0 2023-03-30T08:11:22.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f3416d9d700 1 --2- 172.21.15.87:0/663301083 >> v2:172.21.15.87:3300/0 conn(0x7f341806b280 0x7f34180af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:22.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f3415d9b700 1 --2- 172.21.15.87:0/663301083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34180b08d0 0x7f341806a3e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3408009870 tx=0x7f3408009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e65a21d5356184fd server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f341559a700 1 -- 172.21.15.87:0/663301083 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408017070 con 0x7f34180b08d0 2023-03-30T08:11:22.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f341559a700 1 -- 172.21.15.87:0/663301083 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340800d040 con 0x7f34180b08d0 2023-03-30T08:11:22.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f341559a700 1 -- 172.21.15.87:0/663301083 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408006d70 con 0x7f34180b08d0 2023-03-30T08:11:22.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f9ade59c700 1 --2- 172.21.15.87:0/323657085 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ac00653f0 0x7f9ac00678a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00c8670 tx=0x7f9ad4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f341cd96700 1 -- 172.21.15.87:0/663301083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34180b08d0 msgr2=0x7f341806a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.152+0000 7f341cd96700 1 --2- 172.21.15.87:0/663301083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34180b08d0 0x7f341806a3e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3408009870 tx=0x7f3408009b80 comp rx=0 tx=0).stop 2023-03-30T08:11:22.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.156+0000 7f341cd96700 1 -- 172.21.15.87:0/663301083 shutdown_connections 2023-03-30T08:11:22.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.156+0000 7f341cd96700 1 --2- 172.21.15.87:0/663301083 >> v2:172.21.15.87:3300/0 conn(0x7f341806b280 0x7f34180af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.156+0000 7f341cd96700 1 --2- 172.21.15.87:0/663301083 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34180b08d0 0x7f341806a3e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.156+0000 7f341cd96700 1 -- 172.21.15.87:0/663301083 >> 172.21.15.87:0/663301083 conn(0x7f34180cf410 msgr2=0x7f34180cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.156+0000 7f341cd96700 1 -- 172.21.15.87:0/663301083 shutdown_connections 2023-03-30T08:11:22.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.156+0000 7f341cd96700 1 -- 172.21.15.87:0/663301083 wait complete. 2023-03-30T08:11:22.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.156+0000 7f9aceffd700 1 -- 172.21.15.87:0/323657085 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f9ad8056810 con 0x7f9ae00c8880 2023-03-30T08:11:22.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.156+0000 7f341cd96700 1 Processor -- start 2023-03-30T08:11:22.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.156+0000 7f341cd96700 1 -- start start 2023-03-30T08:11:22.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.160+0000 7f341cd96700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f341806b280 0x7f34181f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.160+0000 7f341cd96700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341806c4f0 0x7f34180c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.160+0000 7f341cd96700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34180b08d0 0x7f34180c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.160+0000 7f3415d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341806c4f0 0x7f34180c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.160+0000 7f3415d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341806c4f0 0x7f34180c22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:34160/0 (socket says 172.21.15.87:34160) 2023-03-30T08:11:22.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.160+0000 7f3416d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34180b08d0 0x7f34180c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.160+0000 7f3416d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34180b08d0 0x7f34180c27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52034/0 (socket says 172.21.15.87:52034) 2023-03-30T08:11:22.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.160+0000 7f3415d9b700 1 -- 172.21.15.87:0/2193265493 learned_addr learned my addr 172.21.15.87:0/2193265493 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:22.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.160+0000 7f341cd96700 1 -- 172.21.15.87:0/2193265493 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34180c42a0 con 0x7f34180b08d0 2023-03-30T08:11:22.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.160+0000 7f341cd96700 1 -- 172.21.15.87:0/2193265493 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34180c4580 con 0x7f341806b280 2023-03-30T08:11:22.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.160+0000 7f341cd96700 1 -- 172.21.15.87:0/2193265493 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34180c4860 con 0x7f341806c4f0 2023-03-30T08:11:22.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.164+0000 7f341659c700 1 --2- 172.21.15.87:0/2193265493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f341806b280 0x7f34181f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.164+0000 7f3415d9b700 1 -- 172.21.15.87:0/2193265493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f341806b280 msgr2=0x7f34181f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.164+0000 7f3415d9b700 1 --2- 172.21.15.87:0/2193265493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f341806b280 0x7f34181f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.164+0000 7f3415d9b700 1 -- 172.21.15.87:0/2193265493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34180b08d0 msgr2=0x7f34180c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.164+0000 7f3415d9b700 1 --2- 172.21.15.87:0/2193265493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34180b08d0 0x7f34180c27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.164+0000 7f3415d9b700 1 -- 172.21.15.87:0/2193265493 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341000bc80 con 0x7f341806c4f0 2023-03-30T08:11:22.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.164+0000 7f3415d9b700 1 --2- 172.21.15.87:0/2193265493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341806c4f0 0x7f34180c22b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3408014000 tx=0x7f34080047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.164+0000 7f3406ffd700 1 -- 172.21.15.87:0/2193265493 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408017070 con 0x7f341806c4f0 2023-03-30T08:11:22.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.164+0000 7f3406ffd700 1 -- 172.21.15.87:0/2193265493 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3408018040 con 0x7f341806c4f0 2023-03-30T08:11:22.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.164+0000 7f3406ffd700 1 -- 172.21.15.87:0/2193265493 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408003b10 con 0x7f341806c4f0 2023-03-30T08:11:22.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.164+0000 7f341cd96700 1 -- 172.21.15.87:0/2193265493 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34080094d0 con 0x7f341806c4f0 2023-03-30T08:11:22.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.164+0000 7f341cd96700 1 -- 172.21.15.87:0/2193265493 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34180ca560 con 0x7f341806c4f0 2023-03-30T08:11:22.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.168+0000 7f341cd96700 1 -- 172.21.15.87:0/2193265493 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34180ca280 con 0x7f341806c4f0 2023-03-30T08:11:22.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.172+0000 7f3406ffd700 1 -- 172.21.15.87:0/2193265493 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f3408003c70 con 0x7f341806c4f0 2023-03-30T08:11:22.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.172+0000 7f3406ffd700 1 --2- 172.21.15.87:0/2193265493 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f33f80654f0 0x7f33f80679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.172+0000 7f3406ffd700 1 -- 172.21.15.87:0/2193265493 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3408083720 con 0x7f341806c4f0 2023-03-30T08:11:22.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.172+0000 7f341659c700 1 --2- 172.21.15.87:0/2193265493 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f33f80654f0 0x7f33f80679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.172+0000 7f341659c700 1 --2- 172.21.15.87:0/2193265493 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f33f80654f0 0x7f33f80679a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f340c007fd0 tx=0x7f340c00a310 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.180+0000 7f3406ffd700 1 -- 172.21.15.87:0/2193265493 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f3408051120 con 0x7f341806c4f0 2023-03-30T08:11:22.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.200+0000 7efd84c0a700 1 Processor -- start 2023-03-30T08:11:22.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.200+0000 7efd84c0a700 1 -- start start 2023-03-30T08:11:22.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.200+0000 7efd84c0a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efd8015c340 0x7efd8015c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.200+0000 7efd84c0a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efd8006b1b0 0x7efd80069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.200+0000 7efd84c0a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8006c790 con 0x7efd800adc30 2023-03-30T08:11:22.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.200+0000 7efd84c0a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd800ac790 con 0x7efd8006b1b0 2023-03-30T08:11:22.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.200+0000 7efd84c0a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd800c9ee0 con 0x7efd8015c340 2023-03-30T08:11:22.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.200+0000 7efd7ed9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efd8006b1b0 0x7efd80069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.200+0000 7efd7ed9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7efd8006b1b0 0x7efd80069cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52044/0 (socket says 172.21.15.87:52044) 2023-03-30T08:11:22.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.200+0000 7efd7ed9d700 1 -- 172.21.15.87:0/2222222211 learned_addr learned my addr 172.21.15.87:0/2222222211 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:22.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.200+0000 7efd7e59c700 1 --2- 172.21.15.87:0/2222222211 >> v2:172.21.15.115:3300/0 conn(0x7efd8015c340 0x7efd8015c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.200+0000 7efd7ed9d700 1 -- 172.21.15.87:0/2222222211 >> v2:172.21.15.115:3300/0 conn(0x7efd8015c340 msgr2=0x7efd8015c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:22.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.200+0000 7efd7ed9d700 1 --2- 172.21.15.87:0/2222222211 >> v2:172.21.15.115:3300/0 conn(0x7efd8015c340 0x7efd8015c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.200+0000 7efd7ed9d700 1 -- 172.21.15.87:0/2222222211 >> v1:172.21.15.115:6789/0 conn(0x7efd800adc30 legacy=0x7efd800ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.200+0000 7efd7ed9d700 1 -- 172.21.15.87:0/2222222211 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8006b610 con 0x7efd8006b1b0 2023-03-30T08:11:22.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.204+0000 7efd7ed9d700 1 --2- 172.21.15.87:0/2222222211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd8006b1b0 0x7efd80069cd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd8006f550 tx=0x7efd7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6ac2b6f681b8d7 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.204+0000 7efd7d59a700 1 -- 172.21.15.87:0/2222222211 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000e070 con 0x7efd8006b1b0 2023-03-30T08:11:22.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.204+0000 7efd7d59a700 1 -- 172.21.15.87:0/2222222211 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7000b9c0 con 0x7efd8006b1b0 2023-03-30T08:11:22.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.204+0000 7efd7d59a700 1 -- 172.21.15.87:0/2222222211 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000bd70 con 0x7efd8006b1b0 2023-03-30T08:11:22.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.204+0000 7f52c9e51700 1 Processor -- start 2023-03-30T08:11:22.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.204+0000 7efd84c0a700 1 -- 172.21.15.87:0/2222222211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd8006b1b0 msgr2=0x7efd80069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.204+0000 7efd84c0a700 1 --2- 172.21.15.87:0/2222222211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd8006b1b0 0x7efd80069cd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd8006f550 tx=0x7efd7000b330 comp rx=0 tx=0).stop 2023-03-30T08:11:22.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.204+0000 7f52c9e51700 1 -- start start 2023-03-30T08:11:22.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.204+0000 7efd84c0a700 1 -- 172.21.15.87:0/2222222211 shutdown_connections 2023-03-30T08:11:22.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.204+0000 7efd84c0a700 1 --2- 172.21.15.87:0/2222222211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd8006b1b0 0x7efd80069cd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.204+0000 7efd84c0a700 1 --2- 172.21.15.87:0/2222222211 >> v2:172.21.15.115:3300/0 conn(0x7efd8015c340 0x7efd8015c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.204+0000 7efd84c0a700 1 -- 172.21.15.87:0/2222222211 >> 172.21.15.87:0/2222222211 conn(0x7efd800cf410 msgr2=0x7efd800cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.204+0000 7efd84c0a700 1 -- 172.21.15.87:0/2222222211 shutdown_connections 2023-03-30T08:11:22.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.204+0000 7efd84c0a700 1 -- 172.21.15.87:0/2222222211 wait complete. 2023-03-30T08:11:22.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c9e51700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f52bc0e07e0 0x7f52bc055920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c3fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f52bc00c3f0 0x7f52bc039d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48568/0 (socket says 172.21.15.87:48568) 2023-03-30T08:11:22.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c37fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f52bc0e07e0 0x7f52bc055920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c37fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f52bc0e07e0 0x7f52bc055920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34434/0 (socket says 172.21.15.87:34434) 2023-03-30T08:11:22.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c3fff700 1 -- 172.21.15.87:0/1308479809 learned_addr learned my addr 172.21.15.87:0/1308479809 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:22.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7efd84c0a700 1 Processor -- start 2023-03-30T08:11:22.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c9e51700 1 -- 172.21.15.87:0/1308479809 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc056c00 con 0x7f52bc00c3f0 2023-03-30T08:11:22.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7efd84c0a700 1 -- start start 2023-03-30T08:11:22.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c9e51700 1 -- 172.21.15.87:0/1308479809 --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc053260 con 0x7f52bc0361d0 2023-03-30T08:11:22.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c9e51700 1 -- 172.21.15.87:0/1308479809 --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52bc053820 con 0x7f52bc0e07e0 2023-03-30T08:11:22.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804161828 0 0) 0x7f52bc056c00 con 0x7f52bc00c3f0 2023-03-30T08:11:22.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b40035d0 con 0x7f52bc00c3f0 2023-03-30T08:11:22.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964789265 0 0) 0x7f52bc053260 con 0x7f52bc0361d0 2023-03-30T08:11:22.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f3b61f58700 1 Processor -- start 2023-03-30T08:11:22.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52bc056c00 con 0x7f52bc0361d0 2023-03-30T08:11:22.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3370863170 0 0) 0x7f52b40035d0 con 0x7f52bc00c3f0 2023-03-30T08:11:22.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 >> v2:172.21.15.115:3300/0 conn(0x7f52bc0e07e0 msgr2=0x7f52bc055920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:22.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 --2- 172.21.15.87:0/1308479809 >> v2:172.21.15.115:3300/0 conn(0x7f52bc0e07e0 0x7f52bc055920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 >> v1:172.21.15.115:6789/0 conn(0x7f52bc0361d0 legacy=0x7f52bc051630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc053540 con 0x7f52bc00c3f0 2023-03-30T08:11:22.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f52c4073180 con 0x7f52bc00c3f0 2023-03-30T08:11:22.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 >> v1:172.21.15.87:6789/0 conn(0x7f52bc00c3f0 legacy=0x7f52bc039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 --2- 172.21.15.87:0/1308479809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52b4003bb0 0x7f52b4003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 --2- 172.21.15.87:0/1308479809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f52b4004870 0x7f52b4004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 --2- 172.21.15.87:0/1308479809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b4009a20 0x7f52b4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc053820 con 0x7f52b4003bb0 2023-03-30T08:11:22.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b4014890 con 0x7f52b4009a20 2023-03-30T08:11:22.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b4009e90 con 0x7f52b4004870 2023-03-30T08:11:22.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7efd84c0a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd8006b1b0 0x7efd80154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7fd631dba700 1 Processor -- start 2023-03-30T08:11:22.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c2ffd700 1 --2- 172.21.15.87:0/1308479809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f52b4004870 0x7f52b4004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f52c37fe700 1 --2- 172.21.15.87:0/1308479809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52b4003bb0 0x7f52b4003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd84c0a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd800adc30 0x7efd801f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7fd631dba700 1 -- start start 2023-03-30T08:11:22.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f52c37fe700 1 -- 172.21.15.87:0/1308479809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f52b4004870 msgr2=0x7f52b4004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:22.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f52c37fe700 1 --2- 172.21.15.87:0/1308479809 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f52b4004870 0x7f52b4004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f52c37fe700 1 -- 172.21.15.87:0/1308479809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b4009a20 msgr2=0x7f52b4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:22.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f52c37fe700 1 --2- 172.21.15.87:0/1308479809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b4009a20 0x7f52b4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f52c37fe700 1 -- 172.21.15.87:0/1308479809 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc053540 con 0x7f52b4003bb0 2023-03-30T08:11:22.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd7e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd8006b1b0 0x7efd80154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd7e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd8006b1b0 0x7efd80154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34444/0 (socket says 172.21.15.87:34444) 2023-03-30T08:11:22.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd84c0a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd8015c340 0x7efd800b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd7e59c700 1 -- 172.21.15.87:0/3049331367 learned_addr learned my addr 172.21.15.87:0/3049331367 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:22.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd7dd9b700 1 --2- 172.21.15.87:0/3049331367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd800adc30 0x7efd801f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f52c3fff700 1 -- 172.21.15.87:0/1308479809 reap_dead start 2023-03-30T08:11:22.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd7ed9d700 1 --2- 172.21.15.87:0/3049331367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd8015c340 0x7efd800b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f52c37fe700 1 --2- 172.21.15.87:0/1308479809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52b4003bb0 0x7f52b4003fa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f52b0009b40 tx=0x7f52b40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d1e8850ead024b server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd84c0a700 1 -- 172.21.15.87:0/3049331367 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd800c5850 con 0x7efd8015c340 2023-03-30T08:11:22.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd84c0a700 1 -- 172.21.15.87:0/3049331367 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd801f23c0 con 0x7efd8006b1b0 2023-03-30T08:11:22.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.208+0000 7f3b61f58700 1 -- start start 2023-03-30T08:11:22.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd84c0a700 1 -- 172.21.15.87:0/3049331367 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd801f4ee0 con 0x7efd800adc30 2023-03-30T08:11:22.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f3b61f58700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b5c06c4f0 0x7f3b5c069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f3b61f58700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3b5c06b280 0x7f3b5c0af350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f3b61f58700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5c0ca8d0 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f3b61f58700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c0aeeb0 con 0x7f3b5c06b280 2023-03-30T08:11:22.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f3b61f58700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0c9cc0 con 0x7f3b5c06c4f0 2023-03-30T08:11:22.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f3b5bfff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3b5c0b08d0 0x7f3b5c06a210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48572/0 (socket says 172.21.15.87:48572) 2023-03-30T08:11:22.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f3b5bfff700 1 -- 172.21.15.87:0/3541966154 learned_addr learned my addr 172.21.15.87:0/3541966154 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:22.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7fd631dba700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd62c06c4f0 0x7fd62c069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7fd631dba700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62c0ca8d0 con 0x7fd62c0b08d0 2023-03-30T08:11:22.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7fd631dba700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62c0aeeb0 con 0x7fd62c06b280 2023-03-30T08:11:22.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7fd631dba700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c0c9cc0 con 0x7fd62c06c4f0 2023-03-30T08:11:22.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f3b60f56700 1 --2- 172.21.15.87:0/3541966154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b5c06c4f0 0x7f3b5c069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f3b5b7fe700 1 -- 172.21.15.87:0/3541966154 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920982944 0 0) 0x7f3b5c0ca8d0 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f3b5b7fe700 1 -- 172.21.15.87:0/3541966154 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b440035d0 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f6ed4d79700 1 Processor -- start 2023-03-30T08:11:22.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f6ed4d79700 1 -- start start 2023-03-30T08:11:22.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7fd62affd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd62c0b08d0 0x7fd62c06a210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48574/0 (socket says 172.21.15.87:48574) 2023-03-30T08:11:22.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7fd62affd700 1 -- 172.21.15.87:0/3117773306 learned_addr learned my addr 172.21.15.87:0/3117773306 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:22.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd7e59c700 1 -- 172.21.15.87:0/3049331367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd800adc30 msgr2=0x7efd801f1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd7e59c700 1 --2- 172.21.15.87:0/3049331367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd800adc30 0x7efd801f1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd7e59c700 1 -- 172.21.15.87:0/3049331367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd8015c340 msgr2=0x7efd800b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd7e59c700 1 --2- 172.21.15.87:0/3049331367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd8015c340 0x7efd800b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd7e59c700 1 -- 172.21.15.87:0/3049331367 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70009b30 con 0x7efd8006b1b0 2023-03-30T08:11:22.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7fd62b7fe700 1 --2- 172.21.15.87:0/3117773306 >> v2:172.21.15.115:3300/0 conn(0x7fd62c06c4f0 0x7fd62c069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f3b60f56700 1 -- 172.21.15.87:0/3541966154 >> v2:172.21.15.87:3300/0 conn(0x7f3b5c06b280 msgr2=0x7f3b5c0af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:22.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f3b60f56700 1 --2- 172.21.15.87:0/3541966154 >> v2:172.21.15.87:3300/0 conn(0x7f3b5c06b280 0x7f3b5c0af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f3b60f56700 1 -- 172.21.15.87:0/3541966154 >> v1:172.21.15.87:6789/0 conn(0x7f3b5c0b08d0 legacy=0x7f3b5c06a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f3b60f56700 1 -- 172.21.15.87:0/3541966154 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c0c9fa0 con 0x7f3b5c06c4f0 2023-03-30T08:11:22.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd7e59c700 1 --2- 172.21.15.87:0/3049331367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd8006b1b0 0x7efd80154fa0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efd7800e760 tx=0x7efd7800ea70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0005a40 con 0x7f52b4003bb0 2023-03-30T08:11:22.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f3b60f56700 1 --2- 172.21.15.87:0/3541966154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b5c06c4f0 0x7f3b5c069cd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400d1e0 tx=0x7f3b5400d4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b54b8ade10022a3 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b0005ba0 con 0x7f52b4003bb0 2023-03-30T08:11:22.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f52c27fc700 1 -- 172.21.15.87:0/1308479809 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0004020 con 0x7f52b4003bb0 2023-03-30T08:11:22.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7ffabf21e700 1 Processor -- start 2023-03-30T08:11:22.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd76ffd700 1 -- 172.21.15.87:0/3049331367 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7800c070 con 0x7efd8006b1b0 2023-03-30T08:11:22.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7efd84c0a700 1 -- 172.21.15.87:0/3049331367 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd800ca460 con 0x7efd8006b1b0 2023-03-30T08:11:22.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7fd62a7fc700 1 -- 172.21.15.87:0/3117773306 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746510873 0 0) 0x7fd62c0ca8d0 con 0x7fd62c0b08d0 2023-03-30T08:11:22.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7fd62a7fc700 1 -- 172.21.15.87:0/3117773306 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6140034f0 con 0x7fd62c0b08d0 2023-03-30T08:11:22.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7fd62a7fc700 1 -- 172.21.15.87:0/3117773306 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863776508 0 0) 0x7fd62c0aeeb0 con 0x7fd62c06b280 2023-03-30T08:11:22.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7efd84c0a700 1 -- 172.21.15.87:0/3049331367 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd800ca180 con 0x7efd8006b1b0 2023-03-30T08:11:22.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7ffabf21e700 1 -- start start 2023-03-30T08:11:22.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7fd62a7fc700 1 -- 172.21.15.87:0/3117773306 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd62c0ca8d0 con 0x7fd62c06b280 2023-03-30T08:11:22.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7fd62b7fe700 1 -- 172.21.15.87:0/3117773306 >> v1:172.21.15.115:6789/0 conn(0x7fd62c06b280 legacy=0x7fd62c0af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7fd62b7fe700 1 -- 172.21.15.87:0/3117773306 >> v1:172.21.15.87:6789/0 conn(0x7fd62c0b08d0 legacy=0x7fd62c06a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7fd62b7fe700 1 -- 172.21.15.87:0/3117773306 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c0c9fa0 con 0x7fd62c06c4f0 2023-03-30T08:11:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.212+0000 7f6ed4d79700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6ec80e6d20 0x7f6ec8005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f6ed4d79700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec8006eb0 con 0x7f6ec8036630 2023-03-30T08:11:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f6ed4d79700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec8006610 con 0x7f6ec80e70f0 2023-03-30T08:11:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f6ed4d79700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec80068f0 con 0x7f6ec80e6d20 2023-03-30T08:11:22.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f3b5b7fe700 1 -- 172.21.15.87:0/3541966154 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54010070 con 0x7f3b5c06c4f0 2023-03-30T08:11:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f6ece59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6ec80e6d20 0x7f6ec8005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f6eced9d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f6ec8036630 0x7f6ec8036a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48586/0 (socket says 172.21.15.87:48586) 2023-03-30T08:11:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f6eced9d700 1 -- 172.21.15.87:0/3305107693 learned_addr learned my addr 172.21.15.87:0/3305107693 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:22.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f3b5b7fe700 1 -- 172.21.15.87:0/3541966154 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5400dbb0 con 0x7f3b5c06c4f0 2023-03-30T08:11:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f3b5b7fe700 1 -- 172.21.15.87:0/3541966154 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54007aa0 con 0x7f3b5c06c4f0 2023-03-30T08:11:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7fd62b7fe700 1 --2- 172.21.15.87:0/3117773306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd62c06c4f0 0x7fd62c069cd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd620009260 tx=0x7fd620009570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cef189f76b77e68 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f52c9e51700 1 -- 172.21.15.87:0/1308479809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52b4003bb0 msgr2=0x7f52b4003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f52c9e51700 1 --2- 172.21.15.87:0/1308479809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52b4003bb0 0x7f52b4003fa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f52b0009b40 tx=0x7f52b40058a0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f52c9e51700 1 -- 172.21.15.87:0/1308479809 shutdown_connections 2023-03-30T08:11:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f52c9e51700 1 --2- 172.21.15.87:0/1308479809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52b4003bb0 0x7f52b4003fa0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f52c9e51700 1 -- 172.21.15.87:0/1308479809 >> 172.21.15.87:0/1308479809 conn(0x7f52bc053980 msgr2=0x7f52bc053d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7efd76ffd700 1 -- 172.21.15.87:0/3049331367 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd78013610 con 0x7efd8006b1b0 2023-03-30T08:11:22.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7efd76ffd700 1 -- 172.21.15.87:0/3049331367 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78013980 con 0x7efd8006b1b0 2023-03-30T08:11:22.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7fd62a7fc700 1 -- 172.21.15.87:0/3117773306 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620004230 con 0x7fd62c06c4f0 2023-03-30T08:11:22.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f3b61f58700 1 -- 172.21.15.87:0/3541966154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b5c06c4f0 msgr2=0x7f3b5c069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f3b61f58700 1 --2- 172.21.15.87:0/3541966154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b5c06c4f0 0x7f3b5c069cd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400d1e0 tx=0x7f3b5400d4f0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f6ecd59a700 1 -- 172.21.15.87:0/3305107693 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175070950 0 0) 0x7f6ec8006eb0 con 0x7f6ec8036630 2023-03-30T08:11:22.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f6ecd59a700 1 -- 172.21.15.87:0/3305107693 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb80035d0 con 0x7f6ec8036630 2023-03-30T08:11:22.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f52c9e51700 1 -- 172.21.15.87:0/1308479809 shutdown_connections 2023-03-30T08:11:22.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f6ece59c700 1 -- 172.21.15.87:0/3305107693 >> v1:172.21.15.115:6789/0 conn(0x7f6ec80e70f0 legacy=0x7f6ec8033f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f6ece59c700 1 -- 172.21.15.87:0/3305107693 >> v1:172.21.15.87:6789/0 conn(0x7f6ec8036630 legacy=0x7f6ec8036a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f6ece59c700 1 -- 172.21.15.87:0/3305107693 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec8006bd0 con 0x7f6ec80e6d20 2023-03-30T08:11:22.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7efd84c0a700 1 -- 172.21.15.87:0/3049331367 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd58005310 con 0x7efd8006b1b0 2023-03-30T08:11:22.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7fd62a7fc700 1 -- 172.21.15.87:0/3117773306 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd620004390 con 0x7fd62c06c4f0 2023-03-30T08:11:22.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7fd62a7fc700 1 -- 172.21.15.87:0/3117773306 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6200036c0 con 0x7fd62c06c4f0 2023-03-30T08:11:22.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7fd631dba700 1 -- 172.21.15.87:0/3117773306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd62c06c4f0 msgr2=0x7fd62c069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7fd631dba700 1 --2- 172.21.15.87:0/3117773306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd62c06c4f0 0x7fd62c069cd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd620009260 tx=0x7fd620009570 comp rx=0 tx=0).stop 2023-03-30T08:11:22.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7fd631dba700 1 -- 172.21.15.87:0/3117773306 shutdown_connections 2023-03-30T08:11:22.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7fd631dba700 1 --2- 172.21.15.87:0/3117773306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd62c06c4f0 0x7fd62c069cd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7fd631dba700 1 -- 172.21.15.87:0/3117773306 >> 172.21.15.87:0/3117773306 conn(0x7fd62c0cf410 msgr2=0x7fd62c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f3b61f58700 1 -- 172.21.15.87:0/3541966154 shutdown_connections 2023-03-30T08:11:22.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f3b61f58700 1 --2- 172.21.15.87:0/3541966154 >> v2:172.21.15.87:3300/0 conn(0x7f3b5c06b280 0x7f3b5c0af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f3b61f58700 1 --2- 172.21.15.87:0/3541966154 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b5c06c4f0 0x7f3b5c069cd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f3b61f58700 1 -- 172.21.15.87:0/3541966154 >> 172.21.15.87:0/3541966154 conn(0x7f3b5c0cf410 msgr2=0x7f3b5c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f52c9e51700 1 -- 172.21.15.87:0/1308479809 wait complete. 2023-03-30T08:11:22.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7ffabf21e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffab80adc30 0x7ffab815c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7ffabf21e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab806c790 con 0x7ffab815c340 2023-03-30T08:11:22.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7ffabf21e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab80c9ee0 con 0x7ffab806b1b0 2023-03-30T08:11:22.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7ffabf21e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80ac790 con 0x7ffab80adc30 2023-03-30T08:11:22.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7fd631dba700 1 -- 172.21.15.87:0/3117773306 shutdown_connections 2023-03-30T08:11:22.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f3b61f58700 1 -- 172.21.15.87:0/3541966154 shutdown_connections 2023-03-30T08:11:22.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7ffabcfba700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ffab815c340 0x7ffab80ac080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48592/0 (socket says 172.21.15.87:48592) 2023-03-30T08:11:22.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7ffabcfba700 1 -- 172.21.15.87:0/249848362 learned_addr learned my addr 172.21.15.87:0/249848362 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7f6ece59c700 1 --2- 172.21.15.87:0/3305107693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ec80e6d20 0x7f6ec8005f80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009850 tx=0x7f6ec4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c220c144e06142ea server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f6ecd59a700 1 -- 172.21.15.87:0/3305107693 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4011830 con 0x7f6ec80e6d20 2023-03-30T08:11:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7efd76ffd700 1 -- 172.21.15.87:0/3049331367 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7efd78013ae0 con 0x7efd8006b1b0 2023-03-30T08:11:22.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f3b61f58700 1 -- 172.21.15.87:0/3541966154 wait complete. 2023-03-30T08:11:22.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188413356 0 0) 0x7ffab80c9ee0 con 0x7ffab806b1b0 2023-03-30T08:11:22.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaa80035d0 con 0x7ffab806b1b0 2023-03-30T08:11:22.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c9e51700 1 Processor -- start 2023-03-30T08:11:22.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c9e51700 1 -- start start 2023-03-30T08:11:22.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998797728 0 0) 0x7ffab806c790 con 0x7ffab815c340 2023-03-30T08:11:22.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffab80c9ee0 con 0x7ffab815c340 2023-03-30T08:11:22.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7efd76ffd700 1 --2- 172.21.15.87:0/3049331367 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efd640653f0 0x7efd640678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7efd76ffd700 1 -- 172.21.15.87:0/3049331367 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efd780829a0 con 0x7efd8006b1b0 2023-03-30T08:11:22.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1591052500 0 0) 0x7ffab80c9ee0 con 0x7ffab815c340 2023-03-30T08:11:22.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffab80adc30 msgr2=0x7ffab815c710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-30T08:11:22.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 --2- 172.21.15.87:0/249848362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffab80adc30 0x7ffab815c710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.216+0000 7fd631dba700 1 -- 172.21.15.87:0/3117773306 wait complete. 2023-03-30T08:11:22.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 >> v1:172.21.15.115:6789/0 conn(0x7ffab806b1b0 legacy=0x7ffab8069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab806b630 con 0x7ffab815c340 2023-03-30T08:11:22.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7ffaac001670 con 0x7ffab815c340 2023-03-30T08:11:22.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 >> v1:172.21.15.87:6789/0 conn(0x7ffab815c340 legacy=0x7ffab80ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 --2- 172.21.15.87:0/249848362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa8003be0 0x7ffaa8003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 --2- 172.21.15.87:0/249848362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa8004870 0x7ffaa8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 --2- 172.21.15.87:0/249848362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa8005420 0x7ffaa800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7fd631dba700 1 Processor -- start 2023-03-30T08:11:22.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80ac790 con 0x7ffaa8004870 2023-03-30T08:11:22.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa800c2c0 con 0x7ffaa8005420 2023-03-30T08:11:22.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa800c480 con 0x7ffaa8003be0 2023-03-30T08:11:22.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c9e51700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52b4003bb0 0x7f52bc0d97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c9e51700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52bc0daad0 0x7f52bc0e2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c9e51700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f52bc0daf40 0x7f52bc0e3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c9e51700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc04e390 con 0x7f52b4003bb0 2023-03-30T08:11:22.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c9e51700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc04e670 con 0x7f52bc0daad0 2023-03-30T08:11:22.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c9e51700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc04e950 con 0x7f52bc0daf40 2023-03-30T08:11:22.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c37fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52b4003bb0 0x7f52bc0d97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c37fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52b4003bb0 0x7f52bc0d97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52096/0 (socket says 172.21.15.87:52096) 2023-03-30T08:11:22.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c37fe700 1 -- 172.21.15.87:0/2906580456 learned_addr learned my addr 172.21.15.87:0/2906580456 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:22.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7efd7dd9b700 1 --2- 172.21.15.87:0/3049331367 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efd640653f0 0x7efd640678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c2ffd700 1 --2- 172.21.15.87:0/2906580456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52bc0daad0 0x7f52bc0e2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f3b61f58700 1 Processor -- start 2023-03-30T08:11:22.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffabcfba700 1 --2- 172.21.15.87:0/249848362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa8003be0 0x7ffaa8003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c3fff700 1 --2- 172.21.15.87:0/2906580456 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f52bc0daf40 0x7f52bc0e3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c37fe700 1 -- 172.21.15.87:0/2906580456 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f52bc0daf40 msgr2=0x7f52bc0e3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c37fe700 1 --2- 172.21.15.87:0/2906580456 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f52bc0daf40 0x7f52bc0e3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c37fe700 1 -- 172.21.15.87:0/2906580456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52bc0daad0 msgr2=0x7f52bc0e2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c37fe700 1 --2- 172.21.15.87:0/2906580456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52bc0daad0 0x7f52bc0e2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c37fe700 1 -- 172.21.15.87:0/2906580456 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc00c890 con 0x7f52b4003bb0 2023-03-30T08:11:22.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7ffabd7bb700 1 --2- 172.21.15.87:0/249848362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa8005420 0x7ffaa800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7efd7dd9b700 1 --2- 172.21.15.87:0/3049331367 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efd640653f0 0x7efd640678a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efd801554e0 tx=0x7efd68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f52c37fe700 1 --2- 172.21.15.87:0/2906580456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52b4003bb0 0x7f52bc0d97e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f52b4014860 tx=0x7f52b00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7fd631dba700 1 -- start start 2023-03-30T08:11:22.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7fd631dba700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd62c06b280 0x7fd62c0c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffabcfba700 1 -- 172.21.15.87:0/249848362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa8005420 msgr2=0x7ffaa800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:22.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffabcfba700 1 --2- 172.21.15.87:0/249848362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaa8005420 0x7ffaa800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffabcfba700 1 -- 172.21.15.87:0/249848362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa8004870 msgr2=0x7ffaa8004ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-30T08:11:22.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61f58700 1 -- start start 2023-03-30T08:11:22.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f52affff700 1 -- 172.21.15.87:0/2906580456 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0003b50 con 0x7f52b4003bb0 2023-03-30T08:11:22.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f52affff700 1 -- 172.21.15.87:0/2906580456 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b0003cb0 con 0x7f52b4003bb0 2023-03-30T08:11:22.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7fd631dba700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd62c06c4f0 0x7fd62c155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffab7fff700 1 --2- 172.21.15.87:0/249848362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa8004870 0x7ffaa8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f52c9e51700 1 -- 172.21.15.87:0/2906580456 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc056890 con 0x7f52b4003bb0 2023-03-30T08:11:22.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f52affff700 1 -- 172.21.15.87:0/2906580456 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b000e900 con 0x7f52b4003bb0 2023-03-30T08:11:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7fd62b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd62c06b280 0x7fd62c0c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7fd62b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd62c06b280 0x7fd62c0c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34486/0 (socket says 172.21.15.87:34486) 2023-03-30T08:11:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f6ecd59a700 1 -- 172.21.15.87:0/3305107693 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec4011990 con 0x7f6ec80e6d20 2023-03-30T08:11:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.220+0000 7f6ecd59a700 1 -- 172.21.15.87:0/3305107693 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4011d00 con 0x7f6ec80e6d20 2023-03-30T08:11:22.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f6ed4d79700 1 -- 172.21.15.87:0/3305107693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ec80e6d20 msgr2=0x7f6ec8005f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f6ed4d79700 1 --2- 172.21.15.87:0/3305107693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ec80e6d20 0x7f6ec8005f80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009850 tx=0x7f6ec4009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f6ed4d79700 1 -- 172.21.15.87:0/3305107693 shutdown_connections 2023-03-30T08:11:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f6ed4d79700 1 --2- 172.21.15.87:0/3305107693 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ec80e6d20 0x7f6ec8005f80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f6ed4d79700 1 -- 172.21.15.87:0/3305107693 >> 172.21.15.87:0/3305107693 conn(0x7f6ec8051630 msgr2=0x7f6ec8051a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7fd631dba700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd62c0b08d0 0x7fd62c155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7fd62b7fe700 1 -- 172.21.15.87:0/2457554429 learned_addr learned my addr 172.21.15.87:0/2457554429 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f6ed4d79700 1 -- 172.21.15.87:0/3305107693 shutdown_connections 2023-03-30T08:11:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7fd631dba700 1 -- 172.21.15.87:0/2457554429 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0c3d70 con 0x7fd62c0b08d0 2023-03-30T08:11:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7fd631dba700 1 -- 172.21.15.87:0/2457554429 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0c4c90 con 0x7fd62c06b280 2023-03-30T08:11:22.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7fd631dba700 1 -- 172.21.15.87:0/2457554429 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0c5470 con 0x7fd62c06c4f0 2023-03-30T08:11:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7fd62affd700 1 --2- 172.21.15.87:0/2457554429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd62c06c4f0 0x7fd62c155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffabcfba700 1 --2- 172.21.15.87:0/249848362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa8004870 0x7ffaa8004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffabcfba700 1 -- 172.21.15.87:0/249848362 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab806b630 con 0x7ffaa8003be0 2023-03-30T08:11:22.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61f58700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b5c06b280 0x7f3b5c1e3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61f58700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b5c06c4f0 0x7f3b5c157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f52c9e51700 1 -- 172.21.15.87:0/2906580456 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc00ca20 con 0x7f52b4003bb0 2023-03-30T08:11:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61f58700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b5c0b08d0 0x7f3b5c1f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61f58700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0c22b0 con 0x7f3b5c06b280 2023-03-30T08:11:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61f58700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0c5850 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61f58700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c1e36d0 con 0x7f3b5c06c4f0 2023-03-30T08:11:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffab7fff700 1 --2- 172.21.15.87:0/249848362 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa8004870 0x7ffaa8004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffabcfba700 1 --2- 172.21.15.87:0/249848362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa8003be0 0x7ffaa8003fd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00c340 tx=0x7ffaa80058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8be413cc263dd53 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f52c9e51700 1 -- 172.21.15.87:0/2906580456 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc0562d0 con 0x7f52b4003bb0 2023-03-30T08:11:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7fd62affd700 1 -- 172.21.15.87:0/2457554429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd62c06b280 msgr2=0x7fd62c0c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7fd62affd700 1 --2- 172.21.15.87:0/2457554429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd62c06b280 0x7fd62c0c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7fd62affd700 1 -- 172.21.15.87:0/2457554429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd62c0b08d0 msgr2=0x7fd62c155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7fd62affd700 1 --2- 172.21.15.87:0/2457554429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd62c0b08d0 0x7fd62c155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7fd62affd700 1 -- 172.21.15.87:0/2457554429 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd620009d40 con 0x7fd62c06c4f0 2023-03-30T08:11:22.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b5bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b5c06c4f0 0x7f3b5c157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61757700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b5c0b08d0 0x7f3b5c1f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61757700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b5c0b08d0 0x7f3b5c1f08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34504/0 (socket says 172.21.15.87:34504) 2023-03-30T08:11:22.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61757700 1 -- 172.21.15.87:0/310558932 learned_addr learned my addr 172.21.15.87:0/310558932 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac007c30 con 0x7ffaa8003be0 2023-03-30T08:11:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac00ce00 con 0x7ffaa8003be0 2023-03-30T08:11:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffab77fe700 1 -- 172.21.15.87:0/249848362 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac005bc0 con 0x7ffaa8003be0 2023-03-30T08:11:22.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61757700 1 -- 172.21.15.87:0/310558932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b5c06c4f0 msgr2=0x7f3b5c157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61757700 1 --2- 172.21.15.87:0/310558932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b5c06c4f0 0x7f3b5c157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61757700 1 -- 172.21.15.87:0/310558932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b5c06b280 msgr2=0x7f3b5c1e3190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-30T08:11:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61757700 1 --2- 172.21.15.87:0/310558932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b5c06b280 0x7f3b5c1e3190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61757700 1 -- 172.21.15.87:0/310558932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b54007910 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f3b61757700 1 --2- 172.21.15.87:0/310558932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b5c0b08d0 0x7f3b5c1f08d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00b500 tx=0x7f3b4c00b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffabf21e700 1 -- 172.21.15.87:0/249848362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa8003be0 msgr2=0x7ffaa8003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffabf21e700 1 --2- 172.21.15.87:0/249848362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffaa8003be0 0x7ffaa8003fd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00c340 tx=0x7ffaa80058a0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffabd7bb700 1 -- 172.21.15.87:0/249848362 reap_dead start 2023-03-30T08:11:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffabf21e700 1 -- 172.21.15.87:0/249848362 shutdown_connections 2023-03-30T08:11:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffabf21e700 1 -- 172.21.15.87:0/249848362 >> 172.21.15.87:0/249848362 conn(0x7ffab80cf410 msgr2=0x7ffab80cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7ffabf21e700 1 -- 172.21.15.87:0/249848362 shutdown_connections 2023-03-30T08:11:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7fd62affd700 1 --2- 172.21.15.87:0/2457554429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd62c06c4f0 0x7fd62c155860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd624002230 tx=0x7fd62400ce10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7f3b597fa700 1 -- 172.21.15.87:0/310558932 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011830 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7f3b597fa700 1 -- 172.21.15.87:0/310558932 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c011990 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7f3b597fa700 1 -- 172.21.15.87:0/310558932 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011d20 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7f3b61f58700 1 -- 172.21.15.87:0/310558932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5c0ca560 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f6ed4d79700 1 -- 172.21.15.87:0/3305107693 wait complete. 2023-03-30T08:11:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7f3b61f58700 1 -- 172.21.15.87:0/310558932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5c0ca280 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7efd76ffd700 1 -- 172.21.15.87:0/3049331367 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7efd78053cc0 con 0x7efd8006b1b0 2023-03-30T08:11:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.224+0000 7f6ed4d79700 1 Processor -- start 2023-03-30T08:11:22.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7fd613fff700 1 -- 172.21.15.87:0/2457554429 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400aaa0 con 0x7fd62c06c4f0 2023-03-30T08:11:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7fd613fff700 1 -- 172.21.15.87:0/2457554429 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62400ac00 con 0x7fd62c06c4f0 2023-03-30T08:11:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7fd631dba700 1 -- 172.21.15.87:0/2457554429 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62c0ca560 con 0x7fd62c06c4f0 2023-03-30T08:11:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7fd631dba700 1 -- 172.21.15.87:0/2457554429 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c0ca280 con 0x7fd62c06c4f0 2023-03-30T08:11:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7fd611ffb700 1 -- 172.21.15.87:0/2457554429 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd604005310 con 0x7fd62c06c4f0 2023-03-30T08:11:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7ffabf21e700 1 -- 172.21.15.87:0/249848362 wait complete. 2023-03-30T08:11:22.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7ffabf21e700 1 Processor -- start 2023-03-30T08:11:22.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7ffabf21e700 1 -- start start 2023-03-30T08:11:22.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffabf21e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa8003be0 0x7ffab81f92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.228+0000 7f3b61f58700 1 -- 172.21.15.87:0/310558932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5c0b0e20 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffabf21e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffab80af730 0x7ffab80b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffabf21e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffab81548e0 0x7ffab8154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffabf21e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80c26b0 con 0x7ffaa8003be0 2023-03-30T08:11:22.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffabf21e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab81552c0 con 0x7ffab80af730 2023-03-30T08:11:22.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffabf21e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80c6480 con 0x7ffab81548e0 2023-03-30T08:11:22.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffab7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffab80af730 0x7ffab80b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7f3b597fa700 1 -- 172.21.15.87:0/310558932 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f3b4c01a400 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7f3b597fa700 1 --2- 172.21.15.87:0/310558932 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3b480653f0 0x7f3b480678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7f3b597fa700 1 -- 172.21.15.87:0/310558932 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3b4c0830a0 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffab7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffab80af730 0x7ffab80b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34508/0 (socket says 172.21.15.87:34508) 2023-03-30T08:11:22.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffab7fff700 1 -- 172.21.15.87:0/1101354331 learned_addr learned my addr 172.21.15.87:0/1101354331 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:22.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7fd613fff700 1 -- 172.21.15.87:0/2457554429 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6240070d0 con 0x7fd62c06c4f0 2023-03-30T08:11:22.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffabd7bb700 1 --2- 172.21.15.87:0/1101354331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffab81548e0 0x7ffab8154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffab7fff700 1 -- 172.21.15.87:0/1101354331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffab81548e0 msgr2=0x7ffab8154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffab7fff700 1 --2- 172.21.15.87:0/1101354331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffab81548e0 0x7ffab8154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffab7fff700 1 -- 172.21.15.87:0/1101354331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa8003be0 msgr2=0x7ffab81f92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffab7fff700 1 --2- 172.21.15.87:0/1101354331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa8003be0 0x7ffab81f92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffab7fff700 1 -- 172.21.15.87:0/1101354331 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab80ca460 con 0x7ffab80af730 2023-03-30T08:11:22.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7ffab7fff700 1 --2- 172.21.15.87:0/1101354331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffab80af730 0x7ffab80b0080 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400c820 tx=0x7ffaa400cb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7ffab57fa700 1 -- 172.21.15.87:0/1101354331 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4011800 con 0x7ffab80af730 2023-03-30T08:11:22.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7ffab57fa700 1 -- 172.21.15.87:0/1101354331 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa4011960 con 0x7ffab80af730 2023-03-30T08:11:22.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7ffabf21e700 1 -- 172.21.15.87:0/1101354331 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab80ca180 con 0x7ffab80af730 2023-03-30T08:11:22.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7ffab57fa700 1 -- 172.21.15.87:0/1101354331 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4011cf0 con 0x7ffab80af730 2023-03-30T08:11:22.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7ffabf21e700 1 -- 172.21.15.87:0/1101354331 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab806c420 con 0x7ffab80af730 2023-03-30T08:11:22.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f3b597fa700 1 -- 172.21.15.87:0/310558932 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f3b4c050a10 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f52affff700 1 -- 172.21.15.87:0/2906580456 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f52b000ea60 con 0x7f52b4003bb0 2023-03-30T08:11:22.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f52affff700 1 --2- 172.21.15.87:0/2906580456 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f52a80654f0 0x7f52a80679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.232+0000 7f6ed4d79700 1 -- start start 2023-03-30T08:11:22.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f6ed4d79700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ec8036630 0x7f6ec804bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f6ed4d79700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ec80e6d20 0x7f6ec804ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f6ed4d79700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ec80e70f0 0x7f6ec804e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f6ed4d79700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec804b070 con 0x7f6ec8036630 2023-03-30T08:11:22.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f6ed4d79700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80e6330 con 0x7f6ec80e70f0 2023-03-30T08:11:22.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f6ed4d79700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec804c2f0 con 0x7f6ec80e6d20 2023-03-30T08:11:22.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f3b60f56700 1 --2- 172.21.15.87:0/310558932 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3b480653f0 0x7f3b480678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f6ecdd9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ec80e6d20 0x7f6ec804ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f6ecdd9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ec80e6d20 0x7f6ec804ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:34260/0 (socket says 172.21.15.87:34260) 2023-03-30T08:11:22.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f6ecdd9b700 1 -- 172.21.15.87:0/362630126 learned_addr learned my addr 172.21.15.87:0/362630126 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:22.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f6eced9d700 1 --2- 172.21.15.87:0/362630126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ec80e70f0 0x7f6ec804e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f6eced9d700 1 -- 172.21.15.87:0/362630126 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ec80e6d20 msgr2=0x7f6ec804ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f6eced9d700 1 --2- 172.21.15.87:0/362630126 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ec80e6d20 0x7f6ec804ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f6eced9d700 1 -- 172.21.15.87:0/362630126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ec8036630 msgr2=0x7f6ec804bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f6eced9d700 1 --2- 172.21.15.87:0/362630126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ec8036630 0x7f6ec804bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7f6eced9d700 1 -- 172.21.15.87:0/362630126 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec40094b0 con 0x7f6ec80e70f0 2023-03-30T08:11:22.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.236+0000 7fd613fff700 1 -- 172.21.15.87:0/2457554429 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd624007230 con 0x7fd62c06c4f0 2023-03-30T08:11:22.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.240+0000 7fd613fff700 1 --2- 172.21.15.87:0/2457554429 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd618065440 0x7fd6180678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.240+0000 7fd613fff700 1 -- 172.21.15.87:0/2457554429 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd624082b60 con 0x7fd62c06c4f0 2023-03-30T08:11:22.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.240+0000 7f6eced9d700 1 --2- 172.21.15.87:0/362630126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ec80e70f0 0x7f6ec804e490 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000c310 tx=0x7f6ec000c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.240+0000 7f6ecdd9b700 1 --2- 172.21.15.87:0/362630126 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ec80e6d20 0x7f6ec804ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:22.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.240+0000 7f6ebeffd700 1 -- 172.21.15.87:0/362630126 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0005d90 con 0x7f6ec80e70f0 2023-03-30T08:11:22.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.240+0000 7f6ebeffd700 1 -- 172.21.15.87:0/362630126 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec000ce80 con 0x7f6ec80e70f0 2023-03-30T08:11:22.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.240+0000 7f6ebeffd700 1 -- 172.21.15.87:0/362630126 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec00072d0 con 0x7f6ec80e70f0 2023-03-30T08:11:22.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.240+0000 7f6ed4d79700 1 -- 172.21.15.87:0/362630126 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec8053f80 con 0x7f6ec80e70f0 2023-03-30T08:11:22.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.240+0000 7f6ed4d79700 1 -- 172.21.15.87:0/362630126 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec8052a50 con 0x7f6ec80e70f0 2023-03-30T08:11:22.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.240+0000 7ffab57fa700 1 -- 172.21.15.87:0/1101354331 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ffaa4018360 con 0x7ffab80af730 2023-03-30T08:11:22.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.240+0000 7ffabf21e700 1 -- 172.21.15.87:0/1101354331 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab80c27f0 con 0x7ffab80af730 2023-03-30T08:11:22.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.240+0000 7f52affff700 1 -- 172.21.15.87:0/2906580456 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f52b0084570 con 0x7f52b4003bb0 2023-03-30T08:11:22.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.240+0000 7f52affff700 1 -- 172.21.15.87:0/2906580456 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f52b0051f70 con 0x7f52b4003bb0 2023-03-30T08:11:22.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.240+0000 7f52c2ffd700 1 --2- 172.21.15.87:0/2906580456 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f52a80654f0 0x7f52a80679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.244+0000 7f3b60f56700 1 --2- 172.21.15.87:0/310558932 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3b480653f0 0x7f3b480678a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3b54000f80 tx=0x7f3b54012000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.240+0000 7fd613fff700 1 -- 172.21.15.87:0/2457554429 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fd624050500 con 0x7fd62c06c4f0 2023-03-30T08:11:22.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.244+0000 7ffab57fa700 1 --2- 172.21.15.87:0/1101354331 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffaa8067200 0x7ffaa80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.244+0000 7ffab57fa700 1 -- 172.21.15.87:0/1101354331 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffaa4082870 con 0x7ffab80af730 2023-03-30T08:11:22.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.244+0000 7ffabcfba700 1 --2- 172.21.15.87:0/1101354331 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffaa8067200 0x7ffaa80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.244+0000 7f52c2ffd700 1 --2- 172.21.15.87:0/2906580456 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f52a80654f0 0x7f52a80679a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f52b8001010 tx=0x7f52b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.244+0000 7ffabcfba700 1 --2- 172.21.15.87:0/1101354331 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffaa8067200 0x7ffaa80696b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffaac000ff0 tx=0x7ffaac00a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.244+0000 7fd62b7fe700 1 --2- 172.21.15.87:0/2457554429 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd618065440 0x7fd6180678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.248+0000 7fd62b7fe700 1 --2- 172.21.15.87:0/2457554429 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd618065440 0x7fd6180678f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6200095b0 tx=0x7fd620008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.248+0000 7f6ed4d79700 1 -- 172.21.15.87:0/362630126 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb4005310 con 0x7f6ec80e70f0 2023-03-30T08:11:22.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.248+0000 7ffab57fa700 1 -- 172.21.15.87:0/1101354331 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7ffab80c27f0 con 0x7ffab80af730 2023-03-30T08:11:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.252+0000 7f6ebeffd700 1 -- 172.21.15.87:0/362630126 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6ec0007430 con 0x7f6ec80e70f0 2023-03-30T08:11:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.252+0000 7f6ebeffd700 1 --2- 172.21.15.87:0/362630126 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6eb0065440 0x7f6eb00678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.252+0000 7f6ebeffd700 1 -- 172.21.15.87:0/362630126 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6ec0081eb0 con 0x7f6ec80e70f0 2023-03-30T08:11:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.256+0000 7f6ece59c700 1 --2- 172.21.15.87:0/362630126 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6eb0065440 0x7f6eb00678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.256+0000 7f6ece59c700 1 --2- 172.21.15.87:0/362630126 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6eb0065440 0x7f6eb00678f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40090b0 tx=0x7f6ec4010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.256+0000 7f6ebeffd700 1 -- 172.21.15.87:0/362630126 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f6ec004fa70 con 0x7f6ec80e70f0 2023-03-30T08:11:22.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.476+0000 7f9ae4a9b700 1 -- 172.21.15.87:0/323657085 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9ae014a170 con 0x7f9ae00c8880 2023-03-30T08:11:22.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.476+0000 7f9aceffd700 1 -- 172.21.15.87:0/323657085 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ae014a170 con 0x7f9ae00c8880 2023-03-30T08:11:22.482 INFO:teuthology.orchestra.run.smithi087.stdout:60129542153 2023-03-30T08:11:22.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.480+0000 7f9accff9700 1 -- 172.21.15.87:0/323657085 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ac00653f0 msgr2=0x7f9ac00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.480+0000 7f9accff9700 1 --2- 172.21.15.87:0/323657085 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ac00653f0 0x7f9ac00678a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00c8670 tx=0x7f9ad4008040 comp rx=0 tx=0).stop 2023-03-30T08:11:22.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.480+0000 7f9accff9700 1 -- 172.21.15.87:0/323657085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae00c8880 msgr2=0x7f9ae00c6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.480+0000 7f9accff9700 1 --2- 172.21.15.87:0/323657085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae00c8880 0x7f9ae00c6bc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8011520 tx=0x7f9ad8014000 comp rx=0 tx=0).stop 2023-03-30T08:11:22.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.480+0000 7f9accff9700 1 -- 172.21.15.87:0/323657085 shutdown_connections 2023-03-30T08:11:22.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.480+0000 7f9accff9700 1 --2- 172.21.15.87:0/323657085 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ac00653f0 0x7f9ac00678a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.480+0000 7f9accff9700 1 --2- 172.21.15.87:0/323657085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9ae00c7100 0x7f9ae0159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.480+0000 7f9accff9700 1 --2- 172.21.15.87:0/323657085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ae00c8880 0x7f9ae00c6bc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.480+0000 7f9accff9700 1 --2- 172.21.15.87:0/323657085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9ac8004450 0x7f9ae0148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.480+0000 7f9accff9700 1 -- 172.21.15.87:0/323657085 >> 172.21.15.87:0/323657085 conn(0x7f9ae00cf410 msgr2=0x7f9ae00ada80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.484+0000 7f9accff9700 1 -- 172.21.15.87:0/323657085 shutdown_connections 2023-03-30T08:11:22.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.484+0000 7f9accff9700 1 -- 172.21.15.87:0/323657085 wait complete. 2023-03-30T08:11:22.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.0 2023-03-30T08:11:22.510 DEBUG:teuthology.parallel:result is None 2023-03-30T08:11:22.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.512+0000 7f341cd96700 1 -- 172.21.15.87:0/2193265493 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f34180b0e20 con 0x7f341806c4f0 2023-03-30T08:11:22.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.512+0000 7f3406ffd700 1 -- 172.21.15.87:0/2193265493 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3408054740 con 0x7f341806c4f0 2023-03-30T08:11:22.518 INFO:teuthology.orchestra.run.smithi087.stdout:60129542154 2023-03-30T08:11:22.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.516+0000 7f341cd96700 1 -- 172.21.15.87:0/2193265493 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f33f80654f0 msgr2=0x7f33f80679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.516+0000 7f341cd96700 1 --2- 172.21.15.87:0/2193265493 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f33f80654f0 0x7f33f80679a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f340c007fd0 tx=0x7f340c00a310 comp rx=0 tx=0).stop 2023-03-30T08:11:22.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.516+0000 7f341cd96700 1 -- 172.21.15.87:0/2193265493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341806c4f0 msgr2=0x7f34180c22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.516+0000 7f341cd96700 1 --2- 172.21.15.87:0/2193265493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341806c4f0 0x7f34180c22b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3408014000 tx=0x7f34080047e0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.523 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.516+0000 7f341cd96700 1 -- 172.21.15.87:0/2193265493 shutdown_connections 2023-03-30T08:11:22.523 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.516+0000 7f341cd96700 1 --2- 172.21.15.87:0/2193265493 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f33f80654f0 0x7f33f80679a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.523 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.516+0000 7f341cd96700 1 --2- 172.21.15.87:0/2193265493 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f34180b08d0 0x7f34180c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.523 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.516+0000 7f341cd96700 1 --2- 172.21.15.87:0/2193265493 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f341806c4f0 0x7f34180c22b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.523 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.516+0000 7f341cd96700 1 --2- 172.21.15.87:0/2193265493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f341806b280 0x7f34181f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.524 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.516+0000 7f341cd96700 1 -- 172.21.15.87:0/2193265493 >> 172.21.15.87:0/2193265493 conn(0x7f34180cf410 msgr2=0x7f34180b2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.524 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.516+0000 7f341cd96700 1 -- 172.21.15.87:0/2193265493 shutdown_connections 2023-03-30T08:11:22.524 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.516+0000 7f341cd96700 1 -- 172.21.15.87:0/2193265493 wait complete. 2023-03-30T08:11:22.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.5 2023-03-30T08:11:22.545 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.540+0000 7ffabf21e700 1 -- 172.21.15.87:0/1101354331 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ffab80c27f0 con 0x7ffab80af730 2023-03-30T08:11:22.546 DEBUG:teuthology.parallel:result is None 2023-03-30T08:11:22.546 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.540+0000 7ffab57fa700 1 -- 172.21.15.87:0/1101354331 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffab80c27f0 con 0x7ffab80af730 2023-03-30T08:11:22.547 INFO:teuthology.orchestra.run.smithi087.stdout:60129542153 2023-03-30T08:11:22.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.544+0000 7ffabf21e700 1 -- 172.21.15.87:0/1101354331 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffaa8067200 msgr2=0x7ffaa80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.544+0000 7ffabf21e700 1 --2- 172.21.15.87:0/1101354331 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffaa8067200 0x7ffaa80696b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffaac000ff0 tx=0x7ffaac00a000 comp rx=0 tx=0).stop 2023-03-30T08:11:22.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.544+0000 7ffabf21e700 1 -- 172.21.15.87:0/1101354331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffab80af730 msgr2=0x7ffab80b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.544+0000 7ffabf21e700 1 --2- 172.21.15.87:0/1101354331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffab80af730 0x7ffab80b0080 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400c820 tx=0x7ffaa400cb30 comp rx=0 tx=0).stop 2023-03-30T08:11:22.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.544+0000 7ffabf21e700 1 -- 172.21.15.87:0/1101354331 shutdown_connections 2023-03-30T08:11:22.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.544+0000 7ffabf21e700 1 --2- 172.21.15.87:0/1101354331 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffaa8067200 0x7ffaa80696b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.544+0000 7ffabf21e700 1 --2- 172.21.15.87:0/1101354331 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffab81548e0 0x7ffab8154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.544+0000 7ffabf21e700 1 --2- 172.21.15.87:0/1101354331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffab80af730 0x7ffab80b0080 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.544+0000 7ffabf21e700 1 --2- 172.21.15.87:0/1101354331 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffaa8003be0 0x7ffab81f92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.544+0000 7ffabf21e700 1 -- 172.21.15.87:0/1101354331 >> 172.21.15.87:0/1101354331 conn(0x7ffab80cf410 msgr2=0x7ffab80b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.544+0000 7ffabf21e700 1 -- 172.21.15.87:0/1101354331 shutdown_connections 2023-03-30T08:11:22.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.544+0000 7ffabf21e700 1 -- 172.21.15.87:0/1101354331 wait complete. 2023-03-30T08:11:22.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.548+0000 7fd611ffb700 1 -- 172.21.15.87:0/2457554429 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd604005890 con 0x7fd62c06c4f0 2023-03-30T08:11:22.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.548+0000 7fd613fff700 1 -- 172.21.15.87:0/2457554429 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd624018090 con 0x7fd62c06c4f0 2023-03-30T08:11:22.554 INFO:teuthology.orchestra.run.smithi087.stdout:60129542154 2023-03-30T08:11:22.556 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.552+0000 7fd611ffb700 1 -- 172.21.15.87:0/2457554429 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd618065440 msgr2=0x7fd6180678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.556 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.552+0000 7fd611ffb700 1 --2- 172.21.15.87:0/2457554429 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd618065440 0x7fd6180678f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6200095b0 tx=0x7fd620008030 comp rx=0 tx=0).stop 2023-03-30T08:11:22.556 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.552+0000 7fd611ffb700 1 -- 172.21.15.87:0/2457554429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd62c06c4f0 msgr2=0x7fd62c155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.556 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.552+0000 7fd611ffb700 1 --2- 172.21.15.87:0/2457554429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd62c06c4f0 0x7fd62c155860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd624002230 tx=0x7fd62400ce10 comp rx=0 tx=0).stop 2023-03-30T08:11:22.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.552+0000 7fd611ffb700 1 -- 172.21.15.87:0/2457554429 shutdown_connections 2023-03-30T08:11:22.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.552+0000 7fd611ffb700 1 --2- 172.21.15.87:0/2457554429 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd618065440 0x7fd6180678f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.552+0000 7fd611ffb700 1 --2- 172.21.15.87:0/2457554429 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd62c0b08d0 0x7fd62c155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.552+0000 7fd611ffb700 1 --2- 172.21.15.87:0/2457554429 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd62c06c4f0 0x7fd62c155860 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.552+0000 7fd611ffb700 1 --2- 172.21.15.87:0/2457554429 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd62c06b280 0x7fd62c0c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.552+0000 7fd611ffb700 1 -- 172.21.15.87:0/2457554429 >> 172.21.15.87:0/2457554429 conn(0x7fd62c0cf410 msgr2=0x7fd62c0cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.552+0000 7fd611ffb700 1 -- 172.21.15.87:0/2457554429 shutdown_connections 2023-03-30T08:11:22.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.552+0000 7fd611ffb700 1 -- 172.21.15.87:0/2457554429 wait complete. 2023-03-30T08:11:22.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.556+0000 7efd84c0a700 1 -- 172.21.15.87:0/3049331367 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7efd580055c0 con 0x7efd8006b1b0 2023-03-30T08:11:22.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.556+0000 7efd76ffd700 1 -- 172.21.15.87:0/3049331367 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd78017090 con 0x7efd8006b1b0 2023-03-30T08:11:22.560 INFO:teuthology.orchestra.run.smithi087.stdout:64424509450 2023-03-30T08:11:22.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.556+0000 7f52c9e51700 1 -- 172.21.15.87:0/2906580456 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f52bc005980 con 0x7f52b4003bb0 2023-03-30T08:11:22.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.556+0000 7f52affff700 1 -- 172.21.15.87:0/2906580456 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f52b001a3a0 con 0x7f52b4003bb0 2023-03-30T08:11:22.561 INFO:teuthology.orchestra.run.smithi087.stdout:60129542154 2023-03-30T08:11:22.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.556+0000 7f3b61f58700 1 -- 172.21.15.87:0/310558932 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3b5c0733a0 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7f3b597fa700 1 -- 172.21.15.87:0/310558932 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b4c054030 con 0x7f3b5c0b08d0 2023-03-30T08:11:22.563 INFO:teuthology.orchestra.run.smithi087.stdout:60129542153 2023-03-30T08:11:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7efd84c0a700 1 -- 172.21.15.87:0/3049331367 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efd640653f0 msgr2=0x7efd640678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7efd84c0a700 1 --2- 172.21.15.87:0/3049331367 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efd640653f0 0x7efd640678a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efd801554e0 tx=0x7efd68009040 comp rx=0 tx=0).stop 2023-03-30T08:11:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7efd84c0a700 1 -- 172.21.15.87:0/3049331367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd8006b1b0 msgr2=0x7efd80154fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7efd84c0a700 1 --2- 172.21.15.87:0/3049331367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd8006b1b0 0x7efd80154fa0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efd7800e760 tx=0x7efd7800ea70 comp rx=0 tx=0).stop 2023-03-30T08:11:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7efd84c0a700 1 -- 172.21.15.87:0/3049331367 shutdown_connections 2023-03-30T08:11:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7efd84c0a700 1 --2- 172.21.15.87:0/3049331367 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efd640653f0 0x7efd640678a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7efd84c0a700 1 --2- 172.21.15.87:0/3049331367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efd8015c340 0x7efd800b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7efd84c0a700 1 --2- 172.21.15.87:0/3049331367 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efd800adc30 0x7efd801f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7efd84c0a700 1 --2- 172.21.15.87:0/3049331367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd8006b1b0 0x7efd80154fa0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7efd84c0a700 1 -- 172.21.15.87:0/3049331367 >> 172.21.15.87:0/3049331367 conn(0x7efd800cf410 msgr2=0x7efd80070180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7f52c9e51700 1 -- 172.21.15.87:0/2906580456 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f52a80654f0 msgr2=0x7f52a80679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7f52c9e51700 1 --2- 172.21.15.87:0/2906580456 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f52a80654f0 0x7f52a80679a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f52b8001010 tx=0x7f52b8009040 comp rx=0 tx=0).stop 2023-03-30T08:11:22.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7f52c9e51700 1 -- 172.21.15.87:0/2906580456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52b4003bb0 msgr2=0x7f52bc0d97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7f52c9e51700 1 --2- 172.21.15.87:0/2906580456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52b4003bb0 0x7f52bc0d97e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f52b4014860 tx=0x7f52b00047e0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7efd84c0a700 1 -- 172.21.15.87:0/3049331367 shutdown_connections 2023-03-30T08:11:22.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7efd84c0a700 1 -- 172.21.15.87:0/3049331367 wait complete. 2023-03-30T08:11:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7f52c9e51700 1 -- 172.21.15.87:0/2906580456 shutdown_connections 2023-03-30T08:11:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7f52c9e51700 1 --2- 172.21.15.87:0/2906580456 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f52a80654f0 0x7f52a80679a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7f52c9e51700 1 --2- 172.21.15.87:0/2906580456 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f52bc0daf40 0x7f52bc0e3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7f52c9e51700 1 --2- 172.21.15.87:0/2906580456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52bc0daad0 0x7f52bc0e2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7f52c9e51700 1 --2- 172.21.15.87:0/2906580456 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52b4003bb0 0x7f52bc0d97e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7f52c9e51700 1 -- 172.21.15.87:0/2906580456 >> 172.21.15.87:0/2906580456 conn(0x7f52bc053980 msgr2=0x7f52bc03b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7f52c9e51700 1 -- 172.21.15.87:0/2906580456 shutdown_connections 2023-03-30T08:11:22.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7f52c9e51700 1 -- 172.21.15.87:0/2906580456 wait complete. 2023-03-30T08:11:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7f3b61f58700 1 -- 172.21.15.87:0/310558932 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3b480653f0 msgr2=0x7f3b480678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.560+0000 7f3b61f58700 1 --2- 172.21.15.87:0/310558932 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3b480653f0 0x7f3b480678a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3b54000f80 tx=0x7f3b54012000 comp rx=0 tx=0).stop 2023-03-30T08:11:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.564+0000 7f3b61f58700 1 -- 172.21.15.87:0/310558932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b5c0b08d0 msgr2=0x7f3b5c1f08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.564+0000 7f3b61f58700 1 --2- 172.21.15.87:0/310558932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b5c0b08d0 0x7f3b5c1f08d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00b500 tx=0x7f3b4c00b810 comp rx=0 tx=0).stop 2023-03-30T08:11:22.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.564+0000 7f3b61f58700 1 -- 172.21.15.87:0/310558932 shutdown_connections 2023-03-30T08:11:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.564+0000 7f3b61f58700 1 --2- 172.21.15.87:0/310558932 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3b480653f0 0x7f3b480678a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.564+0000 7f3b61f58700 1 --2- 172.21.15.87:0/310558932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b5c0b08d0 0x7f3b5c1f08d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.564+0000 7f3b61f58700 1 --2- 172.21.15.87:0/310558932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b5c06c4f0 0x7f3b5c157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.564+0000 7f3b61f58700 1 --2- 172.21.15.87:0/310558932 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b5c06b280 0x7f3b5c1e3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.564+0000 7f3b61f58700 1 -- 172.21.15.87:0/310558932 >> 172.21.15.87:0/310558932 conn(0x7f3b5c0cf410 msgr2=0x7f3b5c0af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.4 2023-03-30T08:11:22.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.564+0000 7f3b61f58700 1 -- 172.21.15.87:0/310558932 shutdown_connections 2023-03-30T08:11:22.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.564+0000 7f3b61f58700 1 -- 172.21.15.87:0/310558932 wait complete. 2023-03-30T08:11:22.572 DEBUG:teuthology.parallel:result is None 2023-03-30T08:11:22.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.572+0000 7f6ed4d79700 1 -- 172.21.15.87:0/362630126 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6eb4005890 con 0x7f6ec80e70f0 2023-03-30T08:11:22.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.572+0000 7f6ebeffd700 1 -- 172.21.15.87:0/362630126 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6ec0053090 con 0x7f6ec80e70f0 2023-03-30T08:11:22.577 INFO:teuthology.orchestra.run.smithi087.stdout:60129542154 2023-03-30T08:11:22.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.1 2023-03-30T08:11:22.578 DEBUG:teuthology.parallel:result is None 2023-03-30T08:11:22.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.576+0000 7f6ed4d79700 1 -- 172.21.15.87:0/362630126 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6eb0065440 msgr2=0x7f6eb00678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.576+0000 7f6ed4d79700 1 --2- 172.21.15.87:0/362630126 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6eb0065440 0x7f6eb00678f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40090b0 tx=0x7f6ec4010000 comp rx=0 tx=0).stop 2023-03-30T08:11:22.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.576+0000 7f6ed4d79700 1 -- 172.21.15.87:0/362630126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ec80e70f0 msgr2=0x7f6ec804e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.576+0000 7f6ed4d79700 1 --2- 172.21.15.87:0/362630126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ec80e70f0 0x7f6ec804e490 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000c310 tx=0x7f6ec000c6d0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.576+0000 7f6ed4d79700 1 -- 172.21.15.87:0/362630126 shutdown_connections 2023-03-30T08:11:22.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.576+0000 7f6ed4d79700 1 --2- 172.21.15.87:0/362630126 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6eb0065440 0x7f6eb00678f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.576+0000 7f6ed4d79700 1 --2- 172.21.15.87:0/362630126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ec80e70f0 0x7f6ec804e490 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.576+0000 7f6ed4d79700 1 --2- 172.21.15.87:0/362630126 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ec80e6d20 0x7f6ec804ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.576+0000 7f6ed4d79700 1 --2- 172.21.15.87:0/362630126 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ec8036630 0x7f6ec804bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.576+0000 7f6ed4d79700 1 -- 172.21.15.87:0/362630126 >> 172.21.15.87:0/362630126 conn(0x7f6ec8051630 msgr2=0x7f6ec80e7940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.576+0000 7f6ed4d79700 1 -- 172.21.15.87:0/362630126 shutdown_connections 2023-03-30T08:11:22.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.576+0000 7f6ed4d79700 1 -- 172.21.15.87:0/362630126 wait complete. 2023-03-30T08:11:22.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.7 2023-03-30T08:11:22.588 DEBUG:teuthology.parallel:result is None 2023-03-30T08:11:22.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.6 2023-03-30T08:11:22.591 DEBUG:teuthology.parallel:result is None 2023-03-30T08:11:22.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.3 2023-03-30T08:11:22.592 DEBUG:teuthology.parallel:result is None 2023-03-30T08:11:22.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.2 2023-03-30T08:11:22.597 DEBUG:teuthology.parallel:result is None 2023-03-30T08:11:22.597 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-03-30T08:11:22.598 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-30T08:11:22.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.788+0000 7fb8b52d1700 1 Processor -- start 2023-03-30T08:11:22.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.788+0000 7fb8b52d1700 1 -- start start 2023-03-30T08:11:22.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8b52d1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb8b00b3f30 0x7fb8b00b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8b52d1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8b006a6e0 0x7fb8b00aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8b52d1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b006b670 con 0x7fb8b00af180 2023-03-30T08:11:22.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8b52d1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b00af600 con 0x7fb8b00b3f30 2023-03-30T08:11:22.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8b52d1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b006b0b0 con 0x7fb8b006a6e0 2023-03-30T08:11:22.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8af7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb8b00af180 0x7fb8b015ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48594/0 (socket says 172.21.15.87:48594) 2023-03-30T08:11:22.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8af7fe700 1 -- 172.21.15.87:0/3206616698 learned_addr learned my addr 172.21.15.87:0/3206616698 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:22.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8aeffd700 1 --2- 172.21.15.87:0/3206616698 >> v2:172.21.15.115:3300/0 conn(0x7fb8b00b3f30 0x7fb8b00b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8ae7fc700 1 --2- 172.21.15.87:0/3206616698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8b006a6e0 0x7fb8b00aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8adffb700 1 -- 172.21.15.87:0/3206616698 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655877527 0 0) 0x7fb8b006b670 con 0x7fb8b00af180 2023-03-30T08:11:22.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8adffb700 1 -- 172.21.15.87:0/3206616698 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8980035d0 con 0x7fb8b00af180 2023-03-30T08:11:22.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8ae7fc700 1 -- 172.21.15.87:0/3206616698 >> v2:172.21.15.115:3300/0 conn(0x7fb8b00b3f30 msgr2=0x7fb8b00b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:22.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8ae7fc700 1 --2- 172.21.15.87:0/3206616698 >> v2:172.21.15.115:3300/0 conn(0x7fb8b00b3f30 0x7fb8b00b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8ae7fc700 1 -- 172.21.15.87:0/3206616698 >> v1:172.21.15.87:6789/0 conn(0x7fb8b00af180 legacy=0x7fb8b015ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8ae7fc700 1 -- 172.21.15.87:0/3206616698 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b006b390 con 0x7fb8b006a6e0 2023-03-30T08:11:22.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8ae7fc700 1 --2- 172.21.15.87:0/3206616698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8b006a6e0 0x7fb8b00aec40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009850 tx=0x7fb8a4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1f849d99f92fcd3 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8adffb700 1 -- 172.21.15.87:0/3206616698 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4011830 con 0x7fb8b006a6e0 2023-03-30T08:11:22.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8adffb700 1 -- 172.21.15.87:0/3206616698 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a4011990 con 0x7fb8b006a6e0 2023-03-30T08:11:22.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.792+0000 7fb8adffb700 1 -- 172.21.15.87:0/3206616698 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4011d40 con 0x7fb8b006a6e0 2023-03-30T08:11:22.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 -- 172.21.15.87:0/3206616698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8b006a6e0 msgr2=0x7fb8b00aec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 --2- 172.21.15.87:0/3206616698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8b006a6e0 0x7fb8b00aec40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009850 tx=0x7fb8a4009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:22.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 -- 172.21.15.87:0/3206616698 shutdown_connections 2023-03-30T08:11:22.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 --2- 172.21.15.87:0/3206616698 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8b006a6e0 0x7fb8b00aec40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 --2- 172.21.15.87:0/3206616698 >> v2:172.21.15.115:3300/0 conn(0x7fb8b00b3f30 0x7fb8b00b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 -- 172.21.15.87:0/3206616698 >> 172.21.15.87:0/3206616698 conn(0x7fb8b00cf410 msgr2=0x7fb8b00cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 -- 172.21.15.87:0/3206616698 shutdown_connections 2023-03-30T08:11:22.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 -- 172.21.15.87:0/3206616698 wait complete. 2023-03-30T08:11:22.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 Processor -- start 2023-03-30T08:11:22.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 -- start start 2023-03-30T08:11:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8b006a6e0 0x7fb8b0145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b00af180 0x7fb8b0148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8b00b3f30 0x7fb8b0148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0159b20 con 0x7fb8b00af180 2023-03-30T08:11:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00cc310 con 0x7fb8b006a6e0 2023-03-30T08:11:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.796+0000 7fb8b52d1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0149300 con 0x7fb8b00b3f30 2023-03-30T08:11:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8ae7fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b00af180 0x7fb8b0148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8ae7fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b00af180 0x7fb8b0148790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52146/0 (socket says 172.21.15.87:52146) 2023-03-30T08:11:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8ae7fc700 1 -- 172.21.15.87:0/3085050769 learned_addr learned my addr 172.21.15.87:0/3085050769 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8aeffd700 1 --2- 172.21.15.87:0/3085050769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8b006a6e0 0x7fb8b0145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8ae7fc700 1 -- 172.21.15.87:0/3085050769 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8b00b3f30 msgr2=0x7fb8b0148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8ae7fc700 1 --2- 172.21.15.87:0/3085050769 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8b00b3f30 0x7fb8b0148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8ae7fc700 1 -- 172.21.15.87:0/3085050769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8b006a6e0 msgr2=0x7fb8b0145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8ae7fc700 1 --2- 172.21.15.87:0/3085050769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8b006a6e0 0x7fb8b0145db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8ae7fc700 1 -- 172.21.15.87:0/3085050769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a40094b0 con 0x7fb8b00af180 2023-03-30T08:11:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8aeffd700 1 --2- 172.21.15.87:0/3085050769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8b006a6e0 0x7fb8b0145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8ae7fc700 1 --2- 172.21.15.87:0/3085050769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b00af180 0x7fb8b0148790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4014040 tx=0x7fb8a4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8977fe700 1 -- 172.21.15.87:0/3085050769 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a40036c0 con 0x7fb8b00af180 2023-03-30T08:11:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8977fe700 1 -- 172.21.15.87:0/3085050769 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a401e070 con 0x7fb8b00af180 2023-03-30T08:11:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8b52d1700 1 -- 172.21.15.87:0/3085050769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b00ae1b0 con 0x7fb8b00af180 2023-03-30T08:11:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8977fe700 1 -- 172.21.15.87:0/3085050769 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4003a80 con 0x7fb8b00af180 2023-03-30T08:11:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8b52d1700 1 -- 172.21.15.87:0/3085050769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b00aded0 con 0x7fb8b00af180 2023-03-30T08:11:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.800+0000 7fb8b52d1700 1 -- 172.21.15.87:0/3085050769 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b00b4300 con 0x7fb8b00af180 2023-03-30T08:11:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.804+0000 7fb8977fe700 1 -- 172.21.15.87:0/3085050769 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fb8a4003be0 con 0x7fb8b00af180 2023-03-30T08:11:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.804+0000 7fb8977fe700 1 --2- 172.21.15.87:0/3085050769 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb89c0653f0 0x7fb89c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.804+0000 7fb8977fe700 1 -- 172.21.15.87:0/3085050769 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb8a4020070 con 0x7fb8b00af180 2023-03-30T08:11:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.804+0000 7fb8aeffd700 1 --2- 172.21.15.87:0/3085050769 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb89c0653f0 0x7fb89c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.804+0000 7fb8aeffd700 1 --2- 172.21.15.87:0/3085050769 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb89c0653f0 0x7fb89c0678a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009ad0 tx=0x7fb8a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.808+0000 7fb8977fe700 1 -- 172.21.15.87:0/3085050769 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fb8a4051a80 con 0x7fb8b00af180 2023-03-30T08:11:22.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.960+0000 7fb8b52d1700 1 -- 172.21.15.87:0/3085050769 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8b00b3600 con 0x7fb89c0653f0 2023-03-30T08:11:22.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.976+0000 7fb8977fe700 1 -- 172.21.15.87:0/3085050769 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367078 (secure 0 0 0) 0x7fb8b00b3600 con 0x7fb89c0653f0 2023-03-30T08:11:22.986 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.984+0000 7fb8b52d1700 1 -- 172.21.15.87:0/3085050769 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb89c0653f0 msgr2=0x7fb89c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.984+0000 7fb8b52d1700 1 --2- 172.21.15.87:0/3085050769 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb89c0653f0 0x7fb89c0678a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009ad0 tx=0x7fb8a0008040 comp rx=0 tx=0).stop 2023-03-30T08:11:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.984+0000 7fb8b52d1700 1 -- 172.21.15.87:0/3085050769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b00af180 msgr2=0x7fb8b0148790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.984+0000 7fb8b52d1700 1 --2- 172.21.15.87:0/3085050769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b00af180 0x7fb8b0148790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4014040 tx=0x7fb8a4004770 comp rx=0 tx=0).stop 2023-03-30T08:11:22.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.984+0000 7fb8b52d1700 1 -- 172.21.15.87:0/3085050769 shutdown_connections 2023-03-30T08:11:22.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.984+0000 7fb8b52d1700 1 --2- 172.21.15.87:0/3085050769 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb89c0653f0 0x7fb89c0678a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.984+0000 7fb8b52d1700 1 --2- 172.21.15.87:0/3085050769 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb8b00b3f30 0x7fb8b0148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.984+0000 7fb8b52d1700 1 --2- 172.21.15.87:0/3085050769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb8b00af180 0x7fb8b0148790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.984+0000 7fb8b52d1700 1 --2- 172.21.15.87:0/3085050769 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8b006a6e0 0x7fb8b0145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:22.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.984+0000 7fb8b52d1700 1 -- 172.21.15.87:0/3085050769 >> 172.21.15.87:0/3085050769 conn(0x7fb8b00cf410 msgr2=0x7fb8b00b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:22.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.984+0000 7fb8b52d1700 1 -- 172.21.15.87:0/3085050769 shutdown_connections 2023-03-30T08:11:22.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:22.984+0000 7fb8b52d1700 1 -- 172.21.15.87:0/3085050769 wait complete. 2023-03-30T08:11:22.992 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-03-30T08:11:23.006 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-03-30T08:11:21.897250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594965,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67620,"kb_used_data":3556,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907100,"statfs":{"total":773094113280,"available":773024870400,"internally_reserved":0,"allocated":3641344,"data_stored":2171323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":142,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004930"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.851978+0000","last_change":"2023-03-30T08:11:02.425599+0000","last_active":"2023-03-30T08:11:02.851978+0000","last_peered":"2023-03-30T08:11:02.851978+0000","last_clean":"2023-03-30T08:11:02.851978+0000","last_became_active":"2023-03-30T08:11:02.425042+0000","last_became_peered":"2023-03-30T08:11:02.425042+0000","last_unstale":"2023-03-30T08:11:02.851978+0000","last_undegraded":"2023-03-30T08:11:02.851978+0000","last_fullsized":"2023-03-30T08:11:02.851978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:40:33.035785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406168+0000","last_change":"2023-03-30T08:10:57.939450+0000","last_active":"2023-03-30T08:11:02.406168+0000","last_peered":"2023-03-30T08:11:02.406168+0000","last_clean":"2023-03-30T08:11:02.406168+0000","last_became_active":"2023-03-30T08:10:57.939147+0000","last_became_peered":"2023-03-30T08:10:57.939147+0000","last_unstale":"2023-03-30T08:11:02.406168+0000","last_undegraded":"2023-03-30T08:11:02.406168+0000","last_fullsized":"2023-03-30T08:11:02.406168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:38.146109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395331+0000","last_change":"2023-03-30T08:10:58.389556+0000","last_active":"2023-03-30T08:11:02.395331+0000","last_peered":"2023-03-30T08:11:02.395331+0000","last_clean":"2023-03-30T08:11:02.395331+0000","last_became_active":"2023-03-30T08:10:58.389242+0000","last_became_peered":"2023-03-30T08:10:58.389242+0000","last_unstale":"2023-03-30T08:11:02.395331+0000","last_undegraded":"2023-03-30T08:11:02.395331+0000","last_fullsized":"2023-03-30T08:11:02.395331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:21:53.230935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.959595+0000","last_change":"2023-03-30T08:11:02.434932+0000","last_active":"2023-03-30T08:11:02.959595+0000","last_peered":"2023-03-30T08:11:02.959595+0000","last_clean":"2023-03-30T08:11:02.959595+0000","last_became_active":"2023-03-30T08:11:02.434551+0000","last_became_peered":"2023-03-30T08:11:02.434551+0000","last_unstale":"2023-03-30T08:11:02.959595+0000","last_undegraded":"2023-03-30T08:11:02.959595+0000","last_fullsized":"2023-03-30T08:11:02.959595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:44:14.559765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.411766+0000","last_change":"2023-03-30T08:10:57.937405+0000","last_active":"2023-03-30T08:11:02.411766+0000","last_peered":"2023-03-30T08:11:02.411766+0000","last_clean":"2023-03-30T08:11:02.411766+0000","last_became_active":"2023-03-30T08:10:57.935124+0000","last_became_peered":"2023-03-30T08:10:57.935124+0000","last_unstale":"2023-03-30T08:11:02.411766+0000","last_undegraded":"2023-03-30T08:11:02.411766+0000","last_fullsized":"2023-03-30T08:11:02.411766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:53.405554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399850+0000","last_change":"2023-03-30T08:10:58.403791+0000","last_active":"2023-03-30T08:11:02.399850+0000","last_peered":"2023-03-30T08:11:02.399850+0000","last_clean":"2023-03-30T08:11:02.399850+0000","last_became_active":"2023-03-30T08:10:58.403522+0000","last_became_peered":"2023-03-30T08:10:58.403522+0000","last_unstale":"2023-03-30T08:11:02.399850+0000","last_undegraded":"2023-03-30T08:11:02.399850+0000","last_fullsized":"2023-03-30T08:11:02.399850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:58:27.992306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366005+0000","last_change":"2023-03-30T08:11:02.427878+0000","last_active":"2023-03-30T08:11:03.366005+0000","last_peered":"2023-03-30T08:11:03.366005+0000","last_clean":"2023-03-30T08:11:03.366005+0000","last_became_active":"2023-03-30T08:11:02.421849+0000","last_became_peered":"2023-03-30T08:11:02.421849+0000","last_unstale":"2023-03-30T08:11:03.366005+0000","last_undegraded":"2023-03-30T08:11:03.366005+0000","last_fullsized":"2023-03-30T08:11:03.366005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:38:02.001551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399928+0000","last_change":"2023-03-30T08:10:57.937107+0000","last_active":"2023-03-30T08:11:02.399928+0000","last_peered":"2023-03-30T08:11:02.399928+0000","last_clean":"2023-03-30T08:11:02.399928+0000","last_became_active":"2023-03-30T08:10:57.936809+0000","last_became_peered":"2023-03-30T08:10:57.936809+0000","last_unstale":"2023-03-30T08:11:02.399928+0000","last_undegraded":"2023-03-30T08:11:02.399928+0000","last_fullsized":"2023-03-30T08:11:02.399928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:58:21.827874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394948+0000","last_change":"2023-03-30T08:10:58.390328+0000","last_active":"2023-03-30T08:11:02.394948+0000","last_peered":"2023-03-30T08:11:02.394948+0000","last_clean":"2023-03-30T08:11:02.394948+0000","last_became_active":"2023-03-30T08:10:58.390002+0000","last_became_peered":"2023-03-30T08:10:58.390002+0000","last_unstale":"2023-03-30T08:11:02.394948+0000","last_undegraded":"2023-03-30T08:11:02.394948+0000","last_fullsized":"2023-03-30T08:11:02.394948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:31:49.952044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.854271+0000","last_change":"2023-03-30T08:11:02.427000+0000","last_active":"2023-03-30T08:11:02.854271+0000","last_peered":"2023-03-30T08:11:02.854271+0000","last_clean":"2023-03-30T08:11:02.854271+0000","last_became_active":"2023-03-30T08:11:02.426423+0000","last_became_peered":"2023-03-30T08:11:02.426423+0000","last_unstale":"2023-03-30T08:11:02.854271+0000","last_undegraded":"2023-03-30T08:11:02.854271+0000","last_fullsized":"2023-03-30T08:11:02.854271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:41.480225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399346+0000","last_change":"2023-03-30T08:10:57.937991+0000","last_active":"2023-03-30T08:11:02.399346+0000","last_peered":"2023-03-30T08:11:02.399346+0000","last_clean":"2023-03-30T08:11:02.399346+0000","last_became_active":"2023-03-30T08:10:57.937690+0000","last_became_peered":"2023-03-30T08:10:57.937690+0000","last_unstale":"2023-03-30T08:11:02.399346+0000","last_undegraded":"2023-03-30T08:11:02.399346+0000","last_fullsized":"2023-03-30T08:11:02.399346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:37:16.892431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395882+0000","last_change":"2023-03-30T08:10:58.392963+0000","last_active":"2023-03-30T08:11:02.395882+0000","last_peered":"2023-03-30T08:11:02.395882+0000","last_clean":"2023-03-30T08:11:02.395882+0000","last_became_active":"2023-03-30T08:10:58.388880+0000","last_became_peered":"2023-03-30T08:10:58.388880+0000","last_unstale":"2023-03-30T08:11:02.395882+0000","last_undegraded":"2023-03-30T08:11:02.395882+0000","last_fullsized":"2023-03-30T08:11:02.395882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:25:58.870966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853066+0000","last_change":"2023-03-30T08:11:02.415859+0000","last_active":"2023-03-30T08:11:02.853066+0000","last_peered":"2023-03-30T08:11:02.853066+0000","last_clean":"2023-03-30T08:11:02.853066+0000","last_became_active":"2023-03-30T08:11:02.415410+0000","last_became_peered":"2023-03-30T08:11:02.415410+0000","last_unstale":"2023-03-30T08:11:02.853066+0000","last_undegraded":"2023-03-30T08:11:02.853066+0000","last_fullsized":"2023-03-30T08:11:02.853066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:49:16.476438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406634+0000","last_change":"2023-03-30T08:10:57.947614+0000","last_active":"2023-03-30T08:11:02.406634+0000","last_peered":"2023-03-30T08:11:02.406634+0000","last_clean":"2023-03-30T08:11:02.406634+0000","last_became_active":"2023-03-30T08:10:57.947418+0000","last_became_peered":"2023-03-30T08:10:57.947418+0000","last_unstale":"2023-03-30T08:11:02.406634+0000","last_undegraded":"2023-03-30T08:11:02.406634+0000","last_fullsized":"2023-03-30T08:11:02.406634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:05:18.197097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.417809+0000","last_change":"2023-03-30T08:10:58.394273+0000","last_active":"2023-03-30T08:11:02.417809+0000","last_peered":"2023-03-30T08:11:02.417809+0000","last_clean":"2023-03-30T08:11:02.417809+0000","last_became_active":"2023-03-30T08:10:58.391530+0000","last_became_peered":"2023-03-30T08:10:58.391530+0000","last_unstale":"2023-03-30T08:11:02.417809+0000","last_undegraded":"2023-03-30T08:11:02.417809+0000","last_fullsized":"2023-03-30T08:11:02.417809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:40.846051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.960231+0000","last_change":"2023-03-30T08:11:02.422513+0000","last_active":"2023-03-30T08:11:02.960231+0000","last_peered":"2023-03-30T08:11:02.960231+0000","last_clean":"2023-03-30T08:11:02.960231+0000","last_became_active":"2023-03-30T08:11:02.421920+0000","last_became_peered":"2023-03-30T08:11:02.421920+0000","last_unstale":"2023-03-30T08:11:02.960231+0000","last_undegraded":"2023-03-30T08:11:02.960231+0000","last_fullsized":"2023-03-30T08:11:02.960231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:27:49.655752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395448+0000","last_change":"2023-03-30T08:10:57.940428+0000","last_active":"2023-03-30T08:11:02.395448+0000","last_peered":"2023-03-30T08:11:02.395448+0000","last_clean":"2023-03-30T08:11:02.395448+0000","last_became_active":"2023-03-30T08:10:57.940061+0000","last_became_peered":"2023-03-30T08:10:57.940061+0000","last_unstale":"2023-03-30T08:11:02.395448+0000","last_undegraded":"2023-03-30T08:11:02.395448+0000","last_fullsized":"2023-03-30T08:11:02.395448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:02.973950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413043+0000","last_change":"2023-03-30T08:10:58.392097+0000","last_active":"2023-03-30T08:11:02.413043+0000","last_peered":"2023-03-30T08:11:02.413043+0000","last_clean":"2023-03-30T08:11:02.413043+0000","last_became_active":"2023-03-30T08:10:58.391848+0000","last_became_peered":"2023-03-30T08:10:58.391848+0000","last_unstale":"2023-03-30T08:11:02.413043+0000","last_undegraded":"2023-03-30T08:11:02.413043+0000","last_fullsized":"2023-03-30T08:11:02.413043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366477+0000","last_change":"2023-03-30T08:11:02.423105+0000","last_active":"2023-03-30T08:11:03.366477+0000","last_peered":"2023-03-30T08:11:03.366477+0000","last_clean":"2023-03-30T08:11:03.366477+0000","last_became_active":"2023-03-30T08:11:02.421129+0000","last_became_peered":"2023-03-30T08:11:02.421129+0000","last_unstale":"2023-03-30T08:11:03.366477+0000","last_undegraded":"2023-03-30T08:11:03.366477+0000","last_fullsized":"2023-03-30T08:11:03.366477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:06:26.729383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394857+0000","last_change":"2023-03-30T08:10:57.936602+0000","last_active":"2023-03-30T08:11:02.394857+0000","last_peered":"2023-03-30T08:11:02.394857+0000","last_clean":"2023-03-30T08:11:02.394857+0000","last_became_active":"2023-03-30T08:10:57.936280+0000","last_became_peered":"2023-03-30T08:10:57.936280+0000","last_unstale":"2023-03-30T08:11:02.394857+0000","last_undegraded":"2023-03-30T08:11:02.394857+0000","last_fullsized":"2023-03-30T08:11:02.394857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:53.405554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406100+0000","last_change":"2023-03-30T08:10:58.401670+0000","last_active":"2023-03-30T08:11:02.406100+0000","last_peered":"2023-03-30T08:11:02.406100+0000","last_clean":"2023-03-30T08:11:02.406100+0000","last_became_active":"2023-03-30T08:10:58.401324+0000","last_became_peered":"2023-03-30T08:10:58.401324+0000","last_unstale":"2023-03-30T08:11:02.406100+0000","last_undegraded":"2023-03-30T08:11:02.406100+0000","last_fullsized":"2023-03-30T08:11:02.406100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:35:55.226695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039694+0000","last_change":"2023-03-30T08:11:02.431539+0000","last_active":"2023-03-30T08:11:03.039694+0000","last_peered":"2023-03-30T08:11:03.039694+0000","last_clean":"2023-03-30T08:11:03.039694+0000","last_became_active":"2023-03-30T08:11:02.431107+0000","last_became_peered":"2023-03-30T08:11:02.431107+0000","last_unstale":"2023-03-30T08:11:03.039694+0000","last_undegraded":"2023-03-30T08:11:03.039694+0000","last_fullsized":"2023-03-30T08:11:03.039694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:40:33.035785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396957+0000","last_change":"2023-03-30T08:10:57.943321+0000","last_active":"2023-03-30T08:11:02.396957+0000","last_peered":"2023-03-30T08:11:02.396957+0000","last_clean":"2023-03-30T08:11:02.396957+0000","last_became_active":"2023-03-30T08:10:57.943058+0000","last_became_peered":"2023-03-30T08:10:57.943058+0000","last_unstale":"2023-03-30T08:11:02.396957+0000","last_undegraded":"2023-03-30T08:11:02.396957+0000","last_fullsized":"2023-03-30T08:11:02.396957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:06.629874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403221+0000","last_change":"2023-03-30T08:10:58.401041+0000","last_active":"2023-03-30T08:11:02.403221+0000","last_peered":"2023-03-30T08:11:02.403221+0000","last_clean":"2023-03-30T08:11:02.403221+0000","last_became_active":"2023-03-30T08:10:58.400234+0000","last_became_peered":"2023-03-30T08:10:58.400234+0000","last_unstale":"2023-03-30T08:11:02.403221+0000","last_undegraded":"2023-03-30T08:11:02.403221+0000","last_fullsized":"2023-03-30T08:11:02.403221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:46:19.608053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396781+0000","last_change":"2023-03-30T08:10:58.392868+0000","last_active":"2023-03-30T08:11:02.396781+0000","last_peered":"2023-03-30T08:11:02.396781+0000","last_clean":"2023-03-30T08:11:02.396781+0000","last_became_active":"2023-03-30T08:10:58.392619+0000","last_became_peered":"2023-03-30T08:10:58.392619+0000","last_unstale":"2023-03-30T08:11:02.396781+0000","last_undegraded":"2023-03-30T08:11:02.396781+0000","last_fullsized":"2023-03-30T08:11:02.396781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:15:17.876244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406247+0000","last_change":"2023-03-30T08:10:57.944453+0000","last_active":"2023-03-30T08:11:02.406247+0000","last_peered":"2023-03-30T08:11:02.406247+0000","last_clean":"2023-03-30T08:11:02.406247+0000","last_became_active":"2023-03-30T08:10:57.944114+0000","last_became_peered":"2023-03-30T08:10:57.944114+0000","last_unstale":"2023-03-30T08:11:02.406247+0000","last_undegraded":"2023-03-30T08:11:02.406247+0000","last_fullsized":"2023-03-30T08:11:02.406247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:53.405554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366017+0000","last_change":"2023-03-30T08:11:02.421919+0000","last_active":"2023-03-30T08:11:03.366017+0000","last_peered":"2023-03-30T08:11:03.366017+0000","last_clean":"2023-03-30T08:11:03.366017+0000","last_became_active":"2023-03-30T08:11:02.421212+0000","last_became_peered":"2023-03-30T08:11:02.421212+0000","last_unstale":"2023-03-30T08:11:03.366017+0000","last_undegraded":"2023-03-30T08:11:03.366017+0000","last_fullsized":"2023-03-30T08:11:03.366017+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:43:05.824967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399780+0000","last_change":"2023-03-30T08:10:58.388701+0000","last_active":"2023-03-30T08:11:02.399780+0000","last_peered":"2023-03-30T08:11:02.399780+0000","last_clean":"2023-03-30T08:11:02.399780+0000","last_became_active":"2023-03-30T08:10:58.388445+0000","last_became_peered":"2023-03-30T08:10:58.388445+0000","last_unstale":"2023-03-30T08:11:02.399780+0000","last_undegraded":"2023-03-30T08:11:02.399780+0000","last_fullsized":"2023-03-30T08:11:02.399780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:35:55.226695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.401923+0000","last_change":"2023-03-30T08:10:57.930016+0000","last_active":"2023-03-30T08:11:02.401923+0000","last_peered":"2023-03-30T08:11:02.401923+0000","last_clean":"2023-03-30T08:11:02.401923+0000","last_became_active":"2023-03-30T08:10:57.929673+0000","last_became_peered":"2023-03-30T08:10:57.929673+0000","last_unstale":"2023-03-30T08:11:02.401923+0000","last_undegraded":"2023-03-30T08:11:02.401923+0000","last_fullsized":"2023-03-30T08:11:02.401923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:35:11.040783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853357+0000","last_change":"2023-03-30T08:11:02.426850+0000","last_active":"2023-03-30T08:11:02.853357+0000","last_peered":"2023-03-30T08:11:02.853357+0000","last_clean":"2023-03-30T08:11:02.853357+0000","last_became_active":"2023-03-30T08:11:02.426417+0000","last_became_peered":"2023-03-30T08:11:02.426417+0000","last_unstale":"2023-03-30T08:11:02.853357+0000","last_undegraded":"2023-03-30T08:11:02.853357+0000","last_fullsized":"2023-03-30T08:11:02.853357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:02.698017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.415514+0000","last_change":"2023-03-30T08:10:57.939163+0000","last_active":"2023-03-30T08:11:02.415514+0000","last_peered":"2023-03-30T08:11:02.415514+0000","last_clean":"2023-03-30T08:11:02.415514+0000","last_became_active":"2023-03-30T08:10:57.938683+0000","last_became_peered":"2023-03-30T08:10:57.938683+0000","last_unstale":"2023-03-30T08:11:02.415514+0000","last_undegraded":"2023-03-30T08:11:02.415514+0000","last_fullsized":"2023-03-30T08:11:02.415514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:38.146109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396028+0000","last_change":"2023-03-30T08:10:58.378190+0000","last_active":"2023-03-30T08:11:02.396028+0000","last_peered":"2023-03-30T08:11:02.396028+0000","last_clean":"2023-03-30T08:11:02.396028+0000","last_became_active":"2023-03-30T08:10:58.377665+0000","last_became_peered":"2023-03-30T08:10:58.377665+0000","last_unstale":"2023-03-30T08:11:02.396028+0000","last_undegraded":"2023-03-30T08:11:02.396028+0000","last_fullsized":"2023-03-30T08:11:02.396028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:32:06.544654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.364405+0000","last_change":"2023-03-30T08:11:02.414726+0000","last_active":"2023-03-30T08:11:03.364405+0000","last_peered":"2023-03-30T08:11:03.364405+0000","last_clean":"2023-03-30T08:11:03.364405+0000","last_became_active":"2023-03-30T08:11:02.414203+0000","last_became_peered":"2023-03-30T08:11:02.414203+0000","last_unstale":"2023-03-30T08:11:03.364405+0000","last_undegraded":"2023-03-30T08:11:03.364405+0000","last_fullsized":"2023-03-30T08:11:03.364405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:40:33.035785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:14.328247+0000","last_change":"2023-03-30T08:10:57.938434+0000","last_active":"2023-03-30T08:11:14.328247+0000","last_peered":"2023-03-30T08:11:14.328247+0000","last_clean":"2023-03-30T08:11:14.328247+0000","last_became_active":"2023-03-30T08:10:57.937335+0000","last_became_peered":"2023-03-30T08:10:57.937335+0000","last_unstale":"2023-03-30T08:11:14.328247+0000","last_undegraded":"2023-03-30T08:11:14.328247+0000","last_fullsized":"2023-03-30T08:11:14.328247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:53:52.935025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396026+0000","last_change":"2023-03-30T08:10:58.376378+0000","last_active":"2023-03-30T08:11:02.396026+0000","last_peered":"2023-03-30T08:11:02.396026+0000","last_clean":"2023-03-30T08:11:02.396026+0000","last_became_active":"2023-03-30T08:10:58.376108+0000","last_became_peered":"2023-03-30T08:10:58.376108+0000","last_unstale":"2023-03-30T08:11:02.396026+0000","last_undegraded":"2023-03-30T08:11:02.396026+0000","last_fullsized":"2023-03-30T08:11:02.396026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:38:23.887005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.852648+0000","last_change":"2023-03-30T08:11:02.421977+0000","last_active":"2023-03-30T08:11:02.852648+0000","last_peered":"2023-03-30T08:11:02.852648+0000","last_clean":"2023-03-30T08:11:02.852648+0000","last_became_active":"2023-03-30T08:11:02.421307+0000","last_became_peered":"2023-03-30T08:11:02.421307+0000","last_unstale":"2023-03-30T08:11:02.852648+0000","last_undegraded":"2023-03-30T08:11:02.852648+0000","last_fullsized":"2023-03-30T08:11:02.852648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:28:34.576988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395167+0000","last_change":"2023-03-30T08:10:58.394164+0000","last_active":"2023-03-30T08:11:02.395167+0000","last_peered":"2023-03-30T08:11:02.395167+0000","last_clean":"2023-03-30T08:11:02.395167+0000","last_became_active":"2023-03-30T08:10:58.393905+0000","last_became_peered":"2023-03-30T08:10:58.393905+0000","last_unstale":"2023-03-30T08:11:02.395167+0000","last_undegraded":"2023-03-30T08:11:02.395167+0000","last_fullsized":"2023-03-30T08:11:02.395167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:41:30.721192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403329+0000","last_change":"2023-03-30T08:10:52.871133+0000","last_active":"2023-03-30T08:11:02.403329+0000","last_peered":"2023-03-30T08:11:02.403329+0000","last_clean":"2023-03-30T08:11:02.403329+0000","last_became_active":"2023-03-30T08:10:52.870678+0000","last_became_peered":"2023-03-30T08:10:52.870678+0000","last_unstale":"2023-03-30T08:11:02.403329+0000","last_undegraded":"2023-03-30T08:11:02.403329+0000","last_fullsized":"2023-03-30T08:11:02.403329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:51.162618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039910+0000","last_change":"2023-03-30T08:10:57.940745+0000","last_active":"2023-03-30T08:11:03.039910+0000","last_peered":"2023-03-30T08:11:03.039910+0000","last_clean":"2023-03-30T08:11:03.039910+0000","last_became_active":"2023-03-30T08:10:57.940137+0000","last_became_peered":"2023-03-30T08:10:57.940137+0000","last_unstale":"2023-03-30T08:11:03.039910+0000","last_undegraded":"2023-03-30T08:11:03.039910+0000","last_fullsized":"2023-03-30T08:11:03.039910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:39.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.364288+0000","last_change":"2023-03-30T08:11:02.420407+0000","last_active":"2023-03-30T08:11:03.364288+0000","last_peered":"2023-03-30T08:11:03.364288+0000","last_clean":"2023-03-30T08:11:03.364288+0000","last_became_active":"2023-03-30T08:11:02.420015+0000","last_became_peered":"2023-03-30T08:11:02.420015+0000","last_unstale":"2023-03-30T08:11:03.364288+0000","last_undegraded":"2023-03-30T08:11:03.364288+0000","last_fullsized":"2023-03-30T08:11:03.364288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:28:34.576988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396868+0000","last_change":"2023-03-30T08:10:58.390779+0000","last_active":"2023-03-30T08:11:02.396868+0000","last_peered":"2023-03-30T08:11:02.396868+0000","last_clean":"2023-03-30T08:11:02.396868+0000","last_became_active":"2023-03-30T08:10:58.389965+0000","last_became_peered":"2023-03-30T08:10:58.389965+0000","last_unstale":"2023-03-30T08:11:02.396868+0000","last_undegraded":"2023-03-30T08:11:02.396868+0000","last_fullsized":"2023-03-30T08:11:02.396868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394961+0000","last_change":"2023-03-30T08:10:52.871548+0000","last_active":"2023-03-30T08:11:02.394961+0000","last_peered":"2023-03-30T08:11:02.394961+0000","last_clean":"2023-03-30T08:11:02.394961+0000","last_became_active":"2023-03-30T08:10:52.871152+0000","last_became_peered":"2023-03-30T08:10:52.871152+0000","last_unstale":"2023-03-30T08:11:02.394961+0000","last_undegraded":"2023-03-30T08:11:02.394961+0000","last_fullsized":"2023-03-30T08:11:02.394961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412264+0000","last_change":"2023-03-30T08:10:57.937918+0000","last_active":"2023-03-30T08:11:02.412264+0000","last_peered":"2023-03-30T08:11:02.412264+0000","last_clean":"2023-03-30T08:11:02.412264+0000","last_became_active":"2023-03-30T08:10:57.937687+0000","last_became_peered":"2023-03-30T08:10:57.937687+0000","last_unstale":"2023-03-30T08:11:02.412264+0000","last_undegraded":"2023-03-30T08:11:02.412264+0000","last_fullsized":"2023-03-30T08:11:02.412264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:12:08.652227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.959598+0000","last_change":"2023-03-30T08:11:02.429990+0000","last_active":"2023-03-30T08:11:02.959598+0000","last_peered":"2023-03-30T08:11:02.959598+0000","last_clean":"2023-03-30T08:11:02.959598+0000","last_became_active":"2023-03-30T08:11:02.429585+0000","last_became_peered":"2023-03-30T08:11:02.429585+0000","last_unstale":"2023-03-30T08:11:02.959598+0000","last_undegraded":"2023-03-30T08:11:02.959598+0000","last_fullsized":"2023-03-30T08:11:02.959598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:11:07.869574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406439+0000","last_change":"2023-03-30T08:10:58.406667+0000","last_active":"2023-03-30T08:11:02.406439+0000","last_peered":"2023-03-30T08:11:02.406439+0000","last_clean":"2023-03-30T08:11:02.406439+0000","last_became_active":"2023-03-30T08:10:58.406362+0000","last_became_peered":"2023-03-30T08:10:58.406362+0000","last_unstale":"2023-03-30T08:11:02.406439+0000","last_undegraded":"2023-03-30T08:11:02.406439+0000","last_fullsized":"2023-03-30T08:11:02.406439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:53.625868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.415949+0000","last_change":"2023-03-30T08:10:52.921525+0000","last_active":"2023-03-30T08:11:02.415949+0000","last_peered":"2023-03-30T08:11:02.415949+0000","last_clean":"2023-03-30T08:11:02.415949+0000","last_became_active":"2023-03-30T08:10:52.920885+0000","last_became_peered":"2023-03-30T08:10:52.920885+0000","last_unstale":"2023-03-30T08:11:02.415949+0000","last_undegraded":"2023-03-30T08:11:02.415949+0000","last_fullsized":"2023-03-30T08:11:02.415949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:38:27.041880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396249+0000","last_change":"2023-03-30T08:10:57.929596+0000","last_active":"2023-03-30T08:11:02.396249+0000","last_peered":"2023-03-30T08:11:02.396249+0000","last_clean":"2023-03-30T08:11:02.396249+0000","last_became_active":"2023-03-30T08:10:57.929334+0000","last_became_peered":"2023-03-30T08:10:57.929334+0000","last_unstale":"2023-03-30T08:11:02.396249+0000","last_undegraded":"2023-03-30T08:11:02.396249+0000","last_fullsized":"2023-03-30T08:11:02.396249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:39.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.365879+0000","last_change":"2023-03-30T08:11:02.420714+0000","last_active":"2023-03-30T08:11:03.365879+0000","last_peered":"2023-03-30T08:11:03.365879+0000","last_clean":"2023-03-30T08:11:03.365879+0000","last_became_active":"2023-03-30T08:11:02.419661+0000","last_became_peered":"2023-03-30T08:11:02.419661+0000","last_unstale":"2023-03-30T08:11:03.365879+0000","last_undegraded":"2023-03-30T08:11:03.365879+0000","last_fullsized":"2023-03-30T08:11:03.365879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:50:58.130125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396109+0000","last_change":"2023-03-30T08:10:58.398687+0000","last_active":"2023-03-30T08:11:02.396109+0000","last_peered":"2023-03-30T08:11:02.396109+0000","last_clean":"2023-03-30T08:11:02.396109+0000","last_became_active":"2023-03-30T08:10:58.398357+0000","last_became_peered":"2023-03-30T08:10:58.398357+0000","last_unstale":"2023-03-30T08:11:02.396109+0000","last_undegraded":"2023-03-30T08:11:02.396109+0000","last_fullsized":"2023-03-30T08:11:02.396109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:40:05.484662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396668+0000","last_change":"2023-03-30T08:10:52.921563+0000","last_active":"2023-03-30T08:11:02.396668+0000","last_peered":"2023-03-30T08:11:02.396668+0000","last_clean":"2023-03-30T08:11:02.396668+0000","last_became_active":"2023-03-30T08:10:52.921234+0000","last_became_peered":"2023-03-30T08:10:52.921234+0000","last_unstale":"2023-03-30T08:11:02.396668+0000","last_undegraded":"2023-03-30T08:11:02.396668+0000","last_fullsized":"2023-03-30T08:11:02.396668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399823+0000","last_change":"2023-03-30T08:10:57.938023+0000","last_active":"2023-03-30T08:11:02.399823+0000","last_peered":"2023-03-30T08:11:02.399823+0000","last_clean":"2023-03-30T08:11:02.399823+0000","last_became_active":"2023-03-30T08:10:57.937727+0000","last_became_peered":"2023-03-30T08:10:57.937727+0000","last_unstale":"2023-03-30T08:11:02.399823+0000","last_undegraded":"2023-03-30T08:11:02.399823+0000","last_fullsized":"2023-03-30T08:11:02.399823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:38.146109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039222+0000","last_change":"2023-03-30T08:11:02.421176+0000","last_active":"2023-03-30T08:11:03.039222+0000","last_peered":"2023-03-30T08:11:03.039222+0000","last_clean":"2023-03-30T08:11:03.039222+0000","last_became_active":"2023-03-30T08:11:02.420282+0000","last_became_peered":"2023-03-30T08:11:02.420282+0000","last_unstale":"2023-03-30T08:11:03.039222+0000","last_undegraded":"2023-03-30T08:11:03.039222+0000","last_fullsized":"2023-03-30T08:11:03.039222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:49:16.476438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395271+0000","last_change":"2023-03-30T08:10:58.393615+0000","last_active":"2023-03-30T08:11:02.395271+0000","last_peered":"2023-03-30T08:11:02.395271+0000","last_clean":"2023-03-30T08:11:02.395271+0000","last_became_active":"2023-03-30T08:10:58.393279+0000","last_became_peered":"2023-03-30T08:10:58.393279+0000","last_unstale":"2023-03-30T08:11:02.395271+0000","last_undegraded":"2023-03-30T08:11:02.395271+0000","last_fullsized":"2023-03-30T08:11:02.395271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396015+0000","last_change":"2023-03-30T08:10:57.940319+0000","last_active":"2023-03-30T08:11:02.396015+0000","last_peered":"2023-03-30T08:11:02.396015+0000","last_clean":"2023-03-30T08:11:02.396015+0000","last_became_active":"2023-03-30T08:10:57.940037+0000","last_became_peered":"2023-03-30T08:10:57.940037+0000","last_unstale":"2023-03-30T08:11:02.396015+0000","last_undegraded":"2023-03-30T08:11:02.396015+0000","last_fullsized":"2023-03-30T08:11:02.396015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:53:42.965405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398522+0000","last_change":"2023-03-30T08:10:52.866272+0000","last_active":"2023-03-30T08:11:02.398522+0000","last_peered":"2023-03-30T08:11:02.398522+0000","last_clean":"2023-03-30T08:11:02.398522+0000","last_became_active":"2023-03-30T08:10:52.865919+0000","last_became_peered":"2023-03-30T08:10:52.865919+0000","last_unstale":"2023-03-30T08:11:02.398522+0000","last_undegraded":"2023-03-30T08:11:02.398522+0000","last_fullsized":"2023-03-30T08:11:02.398522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039424+0000","last_change":"2023-03-30T08:11:02.429404+0000","last_active":"2023-03-30T08:11:03.039424+0000","last_peered":"2023-03-30T08:11:03.039424+0000","last_clean":"2023-03-30T08:11:03.039424+0000","last_became_active":"2023-03-30T08:11:02.424334+0000","last_became_peered":"2023-03-30T08:11:02.424334+0000","last_unstale":"2023-03-30T08:11:03.039424+0000","last_undegraded":"2023-03-30T08:11:03.039424+0000","last_fullsized":"2023-03-30T08:11:03.039424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:24:14.599802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395078+0000","last_change":"2023-03-30T08:10:58.400056+0000","last_active":"2023-03-30T08:11:02.395078+0000","last_peered":"2023-03-30T08:11:02.395078+0000","last_clean":"2023-03-30T08:11:02.395078+0000","last_became_active":"2023-03-30T08:10:58.399774+0000","last_became_peered":"2023-03-30T08:10:58.399774+0000","last_unstale":"2023-03-30T08:11:02.395078+0000","last_undegraded":"2023-03-30T08:11:02.395078+0000","last_fullsized":"2023-03-30T08:11:02.395078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394296+0000","last_change":"2023-03-30T08:10:57.938541+0000","last_active":"2023-03-30T08:11:02.394296+0000","last_peered":"2023-03-30T08:11:02.394296+0000","last_clean":"2023-03-30T08:11:02.394296+0000","last_became_active":"2023-03-30T08:10:57.938279+0000","last_became_peered":"2023-03-30T08:10:57.938279+0000","last_unstale":"2023-03-30T08:11:02.394296+0000","last_undegraded":"2023-03-30T08:11:02.394296+0000","last_fullsized":"2023-03-30T08:11:02.394296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:06.629874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.411865+0000","last_change":"2023-03-30T08:10:52.920796+0000","last_active":"2023-03-30T08:11:02.411865+0000","last_peered":"2023-03-30T08:11:02.411865+0000","last_clean":"2023-03-30T08:11:02.411865+0000","last_became_active":"2023-03-30T08:10:52.920327+0000","last_became_peered":"2023-03-30T08:10:52.920327+0000","last_unstale":"2023-03-30T08:11:02.411865+0000","last_undegraded":"2023-03-30T08:11:02.411865+0000","last_fullsized":"2023-03-30T08:11:02.411865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:17.416386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857569+0000","last_change":"2023-03-30T08:11:02.426961+0000","last_active":"2023-03-30T08:11:02.857569+0000","last_peered":"2023-03-30T08:11:02.857569+0000","last_clean":"2023-03-30T08:11:02.857569+0000","last_became_active":"2023-03-30T08:11:02.426542+0000","last_became_peered":"2023-03-30T08:11:02.426542+0000","last_unstale":"2023-03-30T08:11:02.857569+0000","last_undegraded":"2023-03-30T08:11:02.857569+0000","last_fullsized":"2023-03-30T08:11:02.857569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:35:19.751044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406165+0000","last_change":"2023-03-30T08:10:58.392027+0000","last_active":"2023-03-30T08:11:02.406165+0000","last_peered":"2023-03-30T08:11:02.406165+0000","last_clean":"2023-03-30T08:11:02.406165+0000","last_became_active":"2023-03-30T08:10:58.391260+0000","last_became_peered":"2023-03-30T08:10:58.391260+0000","last_unstale":"2023-03-30T08:11:02.406165+0000","last_undegraded":"2023-03-30T08:11:02.406165+0000","last_fullsized":"2023-03-30T08:11:02.406165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.405859+0000","last_change":"2023-03-30T08:10:57.943504+0000","last_active":"2023-03-30T08:11:02.405859+0000","last_peered":"2023-03-30T08:11:02.405859+0000","last_clean":"2023-03-30T08:11:02.405859+0000","last_became_active":"2023-03-30T08:10:57.943209+0000","last_became_peered":"2023-03-30T08:10:57.943209+0000","last_unstale":"2023-03-30T08:11:02.405859+0000","last_undegraded":"2023-03-30T08:11:02.405859+0000","last_fullsized":"2023-03-30T08:11:02.405859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:12:08.652227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413143+0000","last_change":"2023-03-30T08:10:52.866412+0000","last_active":"2023-03-30T08:11:02.413143+0000","last_peered":"2023-03-30T08:11:02.413143+0000","last_clean":"2023-03-30T08:11:02.413143+0000","last_became_active":"2023-03-30T08:10:52.866055+0000","last_became_peered":"2023-03-30T08:10:52.866055+0000","last_unstale":"2023-03-30T08:11:02.413143+0000","last_undegraded":"2023-03-30T08:11:02.413143+0000","last_fullsized":"2023-03-30T08:11:02.413143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:39.045010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366582+0000","last_change":"2023-03-30T08:11:02.425350+0000","last_active":"2023-03-30T08:11:03.366582+0000","last_peered":"2023-03-30T08:11:03.366582+0000","last_clean":"2023-03-30T08:11:03.366582+0000","last_became_active":"2023-03-30T08:11:02.424984+0000","last_became_peered":"2023-03-30T08:11:02.424984+0000","last_unstale":"2023-03-30T08:11:03.366582+0000","last_undegraded":"2023-03-30T08:11:03.366582+0000","last_fullsized":"2023-03-30T08:11:03.366582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:24:06.284671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.405496+0000","last_change":"2023-03-30T08:10:58.385718+0000","last_active":"2023-03-30T08:11:02.405496+0000","last_peered":"2023-03-30T08:11:02.405496+0000","last_clean":"2023-03-30T08:11:02.405496+0000","last_became_active":"2023-03-30T08:10:58.385408+0000","last_became_peered":"2023-03-30T08:10:58.385408+0000","last_unstale":"2023-03-30T08:11:02.405496+0000","last_undegraded":"2023-03-30T08:11:02.405496+0000","last_fullsized":"2023-03-30T08:11:02.405496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:14:52.425655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403314+0000","last_change":"2023-03-30T08:10:57.937910+0000","last_active":"2023-03-30T08:11:02.403314+0000","last_peered":"2023-03-30T08:11:02.403314+0000","last_clean":"2023-03-30T08:11:02.403314+0000","last_became_active":"2023-03-30T08:10:57.937536+0000","last_became_peered":"2023-03-30T08:10:57.937536+0000","last_unstale":"2023-03-30T08:11:02.403314+0000","last_undegraded":"2023-03-30T08:11:02.403314+0000","last_fullsized":"2023-03-30T08:11:02.403314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:43:19.460541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399212+0000","last_change":"2023-03-30T08:10:52.868170+0000","last_active":"2023-03-30T08:11:02.399212+0000","last_peered":"2023-03-30T08:11:02.399212+0000","last_clean":"2023-03-30T08:11:02.399212+0000","last_became_active":"2023-03-30T08:10:52.867790+0000","last_became_peered":"2023-03-30T08:10:52.867790+0000","last_unstale":"2023-03-30T08:11:02.399212+0000","last_undegraded":"2023-03-30T08:11:02.399212+0000","last_fullsized":"2023-03-30T08:11:02.399212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413220+0000","last_change":"2023-03-30T08:10:45.713084+0000","last_active":"2023-03-30T08:11:02.413220+0000","last_peered":"2023-03-30T08:11:02.413220+0000","last_clean":"2023-03-30T08:11:02.413220+0000","last_became_active":"2023-03-30T08:10:45.711645+0000","last_became_peered":"2023-03-30T08:10:45.711645+0000","last_unstale":"2023-03-30T08:11:02.413220+0000","last_undegraded":"2023-03-30T08:11:02.413220+0000","last_fullsized":"2023-03-30T08:11:02.413220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_clean_scrub_stamp":"2023-03-30T08:10:44.620691+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:58:12.738262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853836+0000","last_change":"2023-03-30T08:11:02.435412+0000","last_active":"2023-03-30T08:11:02.853836+0000","last_peered":"2023-03-30T08:11:02.853836+0000","last_clean":"2023-03-30T08:11:02.853836+0000","last_became_active":"2023-03-30T08:11:02.435007+0000","last_became_peered":"2023-03-30T08:11:02.435007+0000","last_unstale":"2023-03-30T08:11:02.853836+0000","last_undegraded":"2023-03-30T08:11:02.853836+0000","last_fullsized":"2023-03-30T08:11:02.853836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:51:55.638235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394980+0000","last_change":"2023-03-30T08:10:58.385689+0000","last_active":"2023-03-30T08:11:02.394980+0000","last_peered":"2023-03-30T08:11:02.394980+0000","last_clean":"2023-03-30T08:11:02.394980+0000","last_became_active":"2023-03-30T08:10:58.385413+0000","last_became_peered":"2023-03-30T08:10:58.385413+0000","last_unstale":"2023-03-30T08:11:02.394980+0000","last_undegraded":"2023-03-30T08:11:02.394980+0000","last_fullsized":"2023-03-30T08:11:02.394980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:58:27.992306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.397069+0000","last_change":"2023-03-30T08:10:57.936928+0000","last_active":"2023-03-30T08:11:02.397069+0000","last_peered":"2023-03-30T08:11:02.397069+0000","last_clean":"2023-03-30T08:11:02.397069+0000","last_became_active":"2023-03-30T08:10:57.935798+0000","last_became_peered":"2023-03-30T08:10:57.935798+0000","last_unstale":"2023-03-30T08:11:02.397069+0000","last_undegraded":"2023-03-30T08:11:02.397069+0000","last_fullsized":"2023-03-30T08:11:02.397069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:05:18.197097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.960953+0000","last_change":"2023-03-30T08:11:02.423183+0000","last_active":"2023-03-30T08:11:02.960953+0000","last_peered":"2023-03-30T08:11:02.960953+0000","last_clean":"2023-03-30T08:11:02.960953+0000","last_became_active":"2023-03-30T08:11:02.422749+0000","last_became_peered":"2023-03-30T08:11:02.422749+0000","last_unstale":"2023-03-30T08:11:02.960953+0000","last_undegraded":"2023-03-30T08:11:02.960953+0000","last_fullsized":"2023-03-30T08:11:02.960953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:00:38.556877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395463+0000","last_change":"2023-03-30T08:10:58.385022+0000","last_active":"2023-03-30T08:11:02.395463+0000","last_peered":"2023-03-30T08:11:02.395463+0000","last_clean":"2023-03-30T08:11:02.395463+0000","last_became_active":"2023-03-30T08:10:58.384750+0000","last_became_peered":"2023-03-30T08:10:58.384750+0000","last_unstale":"2023-03-30T08:11:02.395463+0000","last_undegraded":"2023-03-30T08:11:02.395463+0000","last_fullsized":"2023-03-30T08:11:02.395463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:56:41.526064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395470+0000","last_change":"2023-03-30T08:10:57.939974+0000","last_active":"2023-03-30T08:11:02.395470+0000","last_peered":"2023-03-30T08:11:02.395470+0000","last_clean":"2023-03-30T08:11:02.395470+0000","last_became_active":"2023-03-30T08:10:57.938857+0000","last_became_peered":"2023-03-30T08:10:57.938857+0000","last_unstale":"2023-03-30T08:11:02.395470+0000","last_undegraded":"2023-03-30T08:11:02.395470+0000","last_fullsized":"2023-03-30T08:11:02.395470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:04:22.947813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366491+0000","last_change":"2023-03-30T08:11:02.427807+0000","last_active":"2023-03-30T08:11:03.366491+0000","last_peered":"2023-03-30T08:11:03.366491+0000","last_clean":"2023-03-30T08:11:03.366491+0000","last_became_active":"2023-03-30T08:11:02.427234+0000","last_became_peered":"2023-03-30T08:11:02.427234+0000","last_unstale":"2023-03-30T08:11:03.366491+0000","last_undegraded":"2023-03-30T08:11:03.366491+0000","last_fullsized":"2023-03-30T08:11:03.366491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:40.748097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394764+0000","last_change":"2023-03-30T08:10:58.396674+0000","last_active":"2023-03-30T08:11:02.394764+0000","last_peered":"2023-03-30T08:11:02.394764+0000","last_clean":"2023-03-30T08:11:02.394764+0000","last_became_active":"2023-03-30T08:10:58.396428+0000","last_became_peered":"2023-03-30T08:10:58.396428+0000","last_unstale":"2023-03-30T08:11:02.394764+0000","last_undegraded":"2023-03-30T08:11:02.394764+0000","last_fullsized":"2023-03-30T08:11:02.394764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:38:03.047478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403474+0000","last_change":"2023-03-30T08:10:57.941837+0000","last_active":"2023-03-30T08:11:02.403474+0000","last_peered":"2023-03-30T08:11:02.403474+0000","last_clean":"2023-03-30T08:11:02.403474+0000","last_became_active":"2023-03-30T08:10:57.941547+0000","last_became_peered":"2023-03-30T08:10:57.941547+0000","last_unstale":"2023-03-30T08:11:02.403474+0000","last_undegraded":"2023-03-30T08:11:02.403474+0000","last_fullsized":"2023-03-30T08:11:02.403474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:02.973950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853079+0000","last_change":"2023-03-30T08:11:02.414849+0000","last_active":"2023-03-30T08:11:02.853079+0000","last_peered":"2023-03-30T08:11:02.853079+0000","last_clean":"2023-03-30T08:11:02.853079+0000","last_became_active":"2023-03-30T08:11:02.414475+0000","last_became_peered":"2023-03-30T08:11:02.414475+0000","last_unstale":"2023-03-30T08:11:02.853079+0000","last_undegraded":"2023-03-30T08:11:02.853079+0000","last_fullsized":"2023-03-30T08:11:02.853079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:51:55.638235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395259+0000","last_change":"2023-03-30T08:10:58.390202+0000","last_active":"2023-03-30T08:11:02.395259+0000","last_peered":"2023-03-30T08:11:02.395259+0000","last_clean":"2023-03-30T08:11:02.395259+0000","last_became_active":"2023-03-30T08:10:58.389111+0000","last_became_peered":"2023-03-30T08:10:58.389111+0000","last_unstale":"2023-03-30T08:11:02.395259+0000","last_undegraded":"2023-03-30T08:11:02.395259+0000","last_fullsized":"2023-03-30T08:11:02.395259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:06:23.251839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.404718+0000","last_change":"2023-03-30T08:10:57.943339+0000","last_active":"2023-03-30T08:11:02.404718+0000","last_peered":"2023-03-30T08:11:02.404718+0000","last_clean":"2023-03-30T08:11:02.404718+0000","last_became_active":"2023-03-30T08:10:57.943025+0000","last_became_peered":"2023-03-30T08:10:57.943025+0000","last_unstale":"2023-03-30T08:11:02.404718+0000","last_undegraded":"2023-03-30T08:11:02.404718+0000","last_fullsized":"2023-03-30T08:11:02.404718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:39.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857288+0000","last_change":"2023-03-30T08:11:02.430259+0000","last_active":"2023-03-30T08:11:02.857288+0000","last_peered":"2023-03-30T08:11:02.857288+0000","last_clean":"2023-03-30T08:11:02.857288+0000","last_became_active":"2023-03-30T08:11:02.429913+0000","last_became_peered":"2023-03-30T08:11:02.429913+0000","last_unstale":"2023-03-30T08:11:02.857288+0000","last_undegraded":"2023-03-30T08:11:02.857288+0000","last_fullsized":"2023-03-30T08:11:02.857288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:57:50.469768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406365+0000","last_change":"2023-03-30T08:10:58.399947+0000","last_active":"2023-03-30T08:11:02.406365+0000","last_peered":"2023-03-30T08:11:02.406365+0000","last_clean":"2023-03-30T08:11:02.406365+0000","last_became_active":"2023-03-30T08:10:58.399634+0000","last_became_peered":"2023-03-30T08:10:58.399634+0000","last_unstale":"2023-03-30T08:11:02.406365+0000","last_undegraded":"2023-03-30T08:11:02.406365+0000","last_fullsized":"2023-03-30T08:11:02.406365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:58:27.992306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399443+0000","last_change":"2023-03-30T08:10:57.934972+0000","last_active":"2023-03-30T08:11:02.399443+0000","last_peered":"2023-03-30T08:11:02.399443+0000","last_clean":"2023-03-30T08:11:02.399443+0000","last_became_active":"2023-03-30T08:10:57.934655+0000","last_became_peered":"2023-03-30T08:10:57.934655+0000","last_unstale":"2023-03-30T08:11:02.399443+0000","last_undegraded":"2023-03-30T08:11:02.399443+0000","last_fullsized":"2023-03-30T08:11:02.399443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:49:48.774880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857279+0000","last_change":"2023-03-30T08:11:02.419444+0000","last_active":"2023-03-30T08:11:02.857279+0000","last_peered":"2023-03-30T08:11:02.857279+0000","last_clean":"2023-03-30T08:11:02.857279+0000","last_became_active":"2023-03-30T08:11:02.419054+0000","last_became_peered":"2023-03-30T08:11:02.419054+0000","last_unstale":"2023-03-30T08:11:02.857279+0000","last_undegraded":"2023-03-30T08:11:02.857279+0000","last_fullsized":"2023-03-30T08:11:02.857279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:35:06.686651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403308+0000","last_change":"2023-03-30T08:10:58.375670+0000","last_active":"2023-03-30T08:11:02.403308+0000","last_peered":"2023-03-30T08:11:02.403308+0000","last_clean":"2023-03-30T08:11:02.403308+0000","last_became_active":"2023-03-30T08:10:58.375401+0000","last_became_peered":"2023-03-30T08:10:58.375401+0000","last_unstale":"2023-03-30T08:11:02.403308+0000","last_undegraded":"2023-03-30T08:11:02.403308+0000","last_fullsized":"2023-03-30T08:11:02.403308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:22:19.993012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.415805+0000","last_change":"2023-03-30T08:10:57.934773+0000","last_active":"2023-03-30T08:11:02.415805+0000","last_peered":"2023-03-30T08:11:02.415805+0000","last_clean":"2023-03-30T08:11:02.415805+0000","last_became_active":"2023-03-30T08:10:57.934496+0000","last_became_peered":"2023-03-30T08:10:57.934496+0000","last_unstale":"2023-03-30T08:11:02.415805+0000","last_undegraded":"2023-03-30T08:11:02.415805+0000","last_fullsized":"2023-03-30T08:11:02.415805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:39:29.317281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857187+0000","last_change":"2023-03-30T08:11:02.431555+0000","last_active":"2023-03-30T08:11:02.857187+0000","last_peered":"2023-03-30T08:11:02.857187+0000","last_clean":"2023-03-30T08:11:02.857187+0000","last_became_active":"2023-03-30T08:11:02.431128+0000","last_became_peered":"2023-03-30T08:11:02.431128+0000","last_unstale":"2023-03-30T08:11:02.857187+0000","last_undegraded":"2023-03-30T08:11:02.857187+0000","last_fullsized":"2023-03-30T08:11:02.857187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:57.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394896+0000","last_change":"2023-03-30T08:10:58.373263+0000","last_active":"2023-03-30T08:11:02.394896+0000","last_peered":"2023-03-30T08:11:02.394896+0000","last_clean":"2023-03-30T08:11:02.394896+0000","last_became_active":"2023-03-30T08:10:58.373002+0000","last_became_peered":"2023-03-30T08:10:58.373002+0000","last_unstale":"2023-03-30T08:11:02.394896+0000","last_undegraded":"2023-03-30T08:11:02.394896+0000","last_fullsized":"2023-03-30T08:11:02.394896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:39:17.667535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416575+0000","last_change":"2023-03-30T08:10:57.948558+0000","last_active":"2023-03-30T08:11:02.416575+0000","last_peered":"2023-03-30T08:11:02.416575+0000","last_clean":"2023-03-30T08:11:02.416575+0000","last_became_active":"2023-03-30T08:10:57.948285+0000","last_became_peered":"2023-03-30T08:10:57.948285+0000","last_unstale":"2023-03-30T08:11:02.416575+0000","last_undegraded":"2023-03-30T08:11:02.416575+0000","last_fullsized":"2023-03-30T08:11:02.416575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:35:11.040783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857020+0000","last_change":"2023-03-30T08:11:02.428125+0000","last_active":"2023-03-30T08:11:02.857020+0000","last_peered":"2023-03-30T08:11:02.857020+0000","last_clean":"2023-03-30T08:11:02.857020+0000","last_became_active":"2023-03-30T08:11:02.427821+0000","last_became_peered":"2023-03-30T08:11:02.427821+0000","last_unstale":"2023-03-30T08:11:02.857020+0000","last_undegraded":"2023-03-30T08:11:02.857020+0000","last_fullsized":"2023-03-30T08:11:02.857020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:19:49.490189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398351+0000","last_change":"2023-03-30T08:10:58.396669+0000","last_active":"2023-03-30T08:11:02.398351+0000","last_peered":"2023-03-30T08:11:02.398351+0000","last_clean":"2023-03-30T08:11:02.398351+0000","last_became_active":"2023-03-30T08:10:58.396369+0000","last_became_peered":"2023-03-30T08:10:58.396369+0000","last_unstale":"2023-03-30T08:11:02.398351+0000","last_undegraded":"2023-03-30T08:11:02.398351+0000","last_fullsized":"2023-03-30T08:11:02.398351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416902+0000","last_change":"2023-03-30T08:10:57.947747+0000","last_active":"2023-03-30T08:11:02.416902+0000","last_peered":"2023-03-30T08:11:02.416902+0000","last_clean":"2023-03-30T08:11:02.416902+0000","last_became_active":"2023-03-30T08:10:57.947479+0000","last_became_peered":"2023-03-30T08:10:57.947479+0000","last_unstale":"2023-03-30T08:11:02.416902+0000","last_undegraded":"2023-03-30T08:11:02.416902+0000","last_fullsized":"2023-03-30T08:11:02.416902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:58:21.827874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.854114+0000","last_change":"2023-03-30T08:11:02.428227+0000","last_active":"2023-03-30T08:11:02.854114+0000","last_peered":"2023-03-30T08:11:02.854114+0000","last_clean":"2023-03-30T08:11:02.854114+0000","last_became_active":"2023-03-30T08:11:02.427865+0000","last_became_peered":"2023-03-30T08:11:02.427865+0000","last_unstale":"2023-03-30T08:11:02.854114+0000","last_undegraded":"2023-03-30T08:11:02.854114+0000","last_fullsized":"2023-03-30T08:11:02.854114+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:57:54.590144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366556+0000","last_change":"2023-03-30T08:11:02.425154+0000","last_active":"2023-03-30T08:11:03.366556+0000","last_peered":"2023-03-30T08:11:03.366556+0000","last_clean":"2023-03-30T08:11:03.366556+0000","last_became_active":"2023-03-30T08:11:02.424719+0000","last_became_peered":"2023-03-30T08:11:02.424719+0000","last_unstale":"2023-03-30T08:11:03.366556+0000","last_undegraded":"2023-03-30T08:11:03.366556+0000","last_fullsized":"2023-03-30T08:11:03.366556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:31:01.730540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403168+0000","last_change":"2023-03-30T08:10:57.943082+0000","last_active":"2023-03-30T08:11:02.403168+0000","last_peered":"2023-03-30T08:11:02.403168+0000","last_clean":"2023-03-30T08:11:02.403168+0000","last_became_active":"2023-03-30T08:10:57.942820+0000","last_became_peered":"2023-03-30T08:10:57.942820+0000","last_unstale":"2023-03-30T08:11:02.403168+0000","last_undegraded":"2023-03-30T08:11:02.403168+0000","last_fullsized":"2023-03-30T08:11:02.403168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:53:52.935025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412130+0000","last_change":"2023-03-30T08:10:58.394733+0000","last_active":"2023-03-30T08:11:02.412130+0000","last_peered":"2023-03-30T08:11:02.412130+0000","last_clean":"2023-03-30T08:11:02.412130+0000","last_became_active":"2023-03-30T08:10:58.394491+0000","last_became_peered":"2023-03-30T08:10:58.394491+0000","last_unstale":"2023-03-30T08:11:02.412130+0000","last_undegraded":"2023-03-30T08:11:02.412130+0000","last_fullsized":"2023-03-30T08:11:02.412130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:53.625868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.365349+0000","last_change":"2023-03-30T08:11:02.422104+0000","last_active":"2023-03-30T08:11:03.365349+0000","last_peered":"2023-03-30T08:11:03.365349+0000","last_clean":"2023-03-30T08:11:03.365349+0000","last_became_active":"2023-03-30T08:11:02.421521+0000","last_became_peered":"2023-03-30T08:11:02.421521+0000","last_unstale":"2023-03-30T08:11:03.365349+0000","last_undegraded":"2023-03-30T08:11:03.365349+0000","last_fullsized":"2023-03-30T08:11:03.365349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:40.748097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.414704+0000","last_change":"2023-03-30T08:10:57.942911+0000","last_active":"2023-03-30T08:11:02.414704+0000","last_peered":"2023-03-30T08:11:02.414704+0000","last_clean":"2023-03-30T08:11:02.414704+0000","last_became_active":"2023-03-30T08:10:57.942621+0000","last_became_peered":"2023-03-30T08:10:57.942621+0000","last_unstale":"2023-03-30T08:11:02.414704+0000","last_undegraded":"2023-03-30T08:11:02.414704+0000","last_fullsized":"2023-03-30T08:11:02.414704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:37:16.892431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406251+0000","last_change":"2023-03-30T08:10:58.401562+0000","last_active":"2023-03-30T08:11:02.406251+0000","last_peered":"2023-03-30T08:11:02.406251+0000","last_clean":"2023-03-30T08:11:02.406251+0000","last_became_active":"2023-03-30T08:10:58.400749+0000","last_became_peered":"2023-03-30T08:10:58.400749+0000","last_unstale":"2023-03-30T08:11:02.406251+0000","last_undegraded":"2023-03-30T08:11:02.406251+0000","last_fullsized":"2023-03-30T08:11:02.406251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406724+0000","last_change":"2023-03-30T08:10:57.943258+0000","last_active":"2023-03-30T08:11:02.406724+0000","last_peered":"2023-03-30T08:11:02.406724+0000","last_clean":"2023-03-30T08:11:02.406724+0000","last_became_active":"2023-03-30T08:10:57.942778+0000","last_became_peered":"2023-03-30T08:10:57.942778+0000","last_unstale":"2023-03-30T08:11:02.406724+0000","last_undegraded":"2023-03-30T08:11:02.406724+0000","last_fullsized":"2023-03-30T08:11:02.406724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:06.629874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399677+0000","last_change":"2023-03-30T08:10:58.395671+0000","last_active":"2023-03-30T08:11:02.399677+0000","last_peered":"2023-03-30T08:11:02.399677+0000","last_clean":"2023-03-30T08:11:02.399677+0000","last_became_active":"2023-03-30T08:10:58.395300+0000","last_became_peered":"2023-03-30T08:10:58.395300+0000","last_unstale":"2023-03-30T08:11:02.399677+0000","last_undegraded":"2023-03-30T08:11:02.399677+0000","last_fullsized":"2023-03-30T08:11:02.399677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.364731+0000","last_change":"2023-03-30T08:11:02.425902+0000","last_active":"2023-03-30T08:11:03.364731+0000","last_peered":"2023-03-30T08:11:03.364731+0000","last_clean":"2023-03-30T08:11:03.364731+0000","last_became_active":"2023-03-30T08:11:02.425557+0000","last_became_peered":"2023-03-30T08:11:02.425557+0000","last_unstale":"2023-03-30T08:11:03.364731+0000","last_undegraded":"2023-03-30T08:11:03.364731+0000","last_fullsized":"2023-03-30T08:11:03.364731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:01:41.681380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416216+0000","last_change":"2023-03-30T08:10:57.942208+0000","last_active":"2023-03-30T08:11:02.416216+0000","last_peered":"2023-03-30T08:11:02.416216+0000","last_clean":"2023-03-30T08:11:02.416216+0000","last_became_active":"2023-03-30T08:10:57.941842+0000","last_became_peered":"2023-03-30T08:10:57.941842+0000","last_unstale":"2023-03-30T08:11:02.416216+0000","last_undegraded":"2023-03-30T08:11:02.416216+0000","last_fullsized":"2023-03-30T08:11:02.416216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:49:48.774880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.411403+0000","last_change":"2023-03-30T08:10:58.390960+0000","last_active":"2023-03-30T08:11:02.411403+0000","last_peered":"2023-03-30T08:11:02.411403+0000","last_clean":"2023-03-30T08:11:02.411403+0000","last_became_active":"2023-03-30T08:10:58.390668+0000","last_became_peered":"2023-03-30T08:10:58.390668+0000","last_unstale":"2023-03-30T08:11:02.411403+0000","last_undegraded":"2023-03-30T08:11:02.411403+0000","last_fullsized":"2023-03-30T08:11:02.411403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:06:29.606761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.367121+0000","last_change":"2023-03-30T08:11:02.415367+0000","last_active":"2023-03-30T08:11:03.367121+0000","last_peered":"2023-03-30T08:11:03.367121+0000","last_clean":"2023-03-30T08:11:03.367121+0000","last_became_active":"2023-03-30T08:11:02.414945+0000","last_became_peered":"2023-03-30T08:11:02.414945+0000","last_unstale":"2023-03-30T08:11:03.367121+0000","last_undegraded":"2023-03-30T08:11:03.367121+0000","last_fullsized":"2023-03-30T08:11:03.367121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:49.266964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403049+0000","last_change":"2023-03-30T08:10:58.390221+0000","last_active":"2023-03-30T08:11:02.403049+0000","last_peered":"2023-03-30T08:11:02.403049+0000","last_clean":"2023-03-30T08:11:02.403049+0000","last_became_active":"2023-03-30T08:10:58.389916+0000","last_became_peered":"2023-03-30T08:10:58.389916+0000","last_unstale":"2023-03-30T08:11:02.403049+0000","last_undegraded":"2023-03-30T08:11:02.403049+0000","last_fullsized":"2023-03-30T08:11:02.403049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:33:09.992519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399692+0000","last_change":"2023-03-30T08:10:58.390234+0000","last_active":"2023-03-30T08:11:02.399692+0000","last_peered":"2023-03-30T08:11:02.399692+0000","last_clean":"2023-03-30T08:11:02.399692+0000","last_became_active":"2023-03-30T08:10:58.388988+0000","last_became_peered":"2023-03-30T08:10:58.388988+0000","last_unstale":"2023-03-30T08:11:02.399692+0000","last_undegraded":"2023-03-30T08:11:02.399692+0000","last_fullsized":"2023-03-30T08:11:02.399692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395321+0000","last_change":"2023-03-30T08:10:58.389994+0000","last_active":"2023-03-30T08:11:02.395321+0000","last_peered":"2023-03-30T08:11:02.395321+0000","last_clean":"2023-03-30T08:11:02.395321+0000","last_became_active":"2023-03-30T08:10:58.389699+0000","last_became_peered":"2023-03-30T08:10:58.389699+0000","last_unstale":"2023-03-30T08:11:02.395321+0000","last_undegraded":"2023-03-30T08:11:02.395321+0000","last_fullsized":"2023-03-30T08:11:02.395321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:43:02.347422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.404578+0000","last_change":"2023-03-30T08:10:58.390408+0000","last_active":"2023-03-30T08:11:02.404578+0000","last_peered":"2023-03-30T08:11:02.404578+0000","last_clean":"2023-03-30T08:11:02.404578+0000","last_became_active":"2023-03-30T08:10:58.389982+0000","last_became_peered":"2023-03-30T08:10:58.389982+0000","last_unstale":"2023-03-30T08:11:02.404578+0000","last_undegraded":"2023-03-30T08:11:02.404578+0000","last_fullsized":"2023-03-30T08:11:02.404578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396569+0000","last_change":"2023-03-30T08:10:58.397943+0000","last_active":"2023-03-30T08:11:02.396569+0000","last_peered":"2023-03-30T08:11:02.396569+0000","last_clean":"2023-03-30T08:11:02.396569+0000","last_became_active":"2023-03-30T08:10:58.397652+0000","last_became_peered":"2023-03-30T08:10:58.397652+0000","last_unstale":"2023-03-30T08:11:02.396569+0000","last_undegraded":"2023-03-30T08:11:02.396569+0000","last_fullsized":"2023-03-30T08:11:02.396569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399691+0000","last_change":"2023-03-30T08:10:58.396929+0000","last_active":"2023-03-30T08:11:02.399691+0000","last_peered":"2023-03-30T08:11:02.399691+0000","last_clean":"2023-03-30T08:11:02.399691+0000","last_became_active":"2023-03-30T08:10:58.396575+0000","last_became_peered":"2023-03-30T08:10:58.396575+0000","last_unstale":"2023-03-30T08:11:02.399691+0000","last_undegraded":"2023-03-30T08:11:02.399691+0000","last_fullsized":"2023-03-30T08:11:02.399691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394877+0000","last_change":"2023-03-30T08:10:58.394396+0000","last_active":"2023-03-30T08:11:02.394877+0000","last_peered":"2023-03-30T08:11:02.394877+0000","last_clean":"2023-03-30T08:11:02.394877+0000","last_became_active":"2023-03-30T08:10:58.394147+0000","last_became_peered":"2023-03-30T08:10:58.394147+0000","last_unstale":"2023-03-30T08:11:02.394877+0000","last_undegraded":"2023-03-30T08:11:02.394877+0000","last_fullsized":"2023-03-30T08:11:02.394877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394856+0000","last_change":"2023-03-30T08:10:58.387684+0000","last_active":"2023-03-30T08:11:02.394856+0000","last_peered":"2023-03-30T08:11:02.394856+0000","last_clean":"2023-03-30T08:11:02.394856+0000","last_became_active":"2023-03-30T08:10:58.387427+0000","last_became_peered":"2023-03-30T08:10:58.387427+0000","last_unstale":"2023-03-30T08:11:02.394856+0000","last_undegraded":"2023-03-30T08:11:02.394856+0000","last_fullsized":"2023-03-30T08:11:02.394856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413072+0000","last_change":"2023-03-30T08:10:58.403140+0000","last_active":"2023-03-30T08:11:02.413072+0000","last_peered":"2023-03-30T08:11:02.413072+0000","last_clean":"2023-03-30T08:11:02.413072+0000","last_became_active":"2023-03-30T08:10:58.402888+0000","last_became_peered":"2023-03-30T08:10:58.402888+0000","last_unstale":"2023-03-30T08:11:02.413072+0000","last_undegraded":"2023-03-30T08:11:02.413072+0000","last_fullsized":"2023-03-30T08:11:02.413072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399593+0000","last_change":"2023-03-30T08:10:58.401396+0000","last_active":"2023-03-30T08:11:02.399593+0000","last_peered":"2023-03-30T08:11:02.399593+0000","last_clean":"2023-03-30T08:11:02.399593+0000","last_became_active":"2023-03-30T08:10:58.399503+0000","last_became_peered":"2023-03-30T08:10:58.399503+0000","last_unstale":"2023-03-30T08:11:02.399593+0000","last_undegraded":"2023-03-30T08:11:02.399593+0000","last_fullsized":"2023-03-30T08:11:02.399593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406636+0000","last_change":"2023-03-30T08:10:58.390937+0000","last_active":"2023-03-30T08:11:02.406636+0000","last_peered":"2023-03-30T08:11:02.406636+0000","last_clean":"2023-03-30T08:11:02.406636+0000","last_became_active":"2023-03-30T08:10:58.389638+0000","last_became_peered":"2023-03-30T08:10:58.389638+0000","last_unstale":"2023-03-30T08:11:02.406636+0000","last_undegraded":"2023-03-30T08:11:02.406636+0000","last_fullsized":"2023-03-30T08:11:02.406636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416142+0000","last_change":"2023-03-30T08:10:58.404544+0000","last_active":"2023-03-30T08:11:02.416142+0000","last_peered":"2023-03-30T08:11:02.416142+0000","last_clean":"2023-03-30T08:11:02.416142+0000","last_became_active":"2023-03-30T08:10:58.404283+0000","last_became_peered":"2023-03-30T08:10:58.404283+0000","last_unstale":"2023-03-30T08:11:02.416142+0000","last_undegraded":"2023-03-30T08:11:02.416142+0000","last_fullsized":"2023-03-30T08:11:02.416142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395184+0000","last_change":"2023-03-30T08:10:58.388172+0000","last_active":"2023-03-30T08:11:02.395184+0000","last_peered":"2023-03-30T08:11:02.395184+0000","last_clean":"2023-03-30T08:11:02.395184+0000","last_became_active":"2023-03-30T08:10:58.384720+0000","last_became_peered":"2023-03-30T08:10:58.384720+0000","last_unstale":"2023-03-30T08:11:02.395184+0000","last_undegraded":"2023-03-30T08:11:02.395184+0000","last_fullsized":"2023-03-30T08:11:02.395184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:50:54.652580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.418243+0000","last_change":"2023-03-30T08:10:58.392445+0000","last_active":"2023-03-30T08:11:02.418243+0000","last_peered":"2023-03-30T08:11:02.418243+0000","last_clean":"2023-03-30T08:11:02.418243+0000","last_became_active":"2023-03-30T08:10:58.392143+0000","last_became_peered":"2023-03-30T08:10:58.392143+0000","last_unstale":"2023-03-30T08:11:02.418243+0000","last_undegraded":"2023-03-30T08:11:02.418243+0000","last_fullsized":"2023-03-30T08:11:02.418243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:07.646179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394615+0000","last_change":"2023-03-30T08:10:58.394487+0000","last_active":"2023-03-30T08:11:02.394615+0000","last_peered":"2023-03-30T08:11:02.394615+0000","last_clean":"2023-03-30T08:11:02.394615+0000","last_became_active":"2023-03-30T08:10:58.394174+0000","last_became_peered":"2023-03-30T08:10:58.394174+0000","last_unstale":"2023-03-30T08:11:02.394615+0000","last_undegraded":"2023-03-30T08:11:02.394615+0000","last_fullsized":"2023-03-30T08:11:02.394615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:38:08.997913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406092+0000","last_change":"2023-03-30T08:10:58.407760+0000","last_active":"2023-03-30T08:11:02.406092+0000","last_peered":"2023-03-30T08:11:02.406092+0000","last_clean":"2023-03-30T08:11:02.406092+0000","last_became_active":"2023-03-30T08:10:58.407549+0000","last_became_peered":"2023-03-30T08:10:58.407549+0000","last_unstale":"2023-03-30T08:11:02.406092+0000","last_undegraded":"2023-03-30T08:11:02.406092+0000","last_fullsized":"2023-03-30T08:11:02.406092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395205+0000","last_change":"2023-03-30T08:10:58.397788+0000","last_active":"2023-03-30T08:11:02.395205+0000","last_peered":"2023-03-30T08:11:02.395205+0000","last_clean":"2023-03-30T08:11:02.395205+0000","last_became_active":"2023-03-30T08:10:58.397456+0000","last_became_peered":"2023-03-30T08:10:58.397456+0000","last_unstale":"2023-03-30T08:11:02.395205+0000","last_undegraded":"2023-03-30T08:11:02.395205+0000","last_fullsized":"2023-03-30T08:11:02.395205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:38:35.434847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.414622+0000","last_change":"2023-03-30T08:10:58.391637+0000","last_active":"2023-03-30T08:11:02.414622+0000","last_peered":"2023-03-30T08:11:02.414622+0000","last_clean":"2023-03-30T08:11:02.414622+0000","last_became_active":"2023-03-30T08:10:58.391241+0000","last_became_peered":"2023-03-30T08:10:58.391241+0000","last_unstale":"2023-03-30T08:11:02.414622+0000","last_undegraded":"2023-03-30T08:11:02.414622+0000","last_fullsized":"2023-03-30T08:11:02.414622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:40:05.484662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398410+0000","last_change":"2023-03-30T08:10:58.392474+0000","last_active":"2023-03-30T08:11:02.398410+0000","last_peered":"2023-03-30T08:11:02.398410+0000","last_clean":"2023-03-30T08:11:02.398410+0000","last_became_active":"2023-03-30T08:10:58.392054+0000","last_became_peered":"2023-03-30T08:10:58.392054+0000","last_unstale":"2023-03-30T08:11:02.398410+0000","last_undegraded":"2023-03-30T08:11:02.398410+0000","last_fullsized":"2023-03-30T08:11:02.398410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412024+0000","last_change":"2023-03-30T08:10:58.397632+0000","last_active":"2023-03-30T08:11:02.412024+0000","last_peered":"2023-03-30T08:11:02.412024+0000","last_clean":"2023-03-30T08:11:02.412024+0000","last_became_active":"2023-03-30T08:10:58.392721+0000","last_became_peered":"2023-03-30T08:10:58.392721+0000","last_unstale":"2023-03-30T08:11:02.412024+0000","last_undegraded":"2023-03-30T08:11:02.412024+0000","last_fullsized":"2023-03-30T08:11:02.412024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:39.162414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412163+0000","last_change":"2023-03-30T08:10:58.399202+0000","last_active":"2023-03-30T08:11:02.412163+0000","last_peered":"2023-03-30T08:11:02.412163+0000","last_clean":"2023-03-30T08:11:02.412163+0000","last_became_active":"2023-03-30T08:10:58.398999+0000","last_became_peered":"2023-03-30T08:10:58.398999+0000","last_unstale":"2023-03-30T08:11:02.412163+0000","last_undegraded":"2023-03-30T08:11:02.412163+0000","last_fullsized":"2023-03-30T08:11:02.412163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:49:49.791186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394623+0000","last_change":"2023-03-30T08:10:58.374475+0000","last_active":"2023-03-30T08:11:02.394623+0000","last_peered":"2023-03-30T08:11:02.394623+0000","last_clean":"2023-03-30T08:11:02.394623+0000","last_became_active":"2023-03-30T08:10:58.373968+0000","last_became_peered":"2023-03-30T08:10:58.373968+0000","last_unstale":"2023-03-30T08:11:02.394623+0000","last_undegraded":"2023-03-30T08:11:02.394623+0000","last_fullsized":"2023-03-30T08:11:02.394623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:37:34.381037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.401841+0000","last_change":"2023-03-30T08:10:58.399051+0000","last_active":"2023-03-30T08:11:02.401841+0000","last_peered":"2023-03-30T08:11:02.401841+0000","last_clean":"2023-03-30T08:11:02.401841+0000","last_became_active":"2023-03-30T08:10:58.398767+0000","last_became_peered":"2023-03-30T08:10:58.398767+0000","last_unstale":"2023-03-30T08:11:02.401841+0000","last_undegraded":"2023-03-30T08:11:02.401841+0000","last_fullsized":"2023-03-30T08:11:02.401841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:35:55.226695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.405995+0000","last_change":"2023-03-30T08:10:58.409451+0000","last_active":"2023-03-30T08:11:02.405995+0000","last_peered":"2023-03-30T08:11:02.405995+0000","last_clean":"2023-03-30T08:11:02.405995+0000","last_became_active":"2023-03-30T08:10:58.409195+0000","last_became_peered":"2023-03-30T08:10:58.409195+0000","last_unstale":"2023-03-30T08:11:02.405995+0000","last_undegraded":"2023-03-30T08:11:02.405995+0000","last_fullsized":"2023-03-30T08:11:02.405995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398208+0000","last_change":"2023-03-30T08:10:58.397829+0000","last_active":"2023-03-30T08:11:02.398208+0000","last_peered":"2023-03-30T08:11:02.398208+0000","last_clean":"2023-03-30T08:11:02.398208+0000","last_became_active":"2023-03-30T08:10:58.397472+0000","last_became_peered":"2023-03-30T08:10:58.397472+0000","last_unstale":"2023-03-30T08:11:02.398208+0000","last_undegraded":"2023-03-30T08:11:02.398208+0000","last_fullsized":"2023-03-30T08:11:02.398208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:53.625868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.414543+0000","last_change":"2023-03-30T08:10:58.391590+0000","last_active":"2023-03-30T08:11:02.414543+0000","last_peered":"2023-03-30T08:11:02.414543+0000","last_clean":"2023-03-30T08:11:02.414543+0000","last_became_active":"2023-03-30T08:10:58.390836+0000","last_became_peered":"2023-03-30T08:10:58.390836+0000","last_unstale":"2023-03-30T08:11:02.414543+0000","last_undegraded":"2023-03-30T08:11:02.414543+0000","last_fullsized":"2023-03-30T08:11:02.414543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394825+0000","last_change":"2023-03-30T08:10:58.384402+0000","last_active":"2023-03-30T08:11:02.394825+0000","last_peered":"2023-03-30T08:11:02.394825+0000","last_clean":"2023-03-30T08:11:02.394825+0000","last_became_active":"2023-03-30T08:10:58.384149+0000","last_became_peered":"2023-03-30T08:10:58.384149+0000","last_unstale":"2023-03-30T08:11:02.394825+0000","last_undegraded":"2023-03-30T08:11:02.394825+0000","last_fullsized":"2023-03-30T08:11:02.394825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:49:19.304132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406516+0000","last_change":"2023-03-30T08:10:58.401419+0000","last_active":"2023-03-30T08:11:02.406516+0000","last_peered":"2023-03-30T08:11:02.406516+0000","last_clean":"2023-03-30T08:11:02.406516+0000","last_became_active":"2023-03-30T08:10:58.401118+0000","last_became_peered":"2023-03-30T08:10:58.401118+0000","last_unstale":"2023-03-30T08:11:02.406516+0000","last_undegraded":"2023-03-30T08:11:02.406516+0000","last_fullsized":"2023-03-30T08:11:02.406516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:40:05.484662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403459+0000","last_change":"2023-03-30T08:10:58.397292+0000","last_active":"2023-03-30T08:11:02.403459+0000","last_peered":"2023-03-30T08:11:02.403459+0000","last_clean":"2023-03-30T08:11:02.403459+0000","last_became_active":"2023-03-30T08:10:58.396977+0000","last_became_peered":"2023-03-30T08:10:58.396977+0000","last_unstale":"2023-03-30T08:11:02.403459+0000","last_undegraded":"2023-03-30T08:11:02.403459+0000","last_fullsized":"2023-03-30T08:11:02.403459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:04:09.104430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394458+0000","last_change":"2023-03-30T08:10:58.406332+0000","last_active":"2023-03-30T08:11:02.394458+0000","last_peered":"2023-03-30T08:11:02.394458+0000","last_clean":"2023-03-30T08:11:02.394458+0000","last_became_active":"2023-03-30T08:10:58.406011+0000","last_became_peered":"2023-03-30T08:10:58.406011+0000","last_unstale":"2023-03-30T08:11:02.394458+0000","last_undegraded":"2023-03-30T08:11:02.394458+0000","last_fullsized":"2023-03-30T08:11:02.394458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:14:36.034697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.401759+0000","last_change":"2023-03-30T08:10:58.397437+0000","last_active":"2023-03-30T08:11:02.401759+0000","last_peered":"2023-03-30T08:11:02.401759+0000","last_clean":"2023-03-30T08:11:02.401759+0000","last_became_active":"2023-03-30T08:10:58.396808+0000","last_became_peered":"2023-03-30T08:10:58.396808+0000","last_unstale":"2023-03-30T08:11:02.401759+0000","last_undegraded":"2023-03-30T08:11:02.401759+0000","last_fullsized":"2023-03-30T08:11:02.401759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.418290+0000","last_change":"2023-03-30T08:10:58.392929+0000","last_active":"2023-03-30T08:11:02.418290+0000","last_peered":"2023-03-30T08:11:02.418290+0000","last_clean":"2023-03-30T08:11:02.418290+0000","last_became_active":"2023-03-30T08:10:58.392655+0000","last_became_peered":"2023-03-30T08:10:58.392655+0000","last_unstale":"2023-03-30T08:11:02.418290+0000","last_undegraded":"2023-03-30T08:11:02.418290+0000","last_fullsized":"2023-03-30T08:11:02.418290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:54.421859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4597,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8108,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363732,"statfs":{"total":96636764160,"available":96628461568,"internally_reserved":0,"allocated":299008,"data_stored":122842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9292,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362548,"statfs":{"total":96636764160,"available":96627249152,"internally_reserved":0,"allocated":921600,"data_stored":717225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.423}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":307200,"data_stored":123494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5349999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8256,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363584,"statfs":{"total":96636764160,"available":96628310016,"internally_reserved":0,"allocated":319488,"data_stored":126697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5369999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":122932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.548}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8108,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363732,"statfs":{"total":96636764160,"available":96628461568,"internally_reserved":0,"allocated":299008,"data_stored":122842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8236,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363604,"statfs":{"total":96636764160,"available":96628330496,"internally_reserved":0,"allocated":299008,"data_stored":122842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9264,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362576,"statfs":{"total":96636764160,"available":96627277824,"internally_reserved":0,"allocated":892928,"data_stored":712449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-30T08:11:23.014 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-30T08:11:23.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.200+0000 7f9a722dc700 1 Processor -- start 2023-03-30T08:11:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.204+0000 7f9a722dc700 1 -- start start 2023-03-30T08:11:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.204+0000 7f9a722dc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a6c0d19b0 0x7f9a6c1674a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.204+0000 7f9a722dc700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6c0cd880 con 0x7f9a6c0b4600 2023-03-30T08:11:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.204+0000 7f9a722dc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6c0cf410 con 0x7f9a6c0b1ae0 2023-03-30T08:11:23.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.204+0000 7f9a722dc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0cd270 con 0x7f9a6c0d19b0 2023-03-30T08:11:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.204+0000 7f9a712da700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9a6c0b4600 0x7f9a6c160b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48610/0 (socket says 172.21.15.87:48610) 2023-03-30T08:11:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.204+0000 7f9a712da700 1 -- 172.21.15.87:0/3431427585 learned_addr learned my addr 172.21.15.87:0/3431427585 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.208+0000 7f9a71adb700 1 --2- 172.21.15.87:0/3431427585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a6c0d19b0 0x7f9a6c1674a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:23.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.208+0000 7f9a63fff700 1 -- 172.21.15.87:0/3431427585 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178516409 0 0) 0x7f9a6c0cd880 con 0x7f9a6c0b4600 2023-03-30T08:11:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.208+0000 7f9a63fff700 1 -- 172.21.15.87:0/3431427585 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a580035d0 con 0x7f9a6c0b4600 2023-03-30T08:11:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.208+0000 7f9a63fff700 1 -- 172.21.15.87:0/3431427585 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752436581 0 0) 0x7f9a6c0cf410 con 0x7f9a6c0b1ae0 2023-03-30T08:11:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.208+0000 7f9a63fff700 1 -- 172.21.15.87:0/3431427585 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a6c0cd880 con 0x7f9a6c0b1ae0 2023-03-30T08:11:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.208+0000 7f9a63fff700 1 -- 172.21.15.87:0/3431427585 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3721819688 0 0) 0x7f9a580035d0 con 0x7f9a6c0b4600 2023-03-30T08:11:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.208+0000 7f9a71adb700 1 -- 172.21.15.87:0/3431427585 >> v1:172.21.15.115:6789/0 conn(0x7f9a6c0b1ae0 legacy=0x7f9a6c0b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.208+0000 7f9a71adb700 1 -- 172.21.15.87:0/3431427585 >> v1:172.21.15.87:6789/0 conn(0x7f9a6c0b4600 legacy=0x7f9a6c160b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:23.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.208+0000 7f9a71adb700 1 -- 172.21.15.87:0/3431427585 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c0cf130 con 0x7f9a6c0d19b0 2023-03-30T08:11:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.208+0000 7f9a71adb700 1 --2- 172.21.15.87:0/3431427585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a6c0d19b0 0x7f9a6c1674a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a64009dc0 tx=0x7f9a6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a64caf614ffe004 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.208+0000 7f9a63fff700 1 -- 172.21.15.87:0/3431427585 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6400e070 con 0x7f9a6c0d19b0 2023-03-30T08:11:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.208+0000 7f9a63fff700 1 -- 172.21.15.87:0/3431427585 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a64003a40 con 0x7f9a6c0d19b0 2023-03-30T08:11:23.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.208+0000 7f9a63fff700 1 -- 172.21.15.87:0/3431427585 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68001670 con 0x7f9a6c0d19b0 2023-03-30T08:11:23.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.208+0000 7f9a722dc700 1 -- 172.21.15.87:0/3431427585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a6c0d19b0 msgr2=0x7f9a6c1674a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:23.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.208+0000 7f9a722dc700 1 --2- 172.21.15.87:0/3431427585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a6c0d19b0 0x7f9a6c1674a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a64009dc0 tx=0x7f9a6400b330 comp rx=0 tx=0).stop 2023-03-30T08:11:23.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.212+0000 7f9a722dc700 1 -- 172.21.15.87:0/3431427585 shutdown_connections 2023-03-30T08:11:23.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.212+0000 7f9a722dc700 1 --2- 172.21.15.87:0/3431427585 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a6c0d19b0 0x7f9a6c1674a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.212+0000 7f9a722dc700 1 -- 172.21.15.87:0/3431427585 >> 172.21.15.87:0/3431427585 conn(0x7f9a6c0d0290 msgr2=0x7f9a6c0d2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.212+0000 7f9a722dc700 1 -- 172.21.15.87:0/3431427585 shutdown_connections 2023-03-30T08:11:23.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.212+0000 7f9a722dc700 1 -- 172.21.15.87:0/3431427585 wait complete. 2023-03-30T08:11:23.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.212+0000 7f9a722dc700 1 Processor -- start 2023-03-30T08:11:23.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.212+0000 7f9a722dc700 1 -- start start 2023-03-30T08:11:23.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a722dc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a6c0b1ae0 0x7f9a6c147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:23.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a722dc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a6c0b4600 0x7f9a6c0cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:23.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a722dc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a6c0d19b0 0x7f9a6c0cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:23.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a722dc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c159810 con 0x7f9a6c0d19b0 2023-03-30T08:11:23.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a722dc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c147b70 con 0x7f9a6c0b1ae0 2023-03-30T08:11:23.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a722dc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c15c150 con 0x7f9a6c0b4600 2023-03-30T08:11:23.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a71adb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a6c0d19b0 0x7f9a6c0cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:23.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a70ad9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a6c0b4600 0x7f9a6c0cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:23.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a71adb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a6c0d19b0 0x7f9a6c0cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52154/0 (socket says 172.21.15.87:52154) 2023-03-30T08:11:23.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a71adb700 1 -- 172.21.15.87:0/4001115548 learned_addr learned my addr 172.21.15.87:0/4001115548 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:23.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a712da700 1 --2- 172.21.15.87:0/4001115548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a6c0b1ae0 0x7f9a6c147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:23.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a70ad9700 1 -- 172.21.15.87:0/4001115548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a6c0b1ae0 msgr2=0x7f9a6c147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:23.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a70ad9700 1 --2- 172.21.15.87:0/4001115548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a6c0b1ae0 0x7f9a6c147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a70ad9700 1 -- 172.21.15.87:0/4001115548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a6c0d19b0 msgr2=0x7f9a6c0cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:23.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a70ad9700 1 --2- 172.21.15.87:0/4001115548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a6c0d19b0 0x7f9a6c0cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a70ad9700 1 -- 172.21.15.87:0/4001115548 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a64009a70 con 0x7f9a6c0b4600 2023-03-30T08:11:23.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a71adb700 1 --2- 172.21.15.87:0/4001115548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a6c0d19b0 0x7f9a6c0cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:23.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a70ad9700 1 --2- 172.21.15.87:0/4001115548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a6c0b4600 0x7f9a6c0cbd90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00c400 tx=0x7f9a5c00c710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:23.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a61ffb700 1 -- 172.21.15.87:0/4001115548 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0052d0 con 0x7f9a6c0b4600 2023-03-30T08:11:23.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a61ffb700 1 -- 172.21.15.87:0/4001115548 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c005450 con 0x7f9a6c0b4600 2023-03-30T08:11:23.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a722dc700 1 -- 172.21.15.87:0/4001115548 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6c0cede0 con 0x7f9a6c0b4600 2023-03-30T08:11:23.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a61ffb700 1 -- 172.21.15.87:0/4001115548 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0038e0 con 0x7f9a6c0b4600 2023-03-30T08:11:23.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.216+0000 7f9a722dc700 1 -- 172.21.15.87:0/4001115548 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6c0cd510 con 0x7f9a6c0b4600 2023-03-30T08:11:23.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.220+0000 7f9a722dc700 1 -- 172.21.15.87:0/4001115548 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6c15c910 con 0x7f9a6c0b4600 2023-03-30T08:11:23.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.220+0000 7f9a61ffb700 1 -- 172.21.15.87:0/4001115548 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f9a5c003a40 con 0x7f9a6c0b4600 2023-03-30T08:11:23.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.224+0000 7f9a61ffb700 1 --2- 172.21.15.87:0/4001115548 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9a50065420 0x7f9a500678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:23.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.224+0000 7f9a61ffb700 1 -- 172.21.15.87:0/4001115548 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9a5c081da0 con 0x7f9a6c0b4600 2023-03-30T08:11:23.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.224+0000 7f9a712da700 1 --2- 172.21.15.87:0/4001115548 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9a50065420 0x7f9a500678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:23.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.224+0000 7f9a712da700 1 --2- 172.21.15.87:0/4001115548 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9a50065420 0x7f9a500678d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c06bba0 tx=0x7f9a68000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:23.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.228+0000 7f9a61ffb700 1 -- 172.21.15.87:0/4001115548 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f9a5c04f720 con 0x7f9a6c0b4600 2023-03-30T08:11:23.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.384+0000 7f9a722dc700 1 -- 172.21.15.87:0/4001115548 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a6c0733a0 con 0x7f9a50065420 2023-03-30T08:11:23.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.400+0000 7f9a61ffb700 1 -- 172.21.15.87:0/4001115548 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367078 (secure 0 0 0) 0x7f9a6c0733a0 con 0x7f9a50065420 2023-03-30T08:11:23.406 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:23.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.408+0000 7f9a722dc700 1 -- 172.21.15.87:0/4001115548 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9a50065420 msgr2=0x7f9a500678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:23.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.408+0000 7f9a722dc700 1 --2- 172.21.15.87:0/4001115548 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9a50065420 0x7f9a500678d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c06bba0 tx=0x7f9a68000bc0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.408+0000 7f9a722dc700 1 -- 172.21.15.87:0/4001115548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a6c0b4600 msgr2=0x7f9a6c0cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:23.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.408+0000 7f9a722dc700 1 --2- 172.21.15.87:0/4001115548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a6c0b4600 0x7f9a6c0cbd90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00c400 tx=0x7f9a5c00c710 comp rx=0 tx=0).stop 2023-03-30T08:11:23.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.408+0000 7f9a722dc700 1 -- 172.21.15.87:0/4001115548 shutdown_connections 2023-03-30T08:11:23.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.408+0000 7f9a722dc700 1 --2- 172.21.15.87:0/4001115548 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9a50065420 0x7f9a500678d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.408+0000 7f9a722dc700 1 --2- 172.21.15.87:0/4001115548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a6c0d19b0 0x7f9a6c0cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.408+0000 7f9a722dc700 1 --2- 172.21.15.87:0/4001115548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a6c0b4600 0x7f9a6c0cbd90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.408+0000 7f9a722dc700 1 --2- 172.21.15.87:0/4001115548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a6c0b1ae0 0x7f9a6c147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.408+0000 7f9a722dc700 1 -- 172.21.15.87:0/4001115548 >> 172.21.15.87:0/4001115548 conn(0x7f9a6c0d0290 msgr2=0x7f9a6c0b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:23.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.408+0000 7f9a722dc700 1 -- 172.21.15.87:0/4001115548 shutdown_connections 2023-03-30T08:11:23.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.408+0000 7f9a722dc700 1 -- 172.21.15.87:0/4001115548 wait complete. 2023-03-30T08:11:23.415 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-03-30T08:11:23.433 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-03-30T08:11:21.897250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594965,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67620,"kb_used_data":3556,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907100,"statfs":{"total":773094113280,"available":773024870400,"internally_reserved":0,"allocated":3641344,"data_stored":2171323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":142,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004930"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.851978+0000","last_change":"2023-03-30T08:11:02.425599+0000","last_active":"2023-03-30T08:11:02.851978+0000","last_peered":"2023-03-30T08:11:02.851978+0000","last_clean":"2023-03-30T08:11:02.851978+0000","last_became_active":"2023-03-30T08:11:02.425042+0000","last_became_peered":"2023-03-30T08:11:02.425042+0000","last_unstale":"2023-03-30T08:11:02.851978+0000","last_undegraded":"2023-03-30T08:11:02.851978+0000","last_fullsized":"2023-03-30T08:11:02.851978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:40:33.035785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406168+0000","last_change":"2023-03-30T08:10:57.939450+0000","last_active":"2023-03-30T08:11:02.406168+0000","last_peered":"2023-03-30T08:11:02.406168+0000","last_clean":"2023-03-30T08:11:02.406168+0000","last_became_active":"2023-03-30T08:10:57.939147+0000","last_became_peered":"2023-03-30T08:10:57.939147+0000","last_unstale":"2023-03-30T08:11:02.406168+0000","last_undegraded":"2023-03-30T08:11:02.406168+0000","last_fullsized":"2023-03-30T08:11:02.406168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:38.146109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395331+0000","last_change":"2023-03-30T08:10:58.389556+0000","last_active":"2023-03-30T08:11:02.395331+0000","last_peered":"2023-03-30T08:11:02.395331+0000","last_clean":"2023-03-30T08:11:02.395331+0000","last_became_active":"2023-03-30T08:10:58.389242+0000","last_became_peered":"2023-03-30T08:10:58.389242+0000","last_unstale":"2023-03-30T08:11:02.395331+0000","last_undegraded":"2023-03-30T08:11:02.395331+0000","last_fullsized":"2023-03-30T08:11:02.395331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:21:53.230935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.959595+0000","last_change":"2023-03-30T08:11:02.434932+0000","last_active":"2023-03-30T08:11:02.959595+0000","last_peered":"2023-03-30T08:11:02.959595+0000","last_clean":"2023-03-30T08:11:02.959595+0000","last_became_active":"2023-03-30T08:11:02.434551+0000","last_became_peered":"2023-03-30T08:11:02.434551+0000","last_unstale":"2023-03-30T08:11:02.959595+0000","last_undegraded":"2023-03-30T08:11:02.959595+0000","last_fullsized":"2023-03-30T08:11:02.959595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:44:14.559765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.411766+0000","last_change":"2023-03-30T08:10:57.937405+0000","last_active":"2023-03-30T08:11:02.411766+0000","last_peered":"2023-03-30T08:11:02.411766+0000","last_clean":"2023-03-30T08:11:02.411766+0000","last_became_active":"2023-03-30T08:10:57.935124+0000","last_became_peered":"2023-03-30T08:10:57.935124+0000","last_unstale":"2023-03-30T08:11:02.411766+0000","last_undegraded":"2023-03-30T08:11:02.411766+0000","last_fullsized":"2023-03-30T08:11:02.411766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:53.405554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399850+0000","last_change":"2023-03-30T08:10:58.403791+0000","last_active":"2023-03-30T08:11:02.399850+0000","last_peered":"2023-03-30T08:11:02.399850+0000","last_clean":"2023-03-30T08:11:02.399850+0000","last_became_active":"2023-03-30T08:10:58.403522+0000","last_became_peered":"2023-03-30T08:10:58.403522+0000","last_unstale":"2023-03-30T08:11:02.399850+0000","last_undegraded":"2023-03-30T08:11:02.399850+0000","last_fullsized":"2023-03-30T08:11:02.399850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:58:27.992306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366005+0000","last_change":"2023-03-30T08:11:02.427878+0000","last_active":"2023-03-30T08:11:03.366005+0000","last_peered":"2023-03-30T08:11:03.366005+0000","last_clean":"2023-03-30T08:11:03.366005+0000","last_became_active":"2023-03-30T08:11:02.421849+0000","last_became_peered":"2023-03-30T08:11:02.421849+0000","last_unstale":"2023-03-30T08:11:03.366005+0000","last_undegraded":"2023-03-30T08:11:03.366005+0000","last_fullsized":"2023-03-30T08:11:03.366005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:38:02.001551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399928+0000","last_change":"2023-03-30T08:10:57.937107+0000","last_active":"2023-03-30T08:11:02.399928+0000","last_peered":"2023-03-30T08:11:02.399928+0000","last_clean":"2023-03-30T08:11:02.399928+0000","last_became_active":"2023-03-30T08:10:57.936809+0000","last_became_peered":"2023-03-30T08:10:57.936809+0000","last_unstale":"2023-03-30T08:11:02.399928+0000","last_undegraded":"2023-03-30T08:11:02.399928+0000","last_fullsized":"2023-03-30T08:11:02.399928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:58:21.827874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394948+0000","last_change":"2023-03-30T08:10:58.390328+0000","last_active":"2023-03-30T08:11:02.394948+0000","last_peered":"2023-03-30T08:11:02.394948+0000","last_clean":"2023-03-30T08:11:02.394948+0000","last_became_active":"2023-03-30T08:10:58.390002+0000","last_became_peered":"2023-03-30T08:10:58.390002+0000","last_unstale":"2023-03-30T08:11:02.394948+0000","last_undegraded":"2023-03-30T08:11:02.394948+0000","last_fullsized":"2023-03-30T08:11:02.394948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:31:49.952044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.854271+0000","last_change":"2023-03-30T08:11:02.427000+0000","last_active":"2023-03-30T08:11:02.854271+0000","last_peered":"2023-03-30T08:11:02.854271+0000","last_clean":"2023-03-30T08:11:02.854271+0000","last_became_active":"2023-03-30T08:11:02.426423+0000","last_became_peered":"2023-03-30T08:11:02.426423+0000","last_unstale":"2023-03-30T08:11:02.854271+0000","last_undegraded":"2023-03-30T08:11:02.854271+0000","last_fullsized":"2023-03-30T08:11:02.854271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:41.480225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399346+0000","last_change":"2023-03-30T08:10:57.937991+0000","last_active":"2023-03-30T08:11:02.399346+0000","last_peered":"2023-03-30T08:11:02.399346+0000","last_clean":"2023-03-30T08:11:02.399346+0000","last_became_active":"2023-03-30T08:10:57.937690+0000","last_became_peered":"2023-03-30T08:10:57.937690+0000","last_unstale":"2023-03-30T08:11:02.399346+0000","last_undegraded":"2023-03-30T08:11:02.399346+0000","last_fullsized":"2023-03-30T08:11:02.399346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:37:16.892431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395882+0000","last_change":"2023-03-30T08:10:58.392963+0000","last_active":"2023-03-30T08:11:02.395882+0000","last_peered":"2023-03-30T08:11:02.395882+0000","last_clean":"2023-03-30T08:11:02.395882+0000","last_became_active":"2023-03-30T08:10:58.388880+0000","last_became_peered":"2023-03-30T08:10:58.388880+0000","last_unstale":"2023-03-30T08:11:02.395882+0000","last_undegraded":"2023-03-30T08:11:02.395882+0000","last_fullsized":"2023-03-30T08:11:02.395882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:25:58.870966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853066+0000","last_change":"2023-03-30T08:11:02.415859+0000","last_active":"2023-03-30T08:11:02.853066+0000","last_peered":"2023-03-30T08:11:02.853066+0000","last_clean":"2023-03-30T08:11:02.853066+0000","last_became_active":"2023-03-30T08:11:02.415410+0000","last_became_peered":"2023-03-30T08:11:02.415410+0000","last_unstale":"2023-03-30T08:11:02.853066+0000","last_undegraded":"2023-03-30T08:11:02.853066+0000","last_fullsized":"2023-03-30T08:11:02.853066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:49:16.476438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406634+0000","last_change":"2023-03-30T08:10:57.947614+0000","last_active":"2023-03-30T08:11:02.406634+0000","last_peered":"2023-03-30T08:11:02.406634+0000","last_clean":"2023-03-30T08:11:02.406634+0000","last_became_active":"2023-03-30T08:10:57.947418+0000","last_became_peered":"2023-03-30T08:10:57.947418+0000","last_unstale":"2023-03-30T08:11:02.406634+0000","last_undegraded":"2023-03-30T08:11:02.406634+0000","last_fullsized":"2023-03-30T08:11:02.406634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:05:18.197097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.417809+0000","last_change":"2023-03-30T08:10:58.394273+0000","last_active":"2023-03-30T08:11:02.417809+0000","last_peered":"2023-03-30T08:11:02.417809+0000","last_clean":"2023-03-30T08:11:02.417809+0000","last_became_active":"2023-03-30T08:10:58.391530+0000","last_became_peered":"2023-03-30T08:10:58.391530+0000","last_unstale":"2023-03-30T08:11:02.417809+0000","last_undegraded":"2023-03-30T08:11:02.417809+0000","last_fullsized":"2023-03-30T08:11:02.417809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:40.846051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.960231+0000","last_change":"2023-03-30T08:11:02.422513+0000","last_active":"2023-03-30T08:11:02.960231+0000","last_peered":"2023-03-30T08:11:02.960231+0000","last_clean":"2023-03-30T08:11:02.960231+0000","last_became_active":"2023-03-30T08:11:02.421920+0000","last_became_peered":"2023-03-30T08:11:02.421920+0000","last_unstale":"2023-03-30T08:11:02.960231+0000","last_undegraded":"2023-03-30T08:11:02.960231+0000","last_fullsized":"2023-03-30T08:11:02.960231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:27:49.655752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395448+0000","last_change":"2023-03-30T08:10:57.940428+0000","last_active":"2023-03-30T08:11:02.395448+0000","last_peered":"2023-03-30T08:11:02.395448+0000","last_clean":"2023-03-30T08:11:02.395448+0000","last_became_active":"2023-03-30T08:10:57.940061+0000","last_became_peered":"2023-03-30T08:10:57.940061+0000","last_unstale":"2023-03-30T08:11:02.395448+0000","last_undegraded":"2023-03-30T08:11:02.395448+0000","last_fullsized":"2023-03-30T08:11:02.395448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:02.973950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413043+0000","last_change":"2023-03-30T08:10:58.392097+0000","last_active":"2023-03-30T08:11:02.413043+0000","last_peered":"2023-03-30T08:11:02.413043+0000","last_clean":"2023-03-30T08:11:02.413043+0000","last_became_active":"2023-03-30T08:10:58.391848+0000","last_became_peered":"2023-03-30T08:10:58.391848+0000","last_unstale":"2023-03-30T08:11:02.413043+0000","last_undegraded":"2023-03-30T08:11:02.413043+0000","last_fullsized":"2023-03-30T08:11:02.413043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366477+0000","last_change":"2023-03-30T08:11:02.423105+0000","last_active":"2023-03-30T08:11:03.366477+0000","last_peered":"2023-03-30T08:11:03.366477+0000","last_clean":"2023-03-30T08:11:03.366477+0000","last_became_active":"2023-03-30T08:11:02.421129+0000","last_became_peered":"2023-03-30T08:11:02.421129+0000","last_unstale":"2023-03-30T08:11:03.366477+0000","last_undegraded":"2023-03-30T08:11:03.366477+0000","last_fullsized":"2023-03-30T08:11:03.366477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:06:26.729383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394857+0000","last_change":"2023-03-30T08:10:57.936602+0000","last_active":"2023-03-30T08:11:02.394857+0000","last_peered":"2023-03-30T08:11:02.394857+0000","last_clean":"2023-03-30T08:11:02.394857+0000","last_became_active":"2023-03-30T08:10:57.936280+0000","last_became_peered":"2023-03-30T08:10:57.936280+0000","last_unstale":"2023-03-30T08:11:02.394857+0000","last_undegraded":"2023-03-30T08:11:02.394857+0000","last_fullsized":"2023-03-30T08:11:02.394857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:53.405554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406100+0000","last_change":"2023-03-30T08:10:58.401670+0000","last_active":"2023-03-30T08:11:02.406100+0000","last_peered":"2023-03-30T08:11:02.406100+0000","last_clean":"2023-03-30T08:11:02.406100+0000","last_became_active":"2023-03-30T08:10:58.401324+0000","last_became_peered":"2023-03-30T08:10:58.401324+0000","last_unstale":"2023-03-30T08:11:02.406100+0000","last_undegraded":"2023-03-30T08:11:02.406100+0000","last_fullsized":"2023-03-30T08:11:02.406100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:35:55.226695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039694+0000","last_change":"2023-03-30T08:11:02.431539+0000","last_active":"2023-03-30T08:11:03.039694+0000","last_peered":"2023-03-30T08:11:03.039694+0000","last_clean":"2023-03-30T08:11:03.039694+0000","last_became_active":"2023-03-30T08:11:02.431107+0000","last_became_peered":"2023-03-30T08:11:02.431107+0000","last_unstale":"2023-03-30T08:11:03.039694+0000","last_undegraded":"2023-03-30T08:11:03.039694+0000","last_fullsized":"2023-03-30T08:11:03.039694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:40:33.035785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396957+0000","last_change":"2023-03-30T08:10:57.943321+0000","last_active":"2023-03-30T08:11:02.396957+0000","last_peered":"2023-03-30T08:11:02.396957+0000","last_clean":"2023-03-30T08:11:02.396957+0000","last_became_active":"2023-03-30T08:10:57.943058+0000","last_became_peered":"2023-03-30T08:10:57.943058+0000","last_unstale":"2023-03-30T08:11:02.396957+0000","last_undegraded":"2023-03-30T08:11:02.396957+0000","last_fullsized":"2023-03-30T08:11:02.396957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:06.629874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403221+0000","last_change":"2023-03-30T08:10:58.401041+0000","last_active":"2023-03-30T08:11:02.403221+0000","last_peered":"2023-03-30T08:11:02.403221+0000","last_clean":"2023-03-30T08:11:02.403221+0000","last_became_active":"2023-03-30T08:10:58.400234+0000","last_became_peered":"2023-03-30T08:10:58.400234+0000","last_unstale":"2023-03-30T08:11:02.403221+0000","last_undegraded":"2023-03-30T08:11:02.403221+0000","last_fullsized":"2023-03-30T08:11:02.403221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:46:19.608053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396781+0000","last_change":"2023-03-30T08:10:58.392868+0000","last_active":"2023-03-30T08:11:02.396781+0000","last_peered":"2023-03-30T08:11:02.396781+0000","last_clean":"2023-03-30T08:11:02.396781+0000","last_became_active":"2023-03-30T08:10:58.392619+0000","last_became_peered":"2023-03-30T08:10:58.392619+0000","last_unstale":"2023-03-30T08:11:02.396781+0000","last_undegraded":"2023-03-30T08:11:02.396781+0000","last_fullsized":"2023-03-30T08:11:02.396781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:15:17.876244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406247+0000","last_change":"2023-03-30T08:10:57.944453+0000","last_active":"2023-03-30T08:11:02.406247+0000","last_peered":"2023-03-30T08:11:02.406247+0000","last_clean":"2023-03-30T08:11:02.406247+0000","last_became_active":"2023-03-30T08:10:57.944114+0000","last_became_peered":"2023-03-30T08:10:57.944114+0000","last_unstale":"2023-03-30T08:11:02.406247+0000","last_undegraded":"2023-03-30T08:11:02.406247+0000","last_fullsized":"2023-03-30T08:11:02.406247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:53.405554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366017+0000","last_change":"2023-03-30T08:11:02.421919+0000","last_active":"2023-03-30T08:11:03.366017+0000","last_peered":"2023-03-30T08:11:03.366017+0000","last_clean":"2023-03-30T08:11:03.366017+0000","last_became_active":"2023-03-30T08:11:02.421212+0000","last_became_peered":"2023-03-30T08:11:02.421212+0000","last_unstale":"2023-03-30T08:11:03.366017+0000","last_undegraded":"2023-03-30T08:11:03.366017+0000","last_fullsized":"2023-03-30T08:11:03.366017+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:43:05.824967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399780+0000","last_change":"2023-03-30T08:10:58.388701+0000","last_active":"2023-03-30T08:11:02.399780+0000","last_peered":"2023-03-30T08:11:02.399780+0000","last_clean":"2023-03-30T08:11:02.399780+0000","last_became_active":"2023-03-30T08:10:58.388445+0000","last_became_peered":"2023-03-30T08:10:58.388445+0000","last_unstale":"2023-03-30T08:11:02.399780+0000","last_undegraded":"2023-03-30T08:11:02.399780+0000","last_fullsized":"2023-03-30T08:11:02.399780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:35:55.226695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.401923+0000","last_change":"2023-03-30T08:10:57.930016+0000","last_active":"2023-03-30T08:11:02.401923+0000","last_peered":"2023-03-30T08:11:02.401923+0000","last_clean":"2023-03-30T08:11:02.401923+0000","last_became_active":"2023-03-30T08:10:57.929673+0000","last_became_peered":"2023-03-30T08:10:57.929673+0000","last_unstale":"2023-03-30T08:11:02.401923+0000","last_undegraded":"2023-03-30T08:11:02.401923+0000","last_fullsized":"2023-03-30T08:11:02.401923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:35:11.040783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853357+0000","last_change":"2023-03-30T08:11:02.426850+0000","last_active":"2023-03-30T08:11:02.853357+0000","last_peered":"2023-03-30T08:11:02.853357+0000","last_clean":"2023-03-30T08:11:02.853357+0000","last_became_active":"2023-03-30T08:11:02.426417+0000","last_became_peered":"2023-03-30T08:11:02.426417+0000","last_unstale":"2023-03-30T08:11:02.853357+0000","last_undegraded":"2023-03-30T08:11:02.853357+0000","last_fullsized":"2023-03-30T08:11:02.853357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:02.698017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.415514+0000","last_change":"2023-03-30T08:10:57.939163+0000","last_active":"2023-03-30T08:11:02.415514+0000","last_peered":"2023-03-30T08:11:02.415514+0000","last_clean":"2023-03-30T08:11:02.415514+0000","last_became_active":"2023-03-30T08:10:57.938683+0000","last_became_peered":"2023-03-30T08:10:57.938683+0000","last_unstale":"2023-03-30T08:11:02.415514+0000","last_undegraded":"2023-03-30T08:11:02.415514+0000","last_fullsized":"2023-03-30T08:11:02.415514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:38.146109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396028+0000","last_change":"2023-03-30T08:10:58.378190+0000","last_active":"2023-03-30T08:11:02.396028+0000","last_peered":"2023-03-30T08:11:02.396028+0000","last_clean":"2023-03-30T08:11:02.396028+0000","last_became_active":"2023-03-30T08:10:58.377665+0000","last_became_peered":"2023-03-30T08:10:58.377665+0000","last_unstale":"2023-03-30T08:11:02.396028+0000","last_undegraded":"2023-03-30T08:11:02.396028+0000","last_fullsized":"2023-03-30T08:11:02.396028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:32:06.544654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.364405+0000","last_change":"2023-03-30T08:11:02.414726+0000","last_active":"2023-03-30T08:11:03.364405+0000","last_peered":"2023-03-30T08:11:03.364405+0000","last_clean":"2023-03-30T08:11:03.364405+0000","last_became_active":"2023-03-30T08:11:02.414203+0000","last_became_peered":"2023-03-30T08:11:02.414203+0000","last_unstale":"2023-03-30T08:11:03.364405+0000","last_undegraded":"2023-03-30T08:11:03.364405+0000","last_fullsized":"2023-03-30T08:11:03.364405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:40:33.035785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:14.328247+0000","last_change":"2023-03-30T08:10:57.938434+0000","last_active":"2023-03-30T08:11:14.328247+0000","last_peered":"2023-03-30T08:11:14.328247+0000","last_clean":"2023-03-30T08:11:14.328247+0000","last_became_active":"2023-03-30T08:10:57.937335+0000","last_became_peered":"2023-03-30T08:10:57.937335+0000","last_unstale":"2023-03-30T08:11:14.328247+0000","last_undegraded":"2023-03-30T08:11:14.328247+0000","last_fullsized":"2023-03-30T08:11:14.328247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:53:52.935025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396026+0000","last_change":"2023-03-30T08:10:58.376378+0000","last_active":"2023-03-30T08:11:02.396026+0000","last_peered":"2023-03-30T08:11:02.396026+0000","last_clean":"2023-03-30T08:11:02.396026+0000","last_became_active":"2023-03-30T08:10:58.376108+0000","last_became_peered":"2023-03-30T08:10:58.376108+0000","last_unstale":"2023-03-30T08:11:02.396026+0000","last_undegraded":"2023-03-30T08:11:02.396026+0000","last_fullsized":"2023-03-30T08:11:02.396026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:38:23.887005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.852648+0000","last_change":"2023-03-30T08:11:02.421977+0000","last_active":"2023-03-30T08:11:02.852648+0000","last_peered":"2023-03-30T08:11:02.852648+0000","last_clean":"2023-03-30T08:11:02.852648+0000","last_became_active":"2023-03-30T08:11:02.421307+0000","last_became_peered":"2023-03-30T08:11:02.421307+0000","last_unstale":"2023-03-30T08:11:02.852648+0000","last_undegraded":"2023-03-30T08:11:02.852648+0000","last_fullsized":"2023-03-30T08:11:02.852648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:28:34.576988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395167+0000","last_change":"2023-03-30T08:10:58.394164+0000","last_active":"2023-03-30T08:11:02.395167+0000","last_peered":"2023-03-30T08:11:02.395167+0000","last_clean":"2023-03-30T08:11:02.395167+0000","last_became_active":"2023-03-30T08:10:58.393905+0000","last_became_peered":"2023-03-30T08:10:58.393905+0000","last_unstale":"2023-03-30T08:11:02.395167+0000","last_undegraded":"2023-03-30T08:11:02.395167+0000","last_fullsized":"2023-03-30T08:11:02.395167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:41:30.721192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403329+0000","last_change":"2023-03-30T08:10:52.871133+0000","last_active":"2023-03-30T08:11:02.403329+0000","last_peered":"2023-03-30T08:11:02.403329+0000","last_clean":"2023-03-30T08:11:02.403329+0000","last_became_active":"2023-03-30T08:10:52.870678+0000","last_became_peered":"2023-03-30T08:10:52.870678+0000","last_unstale":"2023-03-30T08:11:02.403329+0000","last_undegraded":"2023-03-30T08:11:02.403329+0000","last_fullsized":"2023-03-30T08:11:02.403329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:51.162618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039910+0000","last_change":"2023-03-30T08:10:57.940745+0000","last_active":"2023-03-30T08:11:03.039910+0000","last_peered":"2023-03-30T08:11:03.039910+0000","last_clean":"2023-03-30T08:11:03.039910+0000","last_became_active":"2023-03-30T08:10:57.940137+0000","last_became_peered":"2023-03-30T08:10:57.940137+0000","last_unstale":"2023-03-30T08:11:03.039910+0000","last_undegraded":"2023-03-30T08:11:03.039910+0000","last_fullsized":"2023-03-30T08:11:03.039910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:39.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.364288+0000","last_change":"2023-03-30T08:11:02.420407+0000","last_active":"2023-03-30T08:11:03.364288+0000","last_peered":"2023-03-30T08:11:03.364288+0000","last_clean":"2023-03-30T08:11:03.364288+0000","last_became_active":"2023-03-30T08:11:02.420015+0000","last_became_peered":"2023-03-30T08:11:02.420015+0000","last_unstale":"2023-03-30T08:11:03.364288+0000","last_undegraded":"2023-03-30T08:11:03.364288+0000","last_fullsized":"2023-03-30T08:11:03.364288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:28:34.576988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396868+0000","last_change":"2023-03-30T08:10:58.390779+0000","last_active":"2023-03-30T08:11:02.396868+0000","last_peered":"2023-03-30T08:11:02.396868+0000","last_clean":"2023-03-30T08:11:02.396868+0000","last_became_active":"2023-03-30T08:10:58.389965+0000","last_became_peered":"2023-03-30T08:10:58.389965+0000","last_unstale":"2023-03-30T08:11:02.396868+0000","last_undegraded":"2023-03-30T08:11:02.396868+0000","last_fullsized":"2023-03-30T08:11:02.396868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394961+0000","last_change":"2023-03-30T08:10:52.871548+0000","last_active":"2023-03-30T08:11:02.394961+0000","last_peered":"2023-03-30T08:11:02.394961+0000","last_clean":"2023-03-30T08:11:02.394961+0000","last_became_active":"2023-03-30T08:10:52.871152+0000","last_became_peered":"2023-03-30T08:10:52.871152+0000","last_unstale":"2023-03-30T08:11:02.394961+0000","last_undegraded":"2023-03-30T08:11:02.394961+0000","last_fullsized":"2023-03-30T08:11:02.394961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412264+0000","last_change":"2023-03-30T08:10:57.937918+0000","last_active":"2023-03-30T08:11:02.412264+0000","last_peered":"2023-03-30T08:11:02.412264+0000","last_clean":"2023-03-30T08:11:02.412264+0000","last_became_active":"2023-03-30T08:10:57.937687+0000","last_became_peered":"2023-03-30T08:10:57.937687+0000","last_unstale":"2023-03-30T08:11:02.412264+0000","last_undegraded":"2023-03-30T08:11:02.412264+0000","last_fullsized":"2023-03-30T08:11:02.412264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:12:08.652227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.959598+0000","last_change":"2023-03-30T08:11:02.429990+0000","last_active":"2023-03-30T08:11:02.959598+0000","last_peered":"2023-03-30T08:11:02.959598+0000","last_clean":"2023-03-30T08:11:02.959598+0000","last_became_active":"2023-03-30T08:11:02.429585+0000","last_became_peered":"2023-03-30T08:11:02.429585+0000","last_unstale":"2023-03-30T08:11:02.959598+0000","last_undegraded":"2023-03-30T08:11:02.959598+0000","last_fullsized":"2023-03-30T08:11:02.959598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:11:07.869574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406439+0000","last_change":"2023-03-30T08:10:58.406667+0000","last_active":"2023-03-30T08:11:02.406439+0000","last_peered":"2023-03-30T08:11:02.406439+0000","last_clean":"2023-03-30T08:11:02.406439+0000","last_became_active":"2023-03-30T08:10:58.406362+0000","last_became_peered":"2023-03-30T08:10:58.406362+0000","last_unstale":"2023-03-30T08:11:02.406439+0000","last_undegraded":"2023-03-30T08:11:02.406439+0000","last_fullsized":"2023-03-30T08:11:02.406439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:53.625868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.415949+0000","last_change":"2023-03-30T08:10:52.921525+0000","last_active":"2023-03-30T08:11:02.415949+0000","last_peered":"2023-03-30T08:11:02.415949+0000","last_clean":"2023-03-30T08:11:02.415949+0000","last_became_active":"2023-03-30T08:10:52.920885+0000","last_became_peered":"2023-03-30T08:10:52.920885+0000","last_unstale":"2023-03-30T08:11:02.415949+0000","last_undegraded":"2023-03-30T08:11:02.415949+0000","last_fullsized":"2023-03-30T08:11:02.415949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:38:27.041880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396249+0000","last_change":"2023-03-30T08:10:57.929596+0000","last_active":"2023-03-30T08:11:02.396249+0000","last_peered":"2023-03-30T08:11:02.396249+0000","last_clean":"2023-03-30T08:11:02.396249+0000","last_became_active":"2023-03-30T08:10:57.929334+0000","last_became_peered":"2023-03-30T08:10:57.929334+0000","last_unstale":"2023-03-30T08:11:02.396249+0000","last_undegraded":"2023-03-30T08:11:02.396249+0000","last_fullsized":"2023-03-30T08:11:02.396249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:39.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.365879+0000","last_change":"2023-03-30T08:11:02.420714+0000","last_active":"2023-03-30T08:11:03.365879+0000","last_peered":"2023-03-30T08:11:03.365879+0000","last_clean":"2023-03-30T08:11:03.365879+0000","last_became_active":"2023-03-30T08:11:02.419661+0000","last_became_peered":"2023-03-30T08:11:02.419661+0000","last_unstale":"2023-03-30T08:11:03.365879+0000","last_undegraded":"2023-03-30T08:11:03.365879+0000","last_fullsized":"2023-03-30T08:11:03.365879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:50:58.130125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396109+0000","last_change":"2023-03-30T08:10:58.398687+0000","last_active":"2023-03-30T08:11:02.396109+0000","last_peered":"2023-03-30T08:11:02.396109+0000","last_clean":"2023-03-30T08:11:02.396109+0000","last_became_active":"2023-03-30T08:10:58.398357+0000","last_became_peered":"2023-03-30T08:10:58.398357+0000","last_unstale":"2023-03-30T08:11:02.396109+0000","last_undegraded":"2023-03-30T08:11:02.396109+0000","last_fullsized":"2023-03-30T08:11:02.396109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:40:05.484662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396668+0000","last_change":"2023-03-30T08:10:52.921563+0000","last_active":"2023-03-30T08:11:02.396668+0000","last_peered":"2023-03-30T08:11:02.396668+0000","last_clean":"2023-03-30T08:11:02.396668+0000","last_became_active":"2023-03-30T08:10:52.921234+0000","last_became_peered":"2023-03-30T08:10:52.921234+0000","last_unstale":"2023-03-30T08:11:02.396668+0000","last_undegraded":"2023-03-30T08:11:02.396668+0000","last_fullsized":"2023-03-30T08:11:02.396668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399823+0000","last_change":"2023-03-30T08:10:57.938023+0000","last_active":"2023-03-30T08:11:02.399823+0000","last_peered":"2023-03-30T08:11:02.399823+0000","last_clean":"2023-03-30T08:11:02.399823+0000","last_became_active":"2023-03-30T08:10:57.937727+0000","last_became_peered":"2023-03-30T08:10:57.937727+0000","last_unstale":"2023-03-30T08:11:02.399823+0000","last_undegraded":"2023-03-30T08:11:02.399823+0000","last_fullsized":"2023-03-30T08:11:02.399823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:38.146109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039222+0000","last_change":"2023-03-30T08:11:02.421176+0000","last_active":"2023-03-30T08:11:03.039222+0000","last_peered":"2023-03-30T08:11:03.039222+0000","last_clean":"2023-03-30T08:11:03.039222+0000","last_became_active":"2023-03-30T08:11:02.420282+0000","last_became_peered":"2023-03-30T08:11:02.420282+0000","last_unstale":"2023-03-30T08:11:03.039222+0000","last_undegraded":"2023-03-30T08:11:03.039222+0000","last_fullsized":"2023-03-30T08:11:03.039222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:49:16.476438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395271+0000","last_change":"2023-03-30T08:10:58.393615+0000","last_active":"2023-03-30T08:11:02.395271+0000","last_peered":"2023-03-30T08:11:02.395271+0000","last_clean":"2023-03-30T08:11:02.395271+0000","last_became_active":"2023-03-30T08:10:58.393279+0000","last_became_peered":"2023-03-30T08:10:58.393279+0000","last_unstale":"2023-03-30T08:11:02.395271+0000","last_undegraded":"2023-03-30T08:11:02.395271+0000","last_fullsized":"2023-03-30T08:11:02.395271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396015+0000","last_change":"2023-03-30T08:10:57.940319+0000","last_active":"2023-03-30T08:11:02.396015+0000","last_peered":"2023-03-30T08:11:02.396015+0000","last_clean":"2023-03-30T08:11:02.396015+0000","last_became_active":"2023-03-30T08:10:57.940037+0000","last_became_peered":"2023-03-30T08:10:57.940037+0000","last_unstale":"2023-03-30T08:11:02.396015+0000","last_undegraded":"2023-03-30T08:11:02.396015+0000","last_fullsized":"2023-03-30T08:11:02.396015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:53:42.965405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398522+0000","last_change":"2023-03-30T08:10:52.866272+0000","last_active":"2023-03-30T08:11:02.398522+0000","last_peered":"2023-03-30T08:11:02.398522+0000","last_clean":"2023-03-30T08:11:02.398522+0000","last_became_active":"2023-03-30T08:10:52.865919+0000","last_became_peered":"2023-03-30T08:10:52.865919+0000","last_unstale":"2023-03-30T08:11:02.398522+0000","last_undegraded":"2023-03-30T08:11:02.398522+0000","last_fullsized":"2023-03-30T08:11:02.398522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.039424+0000","last_change":"2023-03-30T08:11:02.429404+0000","last_active":"2023-03-30T08:11:03.039424+0000","last_peered":"2023-03-30T08:11:03.039424+0000","last_clean":"2023-03-30T08:11:03.039424+0000","last_became_active":"2023-03-30T08:11:02.424334+0000","last_became_peered":"2023-03-30T08:11:02.424334+0000","last_unstale":"2023-03-30T08:11:03.039424+0000","last_undegraded":"2023-03-30T08:11:03.039424+0000","last_fullsized":"2023-03-30T08:11:03.039424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:24:14.599802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395078+0000","last_change":"2023-03-30T08:10:58.400056+0000","last_active":"2023-03-30T08:11:02.395078+0000","last_peered":"2023-03-30T08:11:02.395078+0000","last_clean":"2023-03-30T08:11:02.395078+0000","last_became_active":"2023-03-30T08:10:58.399774+0000","last_became_peered":"2023-03-30T08:10:58.399774+0000","last_unstale":"2023-03-30T08:11:02.395078+0000","last_undegraded":"2023-03-30T08:11:02.395078+0000","last_fullsized":"2023-03-30T08:11:02.395078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394296+0000","last_change":"2023-03-30T08:10:57.938541+0000","last_active":"2023-03-30T08:11:02.394296+0000","last_peered":"2023-03-30T08:11:02.394296+0000","last_clean":"2023-03-30T08:11:02.394296+0000","last_became_active":"2023-03-30T08:10:57.938279+0000","last_became_peered":"2023-03-30T08:10:57.938279+0000","last_unstale":"2023-03-30T08:11:02.394296+0000","last_undegraded":"2023-03-30T08:11:02.394296+0000","last_fullsized":"2023-03-30T08:11:02.394296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:06.629874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.411865+0000","last_change":"2023-03-30T08:10:52.920796+0000","last_active":"2023-03-30T08:11:02.411865+0000","last_peered":"2023-03-30T08:11:02.411865+0000","last_clean":"2023-03-30T08:11:02.411865+0000","last_became_active":"2023-03-30T08:10:52.920327+0000","last_became_peered":"2023-03-30T08:10:52.920327+0000","last_unstale":"2023-03-30T08:11:02.411865+0000","last_undegraded":"2023-03-30T08:11:02.411865+0000","last_fullsized":"2023-03-30T08:11:02.411865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:17.416386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857569+0000","last_change":"2023-03-30T08:11:02.426961+0000","last_active":"2023-03-30T08:11:02.857569+0000","last_peered":"2023-03-30T08:11:02.857569+0000","last_clean":"2023-03-30T08:11:02.857569+0000","last_became_active":"2023-03-30T08:11:02.426542+0000","last_became_peered":"2023-03-30T08:11:02.426542+0000","last_unstale":"2023-03-30T08:11:02.857569+0000","last_undegraded":"2023-03-30T08:11:02.857569+0000","last_fullsized":"2023-03-30T08:11:02.857569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:35:19.751044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406165+0000","last_change":"2023-03-30T08:10:58.392027+0000","last_active":"2023-03-30T08:11:02.406165+0000","last_peered":"2023-03-30T08:11:02.406165+0000","last_clean":"2023-03-30T08:11:02.406165+0000","last_became_active":"2023-03-30T08:10:58.391260+0000","last_became_peered":"2023-03-30T08:10:58.391260+0000","last_unstale":"2023-03-30T08:11:02.406165+0000","last_undegraded":"2023-03-30T08:11:02.406165+0000","last_fullsized":"2023-03-30T08:11:02.406165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.405859+0000","last_change":"2023-03-30T08:10:57.943504+0000","last_active":"2023-03-30T08:11:02.405859+0000","last_peered":"2023-03-30T08:11:02.405859+0000","last_clean":"2023-03-30T08:11:02.405859+0000","last_became_active":"2023-03-30T08:10:57.943209+0000","last_became_peered":"2023-03-30T08:10:57.943209+0000","last_unstale":"2023-03-30T08:11:02.405859+0000","last_undegraded":"2023-03-30T08:11:02.405859+0000","last_fullsized":"2023-03-30T08:11:02.405859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:12:08.652227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413143+0000","last_change":"2023-03-30T08:10:52.866412+0000","last_active":"2023-03-30T08:11:02.413143+0000","last_peered":"2023-03-30T08:11:02.413143+0000","last_clean":"2023-03-30T08:11:02.413143+0000","last_became_active":"2023-03-30T08:10:52.866055+0000","last_became_peered":"2023-03-30T08:10:52.866055+0000","last_unstale":"2023-03-30T08:11:02.413143+0000","last_undegraded":"2023-03-30T08:11:02.413143+0000","last_fullsized":"2023-03-30T08:11:02.413143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:39.045010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366582+0000","last_change":"2023-03-30T08:11:02.425350+0000","last_active":"2023-03-30T08:11:03.366582+0000","last_peered":"2023-03-30T08:11:03.366582+0000","last_clean":"2023-03-30T08:11:03.366582+0000","last_became_active":"2023-03-30T08:11:02.424984+0000","last_became_peered":"2023-03-30T08:11:02.424984+0000","last_unstale":"2023-03-30T08:11:03.366582+0000","last_undegraded":"2023-03-30T08:11:03.366582+0000","last_fullsized":"2023-03-30T08:11:03.366582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:24:06.284671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.405496+0000","last_change":"2023-03-30T08:10:58.385718+0000","last_active":"2023-03-30T08:11:02.405496+0000","last_peered":"2023-03-30T08:11:02.405496+0000","last_clean":"2023-03-30T08:11:02.405496+0000","last_became_active":"2023-03-30T08:10:58.385408+0000","last_became_peered":"2023-03-30T08:10:58.385408+0000","last_unstale":"2023-03-30T08:11:02.405496+0000","last_undegraded":"2023-03-30T08:11:02.405496+0000","last_fullsized":"2023-03-30T08:11:02.405496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:14:52.425655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403314+0000","last_change":"2023-03-30T08:10:57.937910+0000","last_active":"2023-03-30T08:11:02.403314+0000","last_peered":"2023-03-30T08:11:02.403314+0000","last_clean":"2023-03-30T08:11:02.403314+0000","last_became_active":"2023-03-30T08:10:57.937536+0000","last_became_peered":"2023-03-30T08:10:57.937536+0000","last_unstale":"2023-03-30T08:11:02.403314+0000","last_undegraded":"2023-03-30T08:11:02.403314+0000","last_fullsized":"2023-03-30T08:11:02.403314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:43:19.460541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399212+0000","last_change":"2023-03-30T08:10:52.868170+0000","last_active":"2023-03-30T08:11:02.399212+0000","last_peered":"2023-03-30T08:11:02.399212+0000","last_clean":"2023-03-30T08:11:02.399212+0000","last_became_active":"2023-03-30T08:10:52.867790+0000","last_became_peered":"2023-03-30T08:10:52.867790+0000","last_unstale":"2023-03-30T08:11:02.399212+0000","last_undegraded":"2023-03-30T08:11:02.399212+0000","last_fullsized":"2023-03-30T08:11:02.399212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413220+0000","last_change":"2023-03-30T08:10:45.713084+0000","last_active":"2023-03-30T08:11:02.413220+0000","last_peered":"2023-03-30T08:11:02.413220+0000","last_clean":"2023-03-30T08:11:02.413220+0000","last_became_active":"2023-03-30T08:10:45.711645+0000","last_became_peered":"2023-03-30T08:10:45.711645+0000","last_unstale":"2023-03-30T08:11:02.413220+0000","last_undegraded":"2023-03-30T08:11:02.413220+0000","last_fullsized":"2023-03-30T08:11:02.413220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_clean_scrub_stamp":"2023-03-30T08:10:44.620691+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:58:12.738262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853836+0000","last_change":"2023-03-30T08:11:02.435412+0000","last_active":"2023-03-30T08:11:02.853836+0000","last_peered":"2023-03-30T08:11:02.853836+0000","last_clean":"2023-03-30T08:11:02.853836+0000","last_became_active":"2023-03-30T08:11:02.435007+0000","last_became_peered":"2023-03-30T08:11:02.435007+0000","last_unstale":"2023-03-30T08:11:02.853836+0000","last_undegraded":"2023-03-30T08:11:02.853836+0000","last_fullsized":"2023-03-30T08:11:02.853836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:51:55.638235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394980+0000","last_change":"2023-03-30T08:10:58.385689+0000","last_active":"2023-03-30T08:11:02.394980+0000","last_peered":"2023-03-30T08:11:02.394980+0000","last_clean":"2023-03-30T08:11:02.394980+0000","last_became_active":"2023-03-30T08:10:58.385413+0000","last_became_peered":"2023-03-30T08:10:58.385413+0000","last_unstale":"2023-03-30T08:11:02.394980+0000","last_undegraded":"2023-03-30T08:11:02.394980+0000","last_fullsized":"2023-03-30T08:11:02.394980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:58:27.992306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.397069+0000","last_change":"2023-03-30T08:10:57.936928+0000","last_active":"2023-03-30T08:11:02.397069+0000","last_peered":"2023-03-30T08:11:02.397069+0000","last_clean":"2023-03-30T08:11:02.397069+0000","last_became_active":"2023-03-30T08:10:57.935798+0000","last_became_peered":"2023-03-30T08:10:57.935798+0000","last_unstale":"2023-03-30T08:11:02.397069+0000","last_undegraded":"2023-03-30T08:11:02.397069+0000","last_fullsized":"2023-03-30T08:11:02.397069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:05:18.197097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.960953+0000","last_change":"2023-03-30T08:11:02.423183+0000","last_active":"2023-03-30T08:11:02.960953+0000","last_peered":"2023-03-30T08:11:02.960953+0000","last_clean":"2023-03-30T08:11:02.960953+0000","last_became_active":"2023-03-30T08:11:02.422749+0000","last_became_peered":"2023-03-30T08:11:02.422749+0000","last_unstale":"2023-03-30T08:11:02.960953+0000","last_undegraded":"2023-03-30T08:11:02.960953+0000","last_fullsized":"2023-03-30T08:11:02.960953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:00:38.556877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395463+0000","last_change":"2023-03-30T08:10:58.385022+0000","last_active":"2023-03-30T08:11:02.395463+0000","last_peered":"2023-03-30T08:11:02.395463+0000","last_clean":"2023-03-30T08:11:02.395463+0000","last_became_active":"2023-03-30T08:10:58.384750+0000","last_became_peered":"2023-03-30T08:10:58.384750+0000","last_unstale":"2023-03-30T08:11:02.395463+0000","last_undegraded":"2023-03-30T08:11:02.395463+0000","last_fullsized":"2023-03-30T08:11:02.395463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:56:41.526064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395470+0000","last_change":"2023-03-30T08:10:57.939974+0000","last_active":"2023-03-30T08:11:02.395470+0000","last_peered":"2023-03-30T08:11:02.395470+0000","last_clean":"2023-03-30T08:11:02.395470+0000","last_became_active":"2023-03-30T08:10:57.938857+0000","last_became_peered":"2023-03-30T08:10:57.938857+0000","last_unstale":"2023-03-30T08:11:02.395470+0000","last_undegraded":"2023-03-30T08:11:02.395470+0000","last_fullsized":"2023-03-30T08:11:02.395470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:04:22.947813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366491+0000","last_change":"2023-03-30T08:11:02.427807+0000","last_active":"2023-03-30T08:11:03.366491+0000","last_peered":"2023-03-30T08:11:03.366491+0000","last_clean":"2023-03-30T08:11:03.366491+0000","last_became_active":"2023-03-30T08:11:02.427234+0000","last_became_peered":"2023-03-30T08:11:02.427234+0000","last_unstale":"2023-03-30T08:11:03.366491+0000","last_undegraded":"2023-03-30T08:11:03.366491+0000","last_fullsized":"2023-03-30T08:11:03.366491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:40.748097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394764+0000","last_change":"2023-03-30T08:10:58.396674+0000","last_active":"2023-03-30T08:11:02.394764+0000","last_peered":"2023-03-30T08:11:02.394764+0000","last_clean":"2023-03-30T08:11:02.394764+0000","last_became_active":"2023-03-30T08:10:58.396428+0000","last_became_peered":"2023-03-30T08:10:58.396428+0000","last_unstale":"2023-03-30T08:11:02.394764+0000","last_undegraded":"2023-03-30T08:11:02.394764+0000","last_fullsized":"2023-03-30T08:11:02.394764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:38:03.047478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403474+0000","last_change":"2023-03-30T08:10:57.941837+0000","last_active":"2023-03-30T08:11:02.403474+0000","last_peered":"2023-03-30T08:11:02.403474+0000","last_clean":"2023-03-30T08:11:02.403474+0000","last_became_active":"2023-03-30T08:10:57.941547+0000","last_became_peered":"2023-03-30T08:10:57.941547+0000","last_unstale":"2023-03-30T08:11:02.403474+0000","last_undegraded":"2023-03-30T08:11:02.403474+0000","last_fullsized":"2023-03-30T08:11:02.403474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:02.973950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.853079+0000","last_change":"2023-03-30T08:11:02.414849+0000","last_active":"2023-03-30T08:11:02.853079+0000","last_peered":"2023-03-30T08:11:02.853079+0000","last_clean":"2023-03-30T08:11:02.853079+0000","last_became_active":"2023-03-30T08:11:02.414475+0000","last_became_peered":"2023-03-30T08:11:02.414475+0000","last_unstale":"2023-03-30T08:11:02.853079+0000","last_undegraded":"2023-03-30T08:11:02.853079+0000","last_fullsized":"2023-03-30T08:11:02.853079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:51:55.638235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395259+0000","last_change":"2023-03-30T08:10:58.390202+0000","last_active":"2023-03-30T08:11:02.395259+0000","last_peered":"2023-03-30T08:11:02.395259+0000","last_clean":"2023-03-30T08:11:02.395259+0000","last_became_active":"2023-03-30T08:10:58.389111+0000","last_became_peered":"2023-03-30T08:10:58.389111+0000","last_unstale":"2023-03-30T08:11:02.395259+0000","last_undegraded":"2023-03-30T08:11:02.395259+0000","last_fullsized":"2023-03-30T08:11:02.395259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:06:23.251839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.404718+0000","last_change":"2023-03-30T08:10:57.943339+0000","last_active":"2023-03-30T08:11:02.404718+0000","last_peered":"2023-03-30T08:11:02.404718+0000","last_clean":"2023-03-30T08:11:02.404718+0000","last_became_active":"2023-03-30T08:10:57.943025+0000","last_became_peered":"2023-03-30T08:10:57.943025+0000","last_unstale":"2023-03-30T08:11:02.404718+0000","last_undegraded":"2023-03-30T08:11:02.404718+0000","last_fullsized":"2023-03-30T08:11:02.404718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:54:39.829745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857288+0000","last_change":"2023-03-30T08:11:02.430259+0000","last_active":"2023-03-30T08:11:02.857288+0000","last_peered":"2023-03-30T08:11:02.857288+0000","last_clean":"2023-03-30T08:11:02.857288+0000","last_became_active":"2023-03-30T08:11:02.429913+0000","last_became_peered":"2023-03-30T08:11:02.429913+0000","last_unstale":"2023-03-30T08:11:02.857288+0000","last_undegraded":"2023-03-30T08:11:02.857288+0000","last_fullsized":"2023-03-30T08:11:02.857288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:57:50.469768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406365+0000","last_change":"2023-03-30T08:10:58.399947+0000","last_active":"2023-03-30T08:11:02.406365+0000","last_peered":"2023-03-30T08:11:02.406365+0000","last_clean":"2023-03-30T08:11:02.406365+0000","last_became_active":"2023-03-30T08:10:58.399634+0000","last_became_peered":"2023-03-30T08:10:58.399634+0000","last_unstale":"2023-03-30T08:11:02.406365+0000","last_undegraded":"2023-03-30T08:11:02.406365+0000","last_fullsized":"2023-03-30T08:11:02.406365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:58:27.992306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399443+0000","last_change":"2023-03-30T08:10:57.934972+0000","last_active":"2023-03-30T08:11:02.399443+0000","last_peered":"2023-03-30T08:11:02.399443+0000","last_clean":"2023-03-30T08:11:02.399443+0000","last_became_active":"2023-03-30T08:10:57.934655+0000","last_became_peered":"2023-03-30T08:10:57.934655+0000","last_unstale":"2023-03-30T08:11:02.399443+0000","last_undegraded":"2023-03-30T08:11:02.399443+0000","last_fullsized":"2023-03-30T08:11:02.399443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:49:48.774880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857279+0000","last_change":"2023-03-30T08:11:02.419444+0000","last_active":"2023-03-30T08:11:02.857279+0000","last_peered":"2023-03-30T08:11:02.857279+0000","last_clean":"2023-03-30T08:11:02.857279+0000","last_became_active":"2023-03-30T08:11:02.419054+0000","last_became_peered":"2023-03-30T08:11:02.419054+0000","last_unstale":"2023-03-30T08:11:02.857279+0000","last_undegraded":"2023-03-30T08:11:02.857279+0000","last_fullsized":"2023-03-30T08:11:02.857279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:35:06.686651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403308+0000","last_change":"2023-03-30T08:10:58.375670+0000","last_active":"2023-03-30T08:11:02.403308+0000","last_peered":"2023-03-30T08:11:02.403308+0000","last_clean":"2023-03-30T08:11:02.403308+0000","last_became_active":"2023-03-30T08:10:58.375401+0000","last_became_peered":"2023-03-30T08:10:58.375401+0000","last_unstale":"2023-03-30T08:11:02.403308+0000","last_undegraded":"2023-03-30T08:11:02.403308+0000","last_fullsized":"2023-03-30T08:11:02.403308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:22:19.993012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.415805+0000","last_change":"2023-03-30T08:10:57.934773+0000","last_active":"2023-03-30T08:11:02.415805+0000","last_peered":"2023-03-30T08:11:02.415805+0000","last_clean":"2023-03-30T08:11:02.415805+0000","last_became_active":"2023-03-30T08:10:57.934496+0000","last_became_peered":"2023-03-30T08:10:57.934496+0000","last_unstale":"2023-03-30T08:11:02.415805+0000","last_undegraded":"2023-03-30T08:11:02.415805+0000","last_fullsized":"2023-03-30T08:11:02.415805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:39:29.317281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857187+0000","last_change":"2023-03-30T08:11:02.431555+0000","last_active":"2023-03-30T08:11:02.857187+0000","last_peered":"2023-03-30T08:11:02.857187+0000","last_clean":"2023-03-30T08:11:02.857187+0000","last_became_active":"2023-03-30T08:11:02.431128+0000","last_became_peered":"2023-03-30T08:11:02.431128+0000","last_unstale":"2023-03-30T08:11:02.857187+0000","last_undegraded":"2023-03-30T08:11:02.857187+0000","last_fullsized":"2023-03-30T08:11:02.857187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:57.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394896+0000","last_change":"2023-03-30T08:10:58.373263+0000","last_active":"2023-03-30T08:11:02.394896+0000","last_peered":"2023-03-30T08:11:02.394896+0000","last_clean":"2023-03-30T08:11:02.394896+0000","last_became_active":"2023-03-30T08:10:58.373002+0000","last_became_peered":"2023-03-30T08:10:58.373002+0000","last_unstale":"2023-03-30T08:11:02.394896+0000","last_undegraded":"2023-03-30T08:11:02.394896+0000","last_fullsized":"2023-03-30T08:11:02.394896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:39:17.667535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416575+0000","last_change":"2023-03-30T08:10:57.948558+0000","last_active":"2023-03-30T08:11:02.416575+0000","last_peered":"2023-03-30T08:11:02.416575+0000","last_clean":"2023-03-30T08:11:02.416575+0000","last_became_active":"2023-03-30T08:10:57.948285+0000","last_became_peered":"2023-03-30T08:10:57.948285+0000","last_unstale":"2023-03-30T08:11:02.416575+0000","last_undegraded":"2023-03-30T08:11:02.416575+0000","last_fullsized":"2023-03-30T08:11:02.416575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:35:11.040783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.857020+0000","last_change":"2023-03-30T08:11:02.428125+0000","last_active":"2023-03-30T08:11:02.857020+0000","last_peered":"2023-03-30T08:11:02.857020+0000","last_clean":"2023-03-30T08:11:02.857020+0000","last_became_active":"2023-03-30T08:11:02.427821+0000","last_became_peered":"2023-03-30T08:11:02.427821+0000","last_unstale":"2023-03-30T08:11:02.857020+0000","last_undegraded":"2023-03-30T08:11:02.857020+0000","last_fullsized":"2023-03-30T08:11:02.857020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:19:49.490189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398351+0000","last_change":"2023-03-30T08:10:58.396669+0000","last_active":"2023-03-30T08:11:02.398351+0000","last_peered":"2023-03-30T08:11:02.398351+0000","last_clean":"2023-03-30T08:11:02.398351+0000","last_became_active":"2023-03-30T08:10:58.396369+0000","last_became_peered":"2023-03-30T08:10:58.396369+0000","last_unstale":"2023-03-30T08:11:02.398351+0000","last_undegraded":"2023-03-30T08:11:02.398351+0000","last_fullsized":"2023-03-30T08:11:02.398351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416902+0000","last_change":"2023-03-30T08:10:57.947747+0000","last_active":"2023-03-30T08:11:02.416902+0000","last_peered":"2023-03-30T08:11:02.416902+0000","last_clean":"2023-03-30T08:11:02.416902+0000","last_became_active":"2023-03-30T08:10:57.947479+0000","last_became_peered":"2023-03-30T08:10:57.947479+0000","last_unstale":"2023-03-30T08:11:02.416902+0000","last_undegraded":"2023-03-30T08:11:02.416902+0000","last_fullsized":"2023-03-30T08:11:02.416902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:58:21.827874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.854114+0000","last_change":"2023-03-30T08:11:02.428227+0000","last_active":"2023-03-30T08:11:02.854114+0000","last_peered":"2023-03-30T08:11:02.854114+0000","last_clean":"2023-03-30T08:11:02.854114+0000","last_became_active":"2023-03-30T08:11:02.427865+0000","last_became_peered":"2023-03-30T08:11:02.427865+0000","last_unstale":"2023-03-30T08:11:02.854114+0000","last_undegraded":"2023-03-30T08:11:02.854114+0000","last_fullsized":"2023-03-30T08:11:02.854114+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:57:54.590144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.366556+0000","last_change":"2023-03-30T08:11:02.425154+0000","last_active":"2023-03-30T08:11:03.366556+0000","last_peered":"2023-03-30T08:11:03.366556+0000","last_clean":"2023-03-30T08:11:03.366556+0000","last_became_active":"2023-03-30T08:11:02.424719+0000","last_became_peered":"2023-03-30T08:11:02.424719+0000","last_unstale":"2023-03-30T08:11:03.366556+0000","last_undegraded":"2023-03-30T08:11:03.366556+0000","last_fullsized":"2023-03-30T08:11:03.366556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:31:01.730540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403168+0000","last_change":"2023-03-30T08:10:57.943082+0000","last_active":"2023-03-30T08:11:02.403168+0000","last_peered":"2023-03-30T08:11:02.403168+0000","last_clean":"2023-03-30T08:11:02.403168+0000","last_became_active":"2023-03-30T08:10:57.942820+0000","last_became_peered":"2023-03-30T08:10:57.942820+0000","last_unstale":"2023-03-30T08:11:02.403168+0000","last_undegraded":"2023-03-30T08:11:02.403168+0000","last_fullsized":"2023-03-30T08:11:02.403168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:53:52.935025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412130+0000","last_change":"2023-03-30T08:10:58.394733+0000","last_active":"2023-03-30T08:11:02.412130+0000","last_peered":"2023-03-30T08:11:02.412130+0000","last_clean":"2023-03-30T08:11:02.412130+0000","last_became_active":"2023-03-30T08:10:58.394491+0000","last_became_peered":"2023-03-30T08:10:58.394491+0000","last_unstale":"2023-03-30T08:11:02.412130+0000","last_undegraded":"2023-03-30T08:11:02.412130+0000","last_fullsized":"2023-03-30T08:11:02.412130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:53.625868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.365349+0000","last_change":"2023-03-30T08:11:02.422104+0000","last_active":"2023-03-30T08:11:03.365349+0000","last_peered":"2023-03-30T08:11:03.365349+0000","last_clean":"2023-03-30T08:11:03.365349+0000","last_became_active":"2023-03-30T08:11:02.421521+0000","last_became_peered":"2023-03-30T08:11:02.421521+0000","last_unstale":"2023-03-30T08:11:03.365349+0000","last_undegraded":"2023-03-30T08:11:03.365349+0000","last_fullsized":"2023-03-30T08:11:03.365349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:40.748097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.414704+0000","last_change":"2023-03-30T08:10:57.942911+0000","last_active":"2023-03-30T08:11:02.414704+0000","last_peered":"2023-03-30T08:11:02.414704+0000","last_clean":"2023-03-30T08:11:02.414704+0000","last_became_active":"2023-03-30T08:10:57.942621+0000","last_became_peered":"2023-03-30T08:10:57.942621+0000","last_unstale":"2023-03-30T08:11:02.414704+0000","last_undegraded":"2023-03-30T08:11:02.414704+0000","last_fullsized":"2023-03-30T08:11:02.414704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:37:16.892431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406251+0000","last_change":"2023-03-30T08:10:58.401562+0000","last_active":"2023-03-30T08:11:02.406251+0000","last_peered":"2023-03-30T08:11:02.406251+0000","last_clean":"2023-03-30T08:11:02.406251+0000","last_became_active":"2023-03-30T08:10:58.400749+0000","last_became_peered":"2023-03-30T08:10:58.400749+0000","last_unstale":"2023-03-30T08:11:02.406251+0000","last_undegraded":"2023-03-30T08:11:02.406251+0000","last_fullsized":"2023-03-30T08:11:02.406251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406724+0000","last_change":"2023-03-30T08:10:57.943258+0000","last_active":"2023-03-30T08:11:02.406724+0000","last_peered":"2023-03-30T08:11:02.406724+0000","last_clean":"2023-03-30T08:11:02.406724+0000","last_became_active":"2023-03-30T08:10:57.942778+0000","last_became_peered":"2023-03-30T08:10:57.942778+0000","last_unstale":"2023-03-30T08:11:02.406724+0000","last_undegraded":"2023-03-30T08:11:02.406724+0000","last_fullsized":"2023-03-30T08:11:02.406724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:06.629874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399677+0000","last_change":"2023-03-30T08:10:58.395671+0000","last_active":"2023-03-30T08:11:02.399677+0000","last_peered":"2023-03-30T08:11:02.399677+0000","last_clean":"2023-03-30T08:11:02.399677+0000","last_became_active":"2023-03-30T08:10:58.395300+0000","last_became_peered":"2023-03-30T08:10:58.395300+0000","last_unstale":"2023-03-30T08:11:02.399677+0000","last_undegraded":"2023-03-30T08:11:02.399677+0000","last_fullsized":"2023-03-30T08:11:02.399677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.364731+0000","last_change":"2023-03-30T08:11:02.425902+0000","last_active":"2023-03-30T08:11:03.364731+0000","last_peered":"2023-03-30T08:11:03.364731+0000","last_clean":"2023-03-30T08:11:03.364731+0000","last_became_active":"2023-03-30T08:11:02.425557+0000","last_became_peered":"2023-03-30T08:11:02.425557+0000","last_unstale":"2023-03-30T08:11:03.364731+0000","last_undegraded":"2023-03-30T08:11:03.364731+0000","last_fullsized":"2023-03-30T08:11:03.364731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:01:41.681380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416216+0000","last_change":"2023-03-30T08:10:57.942208+0000","last_active":"2023-03-30T08:11:02.416216+0000","last_peered":"2023-03-30T08:11:02.416216+0000","last_clean":"2023-03-30T08:11:02.416216+0000","last_became_active":"2023-03-30T08:10:57.941842+0000","last_became_peered":"2023-03-30T08:10:57.941842+0000","last_unstale":"2023-03-30T08:11:02.416216+0000","last_undegraded":"2023-03-30T08:11:02.416216+0000","last_fullsized":"2023-03-30T08:11:02.416216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:56.882753+0000","last_clean_scrub_stamp":"2023-03-30T08:10:56.882753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:49:48.774880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.411403+0000","last_change":"2023-03-30T08:10:58.390960+0000","last_active":"2023-03-30T08:11:02.411403+0000","last_peered":"2023-03-30T08:11:02.411403+0000","last_clean":"2023-03-30T08:11:02.411403+0000","last_became_active":"2023-03-30T08:10:58.390668+0000","last_became_peered":"2023-03-30T08:10:58.390668+0000","last_unstale":"2023-03-30T08:11:02.411403+0000","last_undegraded":"2023-03-30T08:11:02.411403+0000","last_fullsized":"2023-03-30T08:11:02.411403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:06:29.606761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-03-30T08:11:03.367121+0000","last_change":"2023-03-30T08:11:02.415367+0000","last_active":"2023-03-30T08:11:03.367121+0000","last_peered":"2023-03-30T08:11:03.367121+0000","last_clean":"2023-03-30T08:11:03.367121+0000","last_became_active":"2023-03-30T08:11:02.414945+0000","last_became_peered":"2023-03-30T08:11:02.414945+0000","last_unstale":"2023-03-30T08:11:03.367121+0000","last_undegraded":"2023-03-30T08:11:03.367121+0000","last_fullsized":"2023-03-30T08:11:03.367121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:11:01.376603+0000","last_clean_scrub_stamp":"2023-03-30T08:11:01.376603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:49.266964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403049+0000","last_change":"2023-03-30T08:10:58.390221+0000","last_active":"2023-03-30T08:11:02.403049+0000","last_peered":"2023-03-30T08:11:02.403049+0000","last_clean":"2023-03-30T08:11:02.403049+0000","last_became_active":"2023-03-30T08:10:58.389916+0000","last_became_peered":"2023-03-30T08:10:58.389916+0000","last_unstale":"2023-03-30T08:11:02.403049+0000","last_undegraded":"2023-03-30T08:11:02.403049+0000","last_fullsized":"2023-03-30T08:11:02.403049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:33:09.992519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399692+0000","last_change":"2023-03-30T08:10:58.390234+0000","last_active":"2023-03-30T08:11:02.399692+0000","last_peered":"2023-03-30T08:11:02.399692+0000","last_clean":"2023-03-30T08:11:02.399692+0000","last_became_active":"2023-03-30T08:10:58.388988+0000","last_became_peered":"2023-03-30T08:10:58.388988+0000","last_unstale":"2023-03-30T08:11:02.399692+0000","last_undegraded":"2023-03-30T08:11:02.399692+0000","last_fullsized":"2023-03-30T08:11:02.399692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395321+0000","last_change":"2023-03-30T08:10:58.389994+0000","last_active":"2023-03-30T08:11:02.395321+0000","last_peered":"2023-03-30T08:11:02.395321+0000","last_clean":"2023-03-30T08:11:02.395321+0000","last_became_active":"2023-03-30T08:10:58.389699+0000","last_became_peered":"2023-03-30T08:10:58.389699+0000","last_unstale":"2023-03-30T08:11:02.395321+0000","last_undegraded":"2023-03-30T08:11:02.395321+0000","last_fullsized":"2023-03-30T08:11:02.395321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:43:02.347422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.404578+0000","last_change":"2023-03-30T08:10:58.390408+0000","last_active":"2023-03-30T08:11:02.404578+0000","last_peered":"2023-03-30T08:11:02.404578+0000","last_clean":"2023-03-30T08:11:02.404578+0000","last_became_active":"2023-03-30T08:10:58.389982+0000","last_became_peered":"2023-03-30T08:10:58.389982+0000","last_unstale":"2023-03-30T08:11:02.404578+0000","last_undegraded":"2023-03-30T08:11:02.404578+0000","last_fullsized":"2023-03-30T08:11:02.404578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.396569+0000","last_change":"2023-03-30T08:10:58.397943+0000","last_active":"2023-03-30T08:11:02.396569+0000","last_peered":"2023-03-30T08:11:02.396569+0000","last_clean":"2023-03-30T08:11:02.396569+0000","last_became_active":"2023-03-30T08:10:58.397652+0000","last_became_peered":"2023-03-30T08:10:58.397652+0000","last_unstale":"2023-03-30T08:11:02.396569+0000","last_undegraded":"2023-03-30T08:11:02.396569+0000","last_fullsized":"2023-03-30T08:11:02.396569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399691+0000","last_change":"2023-03-30T08:10:58.396929+0000","last_active":"2023-03-30T08:11:02.399691+0000","last_peered":"2023-03-30T08:11:02.399691+0000","last_clean":"2023-03-30T08:11:02.399691+0000","last_became_active":"2023-03-30T08:10:58.396575+0000","last_became_peered":"2023-03-30T08:10:58.396575+0000","last_unstale":"2023-03-30T08:11:02.399691+0000","last_undegraded":"2023-03-30T08:11:02.399691+0000","last_fullsized":"2023-03-30T08:11:02.399691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394877+0000","last_change":"2023-03-30T08:10:58.394396+0000","last_active":"2023-03-30T08:11:02.394877+0000","last_peered":"2023-03-30T08:11:02.394877+0000","last_clean":"2023-03-30T08:11:02.394877+0000","last_became_active":"2023-03-30T08:10:58.394147+0000","last_became_peered":"2023-03-30T08:10:58.394147+0000","last_unstale":"2023-03-30T08:11:02.394877+0000","last_undegraded":"2023-03-30T08:11:02.394877+0000","last_fullsized":"2023-03-30T08:11:02.394877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394856+0000","last_change":"2023-03-30T08:10:58.387684+0000","last_active":"2023-03-30T08:11:02.394856+0000","last_peered":"2023-03-30T08:11:02.394856+0000","last_clean":"2023-03-30T08:11:02.394856+0000","last_became_active":"2023-03-30T08:10:58.387427+0000","last_became_peered":"2023-03-30T08:10:58.387427+0000","last_unstale":"2023-03-30T08:11:02.394856+0000","last_undegraded":"2023-03-30T08:11:02.394856+0000","last_fullsized":"2023-03-30T08:11:02.394856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.413072+0000","last_change":"2023-03-30T08:10:58.403140+0000","last_active":"2023-03-30T08:11:02.413072+0000","last_peered":"2023-03-30T08:11:02.413072+0000","last_clean":"2023-03-30T08:11:02.413072+0000","last_became_active":"2023-03-30T08:10:58.402888+0000","last_became_peered":"2023-03-30T08:10:58.402888+0000","last_unstale":"2023-03-30T08:11:02.413072+0000","last_undegraded":"2023-03-30T08:11:02.413072+0000","last_fullsized":"2023-03-30T08:11:02.413072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.399593+0000","last_change":"2023-03-30T08:10:58.401396+0000","last_active":"2023-03-30T08:11:02.399593+0000","last_peered":"2023-03-30T08:11:02.399593+0000","last_clean":"2023-03-30T08:11:02.399593+0000","last_became_active":"2023-03-30T08:10:58.399503+0000","last_became_peered":"2023-03-30T08:10:58.399503+0000","last_unstale":"2023-03-30T08:11:02.399593+0000","last_undegraded":"2023-03-30T08:11:02.399593+0000","last_fullsized":"2023-03-30T08:11:02.399593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406636+0000","last_change":"2023-03-30T08:10:58.390937+0000","last_active":"2023-03-30T08:11:02.406636+0000","last_peered":"2023-03-30T08:11:02.406636+0000","last_clean":"2023-03-30T08:11:02.406636+0000","last_became_active":"2023-03-30T08:10:58.389638+0000","last_became_peered":"2023-03-30T08:10:58.389638+0000","last_unstale":"2023-03-30T08:11:02.406636+0000","last_undegraded":"2023-03-30T08:11:02.406636+0000","last_fullsized":"2023-03-30T08:11:02.406636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:09:17.929521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.416142+0000","last_change":"2023-03-30T08:10:58.404544+0000","last_active":"2023-03-30T08:11:02.416142+0000","last_peered":"2023-03-30T08:11:02.416142+0000","last_clean":"2023-03-30T08:11:02.416142+0000","last_became_active":"2023-03-30T08:10:58.404283+0000","last_became_peered":"2023-03-30T08:10:58.404283+0000","last_unstale":"2023-03-30T08:11:02.416142+0000","last_undegraded":"2023-03-30T08:11:02.416142+0000","last_fullsized":"2023-03-30T08:11:02.416142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:41:44.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395184+0000","last_change":"2023-03-30T08:10:58.388172+0000","last_active":"2023-03-30T08:11:02.395184+0000","last_peered":"2023-03-30T08:11:02.395184+0000","last_clean":"2023-03-30T08:11:02.395184+0000","last_became_active":"2023-03-30T08:10:58.384720+0000","last_became_peered":"2023-03-30T08:10:58.384720+0000","last_unstale":"2023-03-30T08:11:02.395184+0000","last_undegraded":"2023-03-30T08:11:02.395184+0000","last_fullsized":"2023-03-30T08:11:02.395184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:50:54.652580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.418243+0000","last_change":"2023-03-30T08:10:58.392445+0000","last_active":"2023-03-30T08:11:02.418243+0000","last_peered":"2023-03-30T08:11:02.418243+0000","last_clean":"2023-03-30T08:11:02.418243+0000","last_became_active":"2023-03-30T08:10:58.392143+0000","last_became_peered":"2023-03-30T08:10:58.392143+0000","last_unstale":"2023-03-30T08:11:02.418243+0000","last_undegraded":"2023-03-30T08:11:02.418243+0000","last_fullsized":"2023-03-30T08:11:02.418243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:36:07.646179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394615+0000","last_change":"2023-03-30T08:10:58.394487+0000","last_active":"2023-03-30T08:11:02.394615+0000","last_peered":"2023-03-30T08:11:02.394615+0000","last_clean":"2023-03-30T08:11:02.394615+0000","last_became_active":"2023-03-30T08:10:58.394174+0000","last_became_peered":"2023-03-30T08:10:58.394174+0000","last_unstale":"2023-03-30T08:11:02.394615+0000","last_undegraded":"2023-03-30T08:11:02.394615+0000","last_fullsized":"2023-03-30T08:11:02.394615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:38:08.997913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406092+0000","last_change":"2023-03-30T08:10:58.407760+0000","last_active":"2023-03-30T08:11:02.406092+0000","last_peered":"2023-03-30T08:11:02.406092+0000","last_clean":"2023-03-30T08:11:02.406092+0000","last_became_active":"2023-03-30T08:10:58.407549+0000","last_became_peered":"2023-03-30T08:10:58.407549+0000","last_unstale":"2023-03-30T08:11:02.406092+0000","last_undegraded":"2023-03-30T08:11:02.406092+0000","last_fullsized":"2023-03-30T08:11:02.406092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.395205+0000","last_change":"2023-03-30T08:10:58.397788+0000","last_active":"2023-03-30T08:11:02.395205+0000","last_peered":"2023-03-30T08:11:02.395205+0000","last_clean":"2023-03-30T08:11:02.395205+0000","last_became_active":"2023-03-30T08:10:58.397456+0000","last_became_peered":"2023-03-30T08:10:58.397456+0000","last_unstale":"2023-03-30T08:11:02.395205+0000","last_undegraded":"2023-03-30T08:11:02.395205+0000","last_fullsized":"2023-03-30T08:11:02.395205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:38:35.434847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.414622+0000","last_change":"2023-03-30T08:10:58.391637+0000","last_active":"2023-03-30T08:11:02.414622+0000","last_peered":"2023-03-30T08:11:02.414622+0000","last_clean":"2023-03-30T08:11:02.414622+0000","last_became_active":"2023-03-30T08:10:58.391241+0000","last_became_peered":"2023-03-30T08:10:58.391241+0000","last_unstale":"2023-03-30T08:11:02.414622+0000","last_undegraded":"2023-03-30T08:11:02.414622+0000","last_fullsized":"2023-03-30T08:11:02.414622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:40:05.484662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398410+0000","last_change":"2023-03-30T08:10:58.392474+0000","last_active":"2023-03-30T08:11:02.398410+0000","last_peered":"2023-03-30T08:11:02.398410+0000","last_clean":"2023-03-30T08:11:02.398410+0000","last_became_active":"2023-03-30T08:10:58.392054+0000","last_became_peered":"2023-03-30T08:10:58.392054+0000","last_unstale":"2023-03-30T08:11:02.398410+0000","last_undegraded":"2023-03-30T08:11:02.398410+0000","last_fullsized":"2023-03-30T08:11:02.398410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:31.677201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412024+0000","last_change":"2023-03-30T08:10:58.397632+0000","last_active":"2023-03-30T08:11:02.412024+0000","last_peered":"2023-03-30T08:11:02.412024+0000","last_clean":"2023-03-30T08:11:02.412024+0000","last_became_active":"2023-03-30T08:10:58.392721+0000","last_became_peered":"2023-03-30T08:10:58.392721+0000","last_unstale":"2023-03-30T08:11:02.412024+0000","last_undegraded":"2023-03-30T08:11:02.412024+0000","last_fullsized":"2023-03-30T08:11:02.412024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:15:39.162414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.412163+0000","last_change":"2023-03-30T08:10:58.399202+0000","last_active":"2023-03-30T08:11:02.412163+0000","last_peered":"2023-03-30T08:11:02.412163+0000","last_clean":"2023-03-30T08:11:02.412163+0000","last_became_active":"2023-03-30T08:10:58.398999+0000","last_became_peered":"2023-03-30T08:10:58.398999+0000","last_unstale":"2023-03-30T08:11:02.412163+0000","last_undegraded":"2023-03-30T08:11:02.412163+0000","last_fullsized":"2023-03-30T08:11:02.412163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:49:49.791186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394623+0000","last_change":"2023-03-30T08:10:58.374475+0000","last_active":"2023-03-30T08:11:02.394623+0000","last_peered":"2023-03-30T08:11:02.394623+0000","last_clean":"2023-03-30T08:11:02.394623+0000","last_became_active":"2023-03-30T08:10:58.373968+0000","last_became_peered":"2023-03-30T08:10:58.373968+0000","last_unstale":"2023-03-30T08:11:02.394623+0000","last_undegraded":"2023-03-30T08:11:02.394623+0000","last_fullsized":"2023-03-30T08:11:02.394623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:37:34.381037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.401841+0000","last_change":"2023-03-30T08:10:58.399051+0000","last_active":"2023-03-30T08:11:02.401841+0000","last_peered":"2023-03-30T08:11:02.401841+0000","last_clean":"2023-03-30T08:11:02.401841+0000","last_became_active":"2023-03-30T08:10:58.398767+0000","last_became_peered":"2023-03-30T08:10:58.398767+0000","last_unstale":"2023-03-30T08:11:02.401841+0000","last_undegraded":"2023-03-30T08:11:02.401841+0000","last_fullsized":"2023-03-30T08:11:02.401841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:35:55.226695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.405995+0000","last_change":"2023-03-30T08:10:58.409451+0000","last_active":"2023-03-30T08:11:02.405995+0000","last_peered":"2023-03-30T08:11:02.405995+0000","last_clean":"2023-03-30T08:11:02.405995+0000","last_became_active":"2023-03-30T08:10:58.409195+0000","last_became_peered":"2023-03-30T08:10:58.409195+0000","last_unstale":"2023-03-30T08:11:02.405995+0000","last_undegraded":"2023-03-30T08:11:02.405995+0000","last_fullsized":"2023-03-30T08:11:02.405995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:52.783264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.398208+0000","last_change":"2023-03-30T08:10:58.397829+0000","last_active":"2023-03-30T08:11:02.398208+0000","last_peered":"2023-03-30T08:11:02.398208+0000","last_clean":"2023-03-30T08:11:02.398208+0000","last_became_active":"2023-03-30T08:10:58.397472+0000","last_became_peered":"2023-03-30T08:10:58.397472+0000","last_unstale":"2023-03-30T08:11:02.398208+0000","last_undegraded":"2023-03-30T08:11:02.398208+0000","last_fullsized":"2023-03-30T08:11:02.398208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:30:53.625868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.414543+0000","last_change":"2023-03-30T08:10:58.391590+0000","last_active":"2023-03-30T08:11:02.414543+0000","last_peered":"2023-03-30T08:11:02.414543+0000","last_clean":"2023-03-30T08:11:02.414543+0000","last_became_active":"2023-03-30T08:10:58.390836+0000","last_became_peered":"2023-03-30T08:10:58.390836+0000","last_unstale":"2023-03-30T08:11:02.414543+0000","last_undegraded":"2023-03-30T08:11:02.414543+0000","last_fullsized":"2023-03-30T08:11:02.414543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394825+0000","last_change":"2023-03-30T08:10:58.384402+0000","last_active":"2023-03-30T08:11:02.394825+0000","last_peered":"2023-03-30T08:11:02.394825+0000","last_clean":"2023-03-30T08:11:02.394825+0000","last_became_active":"2023-03-30T08:10:58.384149+0000","last_became_peered":"2023-03-30T08:10:58.384149+0000","last_unstale":"2023-03-30T08:11:02.394825+0000","last_undegraded":"2023-03-30T08:11:02.394825+0000","last_fullsized":"2023-03-30T08:11:02.394825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:49:19.304132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.406516+0000","last_change":"2023-03-30T08:10:58.401419+0000","last_active":"2023-03-30T08:11:02.406516+0000","last_peered":"2023-03-30T08:11:02.406516+0000","last_clean":"2023-03-30T08:11:02.406516+0000","last_became_active":"2023-03-30T08:10:58.401118+0000","last_became_peered":"2023-03-30T08:10:58.401118+0000","last_unstale":"2023-03-30T08:11:02.406516+0000","last_undegraded":"2023-03-30T08:11:02.406516+0000","last_fullsized":"2023-03-30T08:11:02.406516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:40:05.484662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.403459+0000","last_change":"2023-03-30T08:10:58.397292+0000","last_active":"2023-03-30T08:11:02.403459+0000","last_peered":"2023-03-30T08:11:02.403459+0000","last_clean":"2023-03-30T08:11:02.403459+0000","last_became_active":"2023-03-30T08:10:58.396977+0000","last_became_peered":"2023-03-30T08:10:58.396977+0000","last_unstale":"2023-03-30T08:11:02.403459+0000","last_undegraded":"2023-03-30T08:11:02.403459+0000","last_fullsized":"2023-03-30T08:11:02.403459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:04:09.104430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.394458+0000","last_change":"2023-03-30T08:10:58.406332+0000","last_active":"2023-03-30T08:11:02.394458+0000","last_peered":"2023-03-30T08:11:02.394458+0000","last_clean":"2023-03-30T08:11:02.394458+0000","last_became_active":"2023-03-30T08:10:58.406011+0000","last_became_peered":"2023-03-30T08:10:58.406011+0000","last_unstale":"2023-03-30T08:11:02.394458+0000","last_undegraded":"2023-03-30T08:11:02.394458+0000","last_fullsized":"2023-03-30T08:11:02.394458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:14:36.034697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.401759+0000","last_change":"2023-03-30T08:10:58.397437+0000","last_active":"2023-03-30T08:11:02.401759+0000","last_peered":"2023-03-30T08:11:02.401759+0000","last_clean":"2023-03-30T08:11:02.401759+0000","last_became_active":"2023-03-30T08:10:58.396808+0000","last_became_peered":"2023-03-30T08:10:58.396808+0000","last_unstale":"2023-03-30T08:11:02.401759+0000","last_undegraded":"2023-03-30T08:11:02.401759+0000","last_fullsized":"2023-03-30T08:11:02.401759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:24:53.615938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-03-30T08:11:02.418290+0000","last_change":"2023-03-30T08:10:58.392929+0000","last_active":"2023-03-30T08:11:02.418290+0000","last_peered":"2023-03-30T08:11:02.418290+0000","last_clean":"2023-03-30T08:11:02.418290+0000","last_became_active":"2023-03-30T08:10:58.392655+0000","last_became_peered":"2023-03-30T08:10:58.392655+0000","last_unstale":"2023-03-30T08:11:02.418290+0000","last_undegraded":"2023-03-30T08:11:02.418290+0000","last_fullsized":"2023-03-30T08:11:02.418290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:57.899058+0000","last_clean_scrub_stamp":"2023-03-30T08:10:57.899058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:28:54.421859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4597,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8108,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363732,"statfs":{"total":96636764160,"available":96628461568,"internally_reserved":0,"allocated":299008,"data_stored":122842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9292,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362548,"statfs":{"total":96636764160,"available":96627249152,"internally_reserved":0,"allocated":921600,"data_stored":717225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.423}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":307200,"data_stored":123494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5349999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8256,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363584,"statfs":{"total":96636764160,"available":96628310016,"internally_reserved":0,"allocated":319488,"data_stored":126697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5369999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":122932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.548}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8108,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363732,"statfs":{"total":96636764160,"available":96628461568,"internally_reserved":0,"allocated":299008,"data_stored":122842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8236,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363604,"statfs":{"total":96636764160,"available":96628330496,"internally_reserved":0,"allocated":299008,"data_stored":122842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9264,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362576,"statfs":{"total":96636764160,"available":96627277824,"internally_reserved":0,"allocated":892928,"data_stored":712449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-30T08:11:23.441 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-03-30T08:11:23.441 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-03-30T08:11:23.441 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-03-30T08:11:23.441 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-03-30T08:11:23.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.632+0000 7fe74759e700 1 Processor -- start 2023-03-30T08:11:23.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.632+0000 7fe74759e700 1 -- start start 2023-03-30T08:11:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.636+0000 7fe74759e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe74806b050 0x7fe74806b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.636+0000 7fe74759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7480b3020 0x7fe7480ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.636+0000 7fe74759e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74806f8f0 con 0x7fe7480b24a0 2023-03-30T08:11:23.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.636+0000 7fe74759e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74806fb40 con 0x7fe74806b050 2023-03-30T08:11:23.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.636+0000 7fe74759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74806ff90 con 0x7fe7480b3020 2023-03-30T08:11:23.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.636+0000 7fe746d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7480b3020 0x7fe7480ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:23.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.636+0000 7fe746d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7480b3020 0x7fe7480ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:34312/0 (socket says 172.21.15.87:34312) 2023-03-30T08:11:23.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.636+0000 7fe746d9d700 1 -- 172.21.15.87:0/2223451467 learned_addr learned my addr 172.21.15.87:0/2223451467 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:23.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.636+0000 7fe74659c700 1 --2- 172.21.15.87:0/2223451467 >> v2:172.21.15.115:3300/0 conn(0x7fe74806b050 0x7fe74806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:23.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.636+0000 7fe746d9d700 1 -- 172.21.15.87:0/2223451467 >> v2:172.21.15.115:3300/0 conn(0x7fe74806b050 msgr2=0x7fe74806b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:23.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.636+0000 7fe746d9d700 1 --2- 172.21.15.87:0/2223451467 >> v2:172.21.15.115:3300/0 conn(0x7fe74806b050 0x7fe74806b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.636+0000 7fe746d9d700 1 -- 172.21.15.87:0/2223451467 >> v1:172.21.15.115:6789/0 conn(0x7fe7480b24a0 legacy=0x7fe7480b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:23.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.636+0000 7fe746d9d700 1 -- 172.21.15.87:0/2223451467 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7480ce8d0 con 0x7fe7480b3020 2023-03-30T08:11:23.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.636+0000 7fe746d9d700 1 --2- 172.21.15.87:0/2223451467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7480b3020 0x7fe7480ced60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe740009e50 tx=0x7fe74000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=415cd725e6efaafb server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:23.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.640+0000 7fe74559a700 1 -- 172.21.15.87:0/2223451467 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74000e070 con 0x7fe7480b3020 2023-03-30T08:11:23.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.640+0000 7fe74559a700 1 -- 172.21.15.87:0/2223451467 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74000b9c0 con 0x7fe7480b3020 2023-03-30T08:11:23.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.640+0000 7fe74559a700 1 -- 172.21.15.87:0/2223451467 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74000bd70 con 0x7fe7480b3020 2023-03-30T08:11:23.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.640+0000 7fe74759e700 1 -- 172.21.15.87:0/2223451467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7480b3020 msgr2=0x7fe7480ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:23.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.640+0000 7fe74759e700 1 --2- 172.21.15.87:0/2223451467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7480b3020 0x7fe7480ced60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe740009e50 tx=0x7fe74000b330 comp rx=0 tx=0).stop 2023-03-30T08:11:23.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.640+0000 7fe74759e700 1 -- 172.21.15.87:0/2223451467 shutdown_connections 2023-03-30T08:11:23.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.640+0000 7fe74759e700 1 --2- 172.21.15.87:0/2223451467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7480b3020 0x7fe7480ced60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.640+0000 7fe74759e700 1 --2- 172.21.15.87:0/2223451467 >> v2:172.21.15.115:3300/0 conn(0x7fe74806b050 0x7fe74806b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.640+0000 7fe74759e700 1 -- 172.21.15.87:0/2223451467 >> 172.21.15.87:0/2223451467 conn(0x7fe748099d00 msgr2=0x7fe7480d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:23.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.640+0000 7fe74759e700 1 -- 172.21.15.87:0/2223451467 shutdown_connections 2023-03-30T08:11:23.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.640+0000 7fe74759e700 1 -- 172.21.15.87:0/2223451467 wait complete. 2023-03-30T08:11:23.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe74759e700 1 Processor -- start 2023-03-30T08:11:23.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe74759e700 1 -- start start 2023-03-30T08:11:23.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe74759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe74806b050 0x7fe7481e0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:23.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe74759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7480b24a0 0x7fe7480c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:23.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe74759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7480b3020 0x7fe7480ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:23.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe74759e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7480c7350 con 0x7fe7480b24a0 2023-03-30T08:11:23.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe74759e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7480c5ec0 con 0x7fe74806b050 2023-03-30T08:11:23.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe74759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7480c6110 con 0x7fe7480b3020 2023-03-30T08:11:23.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe745d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7480b24a0 0x7fe7480c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:23.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe745d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7480b24a0 0x7fe7480c6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52156/0 (socket says 172.21.15.87:52156) 2023-03-30T08:11:23.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe745d9b700 1 -- 172.21.15.87:0/3331823182 learned_addr learned my addr 172.21.15.87:0/3331823182 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:23.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe74659c700 1 --2- 172.21.15.87:0/3331823182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe74806b050 0x7fe7481e0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:23.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe746d9d700 1 --2- 172.21.15.87:0/3331823182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7480b3020 0x7fe7480ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:23.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe745d9b700 1 -- 172.21.15.87:0/3331823182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7480b3020 msgr2=0x7fe7480ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:23.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe745d9b700 1 --2- 172.21.15.87:0/3331823182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7480b3020 0x7fe7480ae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe745d9b700 1 -- 172.21.15.87:0/3331823182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe74806b050 msgr2=0x7fe7481e0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:23.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe745d9b700 1 --2- 172.21.15.87:0/3331823182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe74806b050 0x7fe7481e0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe745d9b700 1 -- 172.21.15.87:0/3331823182 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe740009b30 con 0x7fe7480b24a0 2023-03-30T08:11:23.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe74659c700 1 --2- 172.21.15.87:0/3331823182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe74806b050 0x7fe7481e0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:23.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.644+0000 7fe745d9b700 1 --2- 172.21.15.87:0/3331823182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7480b24a0 0x7fe7480c6e10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00c530 tx=0x7fe73c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:23.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.648+0000 7fe736ffd700 1 -- 172.21.15.87:0/3331823182 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c0052d0 con 0x7fe7480b24a0 2023-03-30T08:11:23.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.648+0000 7fe736ffd700 1 -- 172.21.15.87:0/3331823182 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c005430 con 0x7fe7480b24a0 2023-03-30T08:11:23.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.648+0000 7fe74759e700 1 -- 172.21.15.87:0/3331823182 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7480ce560 con 0x7fe7480b24a0 2023-03-30T08:11:23.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.648+0000 7fe736ffd700 1 -- 172.21.15.87:0/3331823182 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c0055a0 con 0x7fe7480b24a0 2023-03-30T08:11:23.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.648+0000 7fe74759e700 1 -- 172.21.15.87:0/3331823182 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74806e2a0 con 0x7fe7480b24a0 2023-03-30T08:11:23.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.648+0000 7fe74759e700 1 -- 172.21.15.87:0/3331823182 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74806f3a0 con 0x7fe7480b24a0 2023-03-30T08:11:23.654 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.648+0000 7fe736ffd700 1 -- 172.21.15.87:0/3331823182 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fe73c0038e0 con 0x7fe7480b24a0 2023-03-30T08:11:23.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.652+0000 7fe736ffd700 1 --2- 172.21.15.87:0/3331823182 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe7280653f0 0x7fe7280678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:23.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.652+0000 7fe736ffd700 1 -- 172.21.15.87:0/3331823182 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe73c081f80 con 0x7fe7480b24a0 2023-03-30T08:11:23.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.652+0000 7fe74659c700 1 --2- 172.21.15.87:0/3331823182 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe7280653f0 0x7fe7280678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:23.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.652+0000 7fe74659c700 1 --2- 172.21.15.87:0/3331823182 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe7280653f0 0x7fe7280678a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe738006fd0 tx=0x7fe738008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:23.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.656+0000 7fe736ffd700 1 -- 172.21.15.87:0/3331823182 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fe73c04f910 con 0x7fe7480b24a0 2023-03-30T08:11:23.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.856+0000 7fe74759e700 1 -- 172.21.15.87:0/3331823182 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe7480733a0 con 0x7fe7480b24a0 2023-03-30T08:11:23.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.860+0000 7fe736ffd700 1 -- 172.21.15.87:0/3331823182 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe73c052f30 con 0x7fe7480b24a0 2023-03-30T08:11:23.864 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:23.864 INFO:teuthology.orchestra.run.smithi087.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-03-30T08:11:23.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.860+0000 7fe74759e700 1 -- 172.21.15.87:0/3331823182 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe7280653f0 msgr2=0x7fe7280678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:23.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.860+0000 7fe74759e700 1 --2- 172.21.15.87:0/3331823182 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe7280653f0 0x7fe7280678a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe738006fd0 tx=0x7fe738008040 comp rx=0 tx=0).stop 2023-03-30T08:11:23.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.860+0000 7fe74759e700 1 -- 172.21.15.87:0/3331823182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7480b24a0 msgr2=0x7fe7480c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:23.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.860+0000 7fe74759e700 1 --2- 172.21.15.87:0/3331823182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7480b24a0 0x7fe7480c6e10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00c530 tx=0x7fe73c00c840 comp rx=0 tx=0).stop 2023-03-30T08:11:23.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.860+0000 7fe74759e700 1 -- 172.21.15.87:0/3331823182 shutdown_connections 2023-03-30T08:11:23.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.860+0000 7fe74759e700 1 --2- 172.21.15.87:0/3331823182 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe7280653f0 0x7fe7280678a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.860+0000 7fe74759e700 1 --2- 172.21.15.87:0/3331823182 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7480b3020 0x7fe7480ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.860+0000 7fe74759e700 1 --2- 172.21.15.87:0/3331823182 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7480b24a0 0x7fe7480c6e10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.860+0000 7fe74759e700 1 --2- 172.21.15.87:0/3331823182 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe74806b050 0x7fe7481e0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:23.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.860+0000 7fe74759e700 1 -- 172.21.15.87:0/3331823182 >> 172.21.15.87:0/3331823182 conn(0x7fe748099d00 msgr2=0x7fe7481e3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:23.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.860+0000 7fe74759e700 1 -- 172.21.15.87:0/3331823182 shutdown_connections 2023-03-30T08:11:23.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:23.860+0000 7fe74759e700 1 -- 172.21.15.87:0/3331823182 wait complete. 2023-03-30T08:11:23.887 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-03-30T08:11:23.888 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:24.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.036+0000 7f2e52dce700 1 Processor -- start 2023-03-30T08:11:24.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.036+0000 7f2e52dce700 1 -- start start 2023-03-30T08:11:24.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e52dce700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2e4c164190 0x7f2e4c0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e52dce700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c069f00 con 0x7f2e4c163dc0 2023-03-30T08:11:24.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e52dce700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c06cf70 con 0x7f2e4c0aea30 2023-03-30T08:11:24.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e52dce700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4c06d810 con 0x7f2e4c164190 2023-03-30T08:11:24.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e51dcc700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2e4c163dc0 0x7f2e4c0c95c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48620/0 (socket says 172.21.15.87:48620) 2023-03-30T08:11:24.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e51dcc700 1 -- 172.21.15.87:0/3186445332 learned_addr learned my addr 172.21.15.87:0/3186445332 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:24.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e515cb700 1 --2- 172.21.15.87:0/3186445332 >> v2:172.21.15.115:3300/0 conn(0x7f2e4c164190 0x7f2e4c0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e50dca700 1 -- 172.21.15.87:0/3186445332 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572810195 0 0) 0x7f2e4c069f00 con 0x7f2e4c163dc0 2023-03-30T08:11:24.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e515cb700 1 -- 172.21.15.87:0/3186445332 >> v1:172.21.15.115:6789/0 conn(0x7f2e4c0aea30 legacy=0x7f2e4c06a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e515cb700 1 -- 172.21.15.87:0/3186445332 >> v1:172.21.15.87:6789/0 conn(0x7f2e4c163dc0 legacy=0x7f2e4c0c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e515cb700 1 -- 172.21.15.87:0/3186445332 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c06d250 con 0x7f2e4c164190 2023-03-30T08:11:24.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e515cb700 1 --2- 172.21.15.87:0/3186445332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c164190 0x7f2e4c0c9cd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009850 tx=0x7f2e3c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=931ce1e04df18ed7 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:24.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e50dca700 1 -- 172.21.15.87:0/3186445332 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c011830 con 0x7f2e4c164190 2023-03-30T08:11:24.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e50dca700 1 -- 172.21.15.87:0/3186445332 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c011990 con 0x7f2e4c164190 2023-03-30T08:11:24.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e50dca700 1 -- 172.21.15.87:0/3186445332 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c011d20 con 0x7f2e4c164190 2023-03-30T08:11:24.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e52dce700 1 -- 172.21.15.87:0/3186445332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c164190 msgr2=0x7f2e4c0c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.040+0000 7f2e52dce700 1 --2- 172.21.15.87:0/3186445332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c164190 0x7f2e4c0c9cd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009850 tx=0x7f2e3c009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:24.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e52dce700 1 -- 172.21.15.87:0/3186445332 shutdown_connections 2023-03-30T08:11:24.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e52dce700 1 --2- 172.21.15.87:0/3186445332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c164190 0x7f2e4c0c9cd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e52dce700 1 -- 172.21.15.87:0/3186445332 >> 172.21.15.87:0/3186445332 conn(0x7f2e4c0cf410 msgr2=0x7f2e4c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:24.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e52dce700 1 -- 172.21.15.87:0/3186445332 shutdown_connections 2023-03-30T08:11:24.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e52dce700 1 -- 172.21.15.87:0/3186445332 wait complete. 2023-03-30T08:11:24.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e52dce700 1 Processor -- start 2023-03-30T08:11:24.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e52dce700 1 -- start start 2023-03-30T08:11:24.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e52dce700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e4c0aea30 0x7f2e4c158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e52dce700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c163dc0 0x7f2e4c0c3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e52dce700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e4c164190 0x7f2e4c15be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e52dce700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0bdcc0 con 0x7f2e4c164190 2023-03-30T08:11:24.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e52dce700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0bead0 con 0x7f2e4c163dc0 2023-03-30T08:11:24.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e52dce700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c15b4e0 con 0x7f2e4c0aea30 2023-03-30T08:11:24.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e525cd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e4c164190 0x7f2e4c15be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e525cd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e4c164190 0x7f2e4c15be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52164/0 (socket says 172.21.15.87:52164) 2023-03-30T08:11:24.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e525cd700 1 -- 172.21.15.87:0/3646163186 learned_addr learned my addr 172.21.15.87:0/3646163186 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:24.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.044+0000 7f2e51dcc700 1 --2- 172.21.15.87:0/3646163186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e4c0aea30 0x7f2e4c158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.048+0000 7f2e515cb700 1 --2- 172.21.15.87:0/3646163186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c163dc0 0x7f2e4c0c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.048+0000 7f2e525cd700 1 -- 172.21.15.87:0/3646163186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e4c0aea30 msgr2=0x7f2e4c158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.048+0000 7f2e525cd700 1 --2- 172.21.15.87:0/3646163186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e4c0aea30 0x7f2e4c158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.048+0000 7f2e525cd700 1 -- 172.21.15.87:0/3646163186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c163dc0 msgr2=0x7f2e4c0c3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.048+0000 7f2e525cd700 1 --2- 172.21.15.87:0/3646163186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c163dc0 0x7f2e4c0c3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.048+0000 7f2e525cd700 1 -- 172.21.15.87:0/3646163186 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c0094b0 con 0x7f2e4c164190 2023-03-30T08:11:24.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.048+0000 7f2e525cd700 1 --2- 172.21.15.87:0/3646163186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e4c164190 0x7f2e4c15be60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400cb90 tx=0x7f2e4400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:24.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.048+0000 7f2e427fc700 1 -- 172.21.15.87:0/3646163186 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44003c20 con 0x7f2e4c164190 2023-03-30T08:11:24.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.048+0000 7f2e427fc700 1 -- 172.21.15.87:0/3646163186 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44003d80 con 0x7f2e4c164190 2023-03-30T08:11:24.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.048+0000 7f2e52dce700 1 -- 172.21.15.87:0/3646163186 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4c06cc40 con 0x7f2e4c164190 2023-03-30T08:11:24.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.048+0000 7f2e427fc700 1 -- 172.21.15.87:0/3646163186 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4400abb0 con 0x7f2e4c164190 2023-03-30T08:11:24.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.048+0000 7f2e52dce700 1 -- 172.21.15.87:0/3646163186 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c06d530 con 0x7f2e4c164190 2023-03-30T08:11:24.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.048+0000 7f2e52dce700 1 -- 172.21.15.87:0/3646163186 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c0ca210 con 0x7f2e4c164190 2023-03-30T08:11:24.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.048+0000 7f2e427fc700 1 -- 172.21.15.87:0/3646163186 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f2e4400ad10 con 0x7f2e4c164190 2023-03-30T08:11:24.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.052+0000 7f2e427fc700 1 --2- 172.21.15.87:0/3646163186 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2e300653f0 0x7f2e300678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.052+0000 7f2e427fc700 1 -- 172.21.15.87:0/3646163186 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2e44082bf0 con 0x7f2e4c164190 2023-03-30T08:11:24.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.052+0000 7f2e51dcc700 1 --2- 172.21.15.87:0/3646163186 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2e300653f0 0x7f2e300678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.052+0000 7f2e51dcc700 1 --2- 172.21.15.87:0/3646163186 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2e300653f0 0x7f2e300678a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2e48000f60 tx=0x7f2e48007c40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:24.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.056+0000 7f2e427fc700 1 -- 172.21.15.87:0/3646163186 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f2e44050510 con 0x7f2e4c164190 2023-03-30T08:11:24.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.228+0000 7f2e52dce700 1 -- 172.21.15.87:0/3646163186 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e4c0bec60 con 0x7f2e4c164190 2023-03-30T08:11:24.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.232+0000 7f2e427fc700 1 -- 172.21.15.87:0/3646163186 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19652 (secure 0 0 0) 0x7f2e4c0bec60 con 0x7f2e4c164190 2023-03-30T08:11:24.235 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:24.236 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":28,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:02.841070+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:24.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.232+0000 7f2e52dce700 1 -- 172.21.15.87:0/3646163186 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2e300653f0 msgr2=0x7f2e300678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.232+0000 7f2e52dce700 1 --2- 172.21.15.87:0/3646163186 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2e300653f0 0x7f2e300678a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2e48000f60 tx=0x7f2e48007c40 comp rx=0 tx=0).stop 2023-03-30T08:11:24.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.232+0000 7f2e52dce700 1 -- 172.21.15.87:0/3646163186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e4c164190 msgr2=0x7f2e4c15be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.232+0000 7f2e52dce700 1 --2- 172.21.15.87:0/3646163186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e4c164190 0x7f2e4c15be60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400cb90 tx=0x7f2e4400cf50 comp rx=0 tx=0).stop 2023-03-30T08:11:24.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.232+0000 7f2e52dce700 1 -- 172.21.15.87:0/3646163186 shutdown_connections 2023-03-30T08:11:24.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.232+0000 7f2e52dce700 1 --2- 172.21.15.87:0/3646163186 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2e300653f0 0x7f2e300678a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.232+0000 7f2e52dce700 1 --2- 172.21.15.87:0/3646163186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2e4c164190 0x7f2e4c15be60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.232+0000 7f2e52dce700 1 --2- 172.21.15.87:0/3646163186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e4c163dc0 0x7f2e4c0c3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.232+0000 7f2e52dce700 1 --2- 172.21.15.87:0/3646163186 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2e4c0aea30 0x7f2e4c158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.232+0000 7f2e52dce700 1 -- 172.21.15.87:0/3646163186 >> 172.21.15.87:0/3646163186 conn(0x7f2e4c0cf410 msgr2=0x7f2e4c1eae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:24.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.232+0000 7f2e52dce700 1 -- 172.21.15.87:0/3646163186 shutdown_connections 2023-03-30T08:11:24.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.232+0000 7f2e52dce700 1 -- 172.21.15.87:0/3646163186 wait complete. 2023-03-30T08:11:24.260 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-30T08:10:56.407927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-30T08:10:57.359214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-30T08:11:00.430972+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-30T08:11:24.261 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T08:11:24.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.424+0000 7ff1ee6ff700 1 Processor -- start 2023-03-30T08:11:24.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.424+0000 7ff1ee6ff700 1 -- start start 2023-03-30T08:11:24.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.424+0000 7ff1ee6ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1e81600d0 0x7ff1e806a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.424+0000 7ff1ee6ff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff1e806aab0 0x7ff1e80abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.424+0000 7ff1ee6ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e806a0e0 con 0x7ff1e80ad640 2023-03-30T08:11:24.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.424+0000 7ff1ee6ff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e80c9db0 con 0x7ff1e806aab0 2023-03-30T08:11:24.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.424+0000 7ff1ee6ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e80ca090 con 0x7ff1e81600d0 2023-03-30T08:11:24.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1ecefc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff1e806aab0 0x7ff1e80abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1ecefc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff1e806aab0 0x7ff1e80abfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52174/0 (socket says 172.21.15.87:52174) 2023-03-30T08:11:24.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1ecefc700 1 -- 172.21.15.87:0/2231973283 learned_addr learned my addr 172.21.15.87:0/2231973283 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:24.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1ed6fd700 1 --2- 172.21.15.87:0/2231973283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1e81600d0 0x7ff1e806a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1ecefc700 1 -- 172.21.15.87:0/2231973283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1e81600d0 msgr2=0x7ff1e806a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:24.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1ecefc700 1 --2- 172.21.15.87:0/2231973283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1e81600d0 0x7ff1e806a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1ecefc700 1 -- 172.21.15.87:0/2231973283 >> v1:172.21.15.115:6789/0 conn(0x7ff1e80ad640 legacy=0x7ff1e81604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1ecefc700 1 -- 172.21.15.87:0/2231973283 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e8069d70 con 0x7ff1e806aab0 2023-03-30T08:11:24.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1dffff700 1 -- 172.21.15.87:0/2231973283 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224294930 0 0) 0x7ff1e806a0e0 con 0x7ff1e80ad640 2023-03-30T08:11:24.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1ecefc700 1 --2- 172.21.15.87:0/2231973283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1e806aab0 0x7ff1e80abfe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009910 tx=0x7ff1d8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1571b25d61614ad server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:24.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1dffff700 1 -- 172.21.15.87:0/2231973283 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8011830 con 0x7ff1e806aab0 2023-03-30T08:11:24.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1dffff700 1 -- 172.21.15.87:0/2231973283 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d8011990 con 0x7ff1e806aab0 2023-03-30T08:11:24.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1dffff700 1 -- 172.21.15.87:0/2231973283 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8011d40 con 0x7ff1e806aab0 2023-03-30T08:11:24.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1ee6ff700 1 -- 172.21.15.87:0/2231973283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1e806aab0 msgr2=0x7ff1e80abfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1ee6ff700 1 --2- 172.21.15.87:0/2231973283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1e806aab0 0x7ff1e80abfe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009910 tx=0x7ff1d8009c20 comp rx=0 tx=0).stop 2023-03-30T08:11:24.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1ee6ff700 1 -- 172.21.15.87:0/2231973283 shutdown_connections 2023-03-30T08:11:24.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1ee6ff700 1 --2- 172.21.15.87:0/2231973283 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1e806aab0 0x7ff1e80abfe0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1ee6ff700 1 --2- 172.21.15.87:0/2231973283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1e81600d0 0x7ff1e806a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.428+0000 7ff1ee6ff700 1 -- 172.21.15.87:0/2231973283 >> 172.21.15.87:0/2231973283 conn(0x7ff1e80cf410 msgr2=0x7ff1e80cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:24.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.432+0000 7ff1ee6ff700 1 -- 172.21.15.87:0/2231973283 shutdown_connections 2023-03-30T08:11:24.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.432+0000 7ff1ee6ff700 1 -- 172.21.15.87:0/2231973283 wait complete. 2023-03-30T08:11:24.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.432+0000 7ff1ee6ff700 1 Processor -- start 2023-03-30T08:11:24.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.432+0000 7ff1ee6ff700 1 -- start start 2023-03-30T08:11:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ee6ff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1e806aab0 0x7ff1e815b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ee6ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1e80ad640 0x7ff1e8143160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ee6ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1e81600d0 0x7ff1e80cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ee6ff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e815acb0 con 0x7ff1e806aab0 2023-03-30T08:11:24.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ee6ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e815b680 con 0x7ff1e81600d0 2023-03-30T08:11:24.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ee6ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e80b0ad0 con 0x7ff1e80ad640 2023-03-30T08:11:24.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ed6fd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1e806aab0 0x7ff1e815b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ed6fd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1e806aab0 0x7ff1e815b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52184/0 (socket says 172.21.15.87:52184) 2023-03-30T08:11:24.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ed6fd700 1 -- 172.21.15.87:0/162924983 learned_addr learned my addr 172.21.15.87:0/162924983 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:24.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ecefc700 1 --2- 172.21.15.87:0/162924983 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1e80ad640 0x7ff1e8143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1edefe700 1 --2- 172.21.15.87:0/162924983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1e81600d0 0x7ff1e80cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ed6fd700 1 -- 172.21.15.87:0/162924983 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1e80ad640 msgr2=0x7ff1e8143160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ed6fd700 1 --2- 172.21.15.87:0/162924983 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1e80ad640 0x7ff1e8143160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ed6fd700 1 -- 172.21.15.87:0/162924983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1e81600d0 msgr2=0x7ff1e80cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ed6fd700 1 --2- 172.21.15.87:0/162924983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1e81600d0 0x7ff1e80cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ed6fd700 1 -- 172.21.15.87:0/162924983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d8009570 con 0x7ff1e806aab0 2023-03-30T08:11:24.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ed6fd700 1 --2- 172.21.15.87:0/162924983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1e806aab0 0x7ff1e815b140 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400e840 tx=0x7ff1e400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:24.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ddffb700 1 -- 172.21.15.87:0/162924983 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e40095a0 con 0x7ff1e806aab0 2023-03-30T08:11:24.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ee6ff700 1 -- 172.21.15.87:0/162924983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e80addc0 con 0x7ff1e806aab0 2023-03-30T08:11:24.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ddffb700 1 -- 172.21.15.87:0/162924983 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e4013680 con 0x7ff1e806aab0 2023-03-30T08:11:24.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ddffb700 1 -- 172.21.15.87:0/162924983 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e40139f0 con 0x7ff1e806aab0 2023-03-30T08:11:24.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.436+0000 7ff1ee6ff700 1 -- 172.21.15.87:0/162924983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e80ca370 con 0x7ff1e806aab0 2023-03-30T08:11:24.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.440+0000 7ff1ee6ff700 1 -- 172.21.15.87:0/162924983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e815d8c0 con 0x7ff1e806aab0 2023-03-30T08:11:24.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.440+0000 7ff1ddffb700 1 -- 172.21.15.87:0/162924983 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ff1e4013b50 con 0x7ff1e806aab0 2023-03-30T08:11:24.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.440+0000 7ff1ddffb700 1 --2- 172.21.15.87:0/162924983 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff1cc065420 0x7ff1cc0678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.444+0000 7ff1ddffb700 1 -- 172.21.15.87:0/162924983 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff1e4082ae0 con 0x7ff1e806aab0 2023-03-30T08:11:24.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.444+0000 7ff1ecefc700 1 --2- 172.21.15.87:0/162924983 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff1cc065420 0x7ff1cc0678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.444+0000 7ff1ecefc700 1 --2- 172.21.15.87:0/162924983 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff1cc065420 0x7ff1cc0678d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8000c00 tx=0x7ff1d8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:24.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.448+0000 7ff1ddffb700 1 -- 172.21.15.87:0/162924983 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7ff1e4053d80 con 0x7ff1e806aab0 2023-03-30T08:11:24.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.616+0000 7ff1ee6ff700 1 -- 172.21.15.87:0/162924983 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1e80733a0 con 0x7ff1e806aab0 2023-03-30T08:11:24.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.616+0000 7ff1ddffb700 1 -- 172.21.15.87:0/162924983 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1e4017020 con 0x7ff1e806aab0 2023-03-30T08:11:24.620 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T08:11:24.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.620+0000 7ff1ee6ff700 1 -- 172.21.15.87:0/162924983 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff1cc065420 msgr2=0x7ff1cc0678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.620+0000 7ff1ee6ff700 1 --2- 172.21.15.87:0/162924983 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff1cc065420 0x7ff1cc0678d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8000c00 tx=0x7ff1d8008030 comp rx=0 tx=0).stop 2023-03-30T08:11:24.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.620+0000 7ff1ee6ff700 1 -- 172.21.15.87:0/162924983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1e806aab0 msgr2=0x7ff1e815b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.620+0000 7ff1ee6ff700 1 --2- 172.21.15.87:0/162924983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1e806aab0 0x7ff1e815b140 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400e840 tx=0x7ff1e400eb50 comp rx=0 tx=0).stop 2023-03-30T08:11:24.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.620+0000 7ff1ee6ff700 1 -- 172.21.15.87:0/162924983 shutdown_connections 2023-03-30T08:11:24.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.620+0000 7ff1ee6ff700 1 --2- 172.21.15.87:0/162924983 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff1cc065420 0x7ff1cc0678d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.620+0000 7ff1ee6ff700 1 --2- 172.21.15.87:0/162924983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1e81600d0 0x7ff1e80cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.620+0000 7ff1ee6ff700 1 --2- 172.21.15.87:0/162924983 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1e80ad640 0x7ff1e8143160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.620+0000 7ff1ee6ff700 1 --2- 172.21.15.87:0/162924983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1e806aab0 0x7ff1e815b140 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.620+0000 7ff1ee6ff700 1 -- 172.21.15.87:0/162924983 >> 172.21.15.87:0/162924983 conn(0x7ff1e80cf410 msgr2=0x7ff1e8070180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:24.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.620+0000 7ff1ee6ff700 1 -- 172.21.15.87:0/162924983 shutdown_connections 2023-03-30T08:11:24.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.620+0000 7ff1ee6ff700 1 -- 172.21.15.87:0/162924983 wait complete. 2023-03-30T08:11:24.644 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T08:11:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.812+0000 7f6d5f7f2700 1 Processor -- start 2023-03-30T08:11:24.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.812+0000 7f6d5f7f2700 1 -- start start 2023-03-30T08:11:24.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.812+0000 7f6d5f7f2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d58070b30 0x7f6d580cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.812+0000 7f6d5f7f2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5815e8c0 con 0x7f6d580b41c0 2023-03-30T08:11:24.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d5f7f2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d580c96b0 con 0x7f6d580c8fb0 2023-03-30T08:11:24.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d5f7f2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5815ed50 con 0x7f6d58070b30 2023-03-30T08:11:24.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d5d58e700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f6d580b41c0 0x7f6d58070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48622/0 (socket says 172.21.15.87:48622) 2023-03-30T08:11:24.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d5d58e700 1 -- 172.21.15.87:0/403693867 learned_addr learned my addr 172.21.15.87:0/403693867 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:24.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d5cd8d700 1 --2- 172.21.15.87:0/403693867 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d58070b30 0x7f6d580cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d4ffff700 1 -- 172.21.15.87:0/403693867 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877118306 0 0) 0x7f6d5815e8c0 con 0x7f6d580b41c0 2023-03-30T08:11:24.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d4ffff700 1 -- 172.21.15.87:0/403693867 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d440035d0 con 0x7f6d580b41c0 2023-03-30T08:11:24.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d4ffff700 1 -- 172.21.15.87:0/403693867 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653921049 0 0) 0x7f6d580c96b0 con 0x7f6d580c8fb0 2023-03-30T08:11:24.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d4ffff700 1 -- 172.21.15.87:0/403693867 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d5815e8c0 con 0x7f6d580c8fb0 2023-03-30T08:11:24.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d5cd8d700 1 -- 172.21.15.87:0/403693867 >> v1:172.21.15.115:6789/0 conn(0x7f6d580c8fb0 legacy=0x7f6d580cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d5cd8d700 1 -- 172.21.15.87:0/403693867 >> v1:172.21.15.87:6789/0 conn(0x7f6d580b41c0 legacy=0x7f6d58070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d5cd8d700 1 -- 172.21.15.87:0/403693867 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d580ce720 con 0x7f6d58070b30 2023-03-30T08:11:24.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d5cd8d700 1 --2- 172.21.15.87:0/403693867 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d58070b30 0x7f6d580cab10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009880 tx=0x7f6d48009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31e41824244a1ce1 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:24.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d4ffff700 1 -- 172.21.15.87:0/403693867 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48011830 con 0x7f6d58070b30 2023-03-30T08:11:24.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d4ffff700 1 -- 172.21.15.87:0/403693867 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d48011990 con 0x7f6d58070b30 2023-03-30T08:11:24.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d4ffff700 1 -- 172.21.15.87:0/403693867 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48011d20 con 0x7f6d58070b30 2023-03-30T08:11:24.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d5f7f2700 1 -- 172.21.15.87:0/403693867 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d58070b30 msgr2=0x7f6d580cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.816+0000 7f6d5f7f2700 1 --2- 172.21.15.87:0/403693867 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d58070b30 0x7f6d580cab10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009880 tx=0x7f6d48009b90 comp rx=0 tx=0).stop 2023-03-30T08:11:24.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.820+0000 7f6d5f7f2700 1 -- 172.21.15.87:0/403693867 shutdown_connections 2023-03-30T08:11:24.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.820+0000 7f6d5f7f2700 1 --2- 172.21.15.87:0/403693867 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d58070b30 0x7f6d580cab10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.820+0000 7f6d5f7f2700 1 -- 172.21.15.87:0/403693867 >> 172.21.15.87:0/403693867 conn(0x7f6d580ce960 msgr2=0x7f6d580ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:24.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.820+0000 7f6d5f7f2700 1 -- 172.21.15.87:0/403693867 shutdown_connections 2023-03-30T08:11:24.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.820+0000 7f6d5f7f2700 1 -- 172.21.15.87:0/403693867 wait complete. 2023-03-30T08:11:24.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.820+0000 7f6d5f7f2700 1 Processor -- start 2023-03-30T08:11:24.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.820+0000 7f6d5f7f2700 1 -- start start 2023-03-30T08:11:24.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.820+0000 7f6d5f7f2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d58070b30 0x7f6d58155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.820+0000 7f6d5f7f2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d580b41c0 0x7f6d58154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.820+0000 7f6d5f7f2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d580c8fb0 0x7f6d580c3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.820+0000 7f6d5f7f2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5806d750 con 0x7f6d58070b30 2023-03-30T08:11:24.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.820+0000 7f6d5f7f2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d581f2dc0 con 0x7f6d580b41c0 2023-03-30T08:11:24.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.820+0000 7f6d5f7f2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5806d9a0 con 0x7f6d580c8fb0 2023-03-30T08:11:24.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d5d58e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d58070b30 0x7f6d58155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d5d58e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d58070b30 0x7f6d58155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52200/0 (socket says 172.21.15.87:52200) 2023-03-30T08:11:24.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d5d58e700 1 -- 172.21.15.87:0/4147828691 learned_addr learned my addr 172.21.15.87:0/4147828691 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:24.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d5cd8d700 1 --2- 172.21.15.87:0/4147828691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d580b41c0 0x7f6d58154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d5dd8f700 1 --2- 172.21.15.87:0/4147828691 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d580c8fb0 0x7f6d580c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d5d58e700 1 -- 172.21.15.87:0/4147828691 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d580c8fb0 msgr2=0x7f6d580c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d5d58e700 1 --2- 172.21.15.87:0/4147828691 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d580c8fb0 0x7f6d580c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d5d58e700 1 -- 172.21.15.87:0/4147828691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d580b41c0 msgr2=0x7f6d58154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:24.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d5d58e700 1 --2- 172.21.15.87:0/4147828691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d580b41c0 0x7f6d58154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:24.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d5d58e700 1 -- 172.21.15.87:0/4147828691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d480094b0 con 0x7f6d58070b30 2023-03-30T08:11:24.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d5d58e700 1 --2- 172.21.15.87:0/4147828691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d58070b30 0x7f6d58155100 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400c560 tx=0x7f6d5400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:24.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d4dffb700 1 -- 172.21.15.87:0/4147828691 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54005d90 con 0x7f6d58070b30 2023-03-30T08:11:24.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d4dffb700 1 -- 172.21.15.87:0/4147828691 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d540070d0 con 0x7f6d58070b30 2023-03-30T08:11:24.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d5f7f2700 1 -- 172.21.15.87:0/4147828691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5815df90 con 0x7f6d58070b30 2023-03-30T08:11:24.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d4dffb700 1 -- 172.21.15.87:0/4147828691 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54007460 con 0x7f6d58070b30 2023-03-30T08:11:24.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.824+0000 7f6d5f7f2700 1 -- 172.21.15.87:0/4147828691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d580c93f0 con 0x7f6d58070b30 2023-03-30T08:11:24.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.828+0000 7f6d5f7f2700 1 -- 172.21.15.87:0/4147828691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5815e270 con 0x7f6d58070b30 2023-03-30T08:11:24.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.828+0000 7f6d4dffb700 1 -- 172.21.15.87:0/4147828691 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6d540075c0 con 0x7f6d58070b30 2023-03-30T08:11:24.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.828+0000 7f6d4dffb700 1 --2- 172.21.15.87:0/4147828691 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6d3c0653f0 0x7f6d3c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:24.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.828+0000 7f6d4dffb700 1 -- 172.21.15.87:0/4147828691 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6d54081fd0 con 0x7f6d58070b30 2023-03-30T08:11:24.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.828+0000 7f6d5cd8d700 1 --2- 172.21.15.87:0/4147828691 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6d3c0653f0 0x7f6d3c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:24.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.832+0000 7f6d5cd8d700 1 --2- 172.21.15.87:0/4147828691 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6d3c0653f0 0x7f6d3c0678a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6d58070f20 tx=0x7f6d4801c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:24.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:24.832+0000 7f6d4dffb700 1 -- 172.21.15.87:0/4147828691 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f6d5404f950 con 0x7f6d58070b30 2023-03-30T08:11:25.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.004+0000 7f6d5f7f2700 1 -- 172.21.15.87:0/4147828691 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6d58073ee0 con 0x7f6d58070b30 2023-03-30T08:11:25.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.004+0000 7f6d4dffb700 1 -- 172.21.15.87:0/4147828691 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6d54052f70 con 0x7f6d58070b30 2023-03-30T08:11:25.009 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T08:11:25.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.008+0000 7f6d5f7f2700 1 -- 172.21.15.87:0/4147828691 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6d3c0653f0 msgr2=0x7f6d3c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.008+0000 7f6d5f7f2700 1 --2- 172.21.15.87:0/4147828691 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6d3c0653f0 0x7f6d3c0678a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6d58070f20 tx=0x7f6d4801c040 comp rx=0 tx=0).stop 2023-03-30T08:11:25.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.008+0000 7f6d5f7f2700 1 -- 172.21.15.87:0/4147828691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d58070b30 msgr2=0x7f6d58155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.008+0000 7f6d5f7f2700 1 --2- 172.21.15.87:0/4147828691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d58070b30 0x7f6d58155100 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400c560 tx=0x7f6d5400c870 comp rx=0 tx=0).stop 2023-03-30T08:11:25.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.008+0000 7f6d5f7f2700 1 -- 172.21.15.87:0/4147828691 shutdown_connections 2023-03-30T08:11:25.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.008+0000 7f6d5f7f2700 1 --2- 172.21.15.87:0/4147828691 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6d3c0653f0 0x7f6d3c0678a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.008+0000 7f6d5f7f2700 1 --2- 172.21.15.87:0/4147828691 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6d580c8fb0 0x7f6d580c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.008+0000 7f6d5f7f2700 1 --2- 172.21.15.87:0/4147828691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d580b41c0 0x7f6d58154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.008+0000 7f6d5f7f2700 1 --2- 172.21.15.87:0/4147828691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d58070b30 0x7f6d58155100 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.008+0000 7f6d5f7f2700 1 -- 172.21.15.87:0/4147828691 >> 172.21.15.87:0/4147828691 conn(0x7f6d580ce960 msgr2=0x7f6d580b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:25.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.012+0000 7f6d5f7f2700 1 -- 172.21.15.87:0/4147828691 shutdown_connections 2023-03-30T08:11:25.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.012+0000 7f6d5f7f2700 1 -- 172.21.15.87:0/4147828691 wait complete. 2023-03-30T08:11:25.036 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-30T08:11:25.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.192+0000 7f570632d700 1 Processor -- start 2023-03-30T08:11:25.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.192+0000 7f570632d700 1 -- start start 2023-03-30T08:11:25.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f570632d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f570015c7a0 0x7f57001601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f570632d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f57000cde00 0x7f57000ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f570632d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57000cebf0 0x7f57000700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f570632d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57001611d0 con 0x7f570015c7a0 2023-03-30T08:11:25.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f570632d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5700160720 con 0x7f57000cde00 2023-03-30T08:11:25.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f570632d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57000cf070 con 0x7f57000cebf0 2023-03-30T08:11:25.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f56fffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f570015c7a0 0x7f57001601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f56fffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f570015c7a0 0x7f57001601e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52210/0 (socket says 172.21.15.87:52210) 2023-03-30T08:11:25.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f56fffff700 1 -- 172.21.15.87:0/3025541004 learned_addr learned my addr 172.21.15.87:0/3025541004 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:25.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f56f77fe700 1 --2- 172.21.15.87:0/3025541004 >> v2:172.21.15.115:3300/0 conn(0x7f57000cde00 0x7f57000ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f57048ca700 1 --2- 172.21.15.87:0/3025541004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57000cebf0 0x7f57000700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f56fffff700 1 -- 172.21.15.87:0/3025541004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57000cebf0 msgr2=0x7f57000700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:25.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f56fffff700 1 --2- 172.21.15.87:0/3025541004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57000cebf0 0x7f57000700c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f56fffff700 1 -- 172.21.15.87:0/3025541004 >> v2:172.21.15.115:3300/0 conn(0x7f57000cde00 msgr2=0x7f57000ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:25.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f56fffff700 1 --2- 172.21.15.87:0/3025541004 >> v2:172.21.15.115:3300/0 conn(0x7f57000cde00 0x7f57000ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f56fffff700 1 -- 172.21.15.87:0/3025541004 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57000d0950 con 0x7f570015c7a0 2023-03-30T08:11:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f56fffff700 1 --2- 172.21.15.87:0/3025541004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f570015c7a0 0x7f57001601e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f57000ce610 tx=0x7f56f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b16d35c22c1dc17 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:25.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f56ff7fe700 1 -- 172.21.15.87:0/3025541004 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f000e070 con 0x7f570015c7a0 2023-03-30T08:11:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f56ff7fe700 1 -- 172.21.15.87:0/3025541004 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f000b910 con 0x7f570015c7a0 2023-03-30T08:11:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.196+0000 7f56ff7fe700 1 -- 172.21.15.87:0/3025541004 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f000bcc0 con 0x7f570015c7a0 2023-03-30T08:11:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.200+0000 7f570632d700 1 -- 172.21.15.87:0/3025541004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f570015c7a0 msgr2=0x7f57001601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.200+0000 7f570632d700 1 --2- 172.21.15.87:0/3025541004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f570015c7a0 0x7f57001601e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f57000ce610 tx=0x7f56f000b330 comp rx=0 tx=0).stop 2023-03-30T08:11:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.200+0000 7f570632d700 1 -- 172.21.15.87:0/3025541004 shutdown_connections 2023-03-30T08:11:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.200+0000 7f570632d700 1 --2- 172.21.15.87:0/3025541004 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57000cebf0 0x7f57000700c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.200+0000 7f570632d700 1 --2- 172.21.15.87:0/3025541004 >> v2:172.21.15.115:3300/0 conn(0x7f57000cde00 0x7f57000ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.200+0000 7f570632d700 1 --2- 172.21.15.87:0/3025541004 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f570015c7a0 0x7f57001601e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.200+0000 7f570632d700 1 -- 172.21.15.87:0/3025541004 >> 172.21.15.87:0/3025541004 conn(0x7f570006f340 msgr2=0x7f57000cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:25.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.200+0000 7f570632d700 1 -- 172.21.15.87:0/3025541004 shutdown_connections 2023-03-30T08:11:25.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.200+0000 7f570632d700 1 -- 172.21.15.87:0/3025541004 wait complete. 2023-03-30T08:11:25.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.200+0000 7f570632d700 1 Processor -- start 2023-03-30T08:11:25.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.200+0000 7f570632d700 1 -- start start 2023-03-30T08:11:25.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f570632d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57000cde00 0x7f57000ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f570632d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57000cebf0 0x7f57001f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f570632d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f570015c7a0 0x7f57000c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f570632d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57000ca7b0 con 0x7f57000cebf0 2023-03-30T08:11:25.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f570632d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5700154a90 con 0x7f57000cde00 2023-03-30T08:11:25.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f570632d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57000c94a0 con 0x7f570015c7a0 2023-03-30T08:11:25.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f56f77fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57000cebf0 0x7f57001f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f56f77fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57000cebf0 0x7f57001f1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52212/0 (socket says 172.21.15.87:52212) 2023-03-30T08:11:25.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f56f77fe700 1 -- 172.21.15.87:0/830673018 learned_addr learned my addr 172.21.15.87:0/830673018 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:25.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f56fffff700 1 --2- 172.21.15.87:0/830673018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57000cde00 0x7f57000ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f57048ca700 1 --2- 172.21.15.87:0/830673018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f570015c7a0 0x7f57000c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f56f77fe700 1 -- 172.21.15.87:0/830673018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f570015c7a0 msgr2=0x7f57000c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f56f77fe700 1 --2- 172.21.15.87:0/830673018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f570015c7a0 0x7f57000c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f56f77fe700 1 -- 172.21.15.87:0/830673018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57000cde00 msgr2=0x7f57000ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f56f77fe700 1 --2- 172.21.15.87:0/830673018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57000cde00 0x7f57000ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f56f77fe700 1 -- 172.21.15.87:0/830673018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f0009b30 con 0x7f57000cebf0 2023-03-30T08:11:25.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f56f77fe700 1 --2- 172.21.15.87:0/830673018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57000cebf0 0x7f57001f1700 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f56e800e9d0 tx=0x7f56e800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:25.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f56fd7fa700 1 -- 172.21.15.87:0/830673018 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e8009720 con 0x7f57000cebf0 2023-03-30T08:11:25.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f56fd7fa700 1 -- 172.21.15.87:0/830673018 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e800ee70 con 0x7f57000cebf0 2023-03-30T08:11:25.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f56fd7fa700 1 -- 172.21.15.87:0/830673018 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e800ca50 con 0x7f57000cebf0 2023-03-30T08:11:25.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f570632d700 1 -- 172.21.15.87:0/830673018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5700160c10 con 0x7f57000cebf0 2023-03-30T08:11:25.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.204+0000 7f570632d700 1 -- 172.21.15.87:0/830673018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5700160930 con 0x7f57000cebf0 2023-03-30T08:11:25.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.208+0000 7f570632d700 1 -- 172.21.15.87:0/830673018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5700160ef0 con 0x7f57000cebf0 2023-03-30T08:11:25.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.208+0000 7f56fd7fa700 1 -- 172.21.15.87:0/830673018 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f56e800cbb0 con 0x7f57000cebf0 2023-03-30T08:11:25.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.208+0000 7f56fd7fa700 1 --2- 172.21.15.87:0/830673018 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f56e00653f0 0x7f56e00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.208+0000 7f56fd7fa700 1 -- 172.21.15.87:0/830673018 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f56e8082bb0 con 0x7f57000cebf0 2023-03-30T08:11:25.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.208+0000 7f56fffff700 1 --2- 172.21.15.87:0/830673018 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f56e00653f0 0x7f56e00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.212+0000 7f56fffff700 1 --2- 172.21.15.87:0/830673018 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f56e00653f0 0x7f56e00678a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56f000b370 tx=0x7f56f0009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:25.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.216+0000 7f56fd7fa700 1 -- 172.21.15.87:0/830673018 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f56e8053ed0 con 0x7f57000cebf0 2023-03-30T08:11:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.376+0000 7f570632d700 1 -- 172.21.15.87:0/830673018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5700073ee0 con 0x7f57000cebf0 2023-03-30T08:11:25.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.380+0000 7f56fd7fa700 1 -- 172.21.15.87:0/830673018 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56e800ce60 con 0x7f57000cebf0 2023-03-30T08:11:25.384 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:25.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.380+0000 7f570632d700 1 -- 172.21.15.87:0/830673018 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f56e00653f0 msgr2=0x7f56e00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.380+0000 7f570632d700 1 --2- 172.21.15.87:0/830673018 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f56e00653f0 0x7f56e00678a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56f000b370 tx=0x7f56f0009000 comp rx=0 tx=0).stop 2023-03-30T08:11:25.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.380+0000 7f570632d700 1 -- 172.21.15.87:0/830673018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57000cebf0 msgr2=0x7f57001f1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.380+0000 7f570632d700 1 --2- 172.21.15.87:0/830673018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57000cebf0 0x7f57001f1700 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f56e800e9d0 tx=0x7f56e800ece0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.380+0000 7f570632d700 1 -- 172.21.15.87:0/830673018 shutdown_connections 2023-03-30T08:11:25.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.380+0000 7f570632d700 1 --2- 172.21.15.87:0/830673018 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f56e00653f0 0x7f56e00678a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.380+0000 7f570632d700 1 --2- 172.21.15.87:0/830673018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f570015c7a0 0x7f57000c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.380+0000 7f570632d700 1 --2- 172.21.15.87:0/830673018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57000cebf0 0x7f57001f1700 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.380+0000 7f570632d700 1 --2- 172.21.15.87:0/830673018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57000cde00 0x7f57000ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.380+0000 7f570632d700 1 -- 172.21.15.87:0/830673018 >> 172.21.15.87:0/830673018 conn(0x7f570006f340 msgr2=0x7f57000b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:25.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.380+0000 7f570632d700 1 -- 172.21.15.87:0/830673018 shutdown_connections 2023-03-30T08:11:25.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.380+0000 7f570632d700 1 -- 172.21.15.87:0/830673018 wait complete. 2023-03-30T08:11:25.406 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-30T08:11:25.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.560+0000 7f42833a8700 1 Processor -- start 2023-03-30T08:11:25.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.560+0000 7f42833a8700 1 -- start start 2023-03-30T08:11:25.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.564+0000 7f42833a8700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f427c0b3f30 0x7f427c0b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.564+0000 7f42833a8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427c06a6e0 0x7f427c0aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.564+0000 7f42833a8700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427c06b670 con 0x7f427c0af180 2023-03-30T08:11:25.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.564+0000 7f42833a8700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427c0af600 con 0x7f427c0b3f30 2023-03-30T08:11:25.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.564+0000 7f42833a8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c06b0b0 con 0x7f427c06a6e0 2023-03-30T08:11:25.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.564+0000 7f42823a6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f427c0b3f30 0x7f427c0b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.564+0000 7f42823a6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f427c0b3f30 0x7f427c0b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52226/0 (socket says 172.21.15.87:52226) 2023-03-30T08:11:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.564+0000 7f42823a6700 1 -- 172.21.15.87:0/1801616938 learned_addr learned my addr 172.21.15.87:0/1801616938 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.564+0000 7f4281ba5700 1 --2- 172.21.15.87:0/1801616938 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427c06a6e0 0x7f427c0aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.564+0000 7f42823a6700 1 -- 172.21.15.87:0/1801616938 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427c06a6e0 msgr2=0x7f427c0aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.564+0000 7f42823a6700 1 --2- 172.21.15.87:0/1801616938 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427c06a6e0 0x7f427c0aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.564+0000 7f42823a6700 1 -- 172.21.15.87:0/1801616938 >> v1:172.21.15.87:6789/0 conn(0x7f427c0af180 legacy=0x7f427c15ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.564+0000 7f42823a6700 1 -- 172.21.15.87:0/1801616938 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c06b390 con 0x7f427c0b3f30 2023-03-30T08:11:25.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.564+0000 7f4281ba5700 1 --2- 172.21.15.87:0/1801616938 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427c06a6e0 0x7f427c0aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:25.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.564+0000 7f42823a6700 1 --2- 172.21.15.87:0/1801616938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0b3f30 0x7f427c0b0c10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4278009910 tx=0x7f4278009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567a635420361195 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:25.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.568+0000 7f42813a4700 1 -- 172.21.15.87:0/1801616938 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800ba60 con 0x7f427c0b3f30 2023-03-30T08:11:25.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.568+0000 7f42813a4700 1 -- 172.21.15.87:0/1801616938 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427800bbc0 con 0x7f427c0b3f30 2023-03-30T08:11:25.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.568+0000 7f42813a4700 1 -- 172.21.15.87:0/1801616938 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278009e60 con 0x7f427c0b3f30 2023-03-30T08:11:25.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.568+0000 7f42833a8700 1 -- 172.21.15.87:0/1801616938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0b3f30 msgr2=0x7f427c0b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.568+0000 7f42833a8700 1 --2- 172.21.15.87:0/1801616938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0b3f30 0x7f427c0b0c10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4278009910 tx=0x7f4278009c20 comp rx=0 tx=0).stop 2023-03-30T08:11:25.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.568+0000 7f42833a8700 1 -- 172.21.15.87:0/1801616938 shutdown_connections 2023-03-30T08:11:25.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.568+0000 7f42833a8700 1 --2- 172.21.15.87:0/1801616938 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427c06a6e0 0x7f427c0aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.568+0000 7f42833a8700 1 --2- 172.21.15.87:0/1801616938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0b3f30 0x7f427c0b0c10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.568+0000 7f42833a8700 1 -- 172.21.15.87:0/1801616938 >> 172.21.15.87:0/1801616938 conn(0x7f427c0cf410 msgr2=0x7f427c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:25.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.568+0000 7f42833a8700 1 -- 172.21.15.87:0/1801616938 shutdown_connections 2023-03-30T08:11:25.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.568+0000 7f42833a8700 1 -- 172.21.15.87:0/1801616938 wait complete. 2023-03-30T08:11:25.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f42833a8700 1 Processor -- start 2023-03-30T08:11:25.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f42833a8700 1 -- start start 2023-03-30T08:11:25.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f42833a8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f427c06a6e0 0x7f427c152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f42833a8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0af180 0x7f427c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f42833a8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427c0b3f30 0x7f427c15c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f42833a8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c15b4c0 con 0x7f427c0af180 2023-03-30T08:11:25.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f42833a8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c15a8b0 con 0x7f427c06a6e0 2023-03-30T08:11:25.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f42833a8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c15ab90 con 0x7f427c0b3f30 2023-03-30T08:11:25.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f4281ba5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0af180 0x7f427c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f4281ba5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0af180 0x7f427c15bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52230/0 (socket says 172.21.15.87:52230) 2023-03-30T08:11:25.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f4281ba5700 1 -- 172.21.15.87:0/2429861838 learned_addr learned my addr 172.21.15.87:0/2429861838 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:25.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f4282ba7700 1 --2- 172.21.15.87:0/2429861838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427c0b3f30 0x7f427c15c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f42823a6700 1 --2- 172.21.15.87:0/2429861838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f427c06a6e0 0x7f427c152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f4281ba5700 1 -- 172.21.15.87:0/2429861838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427c0b3f30 msgr2=0x7f427c15c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f4281ba5700 1 --2- 172.21.15.87:0/2429861838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427c0b3f30 0x7f427c15c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f4281ba5700 1 -- 172.21.15.87:0/2429861838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f427c06a6e0 msgr2=0x7f427c152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f4281ba5700 1 --2- 172.21.15.87:0/2429861838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f427c06a6e0 0x7f427c152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f4281ba5700 1 -- 172.21.15.87:0/2429861838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278009570 con 0x7f427c0af180 2023-03-30T08:11:25.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f4281ba5700 1 --2- 172.21.15.87:0/2429861838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0af180 0x7f427c15bf30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f426c010ac0 tx=0x7f426c010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:25.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f4272ffd700 1 -- 172.21.15.87:0/2429861838 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c00ea00 con 0x7f427c0af180 2023-03-30T08:11:25.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f4272ffd700 1 -- 172.21.15.87:0/2429861838 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c00eb60 con 0x7f427c0af180 2023-03-30T08:11:25.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f42833a8700 1 -- 172.21.15.87:0/2429861838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427c0ae1b0 con 0x7f427c0af180 2023-03-30T08:11:25.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f4272ffd700 1 -- 172.21.15.87:0/2429861838 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c016420 con 0x7f427c0af180 2023-03-30T08:11:25.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.572+0000 7f42833a8700 1 -- 172.21.15.87:0/2429861838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c0aded0 con 0x7f427c0af180 2023-03-30T08:11:25.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.576+0000 7f42833a8700 1 -- 172.21.15.87:0/2429861838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427c0b4300 con 0x7f427c0af180 2023-03-30T08:11:25.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.576+0000 7f4272ffd700 1 -- 172.21.15.87:0/2429861838 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f426c016580 con 0x7f427c0af180 2023-03-30T08:11:25.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.576+0000 7f4272ffd700 1 --2- 172.21.15.87:0/2429861838 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f42600653f0 0x7f42600678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.580+0000 7f4272ffd700 1 -- 172.21.15.87:0/2429861838 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f426c087130 con 0x7f427c0af180 2023-03-30T08:11:25.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.580+0000 7f42823a6700 1 --2- 172.21.15.87:0/2429861838 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f42600653f0 0x7f42600678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.580+0000 7f42823a6700 1 --2- 172.21.15.87:0/2429861838 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f42600653f0 0x7f42600678a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4278000c00 tx=0x7f4278008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:25.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.584+0000 7f4272ffd700 1 -- 172.21.15.87:0/2429861838 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f426c054a70 con 0x7f427c0af180 2023-03-30T08:11:25.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.748+0000 7f42833a8700 1 -- 172.21.15.87:0/2429861838 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f427c0733a0 con 0x7f427c0af180 2023-03-30T08:11:25.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.752+0000 7f4272ffd700 1 -- 172.21.15.87:0/2429861838 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f426c058090 con 0x7f427c0af180 2023-03-30T08:11:25.756 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-03-30T08:11:25.760 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.756+0000 7f42833a8700 1 -- 172.21.15.87:0/2429861838 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f42600653f0 msgr2=0x7f42600678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.760 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.756+0000 7f42833a8700 1 --2- 172.21.15.87:0/2429861838 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f42600653f0 0x7f42600678a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4278000c00 tx=0x7f4278008030 comp rx=0 tx=0).stop 2023-03-30T08:11:25.761 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.756+0000 7f42833a8700 1 -- 172.21.15.87:0/2429861838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0af180 msgr2=0x7f427c15bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.761 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.756+0000 7f42833a8700 1 --2- 172.21.15.87:0/2429861838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0af180 0x7f427c15bf30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f426c010ac0 tx=0x7f426c010e80 comp rx=0 tx=0).stop 2023-03-30T08:11:25.761 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.756+0000 7f42833a8700 1 -- 172.21.15.87:0/2429861838 shutdown_connections 2023-03-30T08:11:25.761 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.756+0000 7f42833a8700 1 --2- 172.21.15.87:0/2429861838 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f42600653f0 0x7f42600678a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.761 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.756+0000 7f42833a8700 1 --2- 172.21.15.87:0/2429861838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f427c0b3f30 0x7f427c15c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.761 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.756+0000 7f42833a8700 1 --2- 172.21.15.87:0/2429861838 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f427c0af180 0x7f427c15bf30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.761 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.756+0000 7f42833a8700 1 --2- 172.21.15.87:0/2429861838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f427c06a6e0 0x7f427c152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.762 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.756+0000 7f42833a8700 1 -- 172.21.15.87:0/2429861838 >> 172.21.15.87:0/2429861838 conn(0x7f427c0cf410 msgr2=0x7f427c0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:25.762 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.756+0000 7f42833a8700 1 -- 172.21.15.87:0/2429861838 shutdown_connections 2023-03-30T08:11:25.762 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.756+0000 7f42833a8700 1 -- 172.21.15.87:0/2429861838 wait complete. 2023-03-30T08:11:25.780 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-30T08:11:25.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.940+0000 7fb40759e700 1 Processor -- start 2023-03-30T08:11:25.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.940+0000 7fb40759e700 1 -- start start 2023-03-30T08:11:25.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb40759e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb4080cf9c0 0x7fb40806d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb40759e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4080717d0 con 0x7fb40815c5d0 2023-03-30T08:11:25.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb40759e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4080ccc70 con 0x7fb408071290 2023-03-30T08:11:25.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb40759e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4080cfe80 con 0x7fb4080cf9c0 2023-03-30T08:11:25.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb40659c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb40815c5d0 0x7fb408070b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48642/0 (socket says 172.21.15.87:48642) 2023-03-30T08:11:25.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb40659c700 1 -- 172.21.15.87:0/3537998573 learned_addr learned my addr 172.21.15.87:0/3537998573 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:25.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb3fffff700 1 --2- 172.21.15.87:0/3537998573 >> v2:172.21.15.87:3300/0 conn(0x7fb4080cf9c0 0x7fb40806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb405d9b700 1 -- 172.21.15.87:0/3537998573 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104190227 0 0) 0x7fb4080ccc70 con 0x7fb408071290 2023-03-30T08:11:25.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb405d9b700 1 -- 172.21.15.87:0/3537998573 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3f40035d0 con 0x7fb408071290 2023-03-30T08:11:25.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb3fffff700 1 -- 172.21.15.87:0/3537998573 >> v1:172.21.15.115:6789/0 conn(0x7fb408071290 legacy=0x7fb4081601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb3fffff700 1 -- 172.21.15.87:0/3537998573 >> v1:172.21.15.87:6789/0 conn(0x7fb40815c5d0 legacy=0x7fb408070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb3fffff700 1 -- 172.21.15.87:0/3537998573 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb408071a20 con 0x7fb4080cf9c0 2023-03-30T08:11:25.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb3fffff700 1 --2- 172.21.15.87:0/3537998573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4080cf9c0 0x7fb40806d660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009850 tx=0x7fb3f0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9981ae1d3b97d608 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:25.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb405d9b700 1 -- 172.21.15.87:0/3537998573 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0011830 con 0x7fb4080cf9c0 2023-03-30T08:11:25.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb405d9b700 1 -- 172.21.15.87:0/3537998573 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f0011990 con 0x7fb4080cf9c0 2023-03-30T08:11:25.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.944+0000 7fb405d9b700 1 -- 172.21.15.87:0/3537998573 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0011d40 con 0x7fb4080cf9c0 2023-03-30T08:11:25.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.948+0000 7fb40759e700 1 -- 172.21.15.87:0/3537998573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4080cf9c0 msgr2=0x7fb40806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.948+0000 7fb40759e700 1 --2- 172.21.15.87:0/3537998573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4080cf9c0 0x7fb40806d660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009850 tx=0x7fb3f0009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:25.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.948+0000 7fb40759e700 1 -- 172.21.15.87:0/3537998573 shutdown_connections 2023-03-30T08:11:25.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.948+0000 7fb40759e700 1 --2- 172.21.15.87:0/3537998573 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4080cf9c0 0x7fb40806d660 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.948+0000 7fb40759e700 1 -- 172.21.15.87:0/3537998573 >> 172.21.15.87:0/3537998573 conn(0x7fb4080cc7b0 msgr2=0x7fb4080cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:25.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.948+0000 7fb40759e700 1 -- 172.21.15.87:0/3537998573 shutdown_connections 2023-03-30T08:11:25.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.948+0000 7fb40759e700 1 -- 172.21.15.87:0/3537998573 wait complete. 2023-03-30T08:11:25.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.948+0000 7fb40759e700 1 Processor -- start 2023-03-30T08:11:25.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.948+0000 7fb40759e700 1 -- start start 2023-03-30T08:11:25.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb40759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb408071290 0x7fb408145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb40759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4080cf9c0 0x7fb408156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb40759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb40815c5d0 0x7fb408156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb40759e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4080b2430 con 0x7fb40815c5d0 2023-03-30T08:11:25.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb40759e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4080c4b10 con 0x7fb408071290 2023-03-30T08:11:25.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb40759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4080c4df0 con 0x7fb4080cf9c0 2023-03-30T08:11:25.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb406d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb40815c5d0 0x7fb408156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb3fffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4080cf9c0 0x7fb408156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb406d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb40815c5d0 0x7fb408156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52256/0 (socket says 172.21.15.87:52256) 2023-03-30T08:11:25.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb406d9d700 1 -- 172.21.15.87:0/881363416 learned_addr learned my addr 172.21.15.87:0/881363416 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:25.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb40659c700 1 --2- 172.21.15.87:0/881363416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb408071290 0x7fb408145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb3fffff700 1 -- 172.21.15.87:0/881363416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb408071290 msgr2=0x7fb408145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb3fffff700 1 --2- 172.21.15.87:0/881363416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb408071290 0x7fb408145620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb3fffff700 1 -- 172.21.15.87:0/881363416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb40815c5d0 msgr2=0x7fb408156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:25.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb3fffff700 1 --2- 172.21.15.87:0/881363416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb40815c5d0 0x7fb408156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:25.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb3fffff700 1 -- 172.21.15.87:0/881363416 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f00094b0 con 0x7fb4080cf9c0 2023-03-30T08:11:25.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb406d9d700 1 --2- 172.21.15.87:0/881363416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb40815c5d0 0x7fb408156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb3fffff700 1 --2- 172.21.15.87:0/881363416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4080cf9c0 0x7fb408156640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0016000 tx=0x7fb3f0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb3feffd700 1 -- 172.21.15.87:0/881363416 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f001a990 con 0x7fb4080cf9c0 2023-03-30T08:11:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb3feffd700 1 -- 172.21.15.87:0/881363416 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f001f070 con 0x7fb4080cf9c0 2023-03-30T08:11:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb40759e700 1 -- 172.21.15.87:0/881363416 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40815c9a0 con 0x7fb4080cf9c0 2023-03-30T08:11:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb3feffd700 1 -- 172.21.15.87:0/881363416 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f001ad30 con 0x7fb4080cf9c0 2023-03-30T08:11:25.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.952+0000 7fb40759e700 1 -- 172.21.15.87:0/881363416 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb408071d00 con 0x7fb4080cf9c0 2023-03-30T08:11:25.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.956+0000 7fb40759e700 1 -- 172.21.15.87:0/881363416 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4080ceb70 con 0x7fb4080cf9c0 2023-03-30T08:11:25.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.956+0000 7fb3feffd700 1 -- 172.21.15.87:0/881363416 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fb3f0004070 con 0x7fb4080cf9c0 2023-03-30T08:11:25.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.960+0000 7fb3feffd700 1 --2- 172.21.15.87:0/881363416 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3e8065420 0x7fb3e80678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:25.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.960+0000 7fb3feffd700 1 -- 172.21.15.87:0/881363416 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb3f0083ef0 con 0x7fb4080cf9c0 2023-03-30T08:11:25.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.960+0000 7fb40659c700 1 --2- 172.21.15.87:0/881363416 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3e8065420 0x7fb3e80678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:25.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.960+0000 7fb40659c700 1 --2- 172.21.15.87:0/881363416 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3e8065420 0x7fb3e80678d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8005930 tx=0x7fb3f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:25.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:25.968+0000 7fb3feffd700 1 -- 172.21.15.87:0/881363416 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fb3f0051870 con 0x7fb4080cf9c0 2023-03-30T08:11:26.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.136+0000 7fb40759e700 1 -- 172.21.15.87:0/881363416 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb408072cf0 con 0x7fb4080cf9c0 2023-03-30T08:11:26.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.136+0000 7fb3feffd700 1 -- 172.21.15.87:0/881363416 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb3f0021020 con 0x7fb4080cf9c0 2023-03-30T08:11:26.141 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:26.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.140+0000 7fb40759e700 1 -- 172.21.15.87:0/881363416 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3e8065420 msgr2=0x7fb3e80678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:26.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.140+0000 7fb40759e700 1 --2- 172.21.15.87:0/881363416 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3e8065420 0x7fb3e80678d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8005930 tx=0x7fb3f8009040 comp rx=0 tx=0).stop 2023-03-30T08:11:26.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.140+0000 7fb40759e700 1 -- 172.21.15.87:0/881363416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4080cf9c0 msgr2=0x7fb408156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:26.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.140+0000 7fb40759e700 1 --2- 172.21.15.87:0/881363416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4080cf9c0 0x7fb408156640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0016000 tx=0x7fb3f0004770 comp rx=0 tx=0).stop 2023-03-30T08:11:26.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.140+0000 7fb40759e700 1 -- 172.21.15.87:0/881363416 shutdown_connections 2023-03-30T08:11:26.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.140+0000 7fb40759e700 1 --2- 172.21.15.87:0/881363416 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3e8065420 0x7fb3e80678d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:26.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.140+0000 7fb40759e700 1 --2- 172.21.15.87:0/881363416 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb40815c5d0 0x7fb408156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:26.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.140+0000 7fb40759e700 1 --2- 172.21.15.87:0/881363416 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb4080cf9c0 0x7fb408156640 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:26.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.140+0000 7fb40759e700 1 --2- 172.21.15.87:0/881363416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb408071290 0x7fb408145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:26.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.140+0000 7fb40759e700 1 -- 172.21.15.87:0/881363416 >> 172.21.15.87:0/881363416 conn(0x7fb4080cc7b0 msgr2=0x7fb4080afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:26.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.140+0000 7fb40759e700 1 -- 172.21.15.87:0/881363416 shutdown_connections 2023-03-30T08:11:26.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.140+0000 7fb40759e700 1 -- 172.21.15.87:0/881363416 wait complete. 2023-03-30T08:11:26.162 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T08:11:26.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.320+0000 7f4c0e6b1700 1 Processor -- start 2023-03-30T08:11:26.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.324+0000 7f4c0e6b1700 1 -- start start 2023-03-30T08:11:26.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.324+0000 7f4c0e6b1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c081600d0 0x7f4c0806a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:26.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.324+0000 7f4c0e6b1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4c0806aab0 0x7f4c080abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:26.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.324+0000 7f4c0e6b1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0806a0e0 con 0x7f4c080ad640 2023-03-30T08:11:26.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.324+0000 7f4c0e6b1700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c080c9db0 con 0x7f4c0806aab0 2023-03-30T08:11:26.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.324+0000 7f4c0e6b1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080ca090 con 0x7f4c081600d0 2023-03-30T08:11:26.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.324+0000 7f4c0ceae700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4c0806aab0 0x7f4c080abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:26.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.324+0000 7f4c0deb0700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f4c080ad640 0x7f4c081604a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48648/0 (socket says 172.21.15.87:48648) 2023-03-30T08:11:26.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.324+0000 7f4c0deb0700 1 -- 172.21.15.87:0/630509921 learned_addr learned my addr 172.21.15.87:0/630509921 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:26.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.324+0000 7f4c0d6af700 1 --2- 172.21.15.87:0/630509921 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c081600d0 0x7f4c0806a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:26.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.324+0000 7f4c0ceae700 1 -- 172.21.15.87:0/630509921 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c081600d0 msgr2=0x7f4c0806a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:26.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.324+0000 7f4c0ceae700 1 --2- 172.21.15.87:0/630509921 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c081600d0 0x7f4c0806a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:26.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.324+0000 7f4c0ceae700 1 -- 172.21.15.87:0/630509921 >> v1:172.21.15.87:6789/0 conn(0x7f4c080ad640 legacy=0x7f4c081604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:26.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.324+0000 7f4c0ceae700 1 -- 172.21.15.87:0/630509921 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c08069d70 con 0x7f4c0806aab0 2023-03-30T08:11:26.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.324+0000 7f4bfffff700 1 -- 172.21.15.87:0/630509921 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073130632 0 0) 0x7f4c0806a0e0 con 0x7f4c080ad640 2023-03-30T08:11:26.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.328+0000 7f4c0ceae700 1 --2- 172.21.15.87:0/630509921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c0806aab0 0x7f4c080abfe0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009850 tx=0x7f4bf8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2fa2e2861f5b89 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:26.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.328+0000 7f4bfffff700 1 -- 172.21.15.87:0/630509921 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8011830 con 0x7f4c0806aab0 2023-03-30T08:11:26.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.328+0000 7f4bfffff700 1 -- 172.21.15.87:0/630509921 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf8011990 con 0x7f4c0806aab0 2023-03-30T08:11:26.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.328+0000 7f4bfffff700 1 -- 172.21.15.87:0/630509921 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8011d40 con 0x7f4c0806aab0 2023-03-30T08:11:26.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.328+0000 7f4c0e6b1700 1 -- 172.21.15.87:0/630509921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c0806aab0 msgr2=0x7f4c080abfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:26.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.328+0000 7f4c0e6b1700 1 --2- 172.21.15.87:0/630509921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c0806aab0 0x7f4c080abfe0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009850 tx=0x7f4bf8009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:26.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.328+0000 7f4c0e6b1700 1 -- 172.21.15.87:0/630509921 shutdown_connections 2023-03-30T08:11:26.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.328+0000 7f4c0e6b1700 1 --2- 172.21.15.87:0/630509921 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c0806aab0 0x7f4c080abfe0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:26.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.328+0000 7f4c0e6b1700 1 --2- 172.21.15.87:0/630509921 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c081600d0 0x7f4c0806a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:26.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.328+0000 7f4c0e6b1700 1 -- 172.21.15.87:0/630509921 >> 172.21.15.87:0/630509921 conn(0x7f4c080cf410 msgr2=0x7f4c080cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:26.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.328+0000 7f4c0e6b1700 1 -- 172.21.15.87:0/630509921 shutdown_connections 2023-03-30T08:11:26.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.328+0000 7f4c0e6b1700 1 -- 172.21.15.87:0/630509921 wait complete. 2023-03-30T08:11:26.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.328+0000 7f4c0e6b1700 1 Processor -- start 2023-03-30T08:11:26.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.328+0000 7f4c0e6b1700 1 -- start start 2023-03-30T08:11:26.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0e6b1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c0806aab0 0x7f4c080b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:26.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0e6b1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c080ad640 0x7f4c080cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:26.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0e6b1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c081600d0 0x7f4c080ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:26.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0e6b1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080c2400 con 0x7f4c080ad640 2023-03-30T08:11:26.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0e6b1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c08140bd0 con 0x7f4c0806aab0 2023-03-30T08:11:26.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0e6b1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080c46c0 con 0x7f4c081600d0 2023-03-30T08:11:26.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0ceae700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c080ad640 0x7f4c080cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:26.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0ceae700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c080ad640 0x7f4c080cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52274/0 (socket says 172.21.15.87:52274) 2023-03-30T08:11:26.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0ceae700 1 -- 172.21.15.87:0/3062087134 learned_addr learned my addr 172.21.15.87:0/3062087134 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:26.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0d6af700 1 --2- 172.21.15.87:0/3062087134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c0806aab0 0x7f4c080b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:26.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0deb0700 1 --2- 172.21.15.87:0/3062087134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c081600d0 0x7f4c080ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:26.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0ceae700 1 -- 172.21.15.87:0/3062087134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c081600d0 msgr2=0x7f4c080ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:26.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0ceae700 1 --2- 172.21.15.87:0/3062087134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c081600d0 0x7f4c080ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:26.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0ceae700 1 -- 172.21.15.87:0/3062087134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c0806aab0 msgr2=0x7f4c080b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:26.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0ceae700 1 --2- 172.21.15.87:0/3062087134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c0806aab0 0x7f4c080b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:26.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0ceae700 1 -- 172.21.15.87:0/3062087134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80094b0 con 0x7f4c080ad640 2023-03-30T08:11:26.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0deb0700 1 --2- 172.21.15.87:0/3062087134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c081600d0 0x7f4c080ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:26.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0ceae700 1 --2- 172.21.15.87:0/3062087134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c080ad640 0x7f4c080cc6d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80090b0 tx=0x7f4bf8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:26.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4bfdffb700 1 -- 172.21.15.87:0/3062087134 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf801aa10 con 0x7f4c080ad640 2023-03-30T08:11:26.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4bfdffb700 1 -- 172.21.15.87:0/3062087134 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf801f070 con 0x7f4c080ad640 2023-03-30T08:11:26.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4bfdffb700 1 -- 172.21.15.87:0/3062087134 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf801adb0 con 0x7f4c080ad640 2023-03-30T08:11:26.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0e6b1700 1 -- 172.21.15.87:0/3062087134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c080addc0 con 0x7f4c080ad640 2023-03-30T08:11:26.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.332+0000 7f4c0e6b1700 1 -- 172.21.15.87:0/3062087134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c080ca370 con 0x7f4c080ad640 2023-03-30T08:11:26.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.336+0000 7f4c0e6b1700 1 -- 172.21.15.87:0/3062087134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0815d8c0 con 0x7f4c080ad640 2023-03-30T08:11:26.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.336+0000 7f4bfdffb700 1 -- 172.21.15.87:0/3062087134 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f4bf801b430 con 0x7f4c080ad640 2023-03-30T08:11:26.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.336+0000 7f4bfdffb700 1 --2- 172.21.15.87:0/3062087134 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4bec0653f0 0x7f4bec0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:26.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.336+0000 7f4bfdffb700 1 -- 172.21.15.87:0/3062087134 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4bf8083d50 con 0x7f4c080ad640 2023-03-30T08:11:26.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.336+0000 7f4c0d6af700 1 --2- 172.21.15.87:0/3062087134 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4bec0653f0 0x7f4bec0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:26.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.340+0000 7f4c0d6af700 1 --2- 172.21.15.87:0/3062087134 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4bec0653f0 0x7f4bec0678a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4c081f5250 tx=0x7f4c04009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:26.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.344+0000 7f4bfdffb700 1 -- 172.21.15.87:0/3062087134 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f4bf8051670 con 0x7f4c080ad640 2023-03-30T08:11:26.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.556+0000 7f4c0e6b1700 1 -- 172.21.15.87:0/3062087134 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c08140980 con 0x7f4c080ad640 2023-03-30T08:11:26.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.556+0000 7f4bfdffb700 1 -- 172.21.15.87:0/3062087134 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f4bf8015020 con 0x7f4c080ad640 2023-03-30T08:11:26.562 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:26.563 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2818344230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2818344230},{"type":"v1","addr":"172.21.15.115:6833","nonce":2818344230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3891185444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3891185444},{"type":"v1","addr":"172.21.15.87:6836","nonce":3891185444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3443119914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3443119914},{"type":"v1","addr":"172.21.15.87:6837","nonce":3443119914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-30T08:10:58.351331+0000","modified":"2023-03-30T08:11:17.023824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3640886103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3640886103},{"type":"v1","addr":"172.21.15.115:6835","nonce":3640886103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-30T08:11:26.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.560+0000 7f4c0e6b1700 1 -- 172.21.15.87:0/3062087134 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4bec0653f0 msgr2=0x7f4bec0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:26.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.560+0000 7f4c0e6b1700 1 --2- 172.21.15.87:0/3062087134 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4bec0653f0 0x7f4bec0678a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4c081f5250 tx=0x7f4c04009240 comp rx=0 tx=0).stop 2023-03-30T08:11:26.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.560+0000 7f4c0e6b1700 1 -- 172.21.15.87:0/3062087134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c080ad640 msgr2=0x7f4c080cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:26.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.560+0000 7f4c0e6b1700 1 --2- 172.21.15.87:0/3062087134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c080ad640 0x7f4c080cc6d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80090b0 tx=0x7f4bf8004770 comp rx=0 tx=0).stop 2023-03-30T08:11:26.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.560+0000 7f4c0e6b1700 1 -- 172.21.15.87:0/3062087134 shutdown_connections 2023-03-30T08:11:26.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.560+0000 7f4c0e6b1700 1 --2- 172.21.15.87:0/3062087134 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4bec0653f0 0x7f4bec0678a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:26.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.560+0000 7f4c0e6b1700 1 --2- 172.21.15.87:0/3062087134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c081600d0 0x7f4c080ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:26.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.560+0000 7f4c0e6b1700 1 --2- 172.21.15.87:0/3062087134 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4c080ad640 0x7f4c080cc6d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:26.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.560+0000 7f4c0e6b1700 1 --2- 172.21.15.87:0/3062087134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c0806aab0 0x7f4c080b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:26.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.560+0000 7f4c0e6b1700 1 -- 172.21.15.87:0/3062087134 >> 172.21.15.87:0/3062087134 conn(0x7f4c080cf410 msgr2=0x7f4c08070180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:26.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.560+0000 7f4c0e6b1700 1 -- 172.21.15.87:0/3062087134 shutdown_connections 2023-03-30T08:11:26.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:26.560+0000 7f4c0e6b1700 1 -- 172.21.15.87:0/3062087134 wait complete. 2023-03-30T08:11:26.568 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2023-03-30T08:11:26.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-30T08:10:58.351331+0000', 'modified': '2023-03-30T08:11:17.023824+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6835/3640886103', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 3640886103}, {'type': 'v1', 'addr': '172.21.15.115:6835', 'nonce': 3640886103}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-30T08:11:26.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-30T08:11:26.988 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-03-30T08:11:27.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.148+0000 7fd13eb96700 1 Processor -- start 2023-03-30T08:11:27.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd13eb96700 1 -- start start 2023-03-30T08:11:27.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd13eb96700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1380b41c0 0x7fd1380cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd13eb96700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd138070b30 0x7fd1380cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd13eb96700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13815e8c0 con 0x7fd1380c8fb0 2023-03-30T08:11:27.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd13eb96700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13815ed50 con 0x7fd138070b30 2023-03-30T08:11:27.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd13eb96700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380c96b0 con 0x7fd1380b41c0 2023-03-30T08:11:27.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd13c932700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1380b41c0 0x7fd1380cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd13c932700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1380b41c0 0x7fd1380cab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:34448/0 (socket says 172.21.15.87:34448) 2023-03-30T08:11:27.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd13c932700 1 -- 172.21.15.87:0/1796027299 learned_addr learned my addr 172.21.15.87:0/1796027299 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:27.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd137fff700 1 --1- 172.21.15.87:0/1796027299 >> v1:172.21.15.87:6789/0 conn(0x7fd1380c8fb0 0x7fd138070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48660/0 (socket says 172.21.15.87:48660) 2023-03-30T08:11:27.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd13d133700 1 --2- 172.21.15.87:0/1796027299 >> v2:172.21.15.115:3300/0 conn(0x7fd138070b30 0x7fd1380cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd13c932700 1 -- 172.21.15.87:0/1796027299 >> v2:172.21.15.115:3300/0 conn(0x7fd138070b30 msgr2=0x7fd1380cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:27.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd13c932700 1 --2- 172.21.15.87:0/1796027299 >> v2:172.21.15.115:3300/0 conn(0x7fd138070b30 0x7fd1380cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd13c932700 1 -- 172.21.15.87:0/1796027299 >> v1:172.21.15.87:6789/0 conn(0x7fd1380c8fb0 legacy=0x7fd138070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:27.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd13c932700 1 -- 172.21.15.87:0/1796027299 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1380c9400 con 0x7fd1380b41c0 2023-03-30T08:11:27.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.152+0000 7fd13d133700 1 --2- 172.21.15.87:0/1796027299 >> v2:172.21.15.115:3300/0 conn(0x7fd138070b30 0x7fd1380cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:27.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.156+0000 7fd13c932700 1 --2- 172.21.15.87:0/1796027299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1380b41c0 0x7fd1380cab10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009910 tx=0x7fd12c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b13404d55785692c server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:27.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.156+0000 7fd1377fe700 1 -- 172.21.15.87:0/1796027299 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c00ba60 con 0x7fd1380b41c0 2023-03-30T08:11:27.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.156+0000 7fd1377fe700 1 -- 172.21.15.87:0/1796027299 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c00bbc0 con 0x7fd1380b41c0 2023-03-30T08:11:27.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.156+0000 7fd1377fe700 1 -- 172.21.15.87:0/1796027299 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c009e60 con 0x7fd1380b41c0 2023-03-30T08:11:27.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.156+0000 7fd13eb96700 1 -- 172.21.15.87:0/1796027299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1380b41c0 msgr2=0x7fd1380cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:27.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.156+0000 7fd13eb96700 1 --2- 172.21.15.87:0/1796027299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1380b41c0 0x7fd1380cab10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009910 tx=0x7fd12c009c20 comp rx=0 tx=0).stop 2023-03-30T08:11:27.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.156+0000 7fd13eb96700 1 -- 172.21.15.87:0/1796027299 shutdown_connections 2023-03-30T08:11:27.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.156+0000 7fd13eb96700 1 --2- 172.21.15.87:0/1796027299 >> v2:172.21.15.115:3300/0 conn(0x7fd138070b30 0x7fd1380cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.156+0000 7fd13eb96700 1 --2- 172.21.15.87:0/1796027299 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1380b41c0 0x7fd1380cab10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.156+0000 7fd13eb96700 1 -- 172.21.15.87:0/1796027299 >> 172.21.15.87:0/1796027299 conn(0x7fd1380ce960 msgr2=0x7fd1380ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:27.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.156+0000 7fd13eb96700 1 -- 172.21.15.87:0/1796027299 shutdown_connections 2023-03-30T08:11:27.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.156+0000 7fd13eb96700 1 -- 172.21.15.87:0/1796027299 wait complete. 2023-03-30T08:11:27.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13eb96700 1 Processor -- start 2023-03-30T08:11:27.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13eb96700 1 -- start start 2023-03-30T08:11:27.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13eb96700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd138070b30 0x7fd1380c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13eb96700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1380b41c0 0x7fd1381f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13eb96700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1380c8fb0 0x7fd1381f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13eb96700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd138146850 con 0x7fd1380c8fb0 2023-03-30T08:11:27.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13eb96700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13815c600 con 0x7fd138070b30 2023-03-30T08:11:27.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13eb96700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13815c050 con 0x7fd1380b41c0 2023-03-30T08:11:27.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13d133700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1380c8fb0 0x7fd1381f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13c932700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd138070b30 0x7fd1380c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13c932700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd138070b30 0x7fd1380c7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:34656/0 (socket says 172.21.15.87:34656) 2023-03-30T08:11:27.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13c932700 1 -- 172.21.15.87:0/855425084 learned_addr learned my addr 172.21.15.87:0/855425084 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:27.168 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd137fff700 1 --2- 172.21.15.87:0/855425084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1380b41c0 0x7fd1381f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13c932700 1 -- 172.21.15.87:0/855425084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1380b41c0 msgr2=0x7fd1381f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:27.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13c932700 1 --2- 172.21.15.87:0/855425084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1380b41c0 0x7fd1381f3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13c932700 1 -- 172.21.15.87:0/855425084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1380c8fb0 msgr2=0x7fd1381f36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:27.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13c932700 1 --2- 172.21.15.87:0/855425084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1380c8fb0 0x7fd1381f36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13c932700 1 -- 172.21.15.87:0/855425084 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c009570 con 0x7fd138070b30 2023-03-30T08:11:27.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.160+0000 7fd13d133700 1 --2- 172.21.15.87:0/855425084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1380c8fb0 0x7fd1381f36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:27.169 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.164+0000 7fd13c932700 1 --2- 172.21.15.87:0/855425084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd138070b30 0x7fd1380c7490 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd12c000c00 tx=0x7fd12c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:27.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.164+0000 7fd1357fa700 1 -- 172.21.15.87:0/855425084 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c004450 con 0x7fd138070b30 2023-03-30T08:11:27.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.164+0000 7fd1357fa700 1 -- 172.21.15.87:0/855425084 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c0045b0 con 0x7fd138070b30 2023-03-30T08:11:27.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.164+0000 7fd13eb96700 1 -- 172.21.15.87:0/855425084 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13815df90 con 0x7fd138070b30 2023-03-30T08:11:27.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.164+0000 7fd1357fa700 1 -- 172.21.15.87:0/855425084 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c003900 con 0x7fd138070b30 2023-03-30T08:11:27.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.164+0000 7fd13eb96700 1 -- 172.21.15.87:0/855425084 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1380ce720 con 0x7fd138070b30 2023-03-30T08:11:27.172 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.168+0000 7fd1357fa700 1 -- 172.21.15.87:0/855425084 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd12c003a60 con 0x7fd138070b30 2023-03-30T08:11:27.174 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.168+0000 7fd1357fa700 1 --2- 172.21.15.87:0/855425084 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd11c065440 0x7fd11c0678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd1357fa700 1 -- 172.21.15.87:0/855425084 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd12c083b10 con 0x7fd138070b30 2023-03-30T08:11:27.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd137fff700 1 --2- 172.21.15.87:0/855425084 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd11c065440 0x7fd11c0678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd141e1e740 1 Processor -- start 2023-03-30T08:11:27.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd141e1e740 1 -- start start 2023-03-30T08:11:27.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd137fff700 1 --2- 172.21.15.87:0/855425084 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd11c065440 0x7fd11c0678f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd1380b3a50 tx=0x7fd124007f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:27.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd141e1e740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xc8fae0 0xf3f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd141e1e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8f710 0xf3fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd141e1e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xcda790 0xf0ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd141e1e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0xe1cbc0 con 0xc8f710 2023-03-30T08:11:27.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd141e1e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0xe6fa00 con 0xcda790 2023-03-30T08:11:27.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd141e1e740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0xe68c60 con 0xc8fae0 2023-03-30T08:11:27.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd137fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8f710 0xf3fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd137fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8f710 0xf3fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52284/0 (socket says 172.21.15.87:52284) 2023-03-30T08:11:27.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd137fff700 1 -- 172.21.15.87:0/253001485 learned_addr learned my addr 172.21.15.87:0/253001485 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:27.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd13c932700 1 --2- 172.21.15.87:0/253001485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xc8fae0 0xf3f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd13d133700 1 --2- 172.21.15.87:0/253001485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xcda790 0xf0ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd137fff700 1 -- 172.21.15.87:0/253001485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xc8fae0 msgr2=0xf3f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:27.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd137fff700 1 --2- 172.21.15.87:0/253001485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xc8fae0 0xf3f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd137fff700 1 -- 172.21.15.87:0/253001485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xcda790 msgr2=0xf0ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:27.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd137fff700 1 --2- 172.21.15.87:0/253001485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xcda790 0xf0ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd137fff700 1 -- 172.21.15.87:0/253001485 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe8f9b0 con 0xc8f710 2023-03-30T08:11:27.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd13c932700 1 --2- 172.21.15.87:0/253001485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xc8fae0 0xf3f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:27.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd137fff700 1 --2- 172.21.15.87:0/253001485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8f710 0xf3fa50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd124013560 tx=0x7fd124013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94af7350c2ef349 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:27.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd1227fc700 1 -- 172.21.15.87:0/253001485 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124013ce0 con 0xc8f710 2023-03-30T08:11:27.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd1227fc700 1 -- 172.21.15.87:0/253001485 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd124013e40 con 0xc8f710 2023-03-30T08:11:27.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd1227fc700 1 -- 172.21.15.87:0/253001485 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124001460 con 0xc8f710 2023-03-30T08:11:27.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd141e1e740 1 -- 172.21.15.87:0/253001485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8f710 msgr2=0xf3fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:27.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.172+0000 7fd141e1e740 1 --2- 172.21.15.87:0/253001485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8f710 0xf3fa50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd124013560 tx=0x7fd124013000 comp rx=0 tx=0).stop 2023-03-30T08:11:27.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.176+0000 7fd141e1e740 1 -- 172.21.15.87:0/253001485 shutdown_connections 2023-03-30T08:11:27.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.176+0000 7fd141e1e740 1 --2- 172.21.15.87:0/253001485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xcda790 0xf0ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.176+0000 7fd141e1e740 1 --2- 172.21.15.87:0/253001485 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8f710 0xf3fa50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.176+0000 7fd141e1e740 1 --2- 172.21.15.87:0/253001485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xc8fae0 0xf3f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.176+0000 7fd141e1e740 1 -- 172.21.15.87:0/253001485 >> 172.21.15.87:0/253001485 conn(0xc8feb0 msgr2=0xf29d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:27.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.176+0000 7fd141e1e740 1 -- 172.21.15.87:0/253001485 shutdown_connections 2023-03-30T08:11:27.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.176+0000 7fd141e1e740 1 -- 172.21.15.87:0/253001485 wait complete. 2023-03-30T08:11:27.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.176+0000 7fd141e1e740 1 -- start start 2023-03-30T08:11:27.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.176+0000 7fd141e1e740 1 Processor -- start 2023-03-30T08:11:27.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.176+0000 7fd141e1e740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xc8f710 0xf27490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.176+0000 7fd141e1e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xc8fae0 0xf40c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.176+0000 7fd141e1e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xcda790 0xf3eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.176+0000 7fd141e1e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0xd14b20 con 0xcda790 2023-03-30T08:11:27.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.176+0000 7fd141e1e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0xf01c00 con 0xc8fae0 2023-03-30T08:11:27.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.176+0000 7fd141e1e740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0xf40550 con 0xc8f710 2023-03-30T08:11:27.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd141e1e740 10 client.0 _ll_register_callbacks cb 0xebac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-30T08:11:27.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd13d133700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xcda790 0xf3eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd13d133700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xcda790 0xf3eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52286/0 (socket says 172.21.15.87:52286) 2023-03-30T08:11:27.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd13d133700 1 -- 172.21.15.87:0/1645783532 learned_addr learned my addr 172.21.15.87:0/1645783532 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:27.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd13c932700 1 --2- 172.21.15.87:0/1645783532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xc8f710 0xf27490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd137fff700 1 --2- 172.21.15.87:0/1645783532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xc8fae0 0xf40c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd13d133700 1 -- 172.21.15.87:0/1645783532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xc8f710 msgr2=0xf27490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:27.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd13d133700 1 --2- 172.21.15.87:0/1645783532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xc8f710 0xf27490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd13d133700 1 -- 172.21.15.87:0/1645783532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xc8fae0 msgr2=0xf40c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:27.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd13d133700 1 --2- 172.21.15.87:0/1645783532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xc8fae0 0xf40c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd13d133700 1 -- 172.21.15.87:0/1645783532 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13815e8c0 con 0xcda790 2023-03-30T08:11:27.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd13c932700 1 --2- 172.21.15.87:0/1645783532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xc8f710 0xf27490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:27.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd13d133700 1 --2- 172.21.15.87:0/1645783532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xcda790 0xf3eb20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd130004810 tx=0x7fd130007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd3d7f8b2c199a5 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:27.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd1177fe700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2023-03-30T08:11:27.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd1177fe700 1 -- 172.21.15.87:0/1645783532 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130016660 con 0xcda790 2023-03-30T08:11:27.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd141e1e740 1 -- 172.21.15.87:0/1645783532 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe61c40 con 0xcda790 2023-03-30T08:11:27.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd1177fe700 1 -- 172.21.15.87:0/1645783532 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd1300167c0 con 0xcda790 2023-03-30T08:11:27.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd1177fe700 1 -- 172.21.15.87:0/1645783532 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd13001fea0 con 0xcda790 2023-03-30T08:11:27.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd141e1e740 10 client.4803 fetch_fsmap learned FSMap version 9 2023-03-30T08:11:27.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd141e1e740 1 -- 172.21.15.87:0/1645783532 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0xcdb9e0 con 0xcda790 2023-03-30T08:11:27.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd1177fe700 1 -- 172.21.15.87:0/1645783532 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe61c40 con 0xcda790 2023-03-30T08:11:27.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd1177fe700 1 -- 172.21.15.87:0/1645783532 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fd130014040 con 0xcda790 2023-03-30T08:11:27.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd141e1e740 10 client.4803 fetch_fsmap finished waiting for FSMap version 9 2023-03-30T08:11:27.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd141e1e740 10 client.4803 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-30T08:11:27.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd141e1e740 20 client.4803 populate_metadata read hostname 'smithi087' 2023-03-30T08:11:27.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd141e1e740 1 --2- 172.21.15.87:0/1645783532 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0xf42b70 0xf00750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd141e1e740 4 client.4803 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-30T08:11:27.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd141e1e740 1 -- 172.21.15.87:0/1645783532 --> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xe61960 con 0xf42b70 2023-03-30T08:11:27.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.180+0000 7fd13c932700 1 --2- 172.21.15.87:0/1645783532 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0xf42b70 0xf00750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd1177fe700 10 client.4803 ms_handle_connect on v2:172.21.15.115:6834/3640886103 2023-03-30T08:11:27.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd13c932700 1 --2- 172.21.15.87:0/1645783532 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0xf42b70 0xf00750 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45a3fd738c1aabeb server_cookie=1cde51ce9c20f21a in_seq=0 out_seq=0 2023-03-30T08:11:27.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd1177fe700 1 -- 172.21.15.87:0/1645783532 <== mds.0 v2:172.21.15.115:6834/3640886103 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0xe61960 con 0xf42b70 2023-03-30T08:11:27.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd1177fe700 10 client.4803 handle_command_reply: tid=0 2023-03-30T08:11:27.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd141e1e740 1 client.4803 shutdown 2023-03-30T08:11:27.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd141e1e740 1 -- 172.21.15.87:0/1645783532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xcda790 msgr2=0xf3eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:27.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd141e1e740 1 --2- 172.21.15.87:0/1645783532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xcda790 0xf3eb20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd130004810 tx=0x7fd130007610 comp rx=0 tx=0).stop 2023-03-30T08:11:27.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd141e1e740 1 -- 172.21.15.87:0/1645783532 shutdown_connections 2023-03-30T08:11:27.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd141e1e740 1 --2- 172.21.15.87:0/1645783532 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0xf42b70 0xf00750 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd141e1e740 1 --2- 172.21.15.87:0/1645783532 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xcda790 0xf3eb20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd141e1e740 1 --2- 172.21.15.87:0/1645783532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xc8fae0 0xf40c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd1177fe700 0 client.4803 ms_handle_reset on v2:172.21.15.115:6834/3640886103 2023-03-30T08:11:27.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd141e1e740 1 --2- 172.21.15.87:0/1645783532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xc8f710 0xf27490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd141e1e740 1 -- 172.21.15.87:0/1645783532 >> 172.21.15.87:0/1645783532 conn(0xc8feb0 msgr2=0xf29b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:27.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd141e1e740 1 -- 172.21.15.87:0/1645783532 shutdown_connections 2023-03-30T08:11:27.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd141e1e740 1 -- 172.21.15.87:0/1645783532 wait complete. 2023-03-30T08:11:27.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.184+0000 7fd141e1e740 20 client.4803 trim_cache size 0 max 16384 2023-03-30T08:11:27.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd141e1e740 1 Processor -- start 2023-03-30T08:11:27.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd141e1e740 1 -- start start 2023-03-30T08:11:27.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd141e1e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xc8f710 0xefe2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd141e1e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8fae0 0xefe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd141e1e740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xcda790 0xf00750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd141e1e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0xdf2170 con 0xc8fae0 2023-03-30T08:11:27.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd141e1e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0xe6cc60 con 0xc8f710 2023-03-30T08:11:27.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd141e1e740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0xe70c90 con 0xcda790 2023-03-30T08:11:27.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd137fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8fae0 0xefe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd137fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8fae0 0xefe7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52302/0 (socket says 172.21.15.87:52302) 2023-03-30T08:11:27.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd137fff700 1 -- 172.21.15.87:0/964067986 learned_addr learned my addr 172.21.15.87:0/964067986 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:27.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd13c932700 1 --2- 172.21.15.87:0/964067986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xc8f710 0xefe2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd13d133700 1 --2- 172.21.15.87:0/964067986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xcda790 0xf00750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd137fff700 1 -- 172.21.15.87:0/964067986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xcda790 msgr2=0xf00750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:27.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd137fff700 1 --2- 172.21.15.87:0/964067986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xcda790 0xf00750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd137fff700 1 -- 172.21.15.87:0/964067986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xc8f710 msgr2=0xefe2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:27.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd137fff700 1 --2- 172.21.15.87:0/964067986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xc8f710 0xefe2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd137fff700 1 -- 172.21.15.87:0/964067986 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe2ecc0 con 0xc8fae0 2023-03-30T08:11:27.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.208+0000 7fd137fff700 1 --2- 172.21.15.87:0/964067986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8fae0 0xefe7f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd1240049e0 tx=0x7fd124014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869ae378ab2ebff2 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:27.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.212+0000 7fd122ffd700 1 -- 172.21.15.87:0/964067986 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124004b30 con 0xc8fae0 2023-03-30T08:11:27.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.212+0000 7fd122ffd700 1 -- 172.21.15.87:0/964067986 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd124004c90 con 0xc8fae0 2023-03-30T08:11:27.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.212+0000 7fd122ffd700 1 -- 172.21.15.87:0/964067986 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12402c6a0 con 0xc8fae0 2023-03-30T08:11:27.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.212+0000 7fd141e1e740 1 -- 172.21.15.87:0/964067986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8fae0 msgr2=0xefe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:27.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.212+0000 7fd141e1e740 1 --2- 172.21.15.87:0/964067986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8fae0 0xefe7f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd1240049e0 tx=0x7fd124014000 comp rx=0 tx=0).stop 2023-03-30T08:11:27.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.212+0000 7fd141e1e740 1 -- 172.21.15.87:0/964067986 shutdown_connections 2023-03-30T08:11:27.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.212+0000 7fd141e1e740 1 --2- 172.21.15.87:0/964067986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xcda790 0xf00750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.212+0000 7fd141e1e740 1 --2- 172.21.15.87:0/964067986 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8fae0 0xefe7f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.212+0000 7fd141e1e740 1 --2- 172.21.15.87:0/964067986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xc8f710 0xefe2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.212+0000 7fd141e1e740 1 -- 172.21.15.87:0/964067986 >> 172.21.15.87:0/964067986 conn(0xc8feb0 msgr2=0xf12e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:27.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.212+0000 7fd141e1e740 1 -- 172.21.15.87:0/964067986 shutdown_connections 2023-03-30T08:11:27.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.212+0000 7fd141e1e740 1 -- 172.21.15.87:0/964067986 wait complete. 2023-03-30T08:11:27.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.212+0000 7fd141e1e740 1 -- start start 2023-03-30T08:11:27.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.212+0000 7fd141e1e740 1 Processor -- start 2023-03-30T08:11:27.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd141e1e740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8f710 0xf26880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd141e1e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xc8fae0 0xf3cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd141e1e740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xcda790 0xf3d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd141e1e740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0xe62f60 con 0xc8f710 2023-03-30T08:11:27.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd141e1e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0xe38c30 con 0xc8fae0 2023-03-30T08:11:27.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd141e1e740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0xe66470 con 0xcda790 2023-03-30T08:11:27.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd141e1e740 10 client.0 _ll_register_callbacks cb 0xe09b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-30T08:11:27.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd13c932700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8f710 0xf26880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd13c932700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8f710 0xf26880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52310/0 (socket says 172.21.15.87:52310) 2023-03-30T08:11:27.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd13c932700 1 -- 172.21.15.87:0/257681955 learned_addr learned my addr 172.21.15.87:0/257681955 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:27.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd137fff700 1 --2- 172.21.15.87:0/257681955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xc8fae0 0xf3cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd13d133700 1 --2- 172.21.15.87:0/257681955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xcda790 0xf3d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd13c932700 1 -- 172.21.15.87:0/257681955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xcda790 msgr2=0xf3d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:27.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd13c932700 1 --2- 172.21.15.87:0/257681955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xcda790 0xf3d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd13c932700 1 -- 172.21.15.87:0/257681955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xc8fae0 msgr2=0xf3cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:27.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd13c932700 1 --2- 172.21.15.87:0/257681955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xc8fae0 0xf3cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd13c932700 1 -- 172.21.15.87:0/257681955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xe8f9b0 con 0xc8f710 2023-03-30T08:11:27.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd13d133700 1 --2- 172.21.15.87:0/257681955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xcda790 0xf3d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:27.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd13c932700 1 --2- 172.21.15.87:0/257681955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8f710 0xf26880 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd12c054ed0 tx=0x7fd12c05d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182a53ff253860cc server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:27.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd1177fe700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2023-03-30T08:11:27.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd1177fe700 1 -- 172.21.15.87:0/257681955 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c05a050 con 0xc8f710 2023-03-30T08:11:27.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd1177fe700 1 -- 172.21.15.87:0/257681955 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd12c05cdd0 con 0xc8f710 2023-03-30T08:11:27.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd141e1e740 1 -- 172.21.15.87:0/257681955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd124013e40 con 0xc8f710 2023-03-30T08:11:27.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd1177fe700 1 -- 172.21.15.87:0/257681955 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd12c05cf90 con 0xc8f710 2023-03-30T08:11:27.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd141e1e740 10 client.4809 fetch_fsmap learned FSMap version 9 2023-03-30T08:11:27.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.216+0000 7fd141e1e740 1 -- 172.21.15.87:0/257681955 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0xe147a0 con 0xc8f710 2023-03-30T08:11:27.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd1177fe700 1 -- 172.21.15.87:0/257681955 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd124013e40 con 0xc8f710 2023-03-30T08:11:27.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd1177fe700 1 -- 172.21.15.87:0/257681955 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fd12c068b10 con 0xc8f710 2023-03-30T08:11:27.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 10 client.4809 fetch_fsmap finished waiting for FSMap version 9 2023-03-30T08:11:27.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 10 client.4809 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-30T08:11:27.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 20 client.4809 populate_metadata read hostname 'smithi087' 2023-03-30T08:11:27.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 1 --2- 172.21.15.87:0/257681955 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0xfaa160 0xfaa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:27.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 4 client.4809 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-03-30T08:11:27.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 1 -- 172.21.15.87:0/257681955 --> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] -- command(tid 0: {"prefix": "status"}) v1 -- 0xd0c260 con 0xfaa160 2023-03-30T08:11:27.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd137fff700 1 --2- 172.21.15.87:0/257681955 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0xfaa160 0xfaa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:27.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd137fff700 1 --2- 172.21.15.87:0/257681955 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0xfaa160 0xfaa530 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d7b75edd30992c0 server_cookie=f88f6d0c3e46bc36 in_seq=0 out_seq=0 2023-03-30T08:11:27.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd1177fe700 10 client.4809 ms_handle_connect on v2:172.21.15.115:6834/3640886103 2023-03-30T08:11:27.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd1177fe700 1 -- 172.21.15.87:0/257681955 <== mds.0 v2:172.21.15.115:6834/3640886103 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0xd0c260 con 0xfaa160 2023-03-30T08:11:27.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd1177fe700 10 client.4809 handle_command_reply: tid=0 2023-03-30T08:11:27.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 1 client.4809 shutdown 2023-03-30T08:11:27.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 1 -- 172.21.15.87:0/257681955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8f710 msgr2=0xf26880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:27.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 1 --2- 172.21.15.87:0/257681955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8f710 0xf26880 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd12c054ed0 tx=0x7fd12c05d3e0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 1 -- 172.21.15.87:0/257681955 shutdown_connections 2023-03-30T08:11:27.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 1 --2- 172.21.15.87:0/257681955 >> [v2:172.21.15.115:6834/3640886103,v1:172.21.15.115:6835/3640886103] conn(0xfaa160 0xfaa530 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 1 --2- 172.21.15.87:0/257681955 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0xcda790 0xf3d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd1177fe700 0 client.4809 ms_handle_reset on v2:172.21.15.115:6834/3640886103 2023-03-30T08:11:27.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 1 --2- 172.21.15.87:0/257681955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0xc8fae0 0xf3cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 1 --2- 172.21.15.87:0/257681955 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0xc8f710 0xf26880 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 1 -- 172.21.15.87:0/257681955 >> 172.21.15.87:0/257681955 conn(0xc8feb0 msgr2=0xefe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:27.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 1 -- 172.21.15.87:0/257681955 shutdown_connections 2023-03-30T08:11:27.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 1 -- 172.21.15.87:0/257681955 wait complete. 2023-03-30T08:11:27.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.220+0000 7fd141e1e740 20 client.4809 trim_cache size 0 max 16384 2023-03-30T08:11:27.231 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-03-30T08:11:27.232 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "936aee23-1888-4f7e-bc67-7a45e372f20a", 2023-03-30T08:11:27.232 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2023-03-30T08:11:27.232 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4291, 2023-03-30T08:11:27.232 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2023-03-30T08:11:27.232 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2023-03-30T08:11:27.232 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2023-03-30T08:11:27.233 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 28.866837890999999, 2023-03-30T08:11:27.233 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 9, 2023-03-30T08:11:27.233 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 28, 2023-03-30T08:11:27.233 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 28, 2023-03-30T08:11:27.233 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 34.197402809000003 2023-03-30T08:11:27.233 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-03-30T08:11:27.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.224+0000 7fd13eb96700 1 -- 172.21.15.87:0/855425084 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd11c065440 msgr2=0x7fd11c0678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:27.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.224+0000 7fd13eb96700 1 --2- 172.21.15.87:0/855425084 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd11c065440 0x7fd11c0678f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd1380b3a50 tx=0x7fd124007f30 comp rx=0 tx=0).stop 2023-03-30T08:11:27.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.224+0000 7fd13eb96700 1 -- 172.21.15.87:0/855425084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd138070b30 msgr2=0x7fd1380c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:27.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.224+0000 7fd13eb96700 1 --2- 172.21.15.87:0/855425084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd138070b30 0x7fd1380c7490 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd12c000c00 tx=0x7fd12c004770 comp rx=0 tx=0).stop 2023-03-30T08:11:27.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.224+0000 7fd13eb96700 1 -- 172.21.15.87:0/855425084 shutdown_connections 2023-03-30T08:11:27.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.224+0000 7fd13eb96700 1 --2- 172.21.15.87:0/855425084 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd11c065440 0x7fd11c0678f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.224+0000 7fd13eb96700 1 --2- 172.21.15.87:0/855425084 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1380c8fb0 0x7fd1381f36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.224+0000 7fd13eb96700 1 --2- 172.21.15.87:0/855425084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1380b41c0 0x7fd1381f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.224+0000 7fd13eb96700 1 --2- 172.21.15.87:0/855425084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd138070b30 0x7fd1380c7490 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:27.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.224+0000 7fd13eb96700 1 -- 172.21.15.87:0/855425084 >> 172.21.15.87:0/855425084 conn(0x7fd1380ce960 msgr2=0x7fd13806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:27.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.224+0000 7fd13eb96700 1 -- 172.21.15.87:0/855425084 shutdown_connections 2023-03-30T08:11:27.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:27.224+0000 7fd13eb96700 1 -- 172.21.15.87:0/855425084 wait complete. 2023-03-30T08:11:27.250 INFO:teuthology.run_tasks:Running task kclient... 2023-03-30T08:11:27.264 INFO:tasks.kclient:Mounting kernel clients... 2023-03-30T08:11:27.265 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-03-30T08:11:27.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:27.265 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2023-03-30T08:11:27.283 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-03-30T08:11:27.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:27.285 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-03-30T08:11:27.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:27.361 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2023-03-30T08:11:27.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:27.631 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2023-03-30T08:11:27.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:27.645 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2023-03-30T08:11:27.723 INFO:teuthology.orchestra.run.smithi087.stderr:Cannot find device "ceph-brx" 2023-03-30T08:11:27.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T08:11:27.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:27.727 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-03-30T08:11:27.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:27.744 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-03-30T08:11:27.823 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2023-03-30T08:11:27.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T08:11:27.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:27.827 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-03-30T08:11:27.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:27.887 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-03-30T08:11:27.967 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2023-03-30T08:11:27.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T08:11:27.971 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-03-30T08:11:27.971 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-30T08:11:27.972 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-30T08:11:27.972 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-30T08:11:28.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.132+0000 7f3971f83700 1 Processor -- start 2023-03-30T08:11:28.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.132+0000 7f3971f83700 1 -- start start 2023-03-30T08:11:28.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.136+0000 7f3971f83700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f396c1600d0 0x7f396c06a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:28.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.136+0000 7f3971f83700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396c06a0e0 con 0x7f396c0ad640 2023-03-30T08:11:28.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.136+0000 7f3971f83700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396c0c9db0 con 0x7f396c06aab0 2023-03-30T08:11:28.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.136+0000 7f3971f83700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0ca090 con 0x7f396c1600d0 2023-03-30T08:11:28.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.136+0000 7f3971782700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f396c0ad640 0x7f396c1604a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:48664/0 (socket says 172.21.15.87:48664) 2023-03-30T08:11:28.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.136+0000 7f3971782700 1 -- 172.21.15.87:0/3988006478 learned_addr learned my addr 172.21.15.87:0/3988006478 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:28.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.136+0000 7f3970f81700 1 --2- 172.21.15.87:0/3988006478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f396c1600d0 0x7f396c06a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:28.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.136+0000 7f39637fe700 1 -- 172.21.15.87:0/3988006478 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942813441 0 0) 0x7f396c06a0e0 con 0x7f396c0ad640 2023-03-30T08:11:28.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.136+0000 7f39637fe700 1 -- 172.21.15.87:0/3988006478 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39540035d0 con 0x7f396c0ad640 2023-03-30T08:11:28.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 -- 172.21.15.87:0/3988006478 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 215882321 0 0) 0x7f39540035d0 con 0x7f396c0ad640 2023-03-30T08:11:28.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 -- 172.21.15.87:0/3988006478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f396c1600d0 msgr2=0x7f396c06a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:28.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 --2- 172.21.15.87:0/3988006478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f396c1600d0 0x7f396c06a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:28.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 -- 172.21.15.87:0/3988006478 >> v1:172.21.15.115:6789/0 conn(0x7f396c06aab0 legacy=0x7f396c0abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:28.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 -- 172.21.15.87:0/3988006478 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c069d70 con 0x7f396c0ad640 2023-03-30T08:11:28.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 -- 172.21.15.87:0/3988006478 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f39640019f0 con 0x7f396c0ad640 2023-03-30T08:11:28.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 -- 172.21.15.87:0/3988006478 >> v1:172.21.15.87:6789/0 conn(0x7f396c0ad640 legacy=0x7f396c1604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:28.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 --2- 172.21.15.87:0/3988006478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3954003a50 0x7f3954003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:28.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 --2- 172.21.15.87:0/3988006478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f396c1600d0 0x7f3954004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:28.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 --2- 172.21.15.87:0/3988006478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3954004db0 0x7f3954005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:28.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 -- 172.21.15.87:0/3988006478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0ca090 con 0x7f3954004db0 2023-03-30T08:11:28.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 -- 172.21.15.87:0/3988006478 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395400bae0 con 0x7f3954003a50 2023-03-30T08:11:28.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 -- 172.21.15.87:0/3988006478 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395400bc20 con 0x7f396c1600d0 2023-03-30T08:11:28.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f3971782700 1 --2- 172.21.15.87:0/3988006478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3954004db0 0x7f3954005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:28.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f3970f81700 1 --2- 172.21.15.87:0/3988006478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3954003a50 0x7f3954003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:28.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f3963fff700 1 --2- 172.21.15.87:0/3988006478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f396c1600d0 0x7f3954004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:28.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f3971782700 1 -- 172.21.15.87:0/3988006478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f396c1600d0 msgr2=0x7f3954004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:28.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f3971782700 1 --2- 172.21.15.87:0/3988006478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f396c1600d0 0x7f3954004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:28.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f3971782700 1 -- 172.21.15.87:0/3988006478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3954003a50 msgr2=0x7f3954003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:28.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f3971782700 1 --2- 172.21.15.87:0/3988006478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3954003a50 0x7f3954003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:28.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f3971782700 1 -- 172.21.15.87:0/3988006478 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39540035d0 con 0x7f3954004db0 2023-03-30T08:11:28.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f3971782700 1 --2- 172.21.15.87:0/3988006478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3954004db0 0x7f3954005220 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f396400a810 tx=0x7f39540058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e14242ec087be server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:28.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 -- 172.21.15.87:0/3988006478 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396400a250 con 0x7f3954004db0 2023-03-30T08:11:28.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 -- 172.21.15.87:0/3988006478 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39640072f0 con 0x7f3954004db0 2023-03-30T08:11:28.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f39637fe700 1 -- 172.21.15.87:0/3988006478 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39640076a0 con 0x7f3954004db0 2023-03-30T08:11:28.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f3971f83700 1 -- 172.21.15.87:0/3988006478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3954004db0 msgr2=0x7f3954005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:28.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f3971f83700 1 --2- 172.21.15.87:0/3988006478 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3954004db0 0x7f3954005220 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f396400a810 tx=0x7f39540058a0 comp rx=0 tx=0).stop 2023-03-30T08:11:28.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f3971782700 1 -- 172.21.15.87:0/3988006478 reap_dead start 2023-03-30T08:11:28.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f3971f83700 1 -- 172.21.15.87:0/3988006478 shutdown_connections 2023-03-30T08:11:28.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.140+0000 7f3971f83700 1 -- 172.21.15.87:0/3988006478 >> 172.21.15.87:0/3988006478 conn(0x7f396c0cf410 msgr2=0x7f396c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:28.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.144+0000 7f3971f83700 1 -- 172.21.15.87:0/3988006478 shutdown_connections 2023-03-30T08:11:28.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.144+0000 7f3971f83700 1 -- 172.21.15.87:0/3988006478 wait complete. 2023-03-30T08:11:28.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.144+0000 7f3971f83700 1 Processor -- start 2023-03-30T08:11:28.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.144+0000 7f3971f83700 1 -- start start 2023-03-30T08:11:28.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3971f83700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3954004db0 0x7f396c1ef910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:28.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3971f83700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f396c0c3bb0 0x7f396c1f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:28.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3971f83700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f396c1f3440 0x7f396c070460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:28.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3971f83700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0b28d0 con 0x7f3954004db0 2023-03-30T08:11:28.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3971f83700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c1f32d0 con 0x7f396c1f3440 2023-03-30T08:11:28.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3971f83700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0c4020 con 0x7f396c0c3bb0 2023-03-30T08:11:28.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3970f81700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3954004db0 0x7f396c1ef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:28.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3970f81700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3954004db0 0x7f396c1ef910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52328/0 (socket says 172.21.15.87:52328) 2023-03-30T08:11:28.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3970f81700 1 -- 172.21.15.87:0/984092382 learned_addr learned my addr 172.21.15.87:0/984092382 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:28.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3963fff700 1 --2- 172.21.15.87:0/984092382 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f396c0c3bb0 0x7f396c1f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:28.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3971782700 1 --2- 172.21.15.87:0/984092382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f396c1f3440 0x7f396c070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:28.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3970f81700 1 -- 172.21.15.87:0/984092382 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f396c0c3bb0 msgr2=0x7f396c1f2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:28.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3970f81700 1 --2- 172.21.15.87:0/984092382 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f396c0c3bb0 0x7f396c1f2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:28.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3970f81700 1 -- 172.21.15.87:0/984092382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f396c1f3440 msgr2=0x7f396c070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:28.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3970f81700 1 --2- 172.21.15.87:0/984092382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f396c1f3440 0x7f396c070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:28.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3970f81700 1 -- 172.21.15.87:0/984092382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c0addc0 con 0x7f3954004db0 2023-03-30T08:11:28.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3971782700 1 --2- 172.21.15.87:0/984092382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f396c1f3440 0x7f396c070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:28.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3970f81700 1 --2- 172.21.15.87:0/984092382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3954004db0 0x7f396c1ef910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3968011a50 tx=0x7f3968011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:28.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f39617fa700 1 -- 172.21.15.87:0/984092382 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396800f8e0 con 0x7f3954004db0 2023-03-30T08:11:28.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f39617fa700 1 -- 172.21.15.87:0/984092382 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396800fa40 con 0x7f3954004db0 2023-03-30T08:11:28.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f39617fa700 1 -- 172.21.15.87:0/984092382 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396800fdf0 con 0x7f3954004db0 2023-03-30T08:11:28.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3971f83700 1 -- 172.21.15.87:0/984092382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396c0ca370 con 0x7f3954004db0 2023-03-30T08:11:28.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.148+0000 7f3971f83700 1 -- 172.21.15.87:0/984092382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396c15d8c0 con 0x7f3954004db0 2023-03-30T08:11:28.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.152+0000 7f3971f83700 1 -- 172.21.15.87:0/984092382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396c0b2b40 con 0x7f3954004db0 2023-03-30T08:11:28.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.152+0000 7f39617fa700 1 -- 172.21.15.87:0/984092382 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f3968014440 con 0x7f3954004db0 2023-03-30T08:11:28.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.152+0000 7f39617fa700 1 --2- 172.21.15.87:0/984092382 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f39580653f0 0x7f39580678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:28.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.152+0000 7f39617fa700 1 -- 172.21.15.87:0/984092382 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f39680831d0 con 0x7f3954004db0 2023-03-30T08:11:28.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.152+0000 7f3963fff700 1 --2- 172.21.15.87:0/984092382 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f39580653f0 0x7f39580678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.156+0000 7f3963fff700 1 --2- 172.21.15.87:0/984092382 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f39580653f0 0x7f39580678a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f396c15df30 tx=0x7f395c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.160+0000 7f39617fa700 1 -- 172.21.15.87:0/984092382 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f3968050bb0 con 0x7f3954004db0 2023-03-30T08:11:28.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.368+0000 7f3971f83700 1 -- 172.21.15.87:0/984092382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f396c0733a0 con 0x7f3954004db0 2023-03-30T08:11:28.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.368+0000 7f39617fa700 1 -- 172.21.15.87:0/984092382 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f39680541d0 con 0x7f3954004db0 2023-03-30T08:11:28.373 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-03-30T08:11:28.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.372+0000 7f3971f83700 1 -- 172.21.15.87:0/984092382 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f39580653f0 msgr2=0x7f39580678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:28.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.372+0000 7f3971f83700 1 --2- 172.21.15.87:0/984092382 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f39580653f0 0x7f39580678a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f396c15df30 tx=0x7f395c009040 comp rx=0 tx=0).stop 2023-03-30T08:11:28.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.372+0000 7f3971f83700 1 -- 172.21.15.87:0/984092382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3954004db0 msgr2=0x7f396c1ef910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:28.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.372+0000 7f3971f83700 1 --2- 172.21.15.87:0/984092382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3954004db0 0x7f396c1ef910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3968011a50 tx=0x7f3968011d60 comp rx=0 tx=0).stop 2023-03-30T08:11:28.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.372+0000 7f3971f83700 1 -- 172.21.15.87:0/984092382 shutdown_connections 2023-03-30T08:11:28.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.372+0000 7f3971f83700 1 --2- 172.21.15.87:0/984092382 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f39580653f0 0x7f39580678a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:28.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.372+0000 7f3971f83700 1 --2- 172.21.15.87:0/984092382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f396c1f3440 0x7f396c070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:28.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.372+0000 7f3971f83700 1 --2- 172.21.15.87:0/984092382 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f396c0c3bb0 0x7f396c1f2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:28.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.372+0000 7f3971f83700 1 --2- 172.21.15.87:0/984092382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3954004db0 0x7f396c1ef910 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:28.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.372+0000 7f3971f83700 1 -- 172.21.15.87:0/984092382 >> 172.21.15.87:0/984092382 conn(0x7f396c0cf410 msgr2=0x7f396c0c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:28.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.372+0000 7f3971f83700 1 -- 172.21.15.87:0/984092382 shutdown_connections 2023-03-30T08:11:28.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:28.372+0000 7f3971f83700 1 -- 172.21.15.87:0/984092382 wait complete. 2023-03-30T08:11:28.398 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-30T08:11:28.399 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-30T08:11:28.399 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2023-03-30T08:11:28.399 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-30T08:11:28.399 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-30T08:11:28.399 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-30T08:11:28.399 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-30T08:11:28.400 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-30T08:11:28.400 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-30T08:11:28.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:28.400 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2023-03-30T08:11:28.414 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-30T08:11:28.415 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-30T08:11:28.415 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2023-03-30T08:11:28.415 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:28.415 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2023-03-30T08:11:28.415 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:28.415 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:11:28.415 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:28.416 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2023-03-30T08:11:28.416 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:11:28.416 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:28.416 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2023-03-30T08:11:28.416 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:11:28.416 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:28.416 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-30T08:11:28.416 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:28.417 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-03-30T08:11:28.417 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42457sec preferred_lft 42457sec 2023-03-30T08:11:28.417 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2023-03-30T08:11:28.417 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:28.417 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-03-30T08:11:28.417 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:18:c5:86:06 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:28.417 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-03-30T08:11:28.417 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:28.418 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-03-30T08:11:28.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:28.419 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-03-30T08:11:28.419 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-03-30T08:11:28.419 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2023-03-30T08:11:28.420 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2023-03-30T08:11:28.420 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2023-03-30T08:11:28.420 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-03-30T08:11:28.420 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-03-30T08:11:28.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:28.567 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-30T08:11:28.597 INFO:teuthology.orchestra.run.smithi087.stdout:1 2023-03-30T08:11:28.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:28.600 DEBUG:teuthology.orchestra.run.smithi087:> route 2023-03-30T08:11:28.664 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2023-03-30T08:11:28.665 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-30T08:11:28.665 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-03-30T08:11:28.665 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-30T08:11:28.665 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-03-30T08:11:28.665 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-03-30T08:11:28.666 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-03-30T08:11:28.666 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-30T08:11:28.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:28.666 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-03-30T08:11:28.667 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-03-30T08:11:28.667 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-30T08:11:28.667 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-30T08:11:28.667 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-30T08:11:28.667 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-03-30T08:11:28.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:28.797 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2023-03-30T08:11:28.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:28.808 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2023-03-30T08:11:28.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:28.868 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-03-30T08:11:28.868 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-03-30T08:11:28.868 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-30T08:11:28.868 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-03-30T08:11:28.869 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-03-30T08:11:28.975 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-03-30T08:11:28.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:28.976 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-03-30T08:11:28.977 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-03-30T08:11:28.977 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-03-30T08:11:28.977 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-03-30T08:11:28.978 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-03-30T08:11:28.978 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-03-30T08:11:28.979 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-03-30T08:11:28.979 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-03-30T08:11:29.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:29.111 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-03-30T08:11:29.112 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-03-30T08:11:29.112 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2023-03-30T08:11:29.113 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2023-03-30T08:11:29.113 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-03-30T08:11:29.171 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-30T08:11:29.172 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-03-30T08:11:29.184 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-03-30T08:11:29.185 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-30T08:11:29.185 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-03-30T08:11:29.241 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-03-30T08:11:29.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:29.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-30T08:11:29.363 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-30T08:11:29.363 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-30T08:11:29.363 INFO:teuthology.orchestra.run.smithi087.stdout:invalid new device string format 2023-03-30T08:11:29.488 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-30T08:11:29.489 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-30T08:11:29.489 INFO:teuthology.orchestra.run.smithi087.stdout:invalid new device string format 2023-03-30T08:11:29.489 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: resolved to: "172.21.15.87:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-03-30T08:11:29.489 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-30T08:11:29.511 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-30T08:11:29.511 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-30T08:11:29.512 INFO:teuthology.orchestra.run.smithi087.stdout:invalid new device string format 2023-03-30T08:11:29.512 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: resolved to: "172.21.15.87:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-03-30T08:11:29.512 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-30T08:11:29.512 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: resolved to: "172.21.15.87:6789,172.21.15.115:6789,172.21.15.115:6790" 2023-03-30T08:11:29.512 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.87:6789,172.21.15.115:6789,172.21.15.115:6790:/ 2023-03-30T08:11:29.512 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=936aee23-1888-4f7e-bc67-7a45e372f20a" will pass to kernel 2023-03-30T08:11:29.518 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-30T08:11:29.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:29.519 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-03-30T08:11:29.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:29.543 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-30T08:11:29.611 INFO:teuthology.orchestra.run.smithi087.stdout:client4625 2023-03-30T08:11:29.611 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:11:29.612 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:29.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:29.671 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-30T08:11:29.740 INFO:teuthology.orchestra.run.smithi087.stdout:client4625 2023-03-30T08:11:29.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:29.741 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-30T08:11:29.804 INFO:teuthology.orchestra.run.smithi087.stdout:client4625 2023-03-30T08:11:29.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:29.805 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/936aee23-1888-4f7e-bc67-7a45e372f20a.client4625/status') 2023-03-30T08:11:29.879 INFO:teuthology.orchestra.run.smithi087.stdout:instance: client.4625 (3)172.21.15.87:0/4237419720 2023-03-30T08:11:29.880 INFO:teuthology.orchestra.run.smithi087.stdout:blocklisted: false 2023-03-30T08:11:29.880 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2023-03-30T08:11:29.880 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2023-03-30T08:11:29.880 INFO:teuthology.orchestra.run.smithi087.stderr:70 bytes copied, 0.000151199 s, 463 kB/s 2023-03-30T08:11:29.883 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-03-30T08:11:29.883 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-30T08:11:29.883 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-03-30T08:11:29.884 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-30T08:11:30.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.084+0000 7fdec8c6f700 1 Processor -- start 2023-03-30T08:11:30.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.084+0000 7fdec8c6f700 1 -- start start 2023-03-30T08:11:30.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.088+0000 7fdec8c6f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdec40b3f30 0x7fdec40b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:30.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.088+0000 7fdec8c6f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdec40af350 0x7fdec406c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:30.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.088+0000 7fdec8c6f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec406b670 con 0x7fdec406a6e0 2023-03-30T08:11:30.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.088+0000 7fdec8c6f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec406b0b0 con 0x7fdec40b3f30 2023-03-30T08:11:30.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.088+0000 7fdec8c6f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec406b390 con 0x7fdec40af350 2023-03-30T08:11:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.088+0000 7fdec2ffd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fdec406a6e0 0x7fdec40aec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32864/0 (socket says 172.21.15.87:32864) 2023-03-30T08:11:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.088+0000 7fdec2ffd700 1 -- 172.21.15.87:0/1529510488 learned_addr learned my addr 172.21.15.87:0/1529510488 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.088+0000 7fdec3fff700 1 --2- 172.21.15.87:0/1529510488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdec40af350 0x7fdec406c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.088+0000 7fdec37fe700 1 --2- 172.21.15.87:0/1529510488 >> v2:172.21.15.115:3300/0 conn(0x7fdec40b3f30 0x7fdec40b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.088+0000 7fdec27fc700 1 -- 172.21.15.87:0/1529510488 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615587564 0 0) 0x7fdec406b670 con 0x7fdec406a6e0 2023-03-30T08:11:30.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.088+0000 7fdec27fc700 1 -- 172.21.15.87:0/1529510488 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeac0035d0 con 0x7fdec406a6e0 2023-03-30T08:11:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 -- 172.21.15.87:0/1529510488 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1174564935 0 0) 0x7fdeac0035d0 con 0x7fdec406a6e0 2023-03-30T08:11:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 -- 172.21.15.87:0/1529510488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdec40af350 msgr2=0x7fdec406c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 --2- 172.21.15.87:0/1529510488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdec40af350 0x7fdec406c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 -- 172.21.15.87:0/1529510488 >> v2:172.21.15.115:3300/0 conn(0x7fdec40b3f30 msgr2=0x7fdec40b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 --2- 172.21.15.87:0/1529510488 >> v2:172.21.15.115:3300/0 conn(0x7fdec40b3f30 0x7fdec40b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 -- 172.21.15.87:0/1529510488 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec40aded0 con 0x7fdec406a6e0 2023-03-30T08:11:30.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 -- 172.21.15.87:0/1529510488 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7fdeb8001670 con 0x7fdec406a6e0 2023-03-30T08:11:30.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 -- 172.21.15.87:0/1529510488 >> v1:172.21.15.87:6789/0 conn(0x7fdec406a6e0 legacy=0x7fdec40aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:30.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 --2- 172.21.15.87:0/1529510488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdeac003a20 0x7fdeac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:30.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 --2- 172.21.15.87:0/1529510488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdec40af350 0x7fdeac004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:30.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 --2- 172.21.15.87:0/1529510488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeac004db0 0x7fdeac005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:30.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 -- 172.21.15.87:0/1529510488 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec406b0b0 con 0x7fdeac004db0 2023-03-30T08:11:30.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 -- 172.21.15.87:0/1529510488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec406b390 con 0x7fdeac003a20 2023-03-30T08:11:30.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 -- 172.21.15.87:0/1529510488 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac00ba30 con 0x7fdec40af350 2023-03-30T08:11:30.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec3fff700 1 --2- 172.21.15.87:0/1529510488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeac004db0 0x7fdeac005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:30.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec2ffd700 1 --2- 172.21.15.87:0/1529510488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdec40af350 0x7fdeac004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:30.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec37fe700 1 --2- 172.21.15.87:0/1529510488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdeac003a20 0x7fdeac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:30.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec3fff700 1 -- 172.21.15.87:0/1529510488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdec40af350 msgr2=0x7fdeac004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:30.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec3fff700 1 --2- 172.21.15.87:0/1529510488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdec40af350 0x7fdeac004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:30.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec3fff700 1 -- 172.21.15.87:0/1529510488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdeac003a20 msgr2=0x7fdeac003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:30.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec3fff700 1 --2- 172.21.15.87:0/1529510488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdeac003a20 0x7fdeac003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:30.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec3fff700 1 -- 172.21.15.87:0/1529510488 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac0035d0 con 0x7fdeac004db0 2023-03-30T08:11:30.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec37fe700 1 --2- 172.21.15.87:0/1529510488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdeac003a20 0x7fdeac003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:30.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec3fff700 1 --2- 172.21.15.87:0/1529510488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeac004db0 0x7fdeac005220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009fc0 tx=0x7fdeac0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88d0749638171d4 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:30.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 -- 172.21.15.87:0/1529510488 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc00ec30 con 0x7fdeac004db0 2023-03-30T08:11:30.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 -- 172.21.15.87:0/1529510488 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc00f040 con 0x7fdeac004db0 2023-03-30T08:11:30.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec27fc700 1 -- 172.21.15.87:0/1529510488 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc014480 con 0x7fdeac004db0 2023-03-30T08:11:30.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec8c6f700 1 -- 172.21.15.87:0/1529510488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeac004db0 msgr2=0x7fdeac005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:30.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec8c6f700 1 --2- 172.21.15.87:0/1529510488 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeac004db0 0x7fdeac005220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009fc0 tx=0x7fdeac0058a0 comp rx=0 tx=0).stop 2023-03-30T08:11:30.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec3fff700 1 -- 172.21.15.87:0/1529510488 reap_dead start 2023-03-30T08:11:30.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.092+0000 7fdec8c6f700 1 -- 172.21.15.87:0/1529510488 shutdown_connections 2023-03-30T08:11:30.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.096+0000 7fdec8c6f700 1 -- 172.21.15.87:0/1529510488 >> 172.21.15.87:0/1529510488 conn(0x7fdec40cf410 msgr2=0x7fdec40cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:30.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.096+0000 7fdec8c6f700 1 -- 172.21.15.87:0/1529510488 shutdown_connections 2023-03-30T08:11:30.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.096+0000 7fdec8c6f700 1 -- 172.21.15.87:0/1529510488 wait complete. 2023-03-30T08:11:30.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.096+0000 7fdec8c6f700 1 Processor -- start 2023-03-30T08:11:30.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec8c6f700 1 -- start start 2023-03-30T08:11:30.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec8c6f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdec414eb90 0x7fdec40aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:30.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec8c6f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdec414ef60 0x7fdec40a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:30.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec8c6f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdec40a92f0 0x7fdec41e4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:30.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec8c6f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40a9790 con 0x7fdec414ef60 2023-03-30T08:11:30.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec8c6f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec41e3860 con 0x7fdec414eb90 2023-03-30T08:11:30.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec8c6f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec41e3b40 con 0x7fdec40a92f0 2023-03-30T08:11:30.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec2ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdec414ef60 0x7fdec40a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:30.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec2ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdec414ef60 0x7fdec40a8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58634/0 (socket says 172.21.15.87:58634) 2023-03-30T08:11:30.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec2ffd700 1 -- 172.21.15.87:0/1234184332 learned_addr learned my addr 172.21.15.87:0/1234184332 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:30.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec37fe700 1 --2- 172.21.15.87:0/1234184332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdec414eb90 0x7fdec40aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:30.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec3fff700 1 --2- 172.21.15.87:0/1234184332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdec40a92f0 0x7fdec41e4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:30.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec2ffd700 1 -- 172.21.15.87:0/1234184332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdec40a92f0 msgr2=0x7fdec41e4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:30.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec2ffd700 1 --2- 172.21.15.87:0/1234184332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdec40a92f0 0x7fdec41e4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:30.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec2ffd700 1 -- 172.21.15.87:0/1234184332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdec414eb90 msgr2=0x7fdec40aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:30.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec2ffd700 1 --2- 172.21.15.87:0/1234184332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdec414eb90 0x7fdec40aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:30.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec2ffd700 1 -- 172.21.15.87:0/1234184332 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec40b4300 con 0x7fdec414ef60 2023-03-30T08:11:30.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.100+0000 7fdec2ffd700 1 --2- 172.21.15.87:0/1234184332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdec414ef60 0x7fdec40a8db0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800eaa0 tx=0x7fdeb800edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.104+0000 7fdeabfff700 1 -- 172.21.15.87:0/1234184332 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb800ee20 con 0x7fdec414ef60 2023-03-30T08:11:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.104+0000 7fdeabfff700 1 -- 172.21.15.87:0/1234184332 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb800c7e0 con 0x7fdec414ef60 2023-03-30T08:11:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.104+0000 7fdec8c6f700 1 -- 172.21.15.87:0/1234184332 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec40ae1b0 con 0x7fdec414ef60 2023-03-30T08:11:30.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.104+0000 7fdeabfff700 1 -- 172.21.15.87:0/1234184332 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb800cb90 con 0x7fdec414ef60 2023-03-30T08:11:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.104+0000 7fdec8c6f700 1 -- 172.21.15.87:0/1234184332 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec406ab60 con 0x7fdec414ef60 2023-03-30T08:11:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.104+0000 7fdec8c6f700 1 -- 172.21.15.87:0/1234184332 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec40733a0 con 0x7fdec414ef60 2023-03-30T08:11:30.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.104+0000 7fdeabfff700 1 -- 172.21.15.87:0/1234184332 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fdeb800ccf0 con 0x7fdec414ef60 2023-03-30T08:11:30.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.108+0000 7fdeabfff700 1 --2- 172.21.15.87:0/1234184332 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdeb00653f0 0x7fdeb00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:30.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.108+0000 7fdeabfff700 1 -- 172.21.15.87:0/1234184332 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdeb80828d0 con 0x7fdec414ef60 2023-03-30T08:11:30.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.108+0000 7fdec37fe700 1 --2- 172.21.15.87:0/1234184332 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdeb00653f0 0x7fdeb00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:30.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.108+0000 7fdec37fe700 1 --2- 172.21.15.87:0/1234184332 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdeb00653f0 0x7fdeb00678a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009c80 tx=0x7fdeb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:30.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.116+0000 7fdeabfff700 1 -- 172.21.15.87:0/1234184332 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fdeb8050250 con 0x7fdec414ef60 2023-03-30T08:11:30.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.328+0000 7fdec8c6f700 1 -- 172.21.15.87:0/1234184332 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdec40aed30 con 0x7fdec414ef60 2023-03-30T08:11:30.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.328+0000 7fdeabfff700 1 -- 172.21.15.87:0/1234184332 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fdeb8053870 con 0x7fdec414ef60 2023-03-30T08:11:30.334 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-03-30T08:11:30.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.332+0000 7fdec8c6f700 1 -- 172.21.15.87:0/1234184332 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdeb00653f0 msgr2=0x7fdeb00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:30.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.332+0000 7fdec8c6f700 1 --2- 172.21.15.87:0/1234184332 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdeb00653f0 0x7fdeb00678a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009c80 tx=0x7fdeb4008040 comp rx=0 tx=0).stop 2023-03-30T08:11:30.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.332+0000 7fdec8c6f700 1 -- 172.21.15.87:0/1234184332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdec414ef60 msgr2=0x7fdec40a8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:30.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.332+0000 7fdec8c6f700 1 --2- 172.21.15.87:0/1234184332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdec414ef60 0x7fdec40a8db0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800eaa0 tx=0x7fdeb800edb0 comp rx=0 tx=0).stop 2023-03-30T08:11:30.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.332+0000 7fdec8c6f700 1 -- 172.21.15.87:0/1234184332 shutdown_connections 2023-03-30T08:11:30.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.332+0000 7fdec8c6f700 1 --2- 172.21.15.87:0/1234184332 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdeb00653f0 0x7fdeb00678a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:30.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.332+0000 7fdec8c6f700 1 --2- 172.21.15.87:0/1234184332 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdec40a92f0 0x7fdec41e4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:30.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.332+0000 7fdec8c6f700 1 --2- 172.21.15.87:0/1234184332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdec414ef60 0x7fdec40a8db0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:30.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.332+0000 7fdec8c6f700 1 --2- 172.21.15.87:0/1234184332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdec414eb90 0x7fdec40aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:30.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.332+0000 7fdec8c6f700 1 -- 172.21.15.87:0/1234184332 >> 172.21.15.87:0/1234184332 conn(0x7fdec40cf410 msgr2=0x7fdec406ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:30.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.336+0000 7fdec8c6f700 1 -- 172.21.15.87:0/1234184332 shutdown_connections 2023-03-30T08:11:30.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:30.336+0000 7fdec8c6f700 1 -- 172.21.15.87:0/1234184332 wait complete. 2023-03-30T08:11:30.358 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-30T08:11:30.359 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-30T08:11:30.359 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2023-03-30T08:11:30.359 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-03-30T08:11:30.359 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-03-30T08:11:30.360 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-30T08:11:30.360 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-30T08:11:30.360 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-30T08:11:30.360 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-03-30T08:11:30.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:30.361 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2023-03-30T08:11:30.372 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-30T08:11:30.373 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-30T08:11:30.373 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2023-03-30T08:11:30.373 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:30.373 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2023-03-30T08:11:30.373 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:30.373 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:11:30.373 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:30.374 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2023-03-30T08:11:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:11:30.374 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:30.374 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2023-03-30T08:11:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:11:30.374 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-30T08:11:30.374 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:30.375 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-03-30T08:11:30.375 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42455sec preferred_lft 42455sec 2023-03-30T08:11:30.375 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2023-03-30T08:11:30.375 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-03-30T08:11:30.375 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:18:c5:86:06 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:30.375 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-03-30T08:11:30.375 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:30.376 INFO:teuthology.orchestra.run.smithi087.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-30T08:11:30.376 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether ba:c6:29:ff:a6:14 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:30.376 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-03-30T08:11:30.376 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:30.376 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::887:93ff:fe81:2f74/64 scope link 2023-03-30T08:11:30.376 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:30.376 INFO:teuthology.orchestra.run.smithi087.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-30T08:11:30.376 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether ba:c6:29:ff:a6:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-30T08:11:30.377 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::b8c6:29ff:feff:a614/64 scope link tentative 2023-03-30T08:11:30.377 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:30.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:30.378 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-30T08:11:30.449 INFO:teuthology.orchestra.run.smithi087.stdout:1 2023-03-30T08:11:30.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:30.452 DEBUG:teuthology.orchestra.run.smithi087:> route 2023-03-30T08:11:30.513 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2023-03-30T08:11:30.514 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-30T08:11:30.514 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-03-30T08:11:30.514 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-30T08:11:30.514 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-03-30T08:11:30.514 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-03-30T08:11:30.514 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-03-30T08:11:30.515 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-30T08:11:30.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:30.515 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-03-30T08:11:30.515 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-03-30T08:11:30.516 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-30T08:11:30.516 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-30T08:11:30.516 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-30T08:11:30.516 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-03-30T08:11:30.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:30.639 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2023-03-30T08:11:30.652 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-03-30T08:11:30.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:30.653 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2023-03-30T08:11:30.713 INFO:teuthology.orchestra.run.smithi087.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-03-30T08:11:30.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:30.715 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-03-30T08:11:30.715 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-03-30T08:11:30.715 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-03-30T08:11:30.716 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-03-30T08:11:30.716 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-03-30T08:11:30.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:30.826 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-03-30T08:11:30.858 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-30T08:11:30.858 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-30T08:11:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2023-03-30T08:11:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2023-03-30T08:11:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:30.859 INFO:teuthology.orchestra.run.smithi087.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-30T08:11:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether fe:d5:ea:ec:b3:42 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-03-30T08:11:30.859 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-03-30T08:11:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::fcd5:eaff:feec:b342/64 scope link tentative 2023-03-30T08:11:30.860 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:30.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:30.861 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-03-30T08:11:30.939 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-30T08:11:30.940 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-30T08:11:30.940 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2023-03-30T08:11:30.940 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:30.940 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2023-03-30T08:11:30.940 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:30.941 INFO:teuthology.orchestra.run.smithi087.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-30T08:11:30.941 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether fe:d5:ea:ec:b3:42 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-03-30T08:11:30.941 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-03-30T08:11:30.941 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:30.941 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::fcd5:eaff:feec:b342/64 scope link tentative 2023-03-30T08:11:30.941 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:30.943 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-03-30T08:11:30.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:30.944 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-03-30T08:11:30.944 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-03-30T08:11:30.944 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-03-30T08:11:30.945 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-03-30T08:11:30.945 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-03-30T08:11:30.945 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-03-30T08:11:30.945 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-03-30T08:11:30.946 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-03-30T08:11:31.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:31.121 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-03-30T08:11:31.121 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-03-30T08:11:31.122 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.1 up 2023-03-30T08:11:31.122 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.1 master ceph-brx 2023-03-30T08:11:31.122 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-03-30T08:11:31.184 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-30T08:11:31.185 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-03-30T08:11:31.197 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-03-30T08:11:31.197 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-30T08:11:31.198 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-03-30T08:11:31.252 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-03-30T08:11:31.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:31.253 DEBUG:teuthology.orchestra.run.smithi087:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-03-30T08:11:31.377 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-03-30T08:11:31.377 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-03-30T08:11:31.377 INFO:teuthology.orchestra.run.smithi087.stdout:invalid new device string format 2023-03-30T08:11:31.405 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-03-30T08:11:31.406 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-03-30T08:11:31.406 INFO:teuthology.orchestra.run.smithi087.stdout:invalid new device string format 2023-03-30T08:11:31.406 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: resolved to: "172.21.15.87:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-03-30T08:11:31.406 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-30T08:11:31.422 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-03-30T08:11:31.422 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-03-30T08:11:31.422 INFO:teuthology.orchestra.run.smithi087.stdout:invalid new device string format 2023-03-30T08:11:31.423 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: resolved to: "172.21.15.87:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-03-30T08:11:31.424 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-30T08:11:31.424 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: resolved to: "172.21.15.87:6789,172.21.15.115:6789,172.21.15.115:6790" 2023-03-30T08:11:31.424 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.87:6789,172.21.15.115:6789,172.21.15.115:6790:/ 2023-03-30T08:11:31.424 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=936aee23-1888-4f7e-bc67-7a45e372f20a" will pass to kernel 2023-03-30T08:11:31.428 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-30T08:11:31.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:31.430 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-03-30T08:11:31.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:31.458 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-30T08:11:31.522 INFO:teuthology.orchestra.run.smithi087.stdout:client4816 2023-03-30T08:11:31.523 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:11:31.523 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:31.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:31.579 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-30T08:11:31.642 INFO:teuthology.orchestra.run.smithi087.stdout:client4816 2023-03-30T08:11:31.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:31.643 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-30T08:11:31.706 INFO:teuthology.orchestra.run.smithi087.stdout:client4816 2023-03-30T08:11:31.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:31.707 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/936aee23-1888-4f7e-bc67-7a45e372f20a.client4816/status') 2023-03-30T08:11:31.786 INFO:teuthology.orchestra.run.smithi087.stdout:instance: client.4816 (3)172.21.15.87:0/2651430066 2023-03-30T08:11:31.786 INFO:teuthology.orchestra.run.smithi087.stdout:blocklisted: false 2023-03-30T08:11:31.786 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2023-03-30T08:11:31.787 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2023-03-30T08:11:31.787 INFO:teuthology.orchestra.run.smithi087.stderr:70 bytes copied, 0.000149117 s, 469 kB/s 2023-03-30T08:11:31.789 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-03-30T08:11:31.789 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-30T08:11:31.789 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-03-30T08:11:31.790 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-30T08:11:32.003 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.000+0000 7fd499861700 1 Processor -- start 2023-03-30T08:11:32.003 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.000+0000 7fd499861700 1 -- start start 2023-03-30T08:11:32.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.000+0000 7fd499861700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd4940b8570 0x7fd494160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:32.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.000+0000 7fd499861700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd49406a3e0 0x7fd4940d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:32.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.000+0000 7fd499861700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4940d09f0 con 0x7fd4940ceeb0 2023-03-30T08:11:32.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.000+0000 7fd499861700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4940cd240 con 0x7fd4940b8570 2023-03-30T08:11:32.007 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.000+0000 7fd499861700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940cda50 con 0x7fd49406a3e0 2023-03-30T08:11:32.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.000+0000 7fd49885f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd4940b8570 0x7fd494160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:32.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.000+0000 7fd499060700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd49406a3e0 0x7fd4940d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:32.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.000+0000 7fd49885f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd4940b8570 0x7fd494160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58650/0 (socket says 172.21.15.87:58650) 2023-03-30T08:11:32.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.000+0000 7fd49885f700 1 -- 172.21.15.87:0/3041718491 learned_addr learned my addr 172.21.15.87:0/3041718491 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:32.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.000+0000 7fd48bfff700 1 --1- 172.21.15.87:0/3041718491 >> v1:172.21.15.115:6789/0 conn(0x7fd4940ceeb0 0x7fd494069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:37322/0 (socket says 172.21.15.87:37322) 2023-03-30T08:11:32.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd49885f700 1 -- 172.21.15.87:0/3041718491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd49406a3e0 msgr2=0x7fd4940d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:32.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd49885f700 1 --2- 172.21.15.87:0/3041718491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd49406a3e0 0x7fd4940d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:32.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd49885f700 1 -- 172.21.15.87:0/3041718491 >> v1:172.21.15.115:6789/0 conn(0x7fd4940ceeb0 legacy=0x7fd494069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:32.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd49885f700 1 -- 172.21.15.87:0/3041718491 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4940cf300 con 0x7fd4940b8570 2023-03-30T08:11:32.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd49885f700 1 --2- 172.21.15.87:0/3041718491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4940b8570 0x7fd494160930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd490009e50 tx=0x7fd49000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e9a4d8bae5193e server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:32.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd48b7fe700 1 -- 172.21.15.87:0/3041718491 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000e070 con 0x7fd4940b8570 2023-03-30T08:11:32.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd48b7fe700 1 -- 172.21.15.87:0/3041718491 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49000b910 con 0x7fd4940b8570 2023-03-30T08:11:32.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd48b7fe700 1 -- 172.21.15.87:0/3041718491 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000bcc0 con 0x7fd4940b8570 2023-03-30T08:11:32.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd499861700 1 -- 172.21.15.87:0/3041718491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4940b8570 msgr2=0x7fd494160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:32.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd499861700 1 --2- 172.21.15.87:0/3041718491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4940b8570 0x7fd494160930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd490009e50 tx=0x7fd49000b330 comp rx=0 tx=0).stop 2023-03-30T08:11:32.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd499861700 1 -- 172.21.15.87:0/3041718491 shutdown_connections 2023-03-30T08:11:32.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd499861700 1 --2- 172.21.15.87:0/3041718491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd49406a3e0 0x7fd4940d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:32.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd499861700 1 --2- 172.21.15.87:0/3041718491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4940b8570 0x7fd494160930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:32.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd499861700 1 -- 172.21.15.87:0/3041718491 >> 172.21.15.87:0/3041718491 conn(0x7fd4940b5320 msgr2=0x7fd4940cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:32.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd499861700 1 -- 172.21.15.87:0/3041718491 shutdown_connections 2023-03-30T08:11:32.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.004+0000 7fd499861700 1 -- 172.21.15.87:0/3041718491 wait complete. 2023-03-30T08:11:32.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd499861700 1 Processor -- start 2023-03-30T08:11:32.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd499861700 1 -- start start 2023-03-30T08:11:32.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd499861700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49406a3e0 0x7fd49414d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:32.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd499861700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4940b8570 0x7fd49415d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:32.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd499861700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4940ceeb0 0x7fd49415ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:32.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd499861700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940cd020 con 0x7fd4940b8570 2023-03-30T08:11:32.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd499861700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940ccd40 con 0x7fd49406a3e0 2023-03-30T08:11:32.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd499861700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49415e390 con 0x7fd4940ceeb0 2023-03-30T08:11:32.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd48bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4940b8570 0x7fd49415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:32.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd48bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4940b8570 0x7fd49415d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58662/0 (socket says 172.21.15.87:58662) 2023-03-30T08:11:32.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd48bfff700 1 -- 172.21.15.87:0/2329086567 learned_addr learned my addr 172.21.15.87:0/2329086567 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:32.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd49885f700 1 --2- 172.21.15.87:0/2329086567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49406a3e0 0x7fd49414d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:32.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd499060700 1 --2- 172.21.15.87:0/2329086567 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4940ceeb0 0x7fd49415ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:32.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd48bfff700 1 -- 172.21.15.87:0/2329086567 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4940ceeb0 msgr2=0x7fd49415ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:32.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd48bfff700 1 --2- 172.21.15.87:0/2329086567 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4940ceeb0 0x7fd49415ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:32.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd48bfff700 1 -- 172.21.15.87:0/2329086567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49406a3e0 msgr2=0x7fd49414d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:32.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd48bfff700 1 --2- 172.21.15.87:0/2329086567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49406a3e0 0x7fd49414d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:32.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.008+0000 7fd48bfff700 1 -- 172.21.15.87:0/2329086567 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd490009b30 con 0x7fd4940b8570 2023-03-30T08:11:32.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.012+0000 7fd48bfff700 1 --2- 172.21.15.87:0/2329086567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4940b8570 0x7fd49415d960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd48400c480 tx=0x7fd48400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:32.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.012+0000 7fd4897fa700 1 -- 172.21.15.87:0/2329086567 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484005d20 con 0x7fd4940b8570 2023-03-30T08:11:32.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.012+0000 7fd4897fa700 1 -- 172.21.15.87:0/2329086567 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd484005e80 con 0x7fd4940b8570 2023-03-30T08:11:32.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.012+0000 7fd499861700 1 -- 172.21.15.87:0/2329086567 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4940cd490 con 0x7fd4940b8570 2023-03-30T08:11:32.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.012+0000 7fd4897fa700 1 -- 172.21.15.87:0/2329086567 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4840072d0 con 0x7fd4940b8570 2023-03-30T08:11:32.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.012+0000 7fd499861700 1 -- 172.21.15.87:0/2329086567 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4940d28c0 con 0x7fd4940b8570 2023-03-30T08:11:32.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.012+0000 7fd499861700 1 -- 172.21.15.87:0/2329086567 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4940cd770 con 0x7fd4940b8570 2023-03-30T08:11:32.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.016+0000 7fd4897fa700 1 -- 172.21.15.87:0/2329086567 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd484007430 con 0x7fd4940b8570 2023-03-30T08:11:32.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.016+0000 7fd4897fa700 1 --2- 172.21.15.87:0/2329086567 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4800653f0 0x7fd4800678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:32.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.016+0000 7fd4897fa700 1 -- 172.21.15.87:0/2329086567 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd484081db0 con 0x7fd4940b8570 2023-03-30T08:11:32.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.016+0000 7fd49885f700 1 --2- 172.21.15.87:0/2329086567 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4800653f0 0x7fd4800678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:32.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.016+0000 7fd49885f700 1 --2- 172.21.15.87:0/2329086567 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4800653f0 0x7fd4800678a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd49000b370 tx=0x7fd490009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:32.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.020+0000 7fd4897fa700 1 -- 172.21.15.87:0/2329086567 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fd48404a5e0 con 0x7fd4940b8570 2023-03-30T08:11:32.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.228+0000 7fd499861700 1 -- 172.21.15.87:0/2329086567 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd4940733a0 con 0x7fd4940b8570 2023-03-30T08:11:32.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.228+0000 7fd4897fa700 1 -- 172.21.15.87:0/2329086567 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd484017070 con 0x7fd4940b8570 2023-03-30T08:11:32.234 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-03-30T08:11:32.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.232+0000 7fd499861700 1 -- 172.21.15.87:0/2329086567 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4800653f0 msgr2=0x7fd4800678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:32.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.232+0000 7fd499861700 1 --2- 172.21.15.87:0/2329086567 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4800653f0 0x7fd4800678a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd49000b370 tx=0x7fd490009000 comp rx=0 tx=0).stop 2023-03-30T08:11:32.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.232+0000 7fd499861700 1 -- 172.21.15.87:0/2329086567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4940b8570 msgr2=0x7fd49415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:32.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.232+0000 7fd499861700 1 --2- 172.21.15.87:0/2329086567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4940b8570 0x7fd49415d960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd48400c480 tx=0x7fd48400c790 comp rx=0 tx=0).stop 2023-03-30T08:11:32.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.232+0000 7fd499861700 1 -- 172.21.15.87:0/2329086567 shutdown_connections 2023-03-30T08:11:32.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.232+0000 7fd499861700 1 --2- 172.21.15.87:0/2329086567 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4800653f0 0x7fd4800678a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:32.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.232+0000 7fd499861700 1 --2- 172.21.15.87:0/2329086567 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4940ceeb0 0x7fd49415ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:32.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.232+0000 7fd499861700 1 --2- 172.21.15.87:0/2329086567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4940b8570 0x7fd49415d960 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:32.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.232+0000 7fd499861700 1 --2- 172.21.15.87:0/2329086567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd49406a3e0 0x7fd49414d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:32.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.232+0000 7fd499861700 1 -- 172.21.15.87:0/2329086567 >> 172.21.15.87:0/2329086567 conn(0x7fd4940b5320 msgr2=0x7fd49415b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:32.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.232+0000 7fd499861700 1 -- 172.21.15.87:0/2329086567 shutdown_connections 2023-03-30T08:11:32.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:32.232+0000 7fd499861700 1 -- 172.21.15.87:0/2329086567 wait complete. 2023-03-30T08:11:32.257 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-30T08:11:32.257 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-30T08:11:32.257 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-03-30T08:11:32.258 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-03-30T08:11:32.258 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-03-30T08:11:32.258 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-30T08:11:32.259 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-30T08:11:32.259 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-30T08:11:32.260 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-03-30T08:11:32.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:32.261 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-03-30T08:11:32.276 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-30T08:11:32.277 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-30T08:11:32.277 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-03-30T08:11:32.277 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:32.277 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-03-30T08:11:32.277 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:32.278 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:11:32.278 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:32.278 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-03-30T08:11:32.278 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:11:32.278 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:32.278 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-03-30T08:11:32.278 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:11:32.279 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:32.279 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-30T08:11:32.279 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:32.279 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-03-30T08:11:32.279 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 42451sec preferred_lft 42451sec 2023-03-30T08:11:32.279 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-03-30T08:11:32.279 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:32.279 INFO:teuthology.orchestra.run.smithi115.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-03-30T08:11:32.280 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 02:42:48:af:17:23 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:32.280 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-03-30T08:11:32.280 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:32.281 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-03-30T08:11:32.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:32.281 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-03-30T08:11:32.282 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-03-30T08:11:32.282 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add name ceph-brx type bridge 2023-03-30T08:11:32.282 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr flush dev ceph-brx 2023-03-30T08:11:32.282 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set ceph-brx up 2023-03-30T08:11:32.283 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-03-30T08:11:32.283 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-03-30T08:11:32.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:32.425 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-30T08:11:32.453 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-03-30T08:11:32.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:32.456 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-03-30T08:11:32.593 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-03-30T08:11:32.593 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-30T08:11:32.593 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-03-30T08:11:32.594 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-30T08:11:32.594 INFO:teuthology.orchestra.run.smithi115.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-03-30T08:11:32.594 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-03-30T08:11:32.594 INFO:teuthology.orchestra.run.smithi115.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-03-30T08:11:32.594 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-30T08:11:32.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:32.595 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-03-30T08:11:32.595 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-03-30T08:11:32.595 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-30T08:11:32.595 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-30T08:11:32.596 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-30T08:11:32.596 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-03-30T08:11:32.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:32.675 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-03-30T08:11:32.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:32.689 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list-id 2023-03-30T08:11:32.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:32.745 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-03-30T08:11:32.745 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-03-30T08:11:32.745 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-03-30T08:11:32.745 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-03-30T08:11:32.746 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-03-30T08:11:32.849 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-03-30T08:11:32.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:32.850 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-03-30T08:11:32.850 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-03-30T08:11:32.850 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-03-30T08:11:32.850 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-03-30T08:11:32.851 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-03-30T08:11:32.851 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-03-30T08:11:32.851 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-03-30T08:11:32.851 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-03-30T08:11:33.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:33.002 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-03-30T08:11:33.002 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-03-30T08:11:33.003 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-03-30T08:11:33.003 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set dev brx.0 master ceph-brx 2023-03-30T08:11:33.003 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-03-30T08:11:33.063 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-30T08:11:33.063 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-03-30T08:11:33.077 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-03-30T08:11:33.077 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-30T08:11:33.078 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-03-30T08:11:33.144 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-03-30T08:11:33.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:33.145 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-03-30T08:11:33.273 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-03-30T08:11:33.273 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-03-30T08:11:33.274 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2023-03-30T08:11:33.398 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-03-30T08:11:33.399 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-03-30T08:11:33.399 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2023-03-30T08:11:33.399 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.87:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-03-30T08:11:33.399 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-30T08:11:33.417 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-03-30T08:11:33.418 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-03-30T08:11:33.418 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2023-03-30T08:11:33.418 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.87:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-03-30T08:11:33.418 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-30T08:11:33.418 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.87:6789,172.21.15.115:6789,172.21.15.115:6790" 2023-03-30T08:11:33.418 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.87:6789,172.21.15.115:6789,172.21.15.115:6790:/ 2023-03-30T08:11:33.419 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=936aee23-1888-4f7e-bc67-7a45e372f20a" will pass to kernel 2023-03-30T08:11:33.423 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-30T08:11:33.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:33.424 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-03-30T08:11:33.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:33.452 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-30T08:11:33.518 INFO:teuthology.orchestra.run.smithi115.stdout:client4825 2023-03-30T08:11:33.519 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:11:33.519 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:33.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:33.577 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-30T08:11:33.644 INFO:teuthology.orchestra.run.smithi115.stdout:client4825 2023-03-30T08:11:33.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:33.645 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-30T08:11:33.708 INFO:teuthology.orchestra.run.smithi115.stdout:client4825 2023-03-30T08:11:33.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:33.708 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/936aee23-1888-4f7e-bc67-7a45e372f20a.client4825/status') 2023-03-30T08:11:33.784 INFO:teuthology.orchestra.run.smithi115.stdout:instance: client.4825 (3)192.168.0.1:0/100135725 2023-03-30T08:11:33.785 INFO:teuthology.orchestra.run.smithi115.stdout:blocklisted: false 2023-03-30T08:11:33.785 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records in 2023-03-30T08:11:33.785 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records out 2023-03-30T08:11:33.785 INFO:teuthology.orchestra.run.smithi115.stderr:68 bytes copied, 0.000150198 s, 453 kB/s 2023-03-30T08:11:33.787 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-03-30T08:11:33.787 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-30T08:11:33.787 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-03-30T08:11:33.788 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-30T08:11:33.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.948+0000 7fa33e8ab700 1 Processor -- start 2023-03-30T08:11:33.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.948+0000 7fa33e8ab700 1 -- start start 2023-03-30T08:11:33.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33e8ab700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa338163dc0 0x7fa3380c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:33.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33e8ab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa338164190 0x7fa3380c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:33.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33e8ab700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3380aea30 0x7fa3380ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:33.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33e8ab700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33806d810 con 0x7fa3380aea30 2023-03-30T08:11:33.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33e8ab700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3380cc1d0 con 0x7fa338163dc0 2023-03-30T08:11:33.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33e8ab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa338069f00 con 0x7fa338164190 2023-03-30T08:11:33.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33e0aa700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3380aea30 0x7fa3380ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:33.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33e0aa700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa3380aea30 0x7fa3380ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58672/0 (socket says 172.21.15.87:58672) 2023-03-30T08:11:33.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33d8a9700 1 --2- 172.21.15.87:0/1201297055 >> v2:172.21.15.115:3300/0 conn(0x7fa338163dc0 0x7fa3380c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:33.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33e0aa700 1 -- 172.21.15.87:0/1201297055 learned_addr learned my addr 172.21.15.87:0/1201297055 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:33.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33d0a8700 1 --2- 172.21.15.87:0/1201297055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa338164190 0x7fa3380c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:33.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33e0aa700 1 -- 172.21.15.87:0/1201297055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa338164190 msgr2=0x7fa3380c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:33.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33e0aa700 1 --2- 172.21.15.87:0/1201297055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa338164190 0x7fa3380c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:33.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33e0aa700 1 -- 172.21.15.87:0/1201297055 >> v2:172.21.15.115:3300/0 conn(0x7fa338163dc0 msgr2=0x7fa3380c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:33.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33e0aa700 1 --2- 172.21.15.87:0/1201297055 >> v2:172.21.15.115:3300/0 conn(0x7fa338163dc0 0x7fa3380c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:33.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33e0aa700 1 -- 172.21.15.87:0/1201297055 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33806cf70 con 0x7fa3380aea30 2023-03-30T08:11:33.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33d8a9700 1 --2- 172.21.15.87:0/1201297055 >> v2:172.21.15.115:3300/0 conn(0x7fa338163dc0 0x7fa3380c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:33.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33e0aa700 1 --2- 172.21.15.87:0/1201297055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3380aea30 0x7fa3380ca040 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa3380cba30 tx=0x7fa330009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51336722c6e221f server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:33.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33c8a7700 1 -- 172.21.15.87:0/1201297055 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330011830 con 0x7fa3380aea30 2023-03-30T08:11:33.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33c8a7700 1 -- 172.21.15.87:0/1201297055 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa330011990 con 0x7fa3380aea30 2023-03-30T08:11:33.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.952+0000 7fa33c8a7700 1 -- 172.21.15.87:0/1201297055 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330011d20 con 0x7fa3380aea30 2023-03-30T08:11:33.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.956+0000 7fa33e8ab700 1 -- 172.21.15.87:0/1201297055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3380aea30 msgr2=0x7fa3380ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:33.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.956+0000 7fa33e8ab700 1 --2- 172.21.15.87:0/1201297055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3380aea30 0x7fa3380ca040 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa3380cba30 tx=0x7fa330009bf0 comp rx=0 tx=0).stop 2023-03-30T08:11:33.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.956+0000 7fa33e8ab700 1 -- 172.21.15.87:0/1201297055 shutdown_connections 2023-03-30T08:11:33.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.956+0000 7fa33e8ab700 1 --2- 172.21.15.87:0/1201297055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3380aea30 0x7fa3380ca040 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:33.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.956+0000 7fa33e8ab700 1 --2- 172.21.15.87:0/1201297055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa338164190 0x7fa3380c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:33.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.956+0000 7fa33e8ab700 1 --2- 172.21.15.87:0/1201297055 >> v2:172.21.15.115:3300/0 conn(0x7fa338163dc0 0x7fa3380c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:33.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.956+0000 7fa33e8ab700 1 -- 172.21.15.87:0/1201297055 >> 172.21.15.87:0/1201297055 conn(0x7fa3380cf410 msgr2=0x7fa3380cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:33.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.956+0000 7fa33e8ab700 1 -- 172.21.15.87:0/1201297055 shutdown_connections 2023-03-30T08:11:33.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.956+0000 7fa33e8ab700 1 -- 172.21.15.87:0/1201297055 wait complete. 2023-03-30T08:11:33.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33e8ab700 1 Processor -- start 2023-03-30T08:11:33.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33e8ab700 1 -- start start 2023-03-30T08:11:33.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33e8ab700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3380aea30 0x7fa338157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:33.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33e8ab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa338163dc0 0x7fa33815b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:33.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33e8ab700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa338164190 0x7fa33815b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:33.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33e8ab700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380c2d40 con 0x7fa3380aea30 2023-03-30T08:11:33.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33e8ab700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380c20c0 con 0x7fa338164190 2023-03-30T08:11:33.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33e8ab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380c23a0 con 0x7fa338163dc0 2023-03-30T08:11:33.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33d8a9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3380aea30 0x7fa338157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:33.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33d8a9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3380aea30 0x7fa338157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58684/0 (socket says 172.21.15.87:58684) 2023-03-30T08:11:33.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33d8a9700 1 -- 172.21.15.87:0/3831129962 learned_addr learned my addr 172.21.15.87:0/3831129962 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:33.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33d0a8700 1 --2- 172.21.15.87:0/3831129962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa338163dc0 0x7fa33815b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:33.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33e0aa700 1 --2- 172.21.15.87:0/3831129962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa338164190 0x7fa33815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:33.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33d8a9700 1 -- 172.21.15.87:0/3831129962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa338163dc0 msgr2=0x7fa33815b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:33.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33d8a9700 1 --2- 172.21.15.87:0/3831129962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa338163dc0 0x7fa33815b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:33.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33d8a9700 1 -- 172.21.15.87:0/3831129962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa338164190 msgr2=0x7fa33815b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:33.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33d8a9700 1 --2- 172.21.15.87:0/3831129962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa338164190 0x7fa33815b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:33.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33d8a9700 1 -- 172.21.15.87:0/3831129962 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa334009a70 con 0x7fa3380aea30 2023-03-30T08:11:33.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33e0aa700 1 --2- 172.21.15.87:0/3831129962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa338164190 0x7fa33815b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:33.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33d8a9700 1 --2- 172.21.15.87:0/3831129962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3380aea30 0x7fa338157b80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa33400eed0 tx=0x7fa33400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:33.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa32e7fc700 1 -- 172.21.15.87:0/3831129962 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334010040 con 0x7fa3380aea30 2023-03-30T08:11:33.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa32e7fc700 1 -- 172.21.15.87:0/3831129962 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33400be70 con 0x7fa3380aea30 2023-03-30T08:11:33.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa32e7fc700 1 -- 172.21.15.87:0/3831129962 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334014600 con 0x7fa3380aea30 2023-03-30T08:11:33.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33e8ab700 1 -- 172.21.15.87:0/3831129962 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa330009570 con 0x7fa3380aea30 2023-03-30T08:11:33.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.960+0000 7fa33e8ab700 1 -- 172.21.15.87:0/3831129962 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33806d530 con 0x7fa3380aea30 2023-03-30T08:11:33.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.964+0000 7fa33e8ab700 1 -- 172.21.15.87:0/3831129962 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33806d250 con 0x7fa3380aea30 2023-03-30T08:11:33.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.964+0000 7fa32e7fc700 1 -- 172.21.15.87:0/3831129962 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa334014760 con 0x7fa3380aea30 2023-03-30T08:11:33.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.968+0000 7fa32e7fc700 1 --2- 172.21.15.87:0/3831129962 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa31c0653f0 0x7fa31c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:33.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.968+0000 7fa32e7fc700 1 -- 172.21.15.87:0/3831129962 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa334083490 con 0x7fa3380aea30 2023-03-30T08:11:33.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.968+0000 7fa33d0a8700 1 --2- 172.21.15.87:0/3831129962 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa31c0653f0 0x7fa31c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:33.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.968+0000 7fa33d0a8700 1 --2- 172.21.15.87:0/3831129962 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa31c0653f0 0x7fa31c0678a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa3380b09e0 tx=0x7fa328008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:33.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:33.972+0000 7fa32e7fc700 1 -- 172.21.15.87:0/3831129962 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fa334054840 con 0x7fa3380aea30 2023-03-30T08:11:34.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:34.176+0000 7fa33e8ab700 1 -- 172.21.15.87:0/3831129962 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa3380c2fb0 con 0x7fa3380aea30 2023-03-30T08:11:34.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:34.176+0000 7fa32e7fc700 1 -- 172.21.15.87:0/3831129962 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa334054430 con 0x7fa3380aea30 2023-03-30T08:11:34.183 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-03-30T08:11:34.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:34.180+0000 7fa33e8ab700 1 -- 172.21.15.87:0/3831129962 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa31c0653f0 msgr2=0x7fa31c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:34.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:34.180+0000 7fa33e8ab700 1 --2- 172.21.15.87:0/3831129962 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa31c0653f0 0x7fa31c0678a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa3380b09e0 tx=0x7fa328008040 comp rx=0 tx=0).stop 2023-03-30T08:11:34.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:34.180+0000 7fa33e8ab700 1 -- 172.21.15.87:0/3831129962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3380aea30 msgr2=0x7fa338157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:34.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:34.180+0000 7fa33e8ab700 1 --2- 172.21.15.87:0/3831129962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3380aea30 0x7fa338157b80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa33400eed0 tx=0x7fa33400b390 comp rx=0 tx=0).stop 2023-03-30T08:11:34.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:34.180+0000 7fa33e8ab700 1 -- 172.21.15.87:0/3831129962 shutdown_connections 2023-03-30T08:11:34.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:34.180+0000 7fa33e8ab700 1 --2- 172.21.15.87:0/3831129962 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa31c0653f0 0x7fa31c0678a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:34.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:34.180+0000 7fa33e8ab700 1 --2- 172.21.15.87:0/3831129962 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa338164190 0x7fa33815b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:34.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:34.180+0000 7fa33e8ab700 1 --2- 172.21.15.87:0/3831129962 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa338163dc0 0x7fa33815b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:34.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:34.180+0000 7fa33e8ab700 1 --2- 172.21.15.87:0/3831129962 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa3380aea30 0x7fa338157b80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:34.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:34.180+0000 7fa33e8ab700 1 -- 172.21.15.87:0/3831129962 >> 172.21.15.87:0/3831129962 conn(0x7fa3380cf410 msgr2=0x7fa338070180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:34.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:34.180+0000 7fa33e8ab700 1 -- 172.21.15.87:0/3831129962 shutdown_connections 2023-03-30T08:11:34.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:34.180+0000 7fa33e8ab700 1 -- 172.21.15.87:0/3831129962 wait complete. 2023-03-30T08:11:34.205 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-30T08:11:34.206 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-30T08:11:34.206 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-03-30T08:11:34.206 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-03-30T08:11:34.206 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-03-30T08:11:34.207 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-30T08:11:34.207 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-30T08:11:34.207 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-30T08:11:34.207 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-03-30T08:11:34.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:34.208 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-03-30T08:11:34.227 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-30T08:11:34.227 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-30T08:11:34.227 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-03-30T08:11:34.228 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:34.228 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-03-30T08:11:34.228 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:34.228 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:11:34.228 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:34.228 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-03-30T08:11:34.228 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:11:34.229 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:34.229 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-03-30T08:11:34.229 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:11:34.229 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:34.229 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-30T08:11:34.229 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:34.230 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-03-30T08:11:34.230 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 42449sec preferred_lft 42449sec 2023-03-30T08:11:34.230 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-03-30T08:11:34.230 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:34.230 INFO:teuthology.orchestra.run.smithi115.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-03-30T08:11:34.230 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 02:42:48:af:17:23 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:34.231 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-03-30T08:11:34.231 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:34.231 INFO:teuthology.orchestra.run.smithi115.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-30T08:11:34.231 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether be:64:92:c3:31:18 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:11:34.231 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-03-30T08:11:34.231 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:34.232 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::5406:ceff:fee3:c19a/64 scope link 2023-03-30T08:11:34.232 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:34.233 INFO:teuthology.orchestra.run.smithi115.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-30T08:11:34.233 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether be:64:92:c3:31:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-03-30T08:11:34.233 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::bc64:92ff:fec3:3118/64 scope link tentative 2023-03-30T08:11:34.234 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:34.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:34.234 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-30T08:11:34.309 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-03-30T08:11:34.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:34.312 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-03-30T08:11:34.375 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-03-30T08:11:34.376 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-30T08:11:34.376 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-03-30T08:11:34.376 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-30T08:11:34.376 INFO:teuthology.orchestra.run.smithi115.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-03-30T08:11:34.377 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-03-30T08:11:34.377 INFO:teuthology.orchestra.run.smithi115.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-03-30T08:11:34.377 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-30T08:11:34.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:34.378 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-03-30T08:11:34.379 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-03-30T08:11:34.379 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-30T08:11:34.379 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-30T08:11:34.379 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-30T08:11:34.380 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-03-30T08:11:34.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:34.497 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-03-30T08:11:34.511 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-03-30T08:11:34.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:34.513 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list-id 2023-03-30T08:11:34.574 INFO:teuthology.orchestra.run.smithi115.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-03-30T08:11:34.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:34.575 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-03-30T08:11:34.575 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-03-30T08:11:34.575 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-03-30T08:11:34.576 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-03-30T08:11:34.576 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-03-30T08:11:34.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:34.685 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-03-30T08:11:34.717 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-30T08:11:34.717 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-30T08:11:34.718 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-03-30T08:11:34.718 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:34.718 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-03-30T08:11:34.718 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:34.718 INFO:teuthology.orchestra.run.smithi115.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-30T08:11:34.718 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether f6:1c:cc:10:9f:9b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-03-30T08:11:34.718 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-03-30T08:11:34.718 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:34.719 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::f41c:ccff:fe10:9f9b/64 scope link 2023-03-30T08:11:34.719 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:34.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:34.721 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-03-30T08:11:34.794 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-30T08:11:34.794 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-30T08:11:34.794 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-03-30T08:11:34.795 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:34.795 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-03-30T08:11:34.795 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:34.795 INFO:teuthology.orchestra.run.smithi115.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-30T08:11:34.795 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether f6:1c:cc:10:9f:9b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-03-30T08:11:34.795 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-03-30T08:11:34.795 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:34.796 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::f41c:ccff:fe10:9f9b/64 scope link 2023-03-30T08:11:34.796 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:11:34.798 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-03-30T08:11:34.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:34.799 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-03-30T08:11:34.799 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-03-30T08:11:34.799 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-03-30T08:11:34.800 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-03-30T08:11:34.800 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-03-30T08:11:34.800 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-03-30T08:11:34.800 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-03-30T08:11:34.801 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-03-30T08:11:34.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:34.974 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-03-30T08:11:34.974 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-03-30T08:11:34.974 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.1 up 2023-03-30T08:11:34.974 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set dev brx.1 master ceph-brx 2023-03-30T08:11:34.975 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-03-30T08:11:35.038 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-30T08:11:35.039 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-03-30T08:11:35.054 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-03-30T08:11:35.054 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-30T08:11:35.055 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-03-30T08:11:35.111 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-03-30T08:11:35.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:35.112 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-03-30T08:11:35.230 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-03-30T08:11:35.231 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-03-30T08:11:35.231 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2023-03-30T08:11:35.252 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-03-30T08:11:35.252 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-03-30T08:11:35.253 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2023-03-30T08:11:35.253 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.87:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-03-30T08:11:35.253 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-30T08:11:35.267 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-03-30T08:11:35.267 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-03-30T08:11:35.267 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2023-03-30T08:11:35.267 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.87:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-03-30T08:11:35.267 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-30T08:11:35.268 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.87:6789,172.21.15.115:6789,172.21.15.115:6790" 2023-03-30T08:11:35.268 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.87:6789,172.21.15.115:6789,172.21.15.115:6790:/ 2023-03-30T08:11:35.268 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=936aee23-1888-4f7e-bc67-7a45e372f20a" will pass to kernel 2023-03-30T08:11:35.272 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-30T08:11:35.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:35.273 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-03-30T08:11:35.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:35.303 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-30T08:11:35.365 INFO:teuthology.orchestra.run.smithi115.stdout:client4836 2023-03-30T08:11:35.366 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:11:35.366 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:35.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:35.424 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-30T08:11:35.488 INFO:teuthology.orchestra.run.smithi115.stdout:client4836 2023-03-30T08:11:35.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:35.489 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-30T08:11:35.551 INFO:teuthology.orchestra.run.smithi115.stdout:client4836 2023-03-30T08:11:35.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:35.552 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/936aee23-1888-4f7e-bc67-7a45e372f20a.client4836/status') 2023-03-30T08:11:35.626 INFO:teuthology.orchestra.run.smithi115.stdout:instance: client.4836 (3)172.21.15.115:0/4231814039 2023-03-30T08:11:35.626 INFO:teuthology.orchestra.run.smithi115.stdout:blocklisted: false 2023-03-30T08:11:35.627 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records in 2023-03-30T08:11:35.627 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records out 2023-03-30T08:11:35.627 INFO:teuthology.orchestra.run.smithi115.stderr:71 bytes copied, 0.000149048 s, 476 kB/s 2023-03-30T08:11:35.628 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-03-30T08:11:36.004 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:36.171 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.164+0000 7fafde266700 1 Processor -- start 2023-03-30T08:11:36.171 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.168+0000 7fafde266700 1 -- start start 2023-03-30T08:11:36.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.168+0000 7fafde266700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fafd80aea30 0x7fafd816b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.168+0000 7fafde266700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd806b3a0 con 0x7fafd8163dc0 2023-03-30T08:11:36.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.168+0000 7fafde266700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd8069f00 con 0x7fafd8164190 2023-03-30T08:11:36.173 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.168+0000 7fafde266700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd806d810 con 0x7fafd80aea30 2023-03-30T08:11:36.174 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.168+0000 7fafdd264700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fafd8163dc0 0x7fafd80c95c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32866/0 (socket says 172.21.15.87:32866) 2023-03-30T08:11:36.174 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.168+0000 7fafdd264700 1 -- 172.21.15.87:0/21492078 learned_addr learned my addr 172.21.15.87:0/21492078 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:36.174 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.168+0000 7fafdda65700 1 --2- 172.21.15.87:0/21492078 >> v2:172.21.15.87:3300/0 conn(0x7fafd80aea30 0x7fafd816b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.168+0000 7fafcffff700 1 -- 172.21.15.87:0/21492078 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335446921 0 0) 0x7fafd4001110 con 0x7fafd8163dc0 2023-03-30T08:11:36.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.168+0000 7fafcffff700 1 -- 172.21.15.87:0/21492078 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc40035d0 con 0x7fafd8163dc0 2023-03-30T08:11:36.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.168+0000 7fafcffff700 1 -- 172.21.15.87:0/21492078 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487429507 0 0) 0x7fafd8069f00 con 0x7fafd8164190 2023-03-30T08:11:36.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.168+0000 7fafcffff700 1 -- 172.21.15.87:0/21492078 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafd4001110 con 0x7fafd8164190 2023-03-30T08:11:36.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.168+0000 7fafdda65700 1 -- 172.21.15.87:0/21492078 >> v1:172.21.15.115:6789/0 conn(0x7fafd8164190 legacy=0x7fafd80c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.168+0000 7fafdda65700 1 -- 172.21.15.87:0/21492078 >> v1:172.21.15.87:6789/0 conn(0x7fafd8163dc0 legacy=0x7fafd80c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.168+0000 7fafdda65700 1 -- 172.21.15.87:0/21492078 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd80ca3e0 con 0x7fafd80aea30 2023-03-30T08:11:36.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.172+0000 7fafdda65700 1 --2- 172.21.15.87:0/21492078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd80aea30 0x7fafd816b930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009d90 tx=0x7fafd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c448ff7017d38034 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:36.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.172+0000 7fafcffff700 1 -- 172.21.15.87:0/21492078 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd000e070 con 0x7fafd80aea30 2023-03-30T08:11:36.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.172+0000 7fafcffff700 1 -- 172.21.15.87:0/21492078 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd000bb20 con 0x7fafd80aea30 2023-03-30T08:11:36.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.172+0000 7fafcffff700 1 -- 172.21.15.87:0/21492078 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0012430 con 0x7fafd80aea30 2023-03-30T08:11:36.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.172+0000 7fafde266700 1 -- 172.21.15.87:0/21492078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd80aea30 msgr2=0x7fafd816b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.172+0000 7fafde266700 1 --2- 172.21.15.87:0/21492078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd80aea30 0x7fafd816b930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009d90 tx=0x7fafd000b330 comp rx=0 tx=0).stop 2023-03-30T08:11:36.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.172+0000 7fafde266700 1 -- 172.21.15.87:0/21492078 shutdown_connections 2023-03-30T08:11:36.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.172+0000 7fafde266700 1 --2- 172.21.15.87:0/21492078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd80aea30 0x7fafd816b930 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.172+0000 7fafde266700 1 -- 172.21.15.87:0/21492078 >> 172.21.15.87:0/21492078 conn(0x7fafd80cf410 msgr2=0x7fafd80cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:36.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.172+0000 7fafde266700 1 -- 172.21.15.87:0/21492078 shutdown_connections 2023-03-30T08:11:36.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.172+0000 7fafde266700 1 -- 172.21.15.87:0/21492078 wait complete. 2023-03-30T08:11:36.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafde266700 1 Processor -- start 2023-03-30T08:11:36.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafde266700 1 -- start start 2023-03-30T08:11:36.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafde266700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fafd80aea30 0x7fafd81f9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafde266700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafd8163dc0 0x7fafd80c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafde266700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd8164190 0x7fafd80c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafde266700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80c3330 con 0x7fafd8164190 2023-03-30T08:11:36.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafde266700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80c2030 con 0x7fafd80aea30 2023-03-30T08:11:36.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafde266700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80c2310 con 0x7fafd8163dc0 2023-03-30T08:11:36.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafdda65700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd8164190 0x7fafd80c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafdda65700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd8164190 0x7fafd80c2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58710/0 (socket says 172.21.15.87:58710) 2023-03-30T08:11:36.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafdda65700 1 -- 172.21.15.87:0/3744790952 learned_addr learned my addr 172.21.15.87:0/3744790952 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:36.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafdd264700 1 --2- 172.21.15.87:0/3744790952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fafd80aea30 0x7fafd81f9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafdca63700 1 --2- 172.21.15.87:0/3744790952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafd8163dc0 0x7fafd80c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafdda65700 1 -- 172.21.15.87:0/3744790952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafd8163dc0 msgr2=0x7fafd80c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafdda65700 1 --2- 172.21.15.87:0/3744790952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafd8163dc0 0x7fafd80c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafdda65700 1 -- 172.21.15.87:0/3744790952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fafd80aea30 msgr2=0x7fafd81f9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafdda65700 1 --2- 172.21.15.87:0/3744790952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fafd80aea30 0x7fafd81f9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.176+0000 7fafdda65700 1 -- 172.21.15.87:0/3744790952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd0009a70 con 0x7fafd8164190 2023-03-30T08:11:36.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.180+0000 7fafdda65700 1 --2- 172.21.15.87:0/3744790952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd8164190 0x7fafd80c2df0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fafd0013000 tx=0x7fafd0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:36.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.180+0000 7fafcdffb700 1 -- 172.21.15.87:0/3744790952 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0012430 con 0x7fafd8164190 2023-03-30T08:11:36.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.180+0000 7fafcdffb700 1 -- 172.21.15.87:0/3744790952 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd0020070 con 0x7fafd8164190 2023-03-30T08:11:36.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.180+0000 7fafcdffb700 1 -- 172.21.15.87:0/3744790952 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd001ba70 con 0x7fafd8164190 2023-03-30T08:11:36.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.180+0000 7fafde266700 1 -- 172.21.15.87:0/3744790952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd806d250 con 0x7fafd8164190 2023-03-30T08:11:36.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.180+0000 7fafde266700 1 -- 172.21.15.87:0/3744790952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd806cf70 con 0x7fafd8164190 2023-03-30T08:11:36.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.180+0000 7fafde266700 1 -- 172.21.15.87:0/3744790952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd806d530 con 0x7fafd8164190 2023-03-30T08:11:36.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.180+0000 7fafcdffb700 1 -- 172.21.15.87:0/3744790952 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fafd001bbd0 con 0x7fafd8164190 2023-03-30T08:11:36.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.184+0000 7fafcdffb700 1 --2- 172.21.15.87:0/3744790952 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fafbc065420 0x7fafbc0678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.184+0000 7fafcdffb700 1 -- 172.21.15.87:0/3744790952 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fafd0022070 con 0x7fafd8164190 2023-03-30T08:11:36.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.184+0000 7fafdd264700 1 --2- 172.21.15.87:0/3744790952 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fafbc065420 0x7fafbc0678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.184+0000 7fafdd264700 1 --2- 172.21.15.87:0/3744790952 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fafbc065420 0x7fafbc0678d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fafd4000f60 tx=0x7fafd4007e20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:36.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.188+0000 7fafcdffb700 1 -- 172.21.15.87:0/3744790952 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fafd00525f0 con 0x7fafd8164190 2023-03-30T08:11:36.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.360+0000 7fafde266700 1 -- 172.21.15.87:0/3744790952 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafd80ca900 con 0x7fafd8164190 2023-03-30T08:11:36.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.364+0000 7fafcdffb700 1 -- 172.21.15.87:0/3744790952 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+19652 (secure 0 0 0) 0x7fafd002c020 con 0x7fafd8164190 2023-03-30T08:11:36.367 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:36.368 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":28,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:02.841070+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:36.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.368+0000 7fafde266700 1 -- 172.21.15.87:0/3744790952 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fafbc065420 msgr2=0x7fafbc0678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.368+0000 7fafde266700 1 --2- 172.21.15.87:0/3744790952 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fafbc065420 0x7fafbc0678d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fafd4000f60 tx=0x7fafd4007e20 comp rx=0 tx=0).stop 2023-03-30T08:11:36.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.368+0000 7fafde266700 1 -- 172.21.15.87:0/3744790952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd8164190 msgr2=0x7fafd80c2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.368+0000 7fafde266700 1 --2- 172.21.15.87:0/3744790952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd8164190 0x7fafd80c2df0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fafd0013000 tx=0x7fafd0004af0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.368+0000 7fafde266700 1 -- 172.21.15.87:0/3744790952 shutdown_connections 2023-03-30T08:11:36.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.368+0000 7fafde266700 1 --2- 172.21.15.87:0/3744790952 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fafbc065420 0x7fafbc0678d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.368+0000 7fafde266700 1 --2- 172.21.15.87:0/3744790952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fafd8164190 0x7fafd80c2df0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.368+0000 7fafde266700 1 --2- 172.21.15.87:0/3744790952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafd8163dc0 0x7fafd80c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.368+0000 7fafde266700 1 --2- 172.21.15.87:0/3744790952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fafd80aea30 0x7fafd81f9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.368+0000 7fafde266700 1 -- 172.21.15.87:0/3744790952 >> 172.21.15.87:0/3744790952 conn(0x7fafd80cf410 msgr2=0x7fafd8157ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:36.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.368+0000 7fafde266700 1 -- 172.21.15.87:0/3744790952 shutdown_connections 2023-03-30T08:11:36.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.368+0000 7fafde266700 1 -- 172.21.15.87:0/3744790952 wait complete. 2023-03-30T08:11:36.391 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-30T08:10:56.407927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-30T08:10:57.359214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-30T08:11:00.430972+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-30T08:11:36.392 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T08:11:36.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.552+0000 7fe68cefa700 1 Processor -- start 2023-03-30T08:11:36.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.552+0000 7fe68cefa700 1 -- start start 2023-03-30T08:11:36.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe68cefa700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe6880cd7e0 0x7fe6880d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe68cefa700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6880cd350 con 0x7fe6880b4e90 2023-03-30T08:11:36.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe68cefa700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6880b8830 con 0x7fe6880b8460 2023-03-30T08:11:36.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe68cefa700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe688160f50 con 0x7fe6880cd7e0 2023-03-30T08:11:36.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe686d9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe6880cd7e0 0x7fe6880d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe67dd9b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe6880b4e90 0x7fe6880d08d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32868/0 (socket says 172.21.15.87:32868) 2023-03-30T08:11:36.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe67dd9b700 1 -- 172.21.15.87:0/3167414670 learned_addr learned my addr 172.21.15.87:0/3167414670 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:36.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe686d9d700 1 -- 172.21.15.87:0/3167414670 >> v1:172.21.15.115:6789/0 conn(0x7fe6880b8460 legacy=0x7fe6880b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe686d9d700 1 -- 172.21.15.87:0/3167414670 >> v1:172.21.15.87:6789/0 conn(0x7fe6880b4e90 legacy=0x7fe6880d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe686d9d700 1 -- 172.21.15.87:0/3167414670 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6880ceeb0 con 0x7fe6880cd7e0 2023-03-30T08:11:36.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe685d9b700 1 -- 172.21.15.87:0/3167414670 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676175855 0 0) 0x7fe6880cd350 con 0x7fe6880b4e90 2023-03-30T08:11:36.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe686d9d700 1 --2- 172.21.15.87:0/3167414670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880cd7e0 0x7fe6880d0fe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe680009850 tx=0x7fe680009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60db702d49d71f9a server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:36.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe685d9b700 1 -- 172.21.15.87:0/3167414670 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe680011830 con 0x7fe6880cd7e0 2023-03-30T08:11:36.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe685d9b700 1 -- 172.21.15.87:0/3167414670 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe680011990 con 0x7fe6880cd7e0 2023-03-30T08:11:36.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe685d9b700 1 -- 172.21.15.87:0/3167414670 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe680011d20 con 0x7fe6880cd7e0 2023-03-30T08:11:36.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe68cefa700 1 -- 172.21.15.87:0/3167414670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880cd7e0 msgr2=0x7fe6880d0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe68cefa700 1 --2- 172.21.15.87:0/3167414670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880cd7e0 0x7fe6880d0fe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe680009850 tx=0x7fe680009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:36.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe68cefa700 1 -- 172.21.15.87:0/3167414670 shutdown_connections 2023-03-30T08:11:36.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe68cefa700 1 --2- 172.21.15.87:0/3167414670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880cd7e0 0x7fe6880d0fe0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe68cefa700 1 -- 172.21.15.87:0/3167414670 >> 172.21.15.87:0/3167414670 conn(0x7fe6880cf780 msgr2=0x7fe6880cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:36.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe68cefa700 1 -- 172.21.15.87:0/3167414670 shutdown_connections 2023-03-30T08:11:36.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.556+0000 7fe68cefa700 1 -- 172.21.15.87:0/3167414670 wait complete. 2023-03-30T08:11:36.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.560+0000 7fe68cefa700 1 Processor -- start 2023-03-30T08:11:36.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.560+0000 7fe68cefa700 1 -- start start 2023-03-30T08:11:36.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe68cefa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6880b4e90 0x7fe6881577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe68cefa700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880b8460 0x7fe6880b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe68cefa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6880cd7e0 0x7fe6880b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe68cefa700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68815ca60 con 0x7fe6880b8460 2023-03-30T08:11:36.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe68cefa700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6880b4390 con 0x7fe6880b4e90 2023-03-30T08:11:36.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe68cefa700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68815ccb0 con 0x7fe6880cd7e0 2023-03-30T08:11:36.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe67dd9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880b8460 0x7fe6880b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe67dd9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880b8460 0x7fe6880b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58736/0 (socket says 172.21.15.87:58736) 2023-03-30T08:11:36.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe67dd9b700 1 -- 172.21.15.87:0/490063406 learned_addr learned my addr 172.21.15.87:0/490063406 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:36.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe68659c700 1 --2- 172.21.15.87:0/490063406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6880b4e90 0x7fe6881577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe686d9d700 1 --2- 172.21.15.87:0/490063406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6880cd7e0 0x7fe6880b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe67dd9b700 1 -- 172.21.15.87:0/490063406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6880cd7e0 msgr2=0x7fe6880b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe67dd9b700 1 --2- 172.21.15.87:0/490063406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6880cd7e0 0x7fe6880b3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe67dd9b700 1 -- 172.21.15.87:0/490063406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6880b4e90 msgr2=0x7fe6881577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe67dd9b700 1 --2- 172.21.15.87:0/490063406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6880b4e90 0x7fe6881577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe67dd9b700 1 -- 172.21.15.87:0/490063406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6800094b0 con 0x7fe6880b8460 2023-03-30T08:11:36.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe68659c700 1 --2- 172.21.15.87:0/490063406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6880b4e90 0x7fe6881577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:36.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe67dd9b700 1 --2- 172.21.15.87:0/490063406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880b8460 0x7fe6880b3e50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe67000cc80 tx=0x7fe67000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:36.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe67f7fe700 1 -- 172.21.15.87:0/490063406 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000ada0 con 0x7fe6880b8460 2023-03-30T08:11:36.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe67f7fe700 1 -- 172.21.15.87:0/490063406 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67000ce80 con 0x7fe6880b8460 2023-03-30T08:11:36.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe68cefa700 1 -- 172.21.15.87:0/490063406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe688160c70 con 0x7fe6880b8460 2023-03-30T08:11:36.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe67f7fe700 1 -- 172.21.15.87:0/490063406 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe670007310 con 0x7fe6880b8460 2023-03-30T08:11:36.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.564+0000 7fe68cefa700 1 -- 172.21.15.87:0/490063406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6881609b0 con 0x7fe6880b8460 2023-03-30T08:11:36.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.568+0000 7fe68cefa700 1 -- 172.21.15.87:0/490063406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6880cf150 con 0x7fe6880b8460 2023-03-30T08:11:36.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.568+0000 7fe67f7fe700 1 -- 172.21.15.87:0/490063406 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fe670007470 con 0x7fe6880b8460 2023-03-30T08:11:36.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.572+0000 7fe67f7fe700 1 --2- 172.21.15.87:0/490063406 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe6680653f0 0x7fe6680678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.572+0000 7fe67f7fe700 1 -- 172.21.15.87:0/490063406 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe6700828b0 con 0x7fe6880b8460 2023-03-30T08:11:36.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.572+0000 7fe68659c700 1 --2- 172.21.15.87:0/490063406 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe6680653f0 0x7fe6680678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.572+0000 7fe68659c700 1 --2- 172.21.15.87:0/490063406 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe6680653f0 0x7fe6680678a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe678000f60 tx=0x7fe678009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:36.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.576+0000 7fe67f7fe700 1 -- 172.21.15.87:0/490063406 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fe670050110 con 0x7fe6880b8460 2023-03-30T08:11:36.751 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.744+0000 7fe68cefa700 1 -- 172.21.15.87:0/490063406 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6880c9a90 con 0x7fe6880b8460 2023-03-30T08:11:36.751 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.748+0000 7fe67f7fe700 1 -- 172.21.15.87:0/490063406 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe670018070 con 0x7fe6880b8460 2023-03-30T08:11:36.752 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T08:11:36.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.752+0000 7fe68cefa700 1 -- 172.21.15.87:0/490063406 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe6680653f0 msgr2=0x7fe6680678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.752+0000 7fe68cefa700 1 --2- 172.21.15.87:0/490063406 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe6680653f0 0x7fe6680678a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe678000f60 tx=0x7fe678009040 comp rx=0 tx=0).stop 2023-03-30T08:11:36.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.752+0000 7fe68cefa700 1 -- 172.21.15.87:0/490063406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880b8460 msgr2=0x7fe6880b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.756 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.752+0000 7fe68cefa700 1 --2- 172.21.15.87:0/490063406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880b8460 0x7fe6880b3e50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe67000cc80 tx=0x7fe67000a340 comp rx=0 tx=0).stop 2023-03-30T08:11:36.757 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.752+0000 7fe68cefa700 1 -- 172.21.15.87:0/490063406 shutdown_connections 2023-03-30T08:11:36.758 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.752+0000 7fe68cefa700 1 --2- 172.21.15.87:0/490063406 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe6680653f0 0x7fe6680678a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.758 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.752+0000 7fe68cefa700 1 --2- 172.21.15.87:0/490063406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6880cd7e0 0x7fe6880b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.758 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.752+0000 7fe68cefa700 1 --2- 172.21.15.87:0/490063406 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6880b8460 0x7fe6880b3e50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.759 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.752+0000 7fe68cefa700 1 --2- 172.21.15.87:0/490063406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6880b4e90 0x7fe6881577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.759 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.752+0000 7fe68cefa700 1 -- 172.21.15.87:0/490063406 >> 172.21.15.87:0/490063406 conn(0x7fe6880cf780 msgr2=0x7fe6880d27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:36.759 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.752+0000 7fe68cefa700 1 -- 172.21.15.87:0/490063406 shutdown_connections 2023-03-30T08:11:36.759 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.752+0000 7fe68cefa700 1 -- 172.21.15.87:0/490063406 wait complete. 2023-03-30T08:11:36.775 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T08:11:36.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.932+0000 7f346908c700 1 Processor -- start 2023-03-30T08:11:36.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.932+0000 7f346908c700 1 -- start start 2023-03-30T08:11:36.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.932+0000 7f346908c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34640cabc0 0x7f3464069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.932+0000 7f346908c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34640afca0 con 0x7f3464159050 2023-03-30T08:11:36.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.932+0000 7f346908c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346415d110 con 0x7f346415cba0 2023-03-30T08:11:36.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.932+0000 7f346908c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34640afb10 con 0x7f34640cabc0 2023-03-30T08:11:36.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.932+0000 7f3463fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3464159050 0x7f34640cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32870/0 (socket says 172.21.15.87:32870) 2023-03-30T08:11:36.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.932+0000 7f3463fff700 1 -- 172.21.15.87:0/3179100226 learned_addr learned my addr 172.21.15.87:0/3179100226 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:36.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 -- 172.21.15.87:0/3179100226 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000772179 0 0) 0x7f34640afca0 con 0x7f3464159050 2023-03-30T08:11:36.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 -- 172.21.15.87:0/3179100226 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f344c0035d0 con 0x7f3464159050 2023-03-30T08:11:36.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f346888b700 1 --2- 172.21.15.87:0/3179100226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34640cabc0 0x7f3464069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 -- 172.21.15.87:0/3179100226 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1391035631 0 0) 0x7f344c0035d0 con 0x7f3464159050 2023-03-30T08:11:36.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 -- 172.21.15.87:0/3179100226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34640cabc0 msgr2=0x7f3464069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:36.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 --2- 172.21.15.87:0/3179100226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34640cabc0 0x7f3464069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 -- 172.21.15.87:0/3179100226 >> v1:172.21.15.115:6789/0 conn(0x7f346415cba0 legacy=0x7f34640ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 -- 172.21.15.87:0/3179100226 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346415d3f0 con 0x7f3464159050 2023-03-30T08:11:36.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 -- 172.21.15.87:0/3179100226 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f3454001670 con 0x7f3464159050 2023-03-30T08:11:36.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 -- 172.21.15.87:0/3179100226 >> v1:172.21.15.87:6789/0 conn(0x7f3464159050 legacy=0x7f34640cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 --2- 172.21.15.87:0/3179100226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f344c003a50 0x7f344c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 --2- 172.21.15.87:0/3179100226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34640cabc0 0x7f344c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 --2- 172.21.15.87:0/3179100226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f344c004db0 0x7f344c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 -- 172.21.15.87:0/3179100226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34640afb10 con 0x7f344c003a50 2023-03-30T08:11:36.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 -- 172.21.15.87:0/3179100226 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c00bb40 con 0x7f344c004db0 2023-03-30T08:11:36.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 -- 172.21.15.87:0/3179100226 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344c00bd00 con 0x7f34640cabc0 2023-03-30T08:11:36.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3463fff700 1 --2- 172.21.15.87:0/3179100226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f344c003a50 0x7f344c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f34637fe700 1 --2- 172.21.15.87:0/3179100226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34640cabc0 0x7f344c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f346888b700 1 --2- 172.21.15.87:0/3179100226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f344c004db0 0x7f344c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3463fff700 1 -- 172.21.15.87:0/3179100226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34640cabc0 msgr2=0x7f344c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:36.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3463fff700 1 --2- 172.21.15.87:0/3179100226 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34640cabc0 0x7f344c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3463fff700 1 -- 172.21.15.87:0/3179100226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f344c004db0 msgr2=0x7f344c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:36.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3463fff700 1 --2- 172.21.15.87:0/3179100226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f344c004db0 0x7f344c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3463fff700 1 -- 172.21.15.87:0/3179100226 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c0035d0 con 0x7f344c003a50 2023-03-30T08:11:36.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3463fff700 1 --2- 172.21.15.87:0/3179100226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f344c003a50 0x7f344c003e60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f345400c320 tx=0x7f344c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1fdd23755f4f4e7 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:36.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 -- 172.21.15.87:0/3179100226 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454007c30 con 0x7f344c003a50 2023-03-30T08:11:36.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 -- 172.21.15.87:0/3179100226 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345400ce80 con 0x7f344c003a50 2023-03-30T08:11:36.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.936+0000 7f3462ffd700 1 -- 172.21.15.87:0/3179100226 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454005bc0 con 0x7f344c003a50 2023-03-30T08:11:36.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.940+0000 7f346908c700 1 -- 172.21.15.87:0/3179100226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f344c003a50 msgr2=0x7f344c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.940+0000 7f346908c700 1 --2- 172.21.15.87:0/3179100226 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f344c003a50 0x7f344c003e60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f345400c320 tx=0x7f344c0058a0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.940+0000 7f346888b700 1 -- 172.21.15.87:0/3179100226 reap_dead start 2023-03-30T08:11:36.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.940+0000 7f346908c700 1 -- 172.21.15.87:0/3179100226 shutdown_connections 2023-03-30T08:11:36.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.940+0000 7f346908c700 1 -- 172.21.15.87:0/3179100226 >> 172.21.15.87:0/3179100226 conn(0x7f34640cf410 msgr2=0x7f34640cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:36.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.940+0000 7f346908c700 1 -- 172.21.15.87:0/3179100226 shutdown_connections 2023-03-30T08:11:36.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.940+0000 7f346908c700 1 -- 172.21.15.87:0/3179100226 wait complete. 2023-03-30T08:11:36.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.940+0000 7f346908c700 1 Processor -- start 2023-03-30T08:11:36.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.940+0000 7f346908c700 1 -- start start 2023-03-30T08:11:36.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f346908c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f344c003a50 0x7f346414ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f346908c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f346415a1a0 0x7f34640c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f346908c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f346415a610 0x7f34640c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f346908c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34640c2d60 con 0x7f346415a1a0 2023-03-30T08:11:36.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f346908c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34641575c0 con 0x7f346415a610 2023-03-30T08:11:36.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f346908c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34640c2430 con 0x7f344c003a50 2023-03-30T08:11:36.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f34637fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f346415a1a0 0x7f34640c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f34637fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f346415a1a0 0x7f34640c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58760/0 (socket says 172.21.15.87:58760) 2023-03-30T08:11:36.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f34637fe700 1 -- 172.21.15.87:0/1099920453 learned_addr learned my addr 172.21.15.87:0/1099920453 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:36.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f3463fff700 1 --2- 172.21.15.87:0/1099920453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f344c003a50 0x7f346414ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f346888b700 1 --2- 172.21.15.87:0/1099920453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f346415a610 0x7f34640c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f34637fe700 1 -- 172.21.15.87:0/1099920453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f344c003a50 msgr2=0x7f346414ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f34637fe700 1 --2- 172.21.15.87:0/1099920453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f344c003a50 0x7f346414ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f34637fe700 1 -- 172.21.15.87:0/1099920453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f346415a610 msgr2=0x7f34640c4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:36.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f34637fe700 1 --2- 172.21.15.87:0/1099920453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f346415a610 0x7f34640c4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:36.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f34637fe700 1 -- 172.21.15.87:0/1099920453 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346415d9b0 con 0x7f346415a1a0 2023-03-30T08:11:36.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f346888b700 1 --2- 172.21.15.87:0/1099920453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f346415a610 0x7f34640c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:36.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f34637fe700 1 --2- 172.21.15.87:0/1099920453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f346415a1a0 0x7f34640c46a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f345800e7b0 tx=0x7f345800eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:36.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f3460ff9700 1 -- 172.21.15.87:0/1099920453 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34580052e0 con 0x7f346415a1a0 2023-03-30T08:11:36.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f3460ff9700 1 -- 172.21.15.87:0/1099920453 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3458005440 con 0x7f346415a1a0 2023-03-30T08:11:36.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f346908c700 1 -- 172.21.15.87:0/1099920453 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346415d6d0 con 0x7f346415a1a0 2023-03-30T08:11:36.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f3460ff9700 1 -- 172.21.15.87:0/1099920453 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34580038e0 con 0x7f346415a1a0 2023-03-30T08:11:36.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.944+0000 7f346908c700 1 -- 172.21.15.87:0/1099920453 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3464159420 con 0x7f346415a1a0 2023-03-30T08:11:36.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.948+0000 7f346908c700 1 -- 172.21.15.87:0/1099920453 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34640733a0 con 0x7f346415a1a0 2023-03-30T08:11:36.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.948+0000 7f3460ff9700 1 -- 172.21.15.87:0/1099920453 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f3458003a40 con 0x7f346415a1a0 2023-03-30T08:11:36.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.948+0000 7f3460ff9700 1 --2- 172.21.15.87:0/1099920453 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f34500653f0 0x7f34500678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:36.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.948+0000 7f3460ff9700 1 -- 172.21.15.87:0/1099920453 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3458082220 con 0x7f346415a1a0 2023-03-30T08:11:36.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.948+0000 7f3463fff700 1 --2- 172.21.15.87:0/1099920453 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f34500653f0 0x7f34500678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:36.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.952+0000 7f3463fff700 1 --2- 172.21.15.87:0/1099920453 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f34500653f0 0x7f34500678a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3454000c00 tx=0x7f3454007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:36.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:36.956+0000 7f3460ff9700 1 -- 172.21.15.87:0/1099920453 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f345804fc70 con 0x7f346415a1a0 2023-03-30T08:11:37.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.124+0000 7f346908c700 1 -- 172.21.15.87:0/1099920453 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f346406b1e0 con 0x7f346415a1a0 2023-03-30T08:11:37.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.124+0000 7f3460ff9700 1 -- 172.21.15.87:0/1099920453 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3458053290 con 0x7f346415a1a0 2023-03-30T08:11:37.131 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T08:11:37.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.132+0000 7f346908c700 1 -- 172.21.15.87:0/1099920453 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f34500653f0 msgr2=0x7f34500678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:37.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.132+0000 7f346908c700 1 --2- 172.21.15.87:0/1099920453 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f34500653f0 0x7f34500678a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3454000c00 tx=0x7f3454007000 comp rx=0 tx=0).stop 2023-03-30T08:11:37.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.132+0000 7f346908c700 1 -- 172.21.15.87:0/1099920453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f346415a1a0 msgr2=0x7f34640c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:37.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.132+0000 7f346908c700 1 --2- 172.21.15.87:0/1099920453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f346415a1a0 0x7f34640c46a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f345800e7b0 tx=0x7f345800eac0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.132+0000 7f346908c700 1 -- 172.21.15.87:0/1099920453 shutdown_connections 2023-03-30T08:11:37.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.132+0000 7f346908c700 1 --2- 172.21.15.87:0/1099920453 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f34500653f0 0x7f34500678a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.132+0000 7f346908c700 1 --2- 172.21.15.87:0/1099920453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f346415a610 0x7f34640c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.132+0000 7f346908c700 1 --2- 172.21.15.87:0/1099920453 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f346415a1a0 0x7f34640c46a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.132+0000 7f346908c700 1 --2- 172.21.15.87:0/1099920453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f344c003a50 0x7f346414ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.132+0000 7f346908c700 1 -- 172.21.15.87:0/1099920453 >> 172.21.15.87:0/1099920453 conn(0x7f34640cf410 msgr2=0x7f346406c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:37.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.132+0000 7f346908c700 1 -- 172.21.15.87:0/1099920453 shutdown_connections 2023-03-30T08:11:37.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.132+0000 7f346908c700 1 -- 172.21.15.87:0/1099920453 wait complete. 2023-03-30T08:11:37.155 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-30T08:11:37.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.316+0000 7f12c359e700 1 Processor -- start 2023-03-30T08:11:37.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.316+0000 7f12c359e700 1 -- start start 2023-03-30T08:11:37.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c359e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c4163dc0 0x7f12c40c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:37.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c359e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f12c40aea30 0x7f12c406a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:37.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c359e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c4069f00 con 0x7f12c4164190 2023-03-30T08:11:37.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c359e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c406d810 con 0x7f12c40aea30 2023-03-30T08:11:37.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c359e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c40cc1d0 con 0x7f12c4163dc0 2023-03-30T08:11:37.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c2d9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f12c40aea30 0x7f12c406a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:37.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c2d9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f12c40aea30 0x7f12c406a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58776/0 (socket says 172.21.15.87:58776) 2023-03-30T08:11:37.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c2d9d700 1 -- 172.21.15.87:0/3426668078 learned_addr learned my addr 172.21.15.87:0/3426668078 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:37.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c259c700 1 --2- 172.21.15.87:0/3426668078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c4163dc0 0x7f12c40c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:37.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c2d9d700 1 -- 172.21.15.87:0/3426668078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c4163dc0 msgr2=0x7f12c40c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:37.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c2d9d700 1 --2- 172.21.15.87:0/3426668078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c4163dc0 0x7f12c40c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c2d9d700 1 -- 172.21.15.87:0/3426668078 >> v1:172.21.15.115:6789/0 conn(0x7f12c4164190 legacy=0x7f12c40c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:37.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c2d9d700 1 -- 172.21.15.87:0/3426668078 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c406cf70 con 0x7f12c40aea30 2023-03-30T08:11:37.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c2d9d700 1 --2- 172.21.15.87:0/3426668078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12c40aea30 0x7f12c406a390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009e50 tx=0x7f12bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f02174168839bab server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:37.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c159a700 1 -- 172.21.15.87:0/3426668078 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00e070 con 0x7f12c40aea30 2023-03-30T08:11:37.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c159a700 1 -- 172.21.15.87:0/3426668078 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc00b910 con 0x7f12c40aea30 2023-03-30T08:11:37.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c159a700 1 -- 172.21.15.87:0/3426668078 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00bcc0 con 0x7f12c40aea30 2023-03-30T08:11:37.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c359e700 1 -- 172.21.15.87:0/3426668078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12c40aea30 msgr2=0x7f12c406a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:37.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.320+0000 7f12c359e700 1 --2- 172.21.15.87:0/3426668078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12c40aea30 0x7f12c406a390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009e50 tx=0x7f12bc00b330 comp rx=0 tx=0).stop 2023-03-30T08:11:37.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.324+0000 7f12c359e700 1 -- 172.21.15.87:0/3426668078 shutdown_connections 2023-03-30T08:11:37.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.324+0000 7f12c359e700 1 --2- 172.21.15.87:0/3426668078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12c40aea30 0x7f12c406a390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.324+0000 7f12c359e700 1 --2- 172.21.15.87:0/3426668078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c4163dc0 0x7f12c40c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.324+0000 7f12c359e700 1 -- 172.21.15.87:0/3426668078 >> 172.21.15.87:0/3426668078 conn(0x7f12c40cf410 msgr2=0x7f12c40cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:37.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.324+0000 7f12c359e700 1 -- 172.21.15.87:0/3426668078 shutdown_connections 2023-03-30T08:11:37.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.324+0000 7f12c359e700 1 -- 172.21.15.87:0/3426668078 wait complete. 2023-03-30T08:11:37.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.324+0000 7f12c359e700 1 Processor -- start 2023-03-30T08:11:37.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.324+0000 7f12c359e700 1 -- start start 2023-03-30T08:11:37.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12c40aea30 0x7f12c4158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:37.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c359e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c4163dc0 0x7f12c40c2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:37.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c359e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c4164190 0x7f12c40b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:37.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c359e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c40b3220 con 0x7f12c40aea30 2023-03-30T08:11:37.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c359e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c41594b0 con 0x7f12c4163dc0 2023-03-30T08:11:37.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c359e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c40b25a0 con 0x7f12c4164190 2023-03-30T08:11:37.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c259c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12c40aea30 0x7f12c4158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:37.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c259c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12c40aea30 0x7f12c4158f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58790/0 (socket says 172.21.15.87:58790) 2023-03-30T08:11:37.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c259c700 1 -- 172.21.15.87:0/3910496228 learned_addr learned my addr 172.21.15.87:0/3910496228 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:37.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c1d9b700 1 --2- 172.21.15.87:0/3910496228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c4163dc0 0x7f12c40c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:37.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c2d9d700 1 --2- 172.21.15.87:0/3910496228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c4164190 0x7f12c40b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:37.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c259c700 1 -- 172.21.15.87:0/3910496228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c4164190 msgr2=0x7f12c40b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:37.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c259c700 1 --2- 172.21.15.87:0/3910496228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c4164190 0x7f12c40b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c259c700 1 -- 172.21.15.87:0/3910496228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c4163dc0 msgr2=0x7f12c40c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:37.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c259c700 1 --2- 172.21.15.87:0/3910496228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c4163dc0 0x7f12c40c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c259c700 1 -- 172.21.15.87:0/3910496228 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc009b30 con 0x7f12c40aea30 2023-03-30T08:11:37.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c1d9b700 1 --2- 172.21.15.87:0/3910496228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c4163dc0 0x7f12c40c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:37.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c259c700 1 --2- 172.21.15.87:0/3910496228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12c40aea30 0x7f12c4158f70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f12b400e9d0 tx=0x7f12b400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:37.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12b2ffd700 1 -- 172.21.15.87:0/3910496228 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b400c850 con 0x7f12c40aea30 2023-03-30T08:11:37.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12b2ffd700 1 -- 172.21.15.87:0/3910496228 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b400c9b0 con 0x7f12c40aea30 2023-03-30T08:11:37.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c359e700 1 -- 172.21.15.87:0/3910496228 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c406d530 con 0x7f12c40aea30 2023-03-30T08:11:37.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12b2ffd700 1 -- 172.21.15.87:0/3910496228 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b400cd20 con 0x7f12c40aea30 2023-03-30T08:11:37.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c359e700 1 -- 172.21.15.87:0/3910496228 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c406d250 con 0x7f12c40aea30 2023-03-30T08:11:37.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.328+0000 7f12c359e700 1 -- 172.21.15.87:0/3910496228 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c406cc40 con 0x7f12c40aea30 2023-03-30T08:11:37.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.332+0000 7f12b2ffd700 1 -- 172.21.15.87:0/3910496228 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f12b4013470 con 0x7f12c40aea30 2023-03-30T08:11:37.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.332+0000 7f12b2ffd700 1 --2- 172.21.15.87:0/3910496228 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f12a40653f0 0x7f12a40678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:37.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.332+0000 7f12b2ffd700 1 -- 172.21.15.87:0/3910496228 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f12b4082f70 con 0x7f12c40aea30 2023-03-30T08:11:37.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.332+0000 7f12c1d9b700 1 --2- 172.21.15.87:0/3910496228 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f12a40653f0 0x7f12a40678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:37.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.332+0000 7f12c1d9b700 1 --2- 172.21.15.87:0/3910496228 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f12a40653f0 0x7f12a40678a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f12c41f3d60 tx=0x7f12b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:37.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.340+0000 7f12b2ffd700 1 -- 172.21.15.87:0/3910496228 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f12b4050930 con 0x7f12c40aea30 2023-03-30T08:11:37.513 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.508+0000 7f12c359e700 1 -- 172.21.15.87:0/3910496228 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12c40733a0 con 0x7f12c40aea30 2023-03-30T08:11:37.514 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.508+0000 7f12b2ffd700 1 -- 172.21.15.87:0/3910496228 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12b4053f50 con 0x7f12c40aea30 2023-03-30T08:11:37.514 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:37.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.512+0000 7f12c359e700 1 -- 172.21.15.87:0/3910496228 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f12a40653f0 msgr2=0x7f12a40678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:37.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.512+0000 7f12c359e700 1 --2- 172.21.15.87:0/3910496228 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f12a40653f0 0x7f12a40678a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f12c41f3d60 tx=0x7f12b8009040 comp rx=0 tx=0).stop 2023-03-30T08:11:37.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.512+0000 7f12c359e700 1 -- 172.21.15.87:0/3910496228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12c40aea30 msgr2=0x7f12c4158f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:37.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.512+0000 7f12c359e700 1 --2- 172.21.15.87:0/3910496228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12c40aea30 0x7f12c4158f70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f12b400e9d0 tx=0x7f12b400ed90 comp rx=0 tx=0).stop 2023-03-30T08:11:37.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.512+0000 7f12c359e700 1 -- 172.21.15.87:0/3910496228 shutdown_connections 2023-03-30T08:11:37.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.512+0000 7f12c359e700 1 --2- 172.21.15.87:0/3910496228 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f12a40653f0 0x7f12a40678a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.512+0000 7f12c359e700 1 --2- 172.21.15.87:0/3910496228 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12c4164190 0x7f12c40b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.512+0000 7f12c359e700 1 --2- 172.21.15.87:0/3910496228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c4163dc0 0x7f12c40c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.512+0000 7f12c359e700 1 --2- 172.21.15.87:0/3910496228 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f12c40aea30 0x7f12c4158f70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.512+0000 7f12c359e700 1 -- 172.21.15.87:0/3910496228 >> 172.21.15.87:0/3910496228 conn(0x7f12c40cf410 msgr2=0x7f12c406ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:37.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.512+0000 7f12c359e700 1 -- 172.21.15.87:0/3910496228 shutdown_connections 2023-03-30T08:11:37.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.512+0000 7f12c359e700 1 -- 172.21.15.87:0/3910496228 wait complete. 2023-03-30T08:11:37.537 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-30T08:11:37.704 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.700+0000 7faa4f1f2700 1 Processor -- start 2023-03-30T08:11:37.704 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.700+0000 7faa4f1f2700 1 -- start start 2023-03-30T08:11:37.707 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa4f1f2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faa4815d3c0 0x7faa4815d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:37.707 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa4f1f2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa481601c0 con 0x7faa480cd410 2023-03-30T08:11:37.708 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa4f1f2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa48160410 con 0x7faa480cfee0 2023-03-30T08:11:37.708 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa4f1f2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa481606f0 con 0x7faa4815d3c0 2023-03-30T08:11:37.708 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa4cf8e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faa4815d3c0 0x7faa4815d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:37.708 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa47fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7faa480cd410 0x7faa480cf7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32880/0 (socket says 172.21.15.87:32880) 2023-03-30T08:11:37.708 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa47fff700 1 -- 172.21.15.87:0/849039032 learned_addr learned my addr 172.21.15.87:0/849039032 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:37.709 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa4cf8e700 1 -- 172.21.15.87:0/849039032 >> v1:172.21.15.115:6789/0 conn(0x7faa480cfee0 legacy=0x7faa480d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:37.709 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa4cf8e700 1 -- 172.21.15.87:0/849039032 >> v1:172.21.15.87:6789/0 conn(0x7faa480cd410 legacy=0x7faa480cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:37.709 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa4cf8e700 1 -- 172.21.15.87:0/849039032 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa481609d0 con 0x7faa4815d3c0 2023-03-30T08:11:37.709 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa4cf8e700 1 --2- 172.21.15.87:0/849039032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa4815d3c0 0x7faa4815d790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009850 tx=0x7faa3c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f3c4b238219bf9 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:37.710 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa477fe700 1 -- 172.21.15.87:0/849039032 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c011830 con 0x7faa4815d3c0 2023-03-30T08:11:37.710 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa477fe700 1 -- 172.21.15.87:0/849039032 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c011990 con 0x7faa4815d3c0 2023-03-30T08:11:37.710 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa477fe700 1 -- 172.21.15.87:0/849039032 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c011d20 con 0x7faa4815d3c0 2023-03-30T08:11:37.711 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa4f1f2700 1 -- 172.21.15.87:0/849039032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa4815d3c0 msgr2=0x7faa4815d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:37.711 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.704+0000 7faa4f1f2700 1 --2- 172.21.15.87:0/849039032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa4815d3c0 0x7faa4815d790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009850 tx=0x7faa3c009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:37.711 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.708+0000 7faa4f1f2700 1 -- 172.21.15.87:0/849039032 shutdown_connections 2023-03-30T08:11:37.711 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.708+0000 7faa4f1f2700 1 --2- 172.21.15.87:0/849039032 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa4815d3c0 0x7faa4815d790 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.711 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.708+0000 7faa4f1f2700 1 -- 172.21.15.87:0/849039032 >> 172.21.15.87:0/849039032 conn(0x7faa4806b2e0 msgr2=0x7faa4806b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:37.711 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.708+0000 7faa4f1f2700 1 -- 172.21.15.87:0/849039032 shutdown_connections 2023-03-30T08:11:37.712 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.708+0000 7faa4f1f2700 1 -- 172.21.15.87:0/849039032 wait complete. 2023-03-30T08:11:37.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.708+0000 7faa4f1f2700 1 Processor -- start 2023-03-30T08:11:37.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.708+0000 7faa4f1f2700 1 -- start start 2023-03-30T08:11:37.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4f1f2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa480cd410 0x7faa480c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:37.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4f1f2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa480cfee0 0x7faa48154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:37.717 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4f1f2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa4815d3c0 0x7faa48155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:37.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4f1f2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa48153650 con 0x7faa4815d3c0 2023-03-30T08:11:37.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4f1f2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa480c9c50 con 0x7faa480cd410 2023-03-30T08:11:37.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4f1f2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa481558b0 con 0x7faa480cfee0 2023-03-30T08:11:37.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4d78f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa4815d3c0 0x7faa48155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:37.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4d78f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa4815d3c0 0x7faa48155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58816/0 (socket says 172.21.15.87:58816) 2023-03-30T08:11:37.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4d78f700 1 -- 172.21.15.87:0/3762487172 learned_addr learned my addr 172.21.15.87:0/3762487172 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:37.719 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa47fff700 1 --2- 172.21.15.87:0/3762487172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa480cfee0 0x7faa48154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:37.719 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4cf8e700 1 --2- 172.21.15.87:0/3762487172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa480cd410 0x7faa480c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:37.719 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4d78f700 1 -- 172.21.15.87:0/3762487172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa480cfee0 msgr2=0x7faa48154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:37.719 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4d78f700 1 --2- 172.21.15.87:0/3762487172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa480cfee0 0x7faa48154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.719 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4d78f700 1 -- 172.21.15.87:0/3762487172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa480cd410 msgr2=0x7faa480c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:37.719 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4d78f700 1 --2- 172.21.15.87:0/3762487172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa480cd410 0x7faa480c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.719 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4d78f700 1 -- 172.21.15.87:0/3762487172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c0094b0 con 0x7faa4815d3c0 2023-03-30T08:11:37.720 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4cf8e700 1 --2- 172.21.15.87:0/3762487172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa480cd410 0x7faa480c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:37.720 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4d78f700 1 --2- 172.21.15.87:0/3762487172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa4815d3c0 0x7faa48155280 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faa4000cb50 tx=0x7faa4000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:37.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa457fa700 1 -- 172.21.15.87:0/3762487172 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40003c20 con 0x7faa4815d3c0 2023-03-30T08:11:37.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa457fa700 1 -- 172.21.15.87:0/3762487172 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa40003d80 con 0x7faa4815d3c0 2023-03-30T08:11:37.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa4f1f2700 1 -- 172.21.15.87:0/3762487172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa480cd890 con 0x7faa4815d3c0 2023-03-30T08:11:37.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.712+0000 7faa457fa700 1 -- 172.21.15.87:0/3762487172 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4000aac0 con 0x7faa4815d3c0 2023-03-30T08:11:37.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.716+0000 7faa4f1f2700 1 -- 172.21.15.87:0/3762487172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa48160cb0 con 0x7faa4815d3c0 2023-03-30T08:11:37.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.716+0000 7faa4f1f2700 1 -- 172.21.15.87:0/3762487172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa480cda20 con 0x7faa4815d3c0 2023-03-30T08:11:37.722 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.716+0000 7faa457fa700 1 -- 172.21.15.87:0/3762487172 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7faa4000ac20 con 0x7faa4815d3c0 2023-03-30T08:11:37.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.720+0000 7faa457fa700 1 --2- 172.21.15.87:0/3762487172 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7faa2c0653f0 0x7faa2c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:37.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.720+0000 7faa457fa700 1 -- 172.21.15.87:0/3762487172 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faa40082ae0 con 0x7faa4815d3c0 2023-03-30T08:11:37.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.720+0000 7faa4cf8e700 1 --2- 172.21.15.87:0/3762487172 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7faa2c0653f0 0x7faa2c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:37.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.720+0000 7faa4cf8e700 1 --2- 172.21.15.87:0/3762487172 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7faa2c0653f0 0x7faa2c0678a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faa3c014040 tx=0x7faa3c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:37.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.724+0000 7faa457fa700 1 -- 172.21.15.87:0/3762487172 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7faa40050400 con 0x7faa4815d3c0 2023-03-30T08:11:37.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.900+0000 7faa4f1f2700 1 -- 172.21.15.87:0/3762487172 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faa48073ee0 con 0x7faa4815d3c0 2023-03-30T08:11:37.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.900+0000 7faa457fa700 1 -- 172.21.15.87:0/3762487172 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7faa40053a20 con 0x7faa4815d3c0 2023-03-30T08:11:37.905 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-03-30T08:11:37.908 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.904+0000 7faa4f1f2700 1 -- 172.21.15.87:0/3762487172 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7faa2c0653f0 msgr2=0x7faa2c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:37.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.904+0000 7faa4f1f2700 1 --2- 172.21.15.87:0/3762487172 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7faa2c0653f0 0x7faa2c0678a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faa3c014040 tx=0x7faa3c008030 comp rx=0 tx=0).stop 2023-03-30T08:11:37.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.904+0000 7faa4f1f2700 1 -- 172.21.15.87:0/3762487172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa4815d3c0 msgr2=0x7faa48155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:37.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.904+0000 7faa4f1f2700 1 --2- 172.21.15.87:0/3762487172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa4815d3c0 0x7faa48155280 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faa4000cb50 tx=0x7faa4000ce60 comp rx=0 tx=0).stop 2023-03-30T08:11:37.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.904+0000 7faa4f1f2700 1 -- 172.21.15.87:0/3762487172 shutdown_connections 2023-03-30T08:11:37.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.904+0000 7faa4f1f2700 1 --2- 172.21.15.87:0/3762487172 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7faa2c0653f0 0x7faa2c0678a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.904+0000 7faa4f1f2700 1 --2- 172.21.15.87:0/3762487172 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa4815d3c0 0x7faa48155280 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.904+0000 7faa4f1f2700 1 --2- 172.21.15.87:0/3762487172 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa480cfee0 0x7faa48154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.904+0000 7faa4f1f2700 1 --2- 172.21.15.87:0/3762487172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa480cd410 0x7faa480c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:37.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.904+0000 7faa4f1f2700 1 -- 172.21.15.87:0/3762487172 >> 172.21.15.87:0/3762487172 conn(0x7faa4806b2e0 msgr2=0x7faa4815f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:37.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.904+0000 7faa4f1f2700 1 -- 172.21.15.87:0/3762487172 shutdown_connections 2023-03-30T08:11:37.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:37.904+0000 7faa4f1f2700 1 -- 172.21.15.87:0/3762487172 wait complete. 2023-03-30T08:11:37.931 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-30T08:11:38.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.084+0000 7f3fb1f84700 1 Processor -- start 2023-03-30T08:11:38.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.084+0000 7f3fb1f84700 1 -- start start 2023-03-30T08:11:38.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fb1f84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fac0b3f30 0x7f3fac0b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fb1f84700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3fac06a6e0 0x7f3fac0aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fb1f84700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3fac0af180 0x7f3fac15ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fb1f84700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fac0af600 con 0x7f3fac06a6e0 2023-03-30T08:11:38.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fb1f84700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fac06b670 con 0x7f3fac0af180 2023-03-30T08:11:38.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fb1f84700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac06b0b0 con 0x7f3fac0b3f30 2023-03-30T08:11:38.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fa3fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3fac06a6e0 0x7f3fac0aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fa3fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3fac06a6e0 0x7f3fac0aec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58826/0 (socket says 172.21.15.87:58826) 2023-03-30T08:11:38.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fa3fff700 1 -- 172.21.15.87:0/650743949 learned_addr learned my addr 172.21.15.87:0/650743949 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:38.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fa3fff700 1 -- 172.21.15.87:0/650743949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fac0b3f30 msgr2=0x7f3fac0b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:38.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fb1783700 1 --2- 172.21.15.87:0/650743949 >> v2:172.21.15.115:3300/0 conn(0x7f3fac0af180 0x7f3fac15ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fb0f82700 1 --2- 172.21.15.87:0/650743949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fac0b3f30 0x7f3fac0b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fa3fff700 1 --2- 172.21.15.87:0/650743949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fac0b3f30 0x7f3fac0b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fa3fff700 1 -- 172.21.15.87:0/650743949 >> v2:172.21.15.115:3300/0 conn(0x7f3fac0af180 msgr2=0x7f3fac15ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:38.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fa3fff700 1 --2- 172.21.15.87:0/650743949 >> v2:172.21.15.115:3300/0 conn(0x7f3fac0af180 0x7f3fac15ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fa3fff700 1 -- 172.21.15.87:0/650743949 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac06b390 con 0x7f3fac06a6e0 2023-03-30T08:11:38.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fb1783700 1 --2- 172.21.15.87:0/650743949 >> v2:172.21.15.115:3300/0 conn(0x7f3fac0af180 0x7f3fac15ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:38.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fb0f82700 1 --2- 172.21.15.87:0/650743949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fac0b3f30 0x7f3fac0b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:38.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fa3fff700 1 --2- 172.21.15.87:0/650743949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fac06a6e0 0x7f3fac0aec40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0ae880 tx=0x7f3f9c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4aa992b85b44f95 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:38.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fa37fe700 1 -- 172.21.15.87:0/650743949 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00b8a0 con 0x7f3fac06a6e0 2023-03-30T08:11:38.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fa37fe700 1 -- 172.21.15.87:0/650743949 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c00ba00 con 0x7f3fac06a6e0 2023-03-30T08:11:38.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.088+0000 7f3fa37fe700 1 -- 172.21.15.87:0/650743949 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00bd90 con 0x7f3fac06a6e0 2023-03-30T08:11:38.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.092+0000 7f3fb1f84700 1 -- 172.21.15.87:0/650743949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fac06a6e0 msgr2=0x7f3fac0aec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:38.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.092+0000 7f3fb1f84700 1 --2- 172.21.15.87:0/650743949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fac06a6e0 0x7f3fac0aec40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0ae880 tx=0x7f3f9c009bf0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.092+0000 7f3fb1f84700 1 -- 172.21.15.87:0/650743949 shutdown_connections 2023-03-30T08:11:38.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.092+0000 7f3fb1f84700 1 --2- 172.21.15.87:0/650743949 >> v2:172.21.15.115:3300/0 conn(0x7f3fac0af180 0x7f3fac15ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.092+0000 7f3fb1f84700 1 --2- 172.21.15.87:0/650743949 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fac06a6e0 0x7f3fac0aec40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.092+0000 7f3fb1f84700 1 --2- 172.21.15.87:0/650743949 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fac0b3f30 0x7f3fac0b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.092+0000 7f3fb1f84700 1 -- 172.21.15.87:0/650743949 >> 172.21.15.87:0/650743949 conn(0x7f3fac0cf410 msgr2=0x7f3fac0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:38.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.092+0000 7f3fb1f84700 1 -- 172.21.15.87:0/650743949 shutdown_connections 2023-03-30T08:11:38.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.092+0000 7f3fb1f84700 1 -- 172.21.15.87:0/650743949 wait complete. 2023-03-30T08:11:38.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.092+0000 7f3fb1f84700 1 Processor -- start 2023-03-30T08:11:38.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.092+0000 7f3fb1f84700 1 -- start start 2023-03-30T08:11:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fb1f84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fac06a6e0 0x7f3fac147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fb1f84700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fac0af180 0x7f3fac0acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fb1f84700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fac0b3f30 0x7f3fac0c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fb1f84700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac148160 con 0x7f3fac0af180 2023-03-30T08:11:38.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fb1f84700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac15a940 con 0x7f3fac0b3f30 2023-03-30T08:11:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fb1f84700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac15ac20 con 0x7f3fac06a6e0 2023-03-30T08:11:38.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fa3fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fac0af180 0x7f3fac0acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fa3fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fac0af180 0x7f3fac0acaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58842/0 (socket says 172.21.15.87:58842) 2023-03-30T08:11:38.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fa3fff700 1 -- 172.21.15.87:0/3687189356 learned_addr learned my addr 172.21.15.87:0/3687189356 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:38.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fb1783700 1 --2- 172.21.15.87:0/3687189356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fac0b3f30 0x7f3fac0c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fb0f82700 1 --2- 172.21.15.87:0/3687189356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fac06a6e0 0x7f3fac147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fa3fff700 1 -- 172.21.15.87:0/3687189356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fac06a6e0 msgr2=0x7f3fac147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:38.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fa3fff700 1 --2- 172.21.15.87:0/3687189356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fac06a6e0 0x7f3fac147c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fa3fff700 1 -- 172.21.15.87:0/3687189356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fac0b3f30 msgr2=0x7f3fac0c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:38.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fa3fff700 1 --2- 172.21.15.87:0/3687189356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fac0b3f30 0x7f3fac0c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fa3fff700 1 -- 172.21.15.87:0/3687189356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c009570 con 0x7f3fac0af180 2023-03-30T08:11:38.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fa3fff700 1 --2- 172.21.15.87:0/3687189356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fac0af180 0x7f3fac0acaa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c000c00 tx=0x7f3f9c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:38.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fa17fa700 1 -- 172.21.15.87:0/3687189356 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c003ad0 con 0x7f3fac0af180 2023-03-30T08:11:38.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fa17fa700 1 -- 172.21.15.87:0/3687189356 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c01e070 con 0x7f3fac0af180 2023-03-30T08:11:38.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fb1f84700 1 -- 172.21.15.87:0/3687189356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fac0ae1b0 con 0x7f3fac0af180 2023-03-30T08:11:38.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fa17fa700 1 -- 172.21.15.87:0/3687189356 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c003e50 con 0x7f3fac0af180 2023-03-30T08:11:38.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.096+0000 7f3fb1f84700 1 -- 172.21.15.87:0/3687189356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fac0aded0 con 0x7f3fac0af180 2023-03-30T08:11:38.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.100+0000 7f3fb1f84700 1 -- 172.21.15.87:0/3687189356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fac0b4300 con 0x7f3fac0af180 2023-03-30T08:11:38.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.100+0000 7f3fa17fa700 1 -- 172.21.15.87:0/3687189356 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f3f9c011420 con 0x7f3fac0af180 2023-03-30T08:11:38.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.104+0000 7f3fa17fa700 1 --2- 172.21.15.87:0/3687189356 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3f980653f0 0x7f3f980678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.104+0000 7f3fa17fa700 1 -- 172.21.15.87:0/3687189356 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3f9c020070 con 0x7f3fac0af180 2023-03-30T08:11:38.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.104+0000 7f3fb0f82700 1 --2- 172.21.15.87:0/3687189356 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3f980653f0 0x7f3f980678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.104+0000 7f3fb0f82700 1 --2- 172.21.15.87:0/3687189356 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3f980653f0 0x7f3f980678a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800a9a0 tx=0x7f3fa8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:38.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.108+0000 7f3fa17fa700 1 -- 172.21.15.87:0/3687189356 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f3f9c051e80 con 0x7f3fac0af180 2023-03-30T08:11:38.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.284+0000 7f3fb1f84700 1 -- 172.21.15.87:0/3687189356 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3fac0b0ef0 con 0x7f3fac0af180 2023-03-30T08:11:38.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.284+0000 7f3fa17fa700 1 -- 172.21.15.87:0/3687189356 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3f9c0554a0 con 0x7f3fac0af180 2023-03-30T08:11:38.288 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:38.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.288+0000 7f3fb1f84700 1 -- 172.21.15.87:0/3687189356 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3f980653f0 msgr2=0x7f3f980678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:38.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.288+0000 7f3fb1f84700 1 --2- 172.21.15.87:0/3687189356 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3f980653f0 0x7f3f980678a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800a9a0 tx=0x7f3fa8008040 comp rx=0 tx=0).stop 2023-03-30T08:11:38.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.288+0000 7f3fb1f84700 1 -- 172.21.15.87:0/3687189356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fac0af180 msgr2=0x7f3fac0acaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:38.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.288+0000 7f3fb1f84700 1 --2- 172.21.15.87:0/3687189356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fac0af180 0x7f3fac0acaa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c000c00 tx=0x7f3f9c004770 comp rx=0 tx=0).stop 2023-03-30T08:11:38.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.288+0000 7f3fb1f84700 1 -- 172.21.15.87:0/3687189356 shutdown_connections 2023-03-30T08:11:38.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.288+0000 7f3fb1f84700 1 --2- 172.21.15.87:0/3687189356 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3f980653f0 0x7f3f980678a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.288+0000 7f3fb1f84700 1 --2- 172.21.15.87:0/3687189356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fac0b3f30 0x7f3fac0c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.288+0000 7f3fb1f84700 1 --2- 172.21.15.87:0/3687189356 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3fac0af180 0x7f3fac0acaa0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.288+0000 7f3fb1f84700 1 --2- 172.21.15.87:0/3687189356 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fac06a6e0 0x7f3fac147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.288+0000 7f3fb1f84700 1 -- 172.21.15.87:0/3687189356 >> 172.21.15.87:0/3687189356 conn(0x7f3fac0cf410 msgr2=0x7f3fac0b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.288+0000 7f3fb1f84700 1 -- 172.21.15.87:0/3687189356 shutdown_connections 2023-03-30T08:11:38.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.288+0000 7f3fb1f84700 1 -- 172.21.15.87:0/3687189356 wait complete. 2023-03-30T08:11:38.314 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:38.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.476+0000 7fe53a151700 1 Processor -- start 2023-03-30T08:11:38.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.476+0000 7fe53a151700 1 -- start start 2023-03-30T08:11:38.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.476+0000 7fe53a151700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe534163dc0 0x7fe5340c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.476+0000 7fe53a151700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe534164190 0x7fe5340c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.476+0000 7fe53a151700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe5340aea30 0x7fe5340ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.476+0000 7fe53a151700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53406d810 con 0x7fe534164190 2023-03-30T08:11:38.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.476+0000 7fe53a151700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5340cc1d0 con 0x7fe5340aea30 2023-03-30T08:11:38.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.476+0000 7fe53a151700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe534069f00 con 0x7fe534163dc0 2023-03-30T08:11:38.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.476+0000 7fe53894e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe534164190 0x7fe5340c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.476+0000 7fe53894e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe534164190 0x7fe5340c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58858/0 (socket says 172.21.15.87:58858) 2023-03-30T08:11:38.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53894e700 1 -- 172.21.15.87:0/1202826495 learned_addr learned my addr 172.21.15.87:0/1202826495 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:38.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe539950700 1 --2- 172.21.15.87:0/1202826495 >> v2:172.21.15.115:3300/0 conn(0x7fe5340aea30 0x7fe5340ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53914f700 1 --2- 172.21.15.87:0/1202826495 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe534163dc0 0x7fe5340c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53894e700 1 -- 172.21.15.87:0/1202826495 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe534163dc0 msgr2=0x7fe5340c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:38.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53894e700 1 --2- 172.21.15.87:0/1202826495 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe534163dc0 0x7fe5340c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53894e700 1 -- 172.21.15.87:0/1202826495 >> v2:172.21.15.115:3300/0 conn(0x7fe5340aea30 msgr2=0x7fe5340ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:38.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53894e700 1 --2- 172.21.15.87:0/1202826495 >> v2:172.21.15.115:3300/0 conn(0x7fe5340aea30 0x7fe5340ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53894e700 1 -- 172.21.15.87:0/1202826495 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53406cf70 con 0x7fe534164190 2023-03-30T08:11:38.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53894e700 1 --2- 172.21.15.87:0/1202826495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe534164190 0x7fe5340c9b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe5341656a0 tx=0x7fe524009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea88a65bb8bab97 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:38.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe52bfff700 1 -- 172.21.15.87:0/1202826495 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524011830 con 0x7fe534164190 2023-03-30T08:11:38.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe52bfff700 1 -- 172.21.15.87:0/1202826495 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe524011990 con 0x7fe534164190 2023-03-30T08:11:38.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe52bfff700 1 -- 172.21.15.87:0/1202826495 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524011d20 con 0x7fe534164190 2023-03-30T08:11:38.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53a151700 1 -- 172.21.15.87:0/1202826495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe534164190 msgr2=0x7fe5340c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:38.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53a151700 1 --2- 172.21.15.87:0/1202826495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe534164190 0x7fe5340c9b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe5341656a0 tx=0x7fe524009bf0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53a151700 1 -- 172.21.15.87:0/1202826495 shutdown_connections 2023-03-30T08:11:38.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53a151700 1 --2- 172.21.15.87:0/1202826495 >> v2:172.21.15.115:3300/0 conn(0x7fe5340aea30 0x7fe5340ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53a151700 1 --2- 172.21.15.87:0/1202826495 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe534164190 0x7fe5340c9b00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53a151700 1 --2- 172.21.15.87:0/1202826495 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe534163dc0 0x7fe5340c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53a151700 1 -- 172.21.15.87:0/1202826495 >> 172.21.15.87:0/1202826495 conn(0x7fe5340cf410 msgr2=0x7fe5340cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:38.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53a151700 1 -- 172.21.15.87:0/1202826495 shutdown_connections 2023-03-30T08:11:38.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.480+0000 7fe53a151700 1 -- 172.21.15.87:0/1202826495 wait complete. 2023-03-30T08:11:38.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.484+0000 7fe53a151700 1 Processor -- start 2023-03-30T08:11:38.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.484+0000 7fe53a151700 1 -- start start 2023-03-30T08:11:38.491 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe53a151700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5340aea30 0x7fe534153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.491 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe53a151700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe534163dc0 0x7fe5341565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.491 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe53a151700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe534164190 0x7fe534156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.491 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe53a151700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe534154220 con 0x7fe534164190 2023-03-30T08:11:38.491 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe53a151700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe534157160 con 0x7fe5340aea30 2023-03-30T08:11:38.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe53a151700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe534157440 con 0x7fe534163dc0 2023-03-30T08:11:38.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe539950700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe534164190 0x7fe534156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe539950700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe534164190 0x7fe534156ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58864/0 (socket says 172.21.15.87:58864) 2023-03-30T08:11:38.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe53914f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5340aea30 0x7fe534153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe539950700 1 -- 172.21.15.87:0/1022907323 learned_addr learned my addr 172.21.15.87:0/1022907323 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:38.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe53894e700 1 --2- 172.21.15.87:0/1022907323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe534163dc0 0x7fe5341565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe539950700 1 -- 172.21.15.87:0/1022907323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe534163dc0 msgr2=0x7fe5341565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:38.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe539950700 1 --2- 172.21.15.87:0/1022907323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe534163dc0 0x7fe5341565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe539950700 1 -- 172.21.15.87:0/1022907323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5340aea30 msgr2=0x7fe534153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:38.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe539950700 1 --2- 172.21.15.87:0/1022907323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5340aea30 0x7fe534153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe539950700 1 -- 172.21.15.87:0/1022907323 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe524009570 con 0x7fe534164190 2023-03-30T08:11:38.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe539950700 1 --2- 172.21.15.87:0/1022907323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe534164190 0x7fe534156ae0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00e860 tx=0x7fe52c00eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:38.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe529ffb700 1 -- 172.21.15.87:0/1022907323 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c013680 con 0x7fe534164190 2023-03-30T08:11:38.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe529ffb700 1 -- 172.21.15.87:0/1022907323 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c0137e0 con 0x7fe534164190 2023-03-30T08:11:38.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe529ffb700 1 -- 172.21.15.87:0/1022907323 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c013b50 con 0x7fe534164190 2023-03-30T08:11:38.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe53a151700 1 -- 172.21.15.87:0/1022907323 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53406d530 con 0x7fe534164190 2023-03-30T08:11:38.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.488+0000 7fe53a151700 1 -- 172.21.15.87:0/1022907323 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53406d250 con 0x7fe534164190 2023-03-30T08:11:38.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.492+0000 7fe53a151700 1 -- 172.21.15.87:0/1022907323 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53406cc40 con 0x7fe534164190 2023-03-30T08:11:38.497 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.492+0000 7fe529ffb700 1 -- 172.21.15.87:0/1022907323 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fe52c013cb0 con 0x7fe534164190 2023-03-30T08:11:38.499 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.496+0000 7fe529ffb700 1 --2- 172.21.15.87:0/1022907323 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe518065420 0x7fe5180678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.500 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.496+0000 7fe529ffb700 1 -- 172.21.15.87:0/1022907323 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe52c0829f0 con 0x7fe534164190 2023-03-30T08:11:38.500 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.496+0000 7fe53914f700 1 --2- 172.21.15.87:0/1022907323 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe518065420 0x7fe5180678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.496+0000 7fe53914f700 1 --2- 172.21.15.87:0/1022907323 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe518065420 0x7fe5180678d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe530003c30 tx=0x7fe5300098d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:38.504 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.500+0000 7fe529ffb700 1 -- 172.21.15.87:0/1022907323 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fe52c0502d0 con 0x7fe534164190 2023-03-30T08:11:38.675 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.672+0000 7fe53a151700 1 -- 172.21.15.87:0/1022907323 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5340733a0 con 0x7fe534164190 2023-03-30T08:11:38.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.672+0000 7fe529ffb700 1 -- 172.21.15.87:0/1022907323 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+19747 (secure 0 0 0) 0x7fe52c0538f0 con 0x7fe534164190 2023-03-30T08:11:38.677 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:38.677 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":29,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:38.147425+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:38.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.676+0000 7fe53a151700 1 -- 172.21.15.87:0/1022907323 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe518065420 msgr2=0x7fe5180678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:38.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.676+0000 7fe53a151700 1 --2- 172.21.15.87:0/1022907323 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe518065420 0x7fe5180678d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe530003c30 tx=0x7fe5300098d0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.676+0000 7fe53a151700 1 -- 172.21.15.87:0/1022907323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe534164190 msgr2=0x7fe534156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:38.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.676+0000 7fe53a151700 1 --2- 172.21.15.87:0/1022907323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe534164190 0x7fe534156ae0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00e860 tx=0x7fe52c00eb70 comp rx=0 tx=0).stop 2023-03-30T08:11:38.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.676+0000 7fe53a151700 1 -- 172.21.15.87:0/1022907323 shutdown_connections 2023-03-30T08:11:38.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.676+0000 7fe53a151700 1 --2- 172.21.15.87:0/1022907323 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe518065420 0x7fe5180678d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.676+0000 7fe53a151700 1 --2- 172.21.15.87:0/1022907323 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe534164190 0x7fe534156ae0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.676+0000 7fe53a151700 1 --2- 172.21.15.87:0/1022907323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe534163dc0 0x7fe5341565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.676+0000 7fe53a151700 1 --2- 172.21.15.87:0/1022907323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5340aea30 0x7fe534153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.676+0000 7fe53a151700 1 -- 172.21.15.87:0/1022907323 >> 172.21.15.87:0/1022907323 conn(0x7fe5340cf410 msgr2=0x7fe534154a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:38.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.676+0000 7fe53a151700 1 -- 172.21.15.87:0/1022907323 shutdown_connections 2023-03-30T08:11:38.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.676+0000 7fe53a151700 1 -- 172.21.15.87:0/1022907323 wait complete. 2023-03-30T08:11:38.699 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-30T08:10:56.407927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-30T08:10:57.359214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-30T08:11:00.430972+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-30T08:11:38.700 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T08:11:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.860+0000 7fdb5e385700 1 Processor -- start 2023-03-30T08:11:38.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.860+0000 7fdb5e385700 1 -- start start 2023-03-30T08:11:38.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.864+0000 7fdb5e385700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdb580c1dc0 0x7fdb580cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.864+0000 7fdb5e385700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb580cca70 0x7fdb58070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.864+0000 7fdb5e385700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb58164520 con 0x7fdb5806bd80 2023-03-30T08:11:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.864+0000 7fdb5e385700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb58164800 con 0x7fdb580c1dc0 2023-03-30T08:11:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.864+0000 7fdb5e385700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58164ae0 con 0x7fdb580cca70 2023-03-30T08:11:38.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.864+0000 7fdb4f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb580cca70 0x7fdb58070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.864+0000 7fdb57fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdb580c1dc0 0x7fdb580cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.864+0000 7fdb4f7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb580cca70 0x7fdb58070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:42622/0 (socket says 172.21.15.87:42622) 2023-03-30T08:11:38.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.864+0000 7fdb4f7fe700 1 -- 172.21.15.87:0/3277579859 learned_addr learned my addr 172.21.15.87:0/3277579859 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:38.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.864+0000 7fdb4f7fe700 1 -- 172.21.15.87:0/3277579859 >> v2:172.21.15.115:3300/0 conn(0x7fdb580c1dc0 msgr2=0x7fdb580cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:38.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.864+0000 7fdb4f7fe700 1 --2- 172.21.15.87:0/3277579859 >> v2:172.21.15.115:3300/0 conn(0x7fdb580c1dc0 0x7fdb580cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.864+0000 7fdb4f7fe700 1 -- 172.21.15.87:0/3277579859 >> v1:172.21.15.115:6789/0 conn(0x7fdb5806bd80 legacy=0x7fdb5815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:38.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.864+0000 7fdb4f7fe700 1 -- 172.21.15.87:0/3277579859 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb58164dc0 con 0x7fdb580cca70 2023-03-30T08:11:38.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.864+0000 7fdb577fe700 1 -- 172.21.15.87:0/3277579859 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129261457 0 0) 0x7fdb58164520 con 0x7fdb5806bd80 2023-03-30T08:11:38.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.864+0000 7fdb57fff700 1 --2- 172.21.15.87:0/3277579859 >> v2:172.21.15.115:3300/0 conn(0x7fdb580c1dc0 0x7fdb580cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:38.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.868+0000 7fdb4f7fe700 1 --2- 172.21.15.87:0/3277579859 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb580cca70 0x7fdb58070420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009910 tx=0x7fdb40009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbd41aff552460ce server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:38.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.868+0000 7fdb577fe700 1 -- 172.21.15.87:0/3277579859 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40011830 con 0x7fdb580cca70 2023-03-30T08:11:38.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.868+0000 7fdb577fe700 1 -- 172.21.15.87:0/3277579859 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb40011990 con 0x7fdb580cca70 2023-03-30T08:11:38.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.868+0000 7fdb577fe700 1 -- 172.21.15.87:0/3277579859 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40011d40 con 0x7fdb580cca70 2023-03-30T08:11:38.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.868+0000 7fdb5e385700 1 -- 172.21.15.87:0/3277579859 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb580cca70 msgr2=0x7fdb58070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:38.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.868+0000 7fdb5e385700 1 --2- 172.21.15.87:0/3277579859 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb580cca70 0x7fdb58070420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009910 tx=0x7fdb40009c20 comp rx=0 tx=0).stop 2023-03-30T08:11:38.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.868+0000 7fdb5e385700 1 -- 172.21.15.87:0/3277579859 shutdown_connections 2023-03-30T08:11:38.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.868+0000 7fdb5e385700 1 --2- 172.21.15.87:0/3277579859 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb580cca70 0x7fdb58070420 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.868+0000 7fdb5e385700 1 --2- 172.21.15.87:0/3277579859 >> v2:172.21.15.115:3300/0 conn(0x7fdb580c1dc0 0x7fdb580cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.868+0000 7fdb5e385700 1 -- 172.21.15.87:0/3277579859 >> 172.21.15.87:0/3277579859 conn(0x7fdb580ce960 msgr2=0x7fdb580ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:38.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.868+0000 7fdb5e385700 1 -- 172.21.15.87:0/3277579859 shutdown_connections 2023-03-30T08:11:38.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.868+0000 7fdb5e385700 1 -- 172.21.15.87:0/3277579859 wait complete. 2023-03-30T08:11:38.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.872+0000 7fdb5e385700 1 Processor -- start 2023-03-30T08:11:38.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.872+0000 7fdb5e385700 1 -- start start 2023-03-30T08:11:38.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.872+0000 7fdb5e385700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb5806bd80 0x7fdb581638e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.872+0000 7fdb5e385700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb580c1dc0 0x7fdb580b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.872+0000 7fdb5e385700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb580cca70 0x7fdb5815b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.872+0000 7fdb5e385700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58163e20 con 0x7fdb5806bd80 2023-03-30T08:11:38.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.872+0000 7fdb5e385700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580b46d0 con 0x7fdb580cca70 2023-03-30T08:11:38.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.872+0000 7fdb5e385700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58162840 con 0x7fdb580c1dc0 2023-03-30T08:11:38.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb57fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb5806bd80 0x7fdb581638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb57fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb5806bd80 0x7fdb581638e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58870/0 (socket says 172.21.15.87:58870) 2023-03-30T08:11:38.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb57fff700 1 -- 172.21.15.87:0/2245337491 learned_addr learned my addr 172.21.15.87:0/2245337491 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:38.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb4f7fe700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb580c1dc0 0x7fdb580b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb5c922700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb580cca70 0x7fdb5815b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb57fff700 1 -- 172.21.15.87:0/2245337491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb580c1dc0 msgr2=0x7fdb580b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:38.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb57fff700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb580c1dc0 0x7fdb580b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb57fff700 1 -- 172.21.15.87:0/2245337491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb580cca70 msgr2=0x7fdb5815b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:38.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb57fff700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb580cca70 0x7fdb5815b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:38.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb57fff700 1 -- 172.21.15.87:0/2245337491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb48009a70 con 0x7fdb5806bd80 2023-03-30T08:11:38.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb4f7fe700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb580c1dc0 0x7fdb580b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:38.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb5c922700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb580cca70 0x7fdb5815b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:38.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb57fff700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb5806bd80 0x7fdb581638e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800efc0 tx=0x7fdb4800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:38.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb557fa700 1 -- 172.21.15.87:0/2245337491 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4800ce80 con 0x7fdb5806bd80 2023-03-30T08:11:38.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb557fa700 1 -- 172.21.15.87:0/2245337491 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4800f040 con 0x7fdb5806bd80 2023-03-30T08:11:38.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb5e385700 1 -- 172.21.15.87:0/2245337491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb40009570 con 0x7fdb5806bd80 2023-03-30T08:11:38.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb557fa700 1 -- 172.21.15.87:0/2245337491 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb480146a0 con 0x7fdb5806bd80 2023-03-30T08:11:38.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.876+0000 7fdb5e385700 1 -- 172.21.15.87:0/2245337491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb580ce540 con 0x7fdb5806bd80 2023-03-30T08:11:38.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.880+0000 7fdb5e385700 1 -- 172.21.15.87:0/2245337491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb581650a0 con 0x7fdb5806bd80 2023-03-30T08:11:38.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.880+0000 7fdb557fa700 1 -- 172.21.15.87:0/2245337491 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fdb48014800 con 0x7fdb5806bd80 2023-03-30T08:11:38.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.880+0000 7fdb557fa700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdb380653f0 0x7fdb380678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:38.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.884+0000 7fdb557fa700 1 -- 172.21.15.87:0/2245337491 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdb480838f0 con 0x7fdb5806bd80 2023-03-30T08:11:38.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.884+0000 7fdb4f7fe700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdb380653f0 0x7fdb380678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:38.888 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.884+0000 7fdb4f7fe700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdb380653f0 0x7fdb380678a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdb40000c00 tx=0x7fdb40008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:38.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:38.888+0000 7fdb557fa700 1 -- 172.21.15.87:0/2245337491 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fdb48054c80 con 0x7fdb5806bd80 2023-03-30T08:11:39.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.064+0000 7fdb5e385700 1 -- 172.21.15.87:0/2245337491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb580c2190 con 0x7fdb5806bd80 2023-03-30T08:11:39.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.064+0000 7fdb557fa700 1 -- 172.21.15.87:0/2245337491 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb48054870 con 0x7fdb5806bd80 2023-03-30T08:11:39.068 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T08:11:39.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.064+0000 7fdb5e385700 1 -- 172.21.15.87:0/2245337491 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdb380653f0 msgr2=0x7fdb380678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:39.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.064+0000 7fdb5e385700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdb380653f0 0x7fdb380678a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdb40000c00 tx=0x7fdb40008030 comp rx=0 tx=0).stop 2023-03-30T08:11:39.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.068+0000 7fdb5e385700 1 -- 172.21.15.87:0/2245337491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb5806bd80 msgr2=0x7fdb581638e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:39.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.068+0000 7fdb5e385700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb5806bd80 0x7fdb581638e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800efc0 tx=0x7fdb4800c3a0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.068+0000 7fdb5e385700 1 -- 172.21.15.87:0/2245337491 shutdown_connections 2023-03-30T08:11:39.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.068+0000 7fdb5e385700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdb380653f0 0x7fdb380678a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.068+0000 7fdb5e385700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb580cca70 0x7fdb5815b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.068+0000 7fdb5e385700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb580c1dc0 0x7fdb580b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.068+0000 7fdb5e385700 1 --2- 172.21.15.87:0/2245337491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb5806bd80 0x7fdb581638e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.068+0000 7fdb5e385700 1 -- 172.21.15.87:0/2245337491 >> 172.21.15.87:0/2245337491 conn(0x7fdb580ce960 msgr2=0x7fdb5815e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:39.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.068+0000 7fdb5e385700 1 -- 172.21.15.87:0/2245337491 shutdown_connections 2023-03-30T08:11:39.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.068+0000 7fdb5e385700 1 -- 172.21.15.87:0/2245337491 wait complete. 2023-03-30T08:11:39.089 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T08:11:39.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.256+0000 7f2d5d884700 1 Processor -- start 2023-03-30T08:11:39.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.256+0000 7f2d5d884700 1 -- start start 2023-03-30T08:11:39.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.260+0000 7f2d5d884700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2d580cee80 0x7f2d580c9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:39.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.260+0000 7f2d5d884700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5815dfb0 con 0x7f2d581548d0 2023-03-30T08:11:39.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.260+0000 7f2d5d884700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5815eb50 con 0x7f2d5806b340 2023-03-30T08:11:39.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.260+0000 7f2d5d884700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d58070f80 con 0x7f2d580cee80 2023-03-30T08:11:39.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.260+0000 7f2d5c882700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2d580cee80 0x7f2d580c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:39.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.260+0000 7f2d57fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2d581548d0 0x7f2d580cf250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32882/0 (socket says 172.21.15.87:32882) 2023-03-30T08:11:39.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.260+0000 7f2d57fff700 1 -- 172.21.15.87:0/1326124154 learned_addr learned my addr 172.21.15.87:0/1326124154 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:39.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.260+0000 7f2d5c882700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2d580cee80 0x7f2d580c9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58880/0 (socket says 172.21.15.87:58880) 2023-03-30T08:11:39.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.260+0000 7f2d5c882700 1 -- 172.21.15.87:0/1326124154 >> v1:172.21.15.115:6789/0 conn(0x7f2d5806b340 legacy=0x7f2d5815e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:39.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.260+0000 7f2d577fe700 1 -- 172.21.15.87:0/1326124154 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912267858 0 0) 0x7f2d5815dfb0 con 0x7f2d581548d0 2023-03-30T08:11:39.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.260+0000 7f2d5c882700 1 -- 172.21.15.87:0/1326124154 >> v1:172.21.15.87:6789/0 conn(0x7f2d581548d0 legacy=0x7f2d580cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:39.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.260+0000 7f2d5c882700 1 -- 172.21.15.87:0/1326124154 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5815dc60 con 0x7f2d580cee80 2023-03-30T08:11:39.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.264+0000 7f2d5c882700 1 --2- 172.21.15.87:0/1326124154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d580cee80 0x7f2d580c9680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c009850 tx=0x7f2d4c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1707ea51b80806 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:39.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.264+0000 7f2d577fe700 1 -- 172.21.15.87:0/1326124154 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c011830 con 0x7f2d580cee80 2023-03-30T08:11:39.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.264+0000 7f2d577fe700 1 -- 172.21.15.87:0/1326124154 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c011990 con 0x7f2d580cee80 2023-03-30T08:11:39.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.264+0000 7f2d577fe700 1 -- 172.21.15.87:0/1326124154 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c011d20 con 0x7f2d580cee80 2023-03-30T08:11:39.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.264+0000 7f2d5d884700 1 -- 172.21.15.87:0/1326124154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d580cee80 msgr2=0x7f2d580c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:39.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.264+0000 7f2d5d884700 1 --2- 172.21.15.87:0/1326124154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d580cee80 0x7f2d580c9680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c009850 tx=0x7f2d4c009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:39.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.264+0000 7f2d5d884700 1 -- 172.21.15.87:0/1326124154 shutdown_connections 2023-03-30T08:11:39.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.264+0000 7f2d5d884700 1 --2- 172.21.15.87:0/1326124154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d580cee80 0x7f2d580c9680 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.264+0000 7f2d5d884700 1 -- 172.21.15.87:0/1326124154 >> 172.21.15.87:0/1326124154 conn(0x7f2d580b0b80 msgr2=0x7f2d580b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.264+0000 7f2d5d884700 1 -- 172.21.15.87:0/1326124154 shutdown_connections 2023-03-30T08:11:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.264+0000 7f2d5d884700 1 -- 172.21.15.87:0/1326124154 wait complete. 2023-03-30T08:11:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d884700 1 Processor -- start 2023-03-30T08:11:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d884700 1 -- start start 2023-03-30T08:11:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d884700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5806b340 0x7f2d5814b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d884700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d580cee80 0x7f2d5815cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d884700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d581548d0 0x7f2d580b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d884700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d580b2440 con 0x7f2d581548d0 2023-03-30T08:11:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d884700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d580b2720 con 0x7f2d5806b340 2023-03-30T08:11:39.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d884700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d580b2a00 con 0x7f2d580cee80 2023-03-30T08:11:39.274 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d083700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d581548d0 0x7f2d580b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:39.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d083700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d581548d0 0x7f2d580b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58892/0 (socket says 172.21.15.87:58892) 2023-03-30T08:11:39.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d083700 1 -- 172.21.15.87:0/686563482 learned_addr learned my addr 172.21.15.87:0/686563482 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:39.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d57fff700 1 --2- 172.21.15.87:0/686563482 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d580cee80 0x7f2d5815cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:39.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5c882700 1 --2- 172.21.15.87:0/686563482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5806b340 0x7f2d5814b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:39.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d083700 1 -- 172.21.15.87:0/686563482 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d580cee80 msgr2=0x7f2d5815cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:39.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d083700 1 --2- 172.21.15.87:0/686563482 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d580cee80 0x7f2d5815cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d083700 1 -- 172.21.15.87:0/686563482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5806b340 msgr2=0x7f2d5814b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:39.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d083700 1 --2- 172.21.15.87:0/686563482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5806b340 0x7f2d5814b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.268+0000 7f2d5d083700 1 -- 172.21.15.87:0/686563482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c0094b0 con 0x7f2d581548d0 2023-03-30T08:11:39.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.272+0000 7f2d5d083700 1 --2- 172.21.15.87:0/686563482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d581548d0 0x7f2d580b34e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000cb50 tx=0x7f2d5000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:39.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.272+0000 7f2d557fa700 1 -- 172.21.15.87:0/686563482 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50003c20 con 0x7f2d581548d0 2023-03-30T08:11:39.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.272+0000 7f2d557fa700 1 -- 172.21.15.87:0/686563482 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d50003d80 con 0x7f2d581548d0 2023-03-30T08:11:39.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.272+0000 7f2d557fa700 1 -- 172.21.15.87:0/686563482 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5000aa20 con 0x7f2d581548d0 2023-03-30T08:11:39.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.272+0000 7f2d5d884700 1 -- 172.21.15.87:0/686563482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d580cb710 con 0x7f2d581548d0 2023-03-30T08:11:39.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.272+0000 7f2d5d884700 1 -- 172.21.15.87:0/686563482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d580cb430 con 0x7f2d581548d0 2023-03-30T08:11:39.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.272+0000 7f2d5d884700 1 -- 172.21.15.87:0/686563482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d580cb100 con 0x7f2d581548d0 2023-03-30T08:11:39.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.276+0000 7f2d557fa700 1 -- 172.21.15.87:0/686563482 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f2d5000ab80 con 0x7f2d581548d0 2023-03-30T08:11:39.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.276+0000 7f2d557fa700 1 --2- 172.21.15.87:0/686563482 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2d3c0653f0 0x7f2d3c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:39.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.276+0000 7f2d557fa700 1 -- 172.21.15.87:0/686563482 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2d50082a90 con 0x7f2d581548d0 2023-03-30T08:11:39.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.276+0000 7f2d5c882700 1 --2- 172.21.15.87:0/686563482 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2d3c0653f0 0x7f2d3c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:39.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.276+0000 7f2d5c882700 1 --2- 172.21.15.87:0/686563482 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2d3c0653f0 0x7f2d3c0678a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0090b0 tx=0x7f2d4c01c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:39.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.280+0000 7f2d557fa700 1 -- 172.21.15.87:0/686563482 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f2d50050470 con 0x7f2d581548d0 2023-03-30T08:11:39.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.448+0000 7f2d5d884700 1 -- 172.21.15.87:0/686563482 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2d580733a0 con 0x7f2d581548d0 2023-03-30T08:11:39.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.452+0000 7f2d557fa700 1 -- 172.21.15.87:0/686563482 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2d50053a90 con 0x7f2d581548d0 2023-03-30T08:11:39.458 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T08:11:39.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.456+0000 7f2d5d884700 1 -- 172.21.15.87:0/686563482 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2d3c0653f0 msgr2=0x7f2d3c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:39.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.456+0000 7f2d5d884700 1 --2- 172.21.15.87:0/686563482 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2d3c0653f0 0x7f2d3c0678a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0090b0 tx=0x7f2d4c01c040 comp rx=0 tx=0).stop 2023-03-30T08:11:39.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.456+0000 7f2d5d884700 1 -- 172.21.15.87:0/686563482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d581548d0 msgr2=0x7f2d580b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:39.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.456+0000 7f2d5d884700 1 --2- 172.21.15.87:0/686563482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d581548d0 0x7f2d580b34e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000cb50 tx=0x7f2d5000ce60 comp rx=0 tx=0).stop 2023-03-30T08:11:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.456+0000 7f2d5d884700 1 -- 172.21.15.87:0/686563482 shutdown_connections 2023-03-30T08:11:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.456+0000 7f2d5d884700 1 --2- 172.21.15.87:0/686563482 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2d3c0653f0 0x7f2d3c0678a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.456+0000 7f2d5d884700 1 --2- 172.21.15.87:0/686563482 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d581548d0 0x7f2d580b34e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.456+0000 7f2d5d884700 1 --2- 172.21.15.87:0/686563482 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d580cee80 0x7f2d5815cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.456+0000 7f2d5d884700 1 --2- 172.21.15.87:0/686563482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d5806b340 0x7f2d5814b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.456+0000 7f2d5d884700 1 -- 172.21.15.87:0/686563482 >> 172.21.15.87:0/686563482 conn(0x7f2d580b0b80 msgr2=0x7f2d580afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:39.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.456+0000 7f2d5d884700 1 -- 172.21.15.87:0/686563482 shutdown_connections 2023-03-30T08:11:39.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.456+0000 7f2d5d884700 1 -- 172.21.15.87:0/686563482 wait complete. 2023-03-30T08:11:39.478 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-30T08:11:39.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.640+0000 7f250eb84700 1 Processor -- start 2023-03-30T08:11:39.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.640+0000 7f250eb84700 1 -- start start 2023-03-30T08:11:39.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.640+0000 7f250eb84700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f25080b0c10 0x7f25080aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:39.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.640+0000 7f250eb84700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250806b670 con 0x7f25080af180 2023-03-30T08:11:39.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.640+0000 7f250eb84700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250806b0b0 con 0x7f25080b3f30 2023-03-30T08:11:39.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.640+0000 7f250eb84700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25080b1090 con 0x7f25080b0c10 2023-03-30T08:11:39.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.644+0000 7f250e383700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f25080af180 0x7f250806c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:32888/0 (socket says 172.21.15.87:32888) 2023-03-30T08:11:39.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.644+0000 7f250e383700 1 -- 172.21.15.87:0/3736283058 learned_addr learned my addr 172.21.15.87:0/3736283058 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:39.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.644+0000 7f250d381700 1 --2- 172.21.15.87:0/3736283058 >> v2:172.21.15.115:3300/0 conn(0x7f25080b0c10 0x7f25080aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:39.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.644+0000 7f250cb80700 1 -- 172.21.15.87:0/3736283058 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929128199 0 0) 0x7f250806b670 con 0x7f25080af180 2023-03-30T08:11:39.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.644+0000 7f250cb80700 1 -- 172.21.15.87:0/3736283058 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24f40035d0 con 0x7f25080af180 2023-03-30T08:11:39.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.644+0000 7f250d381700 1 -- 172.21.15.87:0/3736283058 >> v1:172.21.15.115:6789/0 conn(0x7f25080b3f30 legacy=0x7f250806a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:39.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.644+0000 7f250d381700 1 -- 172.21.15.87:0/3736283058 >> v1:172.21.15.87:6789/0 conn(0x7f25080af180 legacy=0x7f250806c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:39.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.644+0000 7f250d381700 1 -- 172.21.15.87:0/3736283058 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250806b390 con 0x7f25080b0c10 2023-03-30T08:11:39.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.644+0000 7f250d381700 1 --2- 172.21.15.87:0/3736283058 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25080b0c10 0x7f25080aec40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009850 tx=0x7f24f8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac3ae21b6abc2c4e server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.644+0000 7f250cb80700 1 -- 172.21.15.87:0/3736283058 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8011830 con 0x7f25080b0c10 2023-03-30T08:11:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.644+0000 7f250cb80700 1 -- 172.21.15.87:0/3736283058 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f8011990 con 0x7f25080b0c10 2023-03-30T08:11:39.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.644+0000 7f250cb80700 1 -- 172.21.15.87:0/3736283058 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8011d40 con 0x7f25080b0c10 2023-03-30T08:11:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.648+0000 7f250eb84700 1 -- 172.21.15.87:0/3736283058 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25080b0c10 msgr2=0x7f25080aec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:39.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.648+0000 7f250eb84700 1 --2- 172.21.15.87:0/3736283058 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25080b0c10 0x7f25080aec40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009850 tx=0x7f24f8009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.648+0000 7f250eb84700 1 -- 172.21.15.87:0/3736283058 shutdown_connections 2023-03-30T08:11:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.648+0000 7f250eb84700 1 --2- 172.21.15.87:0/3736283058 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25080b0c10 0x7f25080aec40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.648+0000 7f250eb84700 1 -- 172.21.15.87:0/3736283058 >> 172.21.15.87:0/3736283058 conn(0x7f25080cf410 msgr2=0x7f25080cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.648+0000 7f250eb84700 1 -- 172.21.15.87:0/3736283058 shutdown_connections 2023-03-30T08:11:39.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.648+0000 7f250eb84700 1 -- 172.21.15.87:0/3736283058 wait complete. 2023-03-30T08:11:39.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250eb84700 1 Processor -- start 2023-03-30T08:11:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250eb84700 1 -- start start 2023-03-30T08:11:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250eb84700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25080af180 0x7f2508156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250eb84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25080b0c10 0x7f2508152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250eb84700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25080b3f30 0x7f25080c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250eb84700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250815b080 con 0x7f25080af180 2023-03-30T08:11:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250eb84700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250815b360 con 0x7f25080b3f30 2023-03-30T08:11:39.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250eb84700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250815b640 con 0x7f25080b0c10 2023-03-30T08:11:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250db82700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25080af180 0x7f2508156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250db82700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25080af180 0x7f2508156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:58898/0 (socket says 172.21.15.87:58898) 2023-03-30T08:11:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250db82700 1 -- 172.21.15.87:0/3928848683 learned_addr learned my addr 172.21.15.87:0/3928848683 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250d381700 1 --2- 172.21.15.87:0/3928848683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25080b0c10 0x7f2508152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250e383700 1 --2- 172.21.15.87:0/3928848683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25080b3f30 0x7f25080c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250db82700 1 -- 172.21.15.87:0/3928848683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25080b0c10 msgr2=0x7f2508152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:39.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250db82700 1 --2- 172.21.15.87:0/3928848683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25080b0c10 0x7f2508152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250db82700 1 -- 172.21.15.87:0/3928848683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25080b3f30 msgr2=0x7f25080c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:39.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250db82700 1 --2- 172.21.15.87:0/3928848683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25080b3f30 0x7f25080c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250db82700 1 -- 172.21.15.87:0/3928848683 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f80094b0 con 0x7f25080af180 2023-03-30T08:11:39.660 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250db82700 1 --2- 172.21.15.87:0/3928848683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25080af180 0x7f2508156b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f250400c500 tx=0x7f250400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f24fe7fc700 1 -- 172.21.15.87:0/3928848683 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040052d0 con 0x7f25080af180 2023-03-30T08:11:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f24fe7fc700 1 -- 172.21.15.87:0/3928848683 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2504005430 con 0x7f25080af180 2023-03-30T08:11:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.652+0000 7f250eb84700 1 -- 172.21.15.87:0/3928848683 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25080ae1b0 con 0x7f25080af180 2023-03-30T08:11:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.656+0000 7f24fe7fc700 1 -- 172.21.15.87:0/3928848683 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040055a0 con 0x7f25080af180 2023-03-30T08:11:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.656+0000 7f250eb84700 1 -- 172.21.15.87:0/3928848683 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25080aded0 con 0x7f25080af180 2023-03-30T08:11:39.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.656+0000 7f250eb84700 1 -- 172.21.15.87:0/3928848683 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25080b4300 con 0x7f25080af180 2023-03-30T08:11:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.656+0000 7f24fe7fc700 1 -- 172.21.15.87:0/3928848683 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f25040038e0 con 0x7f25080af180 2023-03-30T08:11:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.656+0000 7f24fe7fc700 1 --2- 172.21.15.87:0/3928848683 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24ec0653f0 0x7f24ec0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:39.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.656+0000 7f24fe7fc700 1 -- 172.21.15.87:0/3928848683 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2504082420 con 0x7f25080af180 2023-03-30T08:11:39.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.660+0000 7f250d381700 1 --2- 172.21.15.87:0/3928848683 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24ec0653f0 0x7f24ec0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:39.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.660+0000 7f250d381700 1 --2- 172.21.15.87:0/3928848683 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24ec0653f0 0x7f24ec0678a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24f80090b0 tx=0x7f24f801c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:39.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.664+0000 7f24fe7fc700 1 -- 172.21.15.87:0/3928848683 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f250404fe50 con 0x7f25080af180 2023-03-30T08:11:39.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.832+0000 7f250eb84700 1 -- 172.21.15.87:0/3928848683 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f250815b1c0 con 0x7f25080af180 2023-03-30T08:11:39.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.832+0000 7f24fe7fc700 1 -- 172.21.15.87:0/3928848683 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f250815b1c0 con 0x7f25080af180 2023-03-30T08:11:39.838 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:39.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.836+0000 7f250eb84700 1 -- 172.21.15.87:0/3928848683 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24ec0653f0 msgr2=0x7f24ec0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:39.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.836+0000 7f250eb84700 1 --2- 172.21.15.87:0/3928848683 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24ec0653f0 0x7f24ec0678a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24f80090b0 tx=0x7f24f801c040 comp rx=0 tx=0).stop 2023-03-30T08:11:39.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.836+0000 7f250eb84700 1 -- 172.21.15.87:0/3928848683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25080af180 msgr2=0x7f2508156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:39.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.836+0000 7f250eb84700 1 --2- 172.21.15.87:0/3928848683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25080af180 0x7f2508156b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f250400c500 tx=0x7f250400c8c0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.836+0000 7f250eb84700 1 -- 172.21.15.87:0/3928848683 shutdown_connections 2023-03-30T08:11:39.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.836+0000 7f250eb84700 1 --2- 172.21.15.87:0/3928848683 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24ec0653f0 0x7f24ec0678a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.836+0000 7f250eb84700 1 --2- 172.21.15.87:0/3928848683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25080b3f30 0x7f25080c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.836+0000 7f250eb84700 1 --2- 172.21.15.87:0/3928848683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25080b0c10 0x7f2508152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.836+0000 7f250eb84700 1 --2- 172.21.15.87:0/3928848683 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f25080af180 0x7f2508156b10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:39.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.836+0000 7f250eb84700 1 -- 172.21.15.87:0/3928848683 >> 172.21.15.87:0/3928848683 conn(0x7f25080cf410 msgr2=0x7f25080cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:39.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.836+0000 7f250eb84700 1 -- 172.21.15.87:0/3928848683 shutdown_connections 2023-03-30T08:11:39.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:39.836+0000 7f250eb84700 1 -- 172.21.15.87:0/3928848683 wait complete. 2023-03-30T08:11:39.862 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-30T08:11:40.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.016+0000 7f33908dc700 1 Processor -- start 2023-03-30T08:11:40.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.016+0000 7f33908dc700 1 -- start start 2023-03-30T08:11:40.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f33908dc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f338c0ca080 0x7f338c0ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f33908dc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f338c158b00 0x7f338c06a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f33908dc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f338c06ac20 0x7f338c0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f33908dc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338c0aff50 con 0x7f338c158b00 2023-03-30T08:11:40.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f33908dc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338c0ca990 con 0x7f338c06ac20 2023-03-30T08:11:40.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f33908dc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0af620 con 0x7f338c0ca080 2023-03-30T08:11:40.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f3382ffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f338c158b00 0x7f338c06a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f3382ffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f338c158b00 0x7f338c06a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55656/0 (socket says 172.21.15.87:55656) 2023-03-30T08:11:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f3382ffd700 1 -- 172.21.15.87:0/1107844701 learned_addr learned my addr 172.21.15.87:0/1107844701 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f338bfff700 1 --2- 172.21.15.87:0/1107844701 >> v2:172.21.15.115:3300/0 conn(0x7f338c06ac20 0x7f338c0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f338b7fe700 1 --2- 172.21.15.87:0/1107844701 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f338c0ca080 0x7f338c0ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f3382ffd700 1 -- 172.21.15.87:0/1107844701 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f338c0ca080 msgr2=0x7f338c0ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f3382ffd700 1 --2- 172.21.15.87:0/1107844701 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f338c0ca080 0x7f338c0ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f3382ffd700 1 -- 172.21.15.87:0/1107844701 >> v2:172.21.15.115:3300/0 conn(0x7f338c06ac20 msgr2=0x7f338c0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f3382ffd700 1 --2- 172.21.15.87:0/1107844701 >> v2:172.21.15.115:3300/0 conn(0x7f338c06ac20 0x7f338c0c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f3382ffd700 1 -- 172.21.15.87:0/1107844701 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c0af900 con 0x7f338c158b00 2023-03-30T08:11:40.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f3382ffd700 1 --2- 172.21.15.87:0/1107844701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c158b00 0x7f338c06a6e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f338c06b6a0 tx=0x7f337400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c4c96b4bf5f77e server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:40.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f338affd700 1 -- 172.21.15.87:0/1107844701 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337400e070 con 0x7f338c158b00 2023-03-30T08:11:40.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f338affd700 1 -- 172.21.15.87:0/1107844701 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337400b910 con 0x7f338c158b00 2023-03-30T08:11:40.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f338affd700 1 -- 172.21.15.87:0/1107844701 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337400bcc0 con 0x7f338c158b00 2023-03-30T08:11:40.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f33908dc700 1 -- 172.21.15.87:0/1107844701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c158b00 msgr2=0x7f338c06a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f33908dc700 1 --2- 172.21.15.87:0/1107844701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c158b00 0x7f338c06a6e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f338c06b6a0 tx=0x7f337400b330 comp rx=0 tx=0).stop 2023-03-30T08:11:40.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f33908dc700 1 -- 172.21.15.87:0/1107844701 shutdown_connections 2023-03-30T08:11:40.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f33908dc700 1 --2- 172.21.15.87:0/1107844701 >> v2:172.21.15.115:3300/0 conn(0x7f338c06ac20 0x7f338c0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f33908dc700 1 --2- 172.21.15.87:0/1107844701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c158b00 0x7f338c06a6e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f33908dc700 1 --2- 172.21.15.87:0/1107844701 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f338c0ca080 0x7f338c0ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.020+0000 7f33908dc700 1 -- 172.21.15.87:0/1107844701 >> 172.21.15.87:0/1107844701 conn(0x7f338c0cf410 msgr2=0x7f338c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.024+0000 7f33908dc700 1 -- 172.21.15.87:0/1107844701 shutdown_connections 2023-03-30T08:11:40.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.024+0000 7f33908dc700 1 -- 172.21.15.87:0/1107844701 wait complete. 2023-03-30T08:11:40.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.024+0000 7f33908dc700 1 Processor -- start 2023-03-30T08:11:40.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.024+0000 7f33908dc700 1 -- start start 2023-03-30T08:11:40.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f33908dc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f338c06ac20 0x7f338c14aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f33908dc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f338c0ca080 0x7f338c0b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f33908dc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c0b3640 0x7f338c14fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f33908dc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c14b420 con 0x7f338c0b3640 2023-03-30T08:11:40.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f33908dc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0b1ae0 con 0x7f338c0ca080 2023-03-30T08:11:40.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f33908dc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338c0b1dc0 con 0x7f338c06ac20 2023-03-30T08:11:40.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f338bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c0b3640 0x7f338c14fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f338bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c0b3640 0x7f338c14fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55662/0 (socket says 172.21.15.87:55662) 2023-03-30T08:11:40.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f338bfff700 1 -- 172.21.15.87:0/1567565579 learned_addr learned my addr 172.21.15.87:0/1567565579 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:40.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f338b7fe700 1 --2- 172.21.15.87:0/1567565579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f338c06ac20 0x7f338c14aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f3382ffd700 1 --2- 172.21.15.87:0/1567565579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f338c0ca080 0x7f338c0b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f338bfff700 1 -- 172.21.15.87:0/1567565579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f338c06ac20 msgr2=0x7f338c14aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f338bfff700 1 --2- 172.21.15.87:0/1567565579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f338c06ac20 0x7f338c14aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f338bfff700 1 -- 172.21.15.87:0/1567565579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f338c0ca080 msgr2=0x7f338c0b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f338bfff700 1 --2- 172.21.15.87:0/1567565579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f338c0ca080 0x7f338c0b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f338bfff700 1 -- 172.21.15.87:0/1567565579 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3374009b30 con 0x7f338c0b3640 2023-03-30T08:11:40.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f3382ffd700 1 --2- 172.21.15.87:0/1567565579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f338c0ca080 0x7f338c0b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:40.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f338bfff700 1 --2- 172.21.15.87:0/1567565579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c0b3640 0x7f338c14fc60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f338400e7f0 tx=0x7f338400ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:40.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f3388ff9700 1 -- 172.21.15.87:0/1567565579 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384013680 con 0x7f338c0b3640 2023-03-30T08:11:40.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f3388ff9700 1 -- 172.21.15.87:0/1567565579 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33840137e0 con 0x7f338c0b3640 2023-03-30T08:11:40.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f3388ff9700 1 -- 172.21.15.87:0/1567565579 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384013b50 con 0x7f338c0b3640 2023-03-30T08:11:40.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f33908dc700 1 -- 172.21.15.87:0/1567565579 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338c0af240 con 0x7f338c0b3640 2023-03-30T08:11:40.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f33908dc700 1 -- 172.21.15.87:0/1567565579 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338c0afbe0 con 0x7f338c0b3640 2023-03-30T08:11:40.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.028+0000 7f33908dc700 1 -- 172.21.15.87:0/1567565579 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338c0af3d0 con 0x7f338c0b3640 2023-03-30T08:11:40.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.032+0000 7f3388ff9700 1 -- 172.21.15.87:0/1567565579 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f3384013cb0 con 0x7f338c0b3640 2023-03-30T08:11:40.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.032+0000 7f3388ff9700 1 --2- 172.21.15.87:0/1567565579 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f336c0653f0 0x7f336c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.032+0000 7f3388ff9700 1 -- 172.21.15.87:0/1567565579 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3384082a40 con 0x7f338c0b3640 2023-03-30T08:11:40.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.032+0000 7f338b7fe700 1 --2- 172.21.15.87:0/1567565579 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f336c0653f0 0x7f336c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.032+0000 7f338b7fe700 1 --2- 172.21.15.87:0/1567565579 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f336c0653f0 0x7f336c0678a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f337c009950 tx=0x7f337c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:40.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.040+0000 7f3388ff9700 1 -- 172.21.15.87:0/1567565579 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f3384053d20 con 0x7f338c0b3640 2023-03-30T08:11:40.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.212+0000 7f33908dc700 1 -- 172.21.15.87:0/1567565579 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f338c0733a0 con 0x7f338c0b3640 2023-03-30T08:11:40.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.216+0000 7f3388ff9700 1 -- 172.21.15.87:0/1567565579 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3384080e60 con 0x7f338c0b3640 2023-03-30T08:11:40.219 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-03-30T08:11:40.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.216+0000 7f33908dc700 1 -- 172.21.15.87:0/1567565579 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f336c0653f0 msgr2=0x7f336c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.216+0000 7f33908dc700 1 --2- 172.21.15.87:0/1567565579 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f336c0653f0 0x7f336c0678a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f337c009950 tx=0x7f337c008040 comp rx=0 tx=0).stop 2023-03-30T08:11:40.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.216+0000 7f33908dc700 1 -- 172.21.15.87:0/1567565579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c0b3640 msgr2=0x7f338c14fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.216+0000 7f33908dc700 1 --2- 172.21.15.87:0/1567565579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c0b3640 0x7f338c14fc60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f338400e7f0 tx=0x7f338400ebb0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.216+0000 7f33908dc700 1 -- 172.21.15.87:0/1567565579 shutdown_connections 2023-03-30T08:11:40.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.216+0000 7f33908dc700 1 --2- 172.21.15.87:0/1567565579 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f336c0653f0 0x7f336c0678a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.216+0000 7f33908dc700 1 --2- 172.21.15.87:0/1567565579 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f338c0b3640 0x7f338c14fc60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.216+0000 7f33908dc700 1 --2- 172.21.15.87:0/1567565579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f338c0ca080 0x7f338c0b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.216+0000 7f33908dc700 1 --2- 172.21.15.87:0/1567565579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f338c06ac20 0x7f338c14aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.216+0000 7f33908dc700 1 -- 172.21.15.87:0/1567565579 >> 172.21.15.87:0/1567565579 conn(0x7f338c0cf410 msgr2=0x7f338c0b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:40.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.216+0000 7f33908dc700 1 -- 172.21.15.87:0/1567565579 shutdown_connections 2023-03-30T08:11:40.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.216+0000 7f33908dc700 1 -- 172.21.15.87:0/1567565579 wait complete. 2023-03-30T08:11:40.245 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-30T08:11:40.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.404+0000 7fd5ff26f700 1 Processor -- start 2023-03-30T08:11:40.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5ff26f700 1 -- start start 2023-03-30T08:11:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5ff26f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd5f80b8460 0x7fd5f80b4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5ff26f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd5f80cd7e0 0x7fd5f80b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5ff26f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f80d27d0 0x7fd5f8069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5ff26f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f8160f50 con 0x7fd5f80b8460 2023-03-30T08:11:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5ff26f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f806c320 con 0x7fd5f80cd7e0 2023-03-30T08:11:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5ff26f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f80cd350 con 0x7fd5f80d27d0 2023-03-30T08:11:40.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5fd00b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd5f80b8460 0x7fd5f80b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5fd00b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd5f80b8460 0x7fd5f80b4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55672/0 (socket says 172.21.15.87:55672) 2023-03-30T08:11:40.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5fd00b700 1 -- 172.21.15.87:0/4028580889 learned_addr learned my addr 172.21.15.87:0/4028580889 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:40.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5fc80a700 1 --2- 172.21.15.87:0/4028580889 >> v2:172.21.15.115:3300/0 conn(0x7fd5f80cd7e0 0x7fd5f80b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5fd80c700 1 --2- 172.21.15.87:0/4028580889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f80d27d0 0x7fd5f8069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5fd00b700 1 -- 172.21.15.87:0/4028580889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f80d27d0 msgr2=0x7fd5f8069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:40.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5fd00b700 1 --2- 172.21.15.87:0/4028580889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f80d27d0 0x7fd5f8069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5fd00b700 1 -- 172.21.15.87:0/4028580889 >> v2:172.21.15.115:3300/0 conn(0x7fd5f80cd7e0 msgr2=0x7fd5f80b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:40.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5fd00b700 1 --2- 172.21.15.87:0/4028580889 >> v2:172.21.15.115:3300/0 conn(0x7fd5f80cd7e0 0x7fd5f80b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.408+0000 7fd5fd00b700 1 -- 172.21.15.87:0/4028580889 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f80b8830 con 0x7fd5f80b8460 2023-03-30T08:11:40.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.412+0000 7fd5fd00b700 1 --2- 172.21.15.87:0/4028580889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f80b8460 0x7fd5f80b4780 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80671a0 tx=0x7fd5f4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed48144c7946048 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:40.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.412+0000 7fd5effff700 1 -- 172.21.15.87:0/4028580889 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4011830 con 0x7fd5f80b8460 2023-03-30T08:11:40.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.412+0000 7fd5effff700 1 -- 172.21.15.87:0/4028580889 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f4011990 con 0x7fd5f80b8460 2023-03-30T08:11:40.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.412+0000 7fd5effff700 1 -- 172.21.15.87:0/4028580889 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4011d40 con 0x7fd5f80b8460 2023-03-30T08:11:40.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.412+0000 7fd5ff26f700 1 -- 172.21.15.87:0/4028580889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f80b8460 msgr2=0x7fd5f80b4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.412+0000 7fd5ff26f700 1 --2- 172.21.15.87:0/4028580889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f80b8460 0x7fd5f80b4780 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80671a0 tx=0x7fd5f4009c20 comp rx=0 tx=0).stop 2023-03-30T08:11:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.412+0000 7fd5ff26f700 1 -- 172.21.15.87:0/4028580889 shutdown_connections 2023-03-30T08:11:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.412+0000 7fd5ff26f700 1 --2- 172.21.15.87:0/4028580889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f80d27d0 0x7fd5f8069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.412+0000 7fd5ff26f700 1 --2- 172.21.15.87:0/4028580889 >> v2:172.21.15.115:3300/0 conn(0x7fd5f80cd7e0 0x7fd5f80b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.412+0000 7fd5ff26f700 1 --2- 172.21.15.87:0/4028580889 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f80b8460 0x7fd5f80b4780 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.412+0000 7fd5ff26f700 1 -- 172.21.15.87:0/4028580889 >> 172.21.15.87:0/4028580889 conn(0x7fd5f80cf780 msgr2=0x7fd5f80cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.412+0000 7fd5ff26f700 1 -- 172.21.15.87:0/4028580889 shutdown_connections 2023-03-30T08:11:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.412+0000 7fd5ff26f700 1 -- 172.21.15.87:0/4028580889 wait complete. 2023-03-30T08:11:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.416+0000 7fd5ff26f700 1 Processor -- start 2023-03-30T08:11:40.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.416+0000 7fd5ff26f700 1 -- start start 2023-03-30T08:11:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5ff26f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f80b8460 0x7fd5f80c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5ff26f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5f80cd7e0 0x7fd5f8156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5ff26f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f80d27d0 0x7fd5f815b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5ff26f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f80c6870 con 0x7fd5f80d27d0 2023-03-30T08:11:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5ff26f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f80ca3b0 con 0x7fd5f80cd7e0 2023-03-30T08:11:40.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5ff26f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f80ca800 con 0x7fd5f80b8460 2023-03-30T08:11:40.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5fd80c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f80d27d0 0x7fd5f815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5fd80c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f80d27d0 0x7fd5f815b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55684/0 (socket says 172.21.15.87:55684) 2023-03-30T08:11:40.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5fd80c700 1 -- 172.21.15.87:0/3434206675 learned_addr learned my addr 172.21.15.87:0/3434206675 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:40.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5fd00b700 1 --2- 172.21.15.87:0/3434206675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f80b8460 0x7fd5f80c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5fc80a700 1 --2- 172.21.15.87:0/3434206675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5f80cd7e0 0x7fd5f8156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5fd80c700 1 -- 172.21.15.87:0/3434206675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f80b8460 msgr2=0x7fd5f80c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5fd80c700 1 --2- 172.21.15.87:0/3434206675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f80b8460 0x7fd5f80c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5fd80c700 1 -- 172.21.15.87:0/3434206675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5f80cd7e0 msgr2=0x7fd5f8156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5fd80c700 1 --2- 172.21.15.87:0/3434206675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5f80cd7e0 0x7fd5f8156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5fd80c700 1 -- 172.21.15.87:0/3434206675 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f4009570 con 0x7fd5f80d27d0 2023-03-30T08:11:40.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5fd80c700 1 --2- 172.21.15.87:0/3434206675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f80d27d0 0x7fd5f815b200 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0007e60 tx=0x7fd5f000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5edffb700 1 -- 172.21.15.87:0/3434206675 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f000ed30 con 0x7fd5f80d27d0 2023-03-30T08:11:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5edffb700 1 -- 172.21.15.87:0/3434206675 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f0014420 con 0x7fd5f80d27d0 2023-03-30T08:11:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5ff26f700 1 -- 172.21.15.87:0/3434206675 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f81609b0 con 0x7fd5f80d27d0 2023-03-30T08:11:40.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5edffb700 1 -- 172.21.15.87:0/3434206675 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f00147d0 con 0x7fd5f80d27d0 2023-03-30T08:11:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.420+0000 7fd5ff26f700 1 -- 172.21.15.87:0/3434206675 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f80ceeb0 con 0x7fd5f80d27d0 2023-03-30T08:11:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.424+0000 7fd5ff26f700 1 -- 172.21.15.87:0/3434206675 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f8160c70 con 0x7fd5f80d27d0 2023-03-30T08:11:40.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.424+0000 7fd5edffb700 1 -- 172.21.15.87:0/3434206675 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd5f0014930 con 0x7fd5f80d27d0 2023-03-30T08:11:40.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.424+0000 7fd5edffb700 1 --2- 172.21.15.87:0/3434206675 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5dc0653f0 0x7fd5dc0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.424+0000 7fd5edffb700 1 -- 172.21.15.87:0/3434206675 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd5f00830f0 con 0x7fd5f80d27d0 2023-03-30T08:11:40.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.424+0000 7fd5fd00b700 1 --2- 172.21.15.87:0/3434206675 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5dc0653f0 0x7fd5dc0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.424+0000 7fd5fd00b700 1 --2- 172.21.15.87:0/3434206675 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5dc0653f0 0x7fd5dc0678a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009c60 tx=0x7fd5f4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:40.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.432+0000 7fd5edffb700 1 -- 172.21.15.87:0/3434206675 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fd5f0050a40 con 0x7fd5f80d27d0 2023-03-30T08:11:40.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.600+0000 7fd5ff26f700 1 -- 172.21.15.87:0/3434206675 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd5f8073ee0 con 0x7fd5f80d27d0 2023-03-30T08:11:40.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.600+0000 7fd5edffb700 1 -- 172.21.15.87:0/3434206675 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd5f0054060 con 0x7fd5f80d27d0 2023-03-30T08:11:40.604 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:40.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.604+0000 7fd5ff26f700 1 -- 172.21.15.87:0/3434206675 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5dc0653f0 msgr2=0x7fd5dc0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.604+0000 7fd5ff26f700 1 --2- 172.21.15.87:0/3434206675 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5dc0653f0 0x7fd5dc0678a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009c60 tx=0x7fd5f4008030 comp rx=0 tx=0).stop 2023-03-30T08:11:40.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.604+0000 7fd5ff26f700 1 -- 172.21.15.87:0/3434206675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f80d27d0 msgr2=0x7fd5f815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.604+0000 7fd5ff26f700 1 --2- 172.21.15.87:0/3434206675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f80d27d0 0x7fd5f815b200 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0007e60 tx=0x7fd5f000e3c0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.604+0000 7fd5ff26f700 1 -- 172.21.15.87:0/3434206675 shutdown_connections 2023-03-30T08:11:40.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.604+0000 7fd5ff26f700 1 --2- 172.21.15.87:0/3434206675 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd5dc0653f0 0x7fd5dc0678a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.604+0000 7fd5ff26f700 1 --2- 172.21.15.87:0/3434206675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f80d27d0 0x7fd5f815b200 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.604+0000 7fd5ff26f700 1 --2- 172.21.15.87:0/3434206675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5f80cd7e0 0x7fd5f8156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.604+0000 7fd5ff26f700 1 --2- 172.21.15.87:0/3434206675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5f80b8460 0x7fd5f80c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.604+0000 7fd5ff26f700 1 -- 172.21.15.87:0/3434206675 >> 172.21.15.87:0/3434206675 conn(0x7fd5f80cf780 msgr2=0x7fd5f815ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:40.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.604+0000 7fd5ff26f700 1 -- 172.21.15.87:0/3434206675 shutdown_connections 2023-03-30T08:11:40.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.604+0000 7fd5ff26f700 1 -- 172.21.15.87:0/3434206675 wait complete. 2023-03-30T08:11:40.626 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.784+0000 7fc09ce30700 1 Processor -- start 2023-03-30T08:11:40.790 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.784+0000 7fc09ce30700 1 -- start start 2023-03-30T08:11:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.788+0000 7fc09ce30700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc0980b41c0 0x7fc0980cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.788+0000 7fc09ce30700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc098070b30 0x7fc0980cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.788+0000 7fc09ce30700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09815e8c0 con 0x7fc0980c8fb0 2023-03-30T08:11:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.788+0000 7fc09ce30700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09815ed50 con 0x7fc098070b30 2023-03-30T08:11:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.788+0000 7fc09ce30700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0980c96b0 con 0x7fc0980b41c0 2023-03-30T08:11:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.788+0000 7fc09659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc0980b41c0 0x7fc0980cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.788+0000 7fc08ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fc0980c8fb0 0x7fc098070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:34630/0 (socket says 172.21.15.87:34630) 2023-03-30T08:11:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.788+0000 7fc08ffff700 1 -- 172.21.15.87:0/1977674457 learned_addr learned my addr 172.21.15.87:0/1977674457 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.788+0000 7fc096d9d700 1 --2- 172.21.15.87:0/1977674457 >> v2:172.21.15.87:3300/0 conn(0x7fc098070b30 0x7fc0980cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.788+0000 7fc09659c700 1 -- 172.21.15.87:0/1977674457 >> v2:172.21.15.87:3300/0 conn(0x7fc098070b30 msgr2=0x7fc0980cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:40.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.788+0000 7fc09659c700 1 --2- 172.21.15.87:0/1977674457 >> v2:172.21.15.87:3300/0 conn(0x7fc098070b30 0x7fc0980cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.788+0000 7fc09659c700 1 -- 172.21.15.87:0/1977674457 >> v1:172.21.15.115:6789/0 conn(0x7fc0980c8fb0 legacy=0x7fc098070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.788+0000 7fc09659c700 1 -- 172.21.15.87:0/1977674457 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0980c9430 con 0x7fc0980b41c0 2023-03-30T08:11:40.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.788+0000 7fc09659c700 1 --2- 172.21.15.87:0/1977674457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0980b41c0 0x7fc0980cab10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc09806fed0 tx=0x7fc088009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c8dbb6d27e30ea server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:40.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.788+0000 7fc095d9b700 1 -- 172.21.15.87:0/1977674457 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088011830 con 0x7fc0980b41c0 2023-03-30T08:11:40.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.792+0000 7fc095d9b700 1 -- 172.21.15.87:0/1977674457 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc088011990 con 0x7fc0980b41c0 2023-03-30T08:11:40.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.792+0000 7fc095d9b700 1 -- 172.21.15.87:0/1977674457 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088011d20 con 0x7fc0980b41c0 2023-03-30T08:11:40.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.792+0000 7fc09ce30700 1 -- 172.21.15.87:0/1977674457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0980b41c0 msgr2=0x7fc0980cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.792+0000 7fc09ce30700 1 --2- 172.21.15.87:0/1977674457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0980b41c0 0x7fc0980cab10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc09806fed0 tx=0x7fc088009b30 comp rx=0 tx=0).stop 2023-03-30T08:11:40.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.792+0000 7fc09ce30700 1 -- 172.21.15.87:0/1977674457 shutdown_connections 2023-03-30T08:11:40.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.792+0000 7fc09ce30700 1 --2- 172.21.15.87:0/1977674457 >> v2:172.21.15.87:3300/0 conn(0x7fc098070b30 0x7fc0980cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.792+0000 7fc09ce30700 1 --2- 172.21.15.87:0/1977674457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0980b41c0 0x7fc0980cab10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.792+0000 7fc09ce30700 1 -- 172.21.15.87:0/1977674457 >> 172.21.15.87:0/1977674457 conn(0x7fc0980ce960 msgr2=0x7fc0980ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:40.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.792+0000 7fc09ce30700 1 -- 172.21.15.87:0/1977674457 shutdown_connections 2023-03-30T08:11:40.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.792+0000 7fc09ce30700 1 -- 172.21.15.87:0/1977674457 wait complete. 2023-03-30T08:11:40.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.792+0000 7fc09ce30700 1 Processor -- start 2023-03-30T08:11:40.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.792+0000 7fc09ce30700 1 -- start start 2023-03-30T08:11:40.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09ce30700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc098070b30 0x7fc09815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09ce30700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0980b41c0 0x7fc0981f1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09ce30700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0980c8fb0 0x7fc0980aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09ce30700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09815c810 con 0x7fc098070b30 2023-03-30T08:11:40.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09ce30700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09815caf0 con 0x7fc0980b41c0 2023-03-30T08:11:40.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09ce30700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09815cdd0 con 0x7fc0980c8fb0 2023-03-30T08:11:40.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc098070b30 0x7fc09815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc098070b30 0x7fc09815c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55694/0 (socket says 172.21.15.87:55694) 2023-03-30T08:11:40.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09659c700 1 -- 172.21.15.87:0/4223485817 learned_addr learned my addr 172.21.15.87:0/4223485817 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:40.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc08ffff700 1 --2- 172.21.15.87:0/4223485817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0980b41c0 0x7fc0981f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09659c700 1 -- 172.21.15.87:0/4223485817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0980c8fb0 msgr2=0x7fc0980aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09659c700 1 --2- 172.21.15.87:0/4223485817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0980c8fb0 0x7fc0980aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09659c700 1 -- 172.21.15.87:0/4223485817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0980b41c0 msgr2=0x7fc0981f1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09659c700 1 --2- 172.21.15.87:0/4223485817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0980b41c0 0x7fc0981f1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09659c700 1 -- 172.21.15.87:0/4223485817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0880094b0 con 0x7fc098070b30 2023-03-30T08:11:40.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc08ffff700 1 --2- 172.21.15.87:0/4223485817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0980b41c0 0x7fc0981f1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:40.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09659c700 1 --2- 172.21.15.87:0/4223485817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc098070b30 0x7fc09815c1c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc088009b70 tx=0x7fc088004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc08effd700 1 -- 172.21.15.87:0/4223485817 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088004530 con 0x7fc098070b30 2023-03-30T08:11:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc08effd700 1 -- 172.21.15.87:0/4223485817 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08801f070 con 0x7fc098070b30 2023-03-30T08:11:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09ce30700 1 -- 172.21.15.87:0/4223485817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09815df90 con 0x7fc098070b30 2023-03-30T08:11:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc08effd700 1 -- 172.21.15.87:0/4223485817 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088003900 con 0x7fc098070b30 2023-03-30T08:11:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09ce30700 1 -- 172.21.15.87:0/4223485817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0980ce720 con 0x7fc098070b30 2023-03-30T08:11:40.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.796+0000 7fc09ce30700 1 -- 172.21.15.87:0/4223485817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09815e270 con 0x7fc098070b30 2023-03-30T08:11:40.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.800+0000 7fc08effd700 1 -- 172.21.15.87:0/4223485817 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc088021030 con 0x7fc098070b30 2023-03-30T08:11:40.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.800+0000 7fc08effd700 1 --2- 172.21.15.87:0/4223485817 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0780653f0 0x7fc0780678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:40.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.800+0000 7fc08effd700 1 -- 172.21.15.87:0/4223485817 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc088083f90 con 0x7fc098070b30 2023-03-30T08:11:40.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.800+0000 7fc08ffff700 1 --2- 172.21.15.87:0/4223485817 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0780653f0 0x7fc0780678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:40.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.804+0000 7fc08ffff700 1 --2- 172.21.15.87:0/4223485817 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0780653f0 0x7fc0780678a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc0980b01b0 tx=0x7fc080009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:40.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.808+0000 7fc08effd700 1 -- 172.21.15.87:0/4223485817 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fc0880518d0 con 0x7fc098070b30 2023-03-30T08:11:40.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.980+0000 7fc09ce30700 1 -- 172.21.15.87:0/4223485817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc098073ee0 con 0x7fc098070b30 2023-03-30T08:11:40.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.980+0000 7fc08effd700 1 -- 172.21.15.87:0/4223485817 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+19747 (secure 0 0 0) 0x7fc088054ef0 con 0x7fc098070b30 2023-03-30T08:11:40.988 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:40.988 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:39.157903+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:40.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.984+0000 7fc09ce30700 1 -- 172.21.15.87:0/4223485817 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0780653f0 msgr2=0x7fc0780678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.984+0000 7fc09ce30700 1 --2- 172.21.15.87:0/4223485817 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0780653f0 0x7fc0780678a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc0980b01b0 tx=0x7fc080009040 comp rx=0 tx=0).stop 2023-03-30T08:11:40.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.984+0000 7fc09ce30700 1 -- 172.21.15.87:0/4223485817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc098070b30 msgr2=0x7fc09815c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:40.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.984+0000 7fc09ce30700 1 --2- 172.21.15.87:0/4223485817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc098070b30 0x7fc09815c1c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc088009b70 tx=0x7fc088004770 comp rx=0 tx=0).stop 2023-03-30T08:11:40.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.988+0000 7fc09ce30700 1 -- 172.21.15.87:0/4223485817 shutdown_connections 2023-03-30T08:11:40.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.988+0000 7fc09ce30700 1 --2- 172.21.15.87:0/4223485817 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0780653f0 0x7fc0780678a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.988+0000 7fc09ce30700 1 --2- 172.21.15.87:0/4223485817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0980c8fb0 0x7fc0980aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.988+0000 7fc09ce30700 1 --2- 172.21.15.87:0/4223485817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0980b41c0 0x7fc0981f1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.988+0000 7fc09ce30700 1 --2- 172.21.15.87:0/4223485817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc098070b30 0x7fc09815c1c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:40.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.988+0000 7fc09ce30700 1 -- 172.21.15.87:0/4223485817 >> 172.21.15.87:0/4223485817 conn(0x7fc0980ce960 msgr2=0x7fc09806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:40.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.988+0000 7fc09ce30700 1 -- 172.21.15.87:0/4223485817 shutdown_connections 2023-03-30T08:11:40.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:40.988+0000 7fc09ce30700 1 -- 172.21.15.87:0/4223485817 wait complete. 2023-03-30T08:11:41.011 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-30T08:10:56.407927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-30T08:10:57.359214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-30T08:11:00.430972+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-30T08:11:41.012 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T08:11:41.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.184+0000 7f76e6172700 1 Processor -- start 2023-03-30T08:11:41.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.184+0000 7f76e6172700 1 -- start start 2023-03-30T08:11:41.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.184+0000 7f76e6172700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e015d590 0x7f76e0070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.184+0000 7f76e6172700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e0070da0 con 0x7f76e0160630 2023-03-30T08:11:41.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.184+0000 7f76e6172700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e00cc8f0 con 0x7f76e0070960 2023-03-30T08:11:41.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.184+0000 7f76e6172700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e015d9c0 con 0x7f76e015d590 2023-03-30T08:11:41.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.184+0000 7f76df7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f76e0160630 0x7f76e0160a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59784/0 (socket says 172.21.15.87:59784) 2023-03-30T08:11:41.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.184+0000 7f76df7fe700 1 -- 172.21.15.87:0/471475001 learned_addr learned my addr 172.21.15.87:0/471475001 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:41.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.184+0000 7f76d6ffd700 1 --2- 172.21.15.87:0/471475001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e015d590 0x7f76e0070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.184+0000 7f76d6ffd700 1 -- 172.21.15.87:0/471475001 >> v1:172.21.15.115:6789/0 conn(0x7f76e0070960 legacy=0x7f76e006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.184+0000 7f76d6ffd700 1 -- 172.21.15.87:0/471475001 >> v1:172.21.15.87:6789/0 conn(0x7f76e0160630 legacy=0x7f76e0160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.184+0000 7f76d6ffd700 1 -- 172.21.15.87:0/471475001 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e00ccbd0 con 0x7f76e015d590 2023-03-30T08:11:41.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.188+0000 7f76d6ffd700 1 --2- 172.21.15.87:0/471475001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e015d590 0x7f76e0070420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009880 tx=0x7f76c8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fb2e573d5226a5a server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:41.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.188+0000 7f76deffd700 1 -- 172.21.15.87:0/471475001 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c8011830 con 0x7f76e015d590 2023-03-30T08:11:41.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.188+0000 7f76deffd700 1 -- 172.21.15.87:0/471475001 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c8011990 con 0x7f76e015d590 2023-03-30T08:11:41.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.188+0000 7f76deffd700 1 -- 172.21.15.87:0/471475001 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c8011d20 con 0x7f76e015d590 2023-03-30T08:11:41.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.192+0000 7f76e6172700 1 -- 172.21.15.87:0/471475001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e015d590 msgr2=0x7f76e0070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.192+0000 7f76e6172700 1 --2- 172.21.15.87:0/471475001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e015d590 0x7f76e0070420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009880 tx=0x7f76c8009b90 comp rx=0 tx=0).stop 2023-03-30T08:11:41.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.192+0000 7f76e6172700 1 -- 172.21.15.87:0/471475001 shutdown_connections 2023-03-30T08:11:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.192+0000 7f76e6172700 1 --2- 172.21.15.87:0/471475001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e015d590 0x7f76e0070420 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.192+0000 7f76e6172700 1 -- 172.21.15.87:0/471475001 >> 172.21.15.87:0/471475001 conn(0x7f76e00ce960 msgr2=0x7f76e00ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.192+0000 7f76e6172700 1 -- 172.21.15.87:0/471475001 shutdown_connections 2023-03-30T08:11:41.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.192+0000 7f76e6172700 1 -- 172.21.15.87:0/471475001 wait complete. 2023-03-30T08:11:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.192+0000 7f76e6172700 1 Processor -- start 2023-03-30T08:11:41.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.192+0000 7f76e6172700 1 -- start start 2023-03-30T08:11:41.199 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76e6172700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76e0070960 0x7f76e01f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76e6172700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e015d590 0x7f76e006cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76e6172700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e0160630 0x7f76e01e6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76e6172700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e01f6410 con 0x7f76e0160630 2023-03-30T08:11:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76e6172700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e006d510 con 0x7f76e0070960 2023-03-30T08:11:41.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76e6172700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e01f5b70 con 0x7f76e015d590 2023-03-30T08:11:41.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76dffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e0160630 0x7f76e01e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76df7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76e0070960 0x7f76e01f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76dffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e0160630 0x7f76e01e6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55708/0 (socket says 172.21.15.87:55708) 2023-03-30T08:11:41.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76d6ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e015d590 0x7f76e006cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76dffff700 1 -- 172.21.15.87:0/1130216291 learned_addr learned my addr 172.21.15.87:0/1130216291 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76d6ffd700 1 -- 172.21.15.87:0/1130216291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76e0070960 msgr2=0x7f76e01f5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76d6ffd700 1 --2- 172.21.15.87:0/1130216291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76e0070960 0x7f76e01f5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76d6ffd700 1 -- 172.21.15.87:0/1130216291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e0160630 msgr2=0x7f76e01e6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76d6ffd700 1 --2- 172.21.15.87:0/1130216291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e0160630 0x7f76e01e6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76d6ffd700 1 -- 172.21.15.87:0/1130216291 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c80094b0 con 0x7f76e015d590 2023-03-30T08:11:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76dffff700 1 --2- 172.21.15.87:0/1130216291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e0160630 0x7f76e01e6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76d6ffd700 1 --2- 172.21.15.87:0/1130216291 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e015d590 0x7f76e006cfd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f76c8016000 tx=0x7f76c8004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76dcff9700 1 -- 172.21.15.87:0/1130216291 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c8004480 con 0x7f76e015d590 2023-03-30T08:11:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76dcff9700 1 -- 172.21.15.87:0/1130216291 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c801f070 con 0x7f76e015d590 2023-03-30T08:11:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76e6172700 1 -- 172.21.15.87:0/1130216291 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e015d070 con 0x7f76e015d590 2023-03-30T08:11:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76dcff9700 1 -- 172.21.15.87:0/1130216291 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c8003900 con 0x7f76e015d590 2023-03-30T08:11:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.196+0000 7f76e6172700 1 -- 172.21.15.87:0/1130216291 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e015cd90 con 0x7f76e015d590 2023-03-30T08:11:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.200+0000 7f76e6172700 1 -- 172.21.15.87:0/1130216291 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e0073ee0 con 0x7f76e015d590 2023-03-30T08:11:41.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.200+0000 7f76dcff9700 1 -- 172.21.15.87:0/1130216291 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f76c8021030 con 0x7f76e015d590 2023-03-30T08:11:41.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.200+0000 7f76dcff9700 1 --2- 172.21.15.87:0/1130216291 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f76c00653f0 0x7f76c00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.200+0000 7f76dcff9700 1 -- 172.21.15.87:0/1130216291 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f76c8083ff0 con 0x7f76e015d590 2023-03-30T08:11:41.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.204+0000 7f76df7fe700 1 --2- 172.21.15.87:0/1130216291 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f76c00653f0 0x7f76c00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.204+0000 7f76df7fe700 1 --2- 172.21.15.87:0/1130216291 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f76c00653f0 0x7f76c00678a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f76d0005930 tx=0x7f76d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:41.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.212+0000 7f76dcff9700 1 -- 172.21.15.87:0/1130216291 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f76c80b45e0 con 0x7f76e015d590 2023-03-30T08:11:41.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.380+0000 7f76e6172700 1 -- 172.21.15.87:0/1130216291 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76e00b12d0 con 0x7f76e015d590 2023-03-30T08:11:41.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.380+0000 7f76dcff9700 1 -- 172.21.15.87:0/1130216291 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76c8051950 con 0x7f76e015d590 2023-03-30T08:11:41.386 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T08:11:41.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.384+0000 7f76e6172700 1 -- 172.21.15.87:0/1130216291 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f76c00653f0 msgr2=0x7f76c00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.384+0000 7f76e6172700 1 --2- 172.21.15.87:0/1130216291 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f76c00653f0 0x7f76c00678a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f76d0005930 tx=0x7f76d0009040 comp rx=0 tx=0).stop 2023-03-30T08:11:41.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.384+0000 7f76e6172700 1 -- 172.21.15.87:0/1130216291 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e015d590 msgr2=0x7f76e006cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.384+0000 7f76e6172700 1 --2- 172.21.15.87:0/1130216291 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e015d590 0x7f76e006cfd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f76c8016000 tx=0x7f76c8004770 comp rx=0 tx=0).stop 2023-03-30T08:11:41.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.384+0000 7f76e6172700 1 -- 172.21.15.87:0/1130216291 shutdown_connections 2023-03-30T08:11:41.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.384+0000 7f76e6172700 1 --2- 172.21.15.87:0/1130216291 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f76c00653f0 0x7f76c00678a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.384+0000 7f76e6172700 1 --2- 172.21.15.87:0/1130216291 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f76e0160630 0x7f76e01e6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.384+0000 7f76e6172700 1 --2- 172.21.15.87:0/1130216291 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76e015d590 0x7f76e006cfd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.384+0000 7f76e6172700 1 --2- 172.21.15.87:0/1130216291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76e0070960 0x7f76e01f5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.384+0000 7f76e6172700 1 -- 172.21.15.87:0/1130216291 >> 172.21.15.87:0/1130216291 conn(0x7f76e00ce960 msgr2=0x7f76e00ca5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:41.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.384+0000 7f76e6172700 1 -- 172.21.15.87:0/1130216291 shutdown_connections 2023-03-30T08:11:41.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.384+0000 7f76e6172700 1 -- 172.21.15.87:0/1130216291 wait complete. 2023-03-30T08:11:41.412 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T08:11:41.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.572+0000 7fe8a5175700 1 Processor -- start 2023-03-30T08:11:41.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.572+0000 7fe8a5175700 1 -- start start 2023-03-30T08:11:41.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.572+0000 7fe8a5175700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe8a00cd7e0 0x7fe8a00d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.572+0000 7fe8a5175700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a00cd350 con 0x7fe8a00b4e90 2023-03-30T08:11:41.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.572+0000 7fe8a5175700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a00b8830 con 0x7fe8a00b8460 2023-03-30T08:11:41.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.572+0000 7fe8a5175700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a0160f50 con 0x7fe8a00cd7e0 2023-03-30T08:11:41.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.572+0000 7fe89659c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe8a00b4e90 0x7fe8a00d08d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59800/0 (socket says 172.21.15.87:59800) 2023-03-30T08:11:41.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.572+0000 7fe89659c700 1 -- 172.21.15.87:0/1578660508 learned_addr learned my addr 172.21.15.87:0/1578660508 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:41.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89f59e700 1 --2- 172.21.15.87:0/1578660508 >> v2:172.21.15.115:3300/0 conn(0x7fe8a00cd7e0 0x7fe8a00d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 -- 172.21.15.87:0/1578660508 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507812572 0 0) 0x7fe8a00cd350 con 0x7fe8a00b4e90 2023-03-30T08:11:41.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 -- 172.21.15.87:0/1578660508 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe88c0035d0 con 0x7fe8a00b4e90 2023-03-30T08:11:41.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 -- 172.21.15.87:0/1578660508 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4258131106 0 0) 0x7fe88c0035d0 con 0x7fe8a00b4e90 2023-03-30T08:11:41.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 -- 172.21.15.87:0/1578660508 >> v2:172.21.15.115:3300/0 conn(0x7fe8a00cd7e0 msgr2=0x7fe8a00d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:41.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 --2- 172.21.15.87:0/1578660508 >> v2:172.21.15.115:3300/0 conn(0x7fe8a00cd7e0 0x7fe8a00d0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 -- 172.21.15.87:0/1578660508 >> v1:172.21.15.115:6789/0 conn(0x7fe8a00b8460 legacy=0x7fe8a00b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 -- 172.21.15.87:0/1578660508 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a00ceeb0 con 0x7fe8a00b4e90 2023-03-30T08:11:41.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 -- 172.21.15.87:0/1578660508 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7fe888001670 con 0x7fe8a00b4e90 2023-03-30T08:11:41.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 -- 172.21.15.87:0/1578660508 >> v1:172.21.15.87:6789/0 conn(0x7fe8a00b4e90 legacy=0x7fe8a00d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 --2- 172.21.15.87:0/1578660508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe88c003a20 0x7fe88c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 --2- 172.21.15.87:0/1578660508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe88c004410 0x7fe88c0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 --2- 172.21.15.87:0/1578660508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe88c0050d0 0x7fe88c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 -- 172.21.15.87:0/1578660508 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0160f50 con 0x7fe88c003a20 2023-03-30T08:11:41.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 -- 172.21.15.87:0/1578660508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c00c020 con 0x7fe88c0050d0 2023-03-30T08:11:41.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 -- 172.21.15.87:0/1578660508 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c00c1e0 con 0x7fe88c004410 2023-03-30T08:11:41.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89ed9d700 1 --2- 172.21.15.87:0/1578660508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe88c003a20 0x7fe88c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89659c700 1 --2- 172.21.15.87:0/1578660508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe88c004410 0x7fe88c0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89ed9d700 1 -- 172.21.15.87:0/1578660508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe88c004410 msgr2=0x7fe88c0048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:41.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89ed9d700 1 --2- 172.21.15.87:0/1578660508 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe88c004410 0x7fe88c0048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89f59e700 1 --2- 172.21.15.87:0/1578660508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe88c0050d0 0x7fe88c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89ed9d700 1 -- 172.21.15.87:0/1578660508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe88c0050d0 msgr2=0x7fe88c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:41.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89ed9d700 1 --2- 172.21.15.87:0/1578660508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe88c0050d0 0x7fe88c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89ed9d700 1 -- 172.21.15.87:0/1578660508 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c0035d0 con 0x7fe88c003a20 2023-03-30T08:11:41.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89f59e700 1 --2- 172.21.15.87:0/1578660508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe88c0050d0 0x7fe88c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:41.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89f59e700 1 -- 172.21.15.87:0/1578660508 reap_dead start 2023-03-30T08:11:41.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89ed9d700 1 --2- 172.21.15.87:0/1578660508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe88c003a20 0x7fe88c003df0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe8900018f0 tx=0x7fe88c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b881245f6e790c server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:41.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 -- 172.21.15.87:0/1578660508 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe890001390 con 0x7fe88c003a20 2023-03-30T08:11:41.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 -- 172.21.15.87:0/1578660508 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8900052d0 con 0x7fe88c003a20 2023-03-30T08:11:41.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.576+0000 7fe89e59c700 1 -- 172.21.15.87:0/1578660508 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8900036a0 con 0x7fe88c003a20 2023-03-30T08:11:41.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.580+0000 7fe8a5175700 1 -- 172.21.15.87:0/1578660508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe88c003a20 msgr2=0x7fe88c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.580+0000 7fe8a5175700 1 --2- 172.21.15.87:0/1578660508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe88c003a20 0x7fe88c003df0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe8900018f0 tx=0x7fe88c0058a0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.580+0000 7fe8a5175700 1 -- 172.21.15.87:0/1578660508 shutdown_connections 2023-03-30T08:11:41.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.580+0000 7fe8a5175700 1 --2- 172.21.15.87:0/1578660508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe88c003a20 0x7fe88c003df0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.580+0000 7fe8a5175700 1 -- 172.21.15.87:0/1578660508 >> 172.21.15.87:0/1578660508 conn(0x7fe8a00cf780 msgr2=0x7fe8a00cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:41.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.580+0000 7fe8a5175700 1 -- 172.21.15.87:0/1578660508 shutdown_connections 2023-03-30T08:11:41.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.580+0000 7fe8a5175700 1 -- 172.21.15.87:0/1578660508 wait complete. 2023-03-30T08:11:41.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe8a5175700 1 Processor -- start 2023-03-30T08:11:41.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe8a5175700 1 -- start start 2023-03-30T08:11:41.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe8a5175700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe88c003a20 0x7fe8a01f7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe8a5175700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8a015e840 0x7fe8a00c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe8a5175700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a00cba70 0x7fe8a00b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe8a5175700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00c9310 con 0x7fe88c003a20 2023-03-30T08:11:41.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe8a5175700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a015ecb0 con 0x7fe8a00cba70 2023-03-30T08:11:41.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe8a5175700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00cab40 con 0x7fe8a015e840 2023-03-30T08:11:41.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe89ed9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe88c003a20 0x7fe8a01f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe89ed9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe88c003a20 0x7fe8a01f7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55726/0 (socket says 172.21.15.87:55726) 2023-03-30T08:11:41.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe89ed9d700 1 -- 172.21.15.87:0/2733111435 learned_addr learned my addr 172.21.15.87:0/2733111435 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:41.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe89659c700 1 --2- 172.21.15.87:0/2733111435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8a015e840 0x7fe8a00c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe89f59e700 1 --2- 172.21.15.87:0/2733111435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a00cba70 0x7fe8a00b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe89ed9d700 1 -- 172.21.15.87:0/2733111435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8a015e840 msgr2=0x7fe8a00c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe89ed9d700 1 --2- 172.21.15.87:0/2733111435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8a015e840 0x7fe8a00c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe89ed9d700 1 -- 172.21.15.87:0/2733111435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a00cba70 msgr2=0x7fe8a00b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe89ed9d700 1 --2- 172.21.15.87:0/2733111435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a00cba70 0x7fe8a00b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe89ed9d700 1 -- 172.21.15.87:0/2733111435 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a0160c70 con 0x7fe88c003a20 2023-03-30T08:11:41.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe89659c700 1 --2- 172.21.15.87:0/2733111435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8a015e840 0x7fe8a00c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:41.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.584+0000 7fe89ed9d700 1 --2- 172.21.15.87:0/2733111435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe88c003a20 0x7fe8a01f7670 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe89000c0e0 tx=0x7fe890001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:41.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.588+0000 7fe897fff700 1 -- 172.21.15.87:0/2733111435 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe890001330 con 0x7fe88c003a20 2023-03-30T08:11:41.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.588+0000 7fe897fff700 1 -- 172.21.15.87:0/2733111435 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe890006880 con 0x7fe88c003a20 2023-03-30T08:11:41.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.588+0000 7fe8a5175700 1 -- 172.21.15.87:0/2733111435 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a01609b0 con 0x7fe88c003a20 2023-03-30T08:11:41.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.588+0000 7fe897fff700 1 -- 172.21.15.87:0/2733111435 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe890006c10 con 0x7fe88c003a20 2023-03-30T08:11:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.588+0000 7fe8a5175700 1 -- 172.21.15.87:0/2733111435 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a00cf150 con 0x7fe88c003a20 2023-03-30T08:11:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.588+0000 7fe8a5175700 1 -- 172.21.15.87:0/2733111435 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a0073ee0 con 0x7fe88c003a20 2023-03-30T08:11:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.588+0000 7fe897fff700 1 -- 172.21.15.87:0/2733111435 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fe890007030 con 0x7fe88c003a20 2023-03-30T08:11:41.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.592+0000 7fe897fff700 1 --2- 172.21.15.87:0/2733111435 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe8800653f0 0x7fe8800678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.592+0000 7fe897fff700 1 -- 172.21.15.87:0/2733111435 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe890083c70 con 0x7fe88c003a20 2023-03-30T08:11:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.592+0000 7fe89659c700 1 --2- 172.21.15.87:0/2733111435 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe8800653f0 0x7fe8800678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.592+0000 7fe89659c700 1 --2- 172.21.15.87:0/2733111435 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe8800653f0 0x7fe8800678a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe888001eb0 tx=0x7fe888009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:41.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.596+0000 7fe897fff700 1 -- 172.21.15.87:0/2733111435 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fe8900515d0 con 0x7fe88c003a20 2023-03-30T08:11:41.770 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.764+0000 7fe8a5175700 1 -- 172.21.15.87:0/2733111435 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe8a00cd0b0 con 0x7fe88c003a20 2023-03-30T08:11:41.771 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.768+0000 7fe897fff700 1 -- 172.21.15.87:0/2733111435 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe8900170a0 con 0x7fe88c003a20 2023-03-30T08:11:41.772 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T08:11:41.774 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.768+0000 7fe8a5175700 1 -- 172.21.15.87:0/2733111435 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe8800653f0 msgr2=0x7fe8800678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.768+0000 7fe8a5175700 1 --2- 172.21.15.87:0/2733111435 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe8800653f0 0x7fe8800678a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe888001eb0 tx=0x7fe888009040 comp rx=0 tx=0).stop 2023-03-30T08:11:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.768+0000 7fe8a5175700 1 -- 172.21.15.87:0/2733111435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe88c003a20 msgr2=0x7fe8a01f7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.768+0000 7fe8a5175700 1 --2- 172.21.15.87:0/2733111435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe88c003a20 0x7fe8a01f7670 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe89000c0e0 tx=0x7fe890001230 comp rx=0 tx=0).stop 2023-03-30T08:11:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.768+0000 7fe8a5175700 1 -- 172.21.15.87:0/2733111435 shutdown_connections 2023-03-30T08:11:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.768+0000 7fe8a5175700 1 --2- 172.21.15.87:0/2733111435 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe8800653f0 0x7fe8800678a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.768+0000 7fe8a5175700 1 --2- 172.21.15.87:0/2733111435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8a00cba70 0x7fe8a00b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.775 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.768+0000 7fe8a5175700 1 --2- 172.21.15.87:0/2733111435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8a015e840 0x7fe8a00c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.768+0000 7fe8a5175700 1 --2- 172.21.15.87:0/2733111435 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe88c003a20 0x7fe8a01f7670 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.768+0000 7fe8a5175700 1 -- 172.21.15.87:0/2733111435 >> 172.21.15.87:0/2733111435 conn(0x7fe8a00cf780 msgr2=0x7fe8a00b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.768+0000 7fe8a5175700 1 -- 172.21.15.87:0/2733111435 shutdown_connections 2023-03-30T08:11:41.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.768+0000 7fe8a5175700 1 -- 172.21.15.87:0/2733111435 wait complete. 2023-03-30T08:11:41.794 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-30T08:11:41.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.956+0000 7fad29b90700 1 Processor -- start 2023-03-30T08:11:41.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.956+0000 7fad29b90700 1 -- start start 2023-03-30T08:11:41.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.956+0000 7fad29b90700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fad240b3f30 0x7fad240b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.956+0000 7fad29b90700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fad240af350 0x7fad2406c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.956+0000 7fad29b90700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2406b670 con 0x7fad2406a6e0 2023-03-30T08:11:41.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.956+0000 7fad29b90700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2406b0b0 con 0x7fad240af350 2023-03-30T08:11:41.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.956+0000 7fad29b90700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2406b390 con 0x7fad240b3f30 2023-03-30T08:11:41.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad2938f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fad240af350 0x7fad2406c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad2938f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fad240af350 0x7fad2406c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55738/0 (socket says 172.21.15.87:55738) 2023-03-30T08:11:41.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad2938f700 1 -- 172.21.15.87:0/48604307 learned_addr learned my addr 172.21.15.87:0/48604307 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:41.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad2938f700 1 -- 172.21.15.87:0/48604307 >> v2:172.21.15.115:3300/0 conn(0x7fad240b3f30 msgr2=0x7fad240b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:41.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad28b8e700 1 --2- 172.21.15.87:0/48604307 >> v2:172.21.15.115:3300/0 conn(0x7fad240b3f30 0x7fad240b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad2938f700 1 --2- 172.21.15.87:0/48604307 >> v2:172.21.15.115:3300/0 conn(0x7fad240b3f30 0x7fad240b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad2938f700 1 -- 172.21.15.87:0/48604307 >> v1:172.21.15.115:6789/0 conn(0x7fad2406a6e0 legacy=0x7fad240aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:41.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad2938f700 1 -- 172.21.15.87:0/48604307 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad240aded0 con 0x7fad240af350 2023-03-30T08:11:41.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad28b8e700 1 --2- 172.21.15.87:0/48604307 >> v2:172.21.15.115:3300/0 conn(0x7fad240b3f30 0x7fad240b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:41.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad2938f700 1 --2- 172.21.15.87:0/48604307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240af350 0x7fad2406c310 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fad240cafe0 tx=0x7fad1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc470954c651ffe3 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:41.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad237fe700 1 -- 172.21.15.87:0/48604307 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c00e070 con 0x7fad240af350 2023-03-30T08:11:41.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad237fe700 1 -- 172.21.15.87:0/48604307 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c003a40 con 0x7fad240af350 2023-03-30T08:11:41.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad237fe700 1 -- 172.21.15.87:0/48604307 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c003df0 con 0x7fad240af350 2023-03-30T08:11:41.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad29b90700 1 -- 172.21.15.87:0/48604307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240af350 msgr2=0x7fad2406c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad29b90700 1 --2- 172.21.15.87:0/48604307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240af350 0x7fad2406c310 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fad240cafe0 tx=0x7fad1c00b330 comp rx=0 tx=0).stop 2023-03-30T08:11:41.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad29b90700 1 -- 172.21.15.87:0/48604307 shutdown_connections 2023-03-30T08:11:41.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad29b90700 1 --2- 172.21.15.87:0/48604307 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240af350 0x7fad2406c310 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad29b90700 1 --2- 172.21.15.87:0/48604307 >> v2:172.21.15.115:3300/0 conn(0x7fad240b3f30 0x7fad240b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad29b90700 1 -- 172.21.15.87:0/48604307 >> 172.21.15.87:0/48604307 conn(0x7fad240cf410 msgr2=0x7fad240cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:41.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad29b90700 1 -- 172.21.15.87:0/48604307 shutdown_connections 2023-03-30T08:11:41.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.960+0000 7fad29b90700 1 -- 172.21.15.87:0/48604307 wait complete. 2023-03-30T08:11:41.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.964+0000 7fad29b90700 1 Processor -- start 2023-03-30T08:11:41.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.964+0000 7fad29b90700 1 -- start start 2023-03-30T08:11:41.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad29b90700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad2406a6e0 0x7fad240ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad29b90700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240af350 0x7fad240b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad29b90700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240b3f30 0x7fad240b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad29b90700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad240c4e70 con 0x7fad240af350 2023-03-30T08:11:41.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad29b90700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad24147b70 con 0x7fad2406a6e0 2023-03-30T08:11:41.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad29b90700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad240ad770 con 0x7fad240b3f30 2023-03-30T08:11:41.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad23fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240af350 0x7fad240b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad23fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240af350 0x7fad240b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55752/0 (socket says 172.21.15.87:55752) 2023-03-30T08:11:41.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad23fff700 1 -- 172.21.15.87:0/3209947087 learned_addr learned my addr 172.21.15.87:0/3209947087 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:41.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad28b8e700 1 --2- 172.21.15.87:0/3209947087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad2406a6e0 0x7fad240ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad2938f700 1 --2- 172.21.15.87:0/3209947087 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240b3f30 0x7fad240b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad23fff700 1 -- 172.21.15.87:0/3209947087 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240b3f30 msgr2=0x7fad240b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad23fff700 1 --2- 172.21.15.87:0/3209947087 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240b3f30 0x7fad240b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad23fff700 1 -- 172.21.15.87:0/3209947087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad2406a6e0 msgr2=0x7fad240ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:41.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad23fff700 1 --2- 172.21.15.87:0/3209947087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad2406a6e0 0x7fad240ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:41.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad23fff700 1 -- 172.21.15.87:0/3209947087 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c009b30 con 0x7fad240af350 2023-03-30T08:11:41.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad23fff700 1 --2- 172.21.15.87:0/3209947087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240af350 0x7fad240b27d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fad1000b4d0 tx=0x7fad1000b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:41.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad217fa700 1 -- 172.21.15.87:0/3209947087 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad10011830 con 0x7fad240af350 2023-03-30T08:11:41.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad217fa700 1 -- 172.21.15.87:0/3209947087 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad10011990 con 0x7fad240af350 2023-03-30T08:11:41.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad217fa700 1 -- 172.21.15.87:0/3209947087 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad10011d40 con 0x7fad240af350 2023-03-30T08:11:41.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad29b90700 1 -- 172.21.15.87:0/3209947087 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad240b4300 con 0x7fad240af350 2023-03-30T08:11:41.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.968+0000 7fad29b90700 1 -- 172.21.15.87:0/3209947087 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad240ae1b0 con 0x7fad240af350 2023-03-30T08:11:41.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.972+0000 7fad29b90700 1 -- 172.21.15.87:0/3209947087 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2406ab60 con 0x7fad240af350 2023-03-30T08:11:41.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.972+0000 7fad217fa700 1 -- 172.21.15.87:0/3209947087 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fad1001a400 con 0x7fad240af350 2023-03-30T08:11:41.979 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.972+0000 7fad217fa700 1 --2- 172.21.15.87:0/3209947087 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fad080653f0 0x7fad080678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:41.979 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.976+0000 7fad217fa700 1 -- 172.21.15.87:0/3209947087 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fad100826d0 con 0x7fad240af350 2023-03-30T08:11:41.979 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.976+0000 7fad28b8e700 1 --2- 172.21.15.87:0/3209947087 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fad080653f0 0x7fad080678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:41.980 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.976+0000 7fad28b8e700 1 --2- 172.21.15.87:0/3209947087 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fad080653f0 0x7fad080678a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fad18006fd0 tx=0x7fad18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:41.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:41.976+0000 7fad217fa700 1 -- 172.21.15.87:0/3209947087 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fad1004ffb0 con 0x7fad240af350 2023-03-30T08:11:42.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.144+0000 7fad29b90700 1 -- 172.21.15.87:0/3209947087 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad240733a0 con 0x7fad240af350 2023-03-30T08:11:42.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.148+0000 7fad217fa700 1 -- 172.21.15.87:0/3209947087 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad100535d0 con 0x7fad240af350 2023-03-30T08:11:42.151 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:42.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.148+0000 7fad29b90700 1 -- 172.21.15.87:0/3209947087 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fad080653f0 msgr2=0x7fad080678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.148+0000 7fad29b90700 1 --2- 172.21.15.87:0/3209947087 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fad080653f0 0x7fad080678a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fad18006fd0 tx=0x7fad18008040 comp rx=0 tx=0).stop 2023-03-30T08:11:42.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.148+0000 7fad29b90700 1 -- 172.21.15.87:0/3209947087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240af350 msgr2=0x7fad240b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.148+0000 7fad29b90700 1 --2- 172.21.15.87:0/3209947087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240af350 0x7fad240b27d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fad1000b4d0 tx=0x7fad1000b7e0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.148+0000 7fad29b90700 1 -- 172.21.15.87:0/3209947087 shutdown_connections 2023-03-30T08:11:42.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.148+0000 7fad29b90700 1 --2- 172.21.15.87:0/3209947087 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fad080653f0 0x7fad080678a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.148+0000 7fad29b90700 1 --2- 172.21.15.87:0/3209947087 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad240b3f30 0x7fad240b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.148+0000 7fad29b90700 1 --2- 172.21.15.87:0/3209947087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad240af350 0x7fad240b27d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.148+0000 7fad29b90700 1 --2- 172.21.15.87:0/3209947087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad2406a6e0 0x7fad240ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.148+0000 7fad29b90700 1 -- 172.21.15.87:0/3209947087 >> 172.21.15.87:0/3209947087 conn(0x7fad240cf410 msgr2=0x7fad2406d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:42.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.148+0000 7fad29b90700 1 -- 172.21.15.87:0/3209947087 shutdown_connections 2023-03-30T08:11:42.155 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.148+0000 7fad29b90700 1 -- 172.21.15.87:0/3209947087 wait complete. 2023-03-30T08:11:42.172 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-30T08:11:42.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.332+0000 7fe612584700 1 Processor -- start 2023-03-30T08:11:42.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.332+0000 7fe612584700 1 -- start start 2023-03-30T08:11:42.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.332+0000 7fe612584700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe60c0b3f30 0x7fe60c0b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:42.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.332+0000 7fe612584700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60c06b670 con 0x7fe60c0af350 2023-03-30T08:11:42.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.332+0000 7fe612584700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60c06b0b0 con 0x7fe60c06a6e0 2023-03-30T08:11:42.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.332+0000 7fe612584700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60c06b390 con 0x7fe60c0b3f30 2023-03-30T08:11:42.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.332+0000 7fe611582700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe60c0b3f30 0x7fe60c0b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:42.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.332+0000 7fe611d83700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe60c0af350 0x7fe60c06c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59804/0 (socket says 172.21.15.87:59804) 2023-03-30T08:11:42.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.332+0000 7fe611d83700 1 -- 172.21.15.87:0/2035621612 learned_addr learned my addr 172.21.15.87:0/2035621612 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:42.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.336+0000 7fe611582700 1 -- 172.21.15.87:0/2035621612 >> v1:172.21.15.115:6789/0 conn(0x7fe60c06a6e0 legacy=0x7fe60c0aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.336+0000 7fe611582700 1 -- 172.21.15.87:0/2035621612 >> v1:172.21.15.87:6789/0 conn(0x7fe60c0af350 legacy=0x7fe60c06c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.336+0000 7fe611582700 1 -- 172.21.15.87:0/2035621612 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c0aded0 con 0x7fe60c0b3f30 2023-03-30T08:11:42.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.336+0000 7fe611582700 1 --2- 172.21.15.87:0/2035621612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe60c0b3f30 0x7fe60c0b0c10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe608009850 tx=0x7fe608009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5232fa49dbbb4c server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:42.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.336+0000 7fe603fff700 1 -- 172.21.15.87:0/2035621612 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608011830 con 0x7fe60c0b3f30 2023-03-30T08:11:42.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.336+0000 7fe603fff700 1 -- 172.21.15.87:0/2035621612 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe608011990 con 0x7fe60c0b3f30 2023-03-30T08:11:42.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.336+0000 7fe603fff700 1 -- 172.21.15.87:0/2035621612 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608011d20 con 0x7fe60c0b3f30 2023-03-30T08:11:42.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.336+0000 7fe612584700 1 -- 172.21.15.87:0/2035621612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe60c0b3f30 msgr2=0x7fe60c0b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.336+0000 7fe612584700 1 --2- 172.21.15.87:0/2035621612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe60c0b3f30 0x7fe60c0b0c10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe608009850 tx=0x7fe608009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:42.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.336+0000 7fe612584700 1 -- 172.21.15.87:0/2035621612 shutdown_connections 2023-03-30T08:11:42.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.336+0000 7fe612584700 1 --2- 172.21.15.87:0/2035621612 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe60c0b3f30 0x7fe60c0b0c10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.336+0000 7fe612584700 1 -- 172.21.15.87:0/2035621612 >> 172.21.15.87:0/2035621612 conn(0x7fe60c0cf410 msgr2=0x7fe60c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:42.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.336+0000 7fe612584700 1 -- 172.21.15.87:0/2035621612 shutdown_connections 2023-03-30T08:11:42.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.336+0000 7fe612584700 1 -- 172.21.15.87:0/2035621612 wait complete. 2023-03-30T08:11:42.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.340+0000 7fe612584700 1 Processor -- start 2023-03-30T08:11:42.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.340+0000 7fe612584700 1 -- start start 2023-03-30T08:11:42.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe612584700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe60c06a6e0 0x7fe60c0abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:42.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe612584700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe60c0af350 0x7fe60c14c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:42.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe612584700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe60c0b3f30 0x7fe60c14cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:42.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe612584700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c14d2e0 con 0x7fe60c0af350 2023-03-30T08:11:42.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe612584700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0cd0f0 con 0x7fe60c06a6e0 2023-03-30T08:11:42.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe612584700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0cd3d0 con 0x7fe60c0b3f30 2023-03-30T08:11:42.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe610d81700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe60c0af350 0x7fe60c14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:42.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe610d81700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe60c0af350 0x7fe60c14c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55778/0 (socket says 172.21.15.87:55778) 2023-03-30T08:11:42.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe610d81700 1 -- 172.21.15.87:0/4122859040 learned_addr learned my addr 172.21.15.87:0/4122859040 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:42.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe611582700 1 --2- 172.21.15.87:0/4122859040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe60c06a6e0 0x7fe60c0abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:42.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe611d83700 1 --2- 172.21.15.87:0/4122859040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe60c0b3f30 0x7fe60c14cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:42.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe610d81700 1 -- 172.21.15.87:0/4122859040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe60c0b3f30 msgr2=0x7fe60c14cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe610d81700 1 --2- 172.21.15.87:0/4122859040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe60c0b3f30 0x7fe60c14cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe610d81700 1 -- 172.21.15.87:0/4122859040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe60c06a6e0 msgr2=0x7fe60c0abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe610d81700 1 --2- 172.21.15.87:0/4122859040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe60c06a6e0 0x7fe60c0abb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe610d81700 1 -- 172.21.15.87:0/4122859040 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6080094b0 con 0x7fe60c0af350 2023-03-30T08:11:42.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe611d83700 1 --2- 172.21.15.87:0/4122859040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe60c0b3f30 0x7fe60c14cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:42.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe610d81700 1 --2- 172.21.15.87:0/4122859040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe60c0af350 0x7fe60c14c860 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00c500 tx=0x7fe5fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:42.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe601ffb700 1 -- 172.21.15.87:0/4122859040 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc0052d0 con 0x7fe60c0af350 2023-03-30T08:11:42.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe601ffb700 1 -- 172.21.15.87:0/4122859040 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc005430 con 0x7fe60c0af350 2023-03-30T08:11:42.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe601ffb700 1 -- 172.21.15.87:0/4122859040 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc0055a0 con 0x7fe60c0af350 2023-03-30T08:11:42.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe612584700 1 -- 172.21.15.87:0/4122859040 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60c0b4300 con 0x7fe60c0af350 2023-03-30T08:11:42.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe612584700 1 -- 172.21.15.87:0/4122859040 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60c0ae1b0 con 0x7fe60c0af350 2023-03-30T08:11:42.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.344+0000 7fe612584700 1 -- 172.21.15.87:0/4122859040 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60c06ab60 con 0x7fe60c0af350 2023-03-30T08:11:42.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.348+0000 7fe601ffb700 1 -- 172.21.15.87:0/4122859040 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fe5fc0038e0 con 0x7fe60c0af350 2023-03-30T08:11:42.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.348+0000 7fe601ffb700 1 --2- 172.21.15.87:0/4122859040 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe5f00653f0 0x7fe5f00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:42.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.348+0000 7fe601ffb700 1 -- 172.21.15.87:0/4122859040 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe5fc081fe0 con 0x7fe60c0af350 2023-03-30T08:11:42.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.348+0000 7fe611582700 1 --2- 172.21.15.87:0/4122859040 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe5f00653f0 0x7fe5f00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:42.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.348+0000 7fe611582700 1 --2- 172.21.15.87:0/4122859040 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe5f00653f0 0x7fe5f00678a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe608014040 tx=0x7fe608008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:42.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.356+0000 7fe601ffb700 1 -- 172.21.15.87:0/4122859040 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fe5fc04f8d0 con 0x7fe60c0af350 2023-03-30T08:11:42.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.532+0000 7fe612584700 1 -- 172.21.15.87:0/4122859040 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe60c15a730 con 0x7fe60c0af350 2023-03-30T08:11:42.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.532+0000 7fe601ffb700 1 -- 172.21.15.87:0/4122859040 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe60c15a730 con 0x7fe60c0af350 2023-03-30T08:11:42.537 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-03-30T08:11:42.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.536+0000 7fe612584700 1 -- 172.21.15.87:0/4122859040 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe5f00653f0 msgr2=0x7fe5f00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.539 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.536+0000 7fe612584700 1 --2- 172.21.15.87:0/4122859040 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe5f00653f0 0x7fe5f00678a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe608014040 tx=0x7fe608008030 comp rx=0 tx=0).stop 2023-03-30T08:11:42.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.536+0000 7fe612584700 1 -- 172.21.15.87:0/4122859040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe60c0af350 msgr2=0x7fe60c14c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.536+0000 7fe612584700 1 --2- 172.21.15.87:0/4122859040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe60c0af350 0x7fe60c14c860 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00c500 tx=0x7fe5fc00c8c0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.536+0000 7fe612584700 1 -- 172.21.15.87:0/4122859040 shutdown_connections 2023-03-30T08:11:42.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.536+0000 7fe612584700 1 --2- 172.21.15.87:0/4122859040 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe5f00653f0 0x7fe5f00678a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.536+0000 7fe612584700 1 --2- 172.21.15.87:0/4122859040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe60c0b3f30 0x7fe60c14cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.536+0000 7fe612584700 1 --2- 172.21.15.87:0/4122859040 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe60c0af350 0x7fe60c14c860 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.536+0000 7fe612584700 1 --2- 172.21.15.87:0/4122859040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe60c06a6e0 0x7fe60c0abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.536+0000 7fe612584700 1 -- 172.21.15.87:0/4122859040 >> 172.21.15.87:0/4122859040 conn(0x7fe60c0cf410 msgr2=0x7fe60c0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:42.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.536+0000 7fe612584700 1 -- 172.21.15.87:0/4122859040 shutdown_connections 2023-03-30T08:11:42.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.536+0000 7fe612584700 1 -- 172.21.15.87:0/4122859040 wait complete. 2023-03-30T08:11:42.558 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-30T08:11:42.603 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:11:42.611 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:11:42.719 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.716+0000 7f2437358700 1 Processor -- start 2023-03-30T08:11:42.720 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.716+0000 7f2437358700 1 -- start start 2023-03-30T08:11:42.722 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.716+0000 7f2437358700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f24300cabc0 0x7f2430069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:42.722 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.716+0000 7f2437358700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24300afca0 con 0x7f2430159050 2023-03-30T08:11:42.722 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.716+0000 7f2437358700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243015d110 con 0x7f243015cba0 2023-03-30T08:11:42.722 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.716+0000 7f2437358700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24300afb10 con 0x7f24300cabc0 2023-03-30T08:11:42.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.716+0000 7f2436356700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2430159050 0x7f24300cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59808/0 (socket says 172.21.15.87:59808) 2023-03-30T08:11:42.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.716+0000 7f2436356700 1 -- 172.21.15.87:0/2796121724 learned_addr learned my addr 172.21.15.87:0/2796121724 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:42.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.716+0000 7f2436b57700 1 --2- 172.21.15.87:0/2796121724 >> v2:172.21.15.115:3300/0 conn(0x7f24300cabc0 0x7f2430069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:42.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 -- 172.21.15.87:0/2796121724 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493693740 0 0) 0x7f24300afca0 con 0x7f2430159050 2023-03-30T08:11:42.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 -- 172.21.15.87:0/2796121724 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f241c0057e0 con 0x7f2430159050 2023-03-30T08:11:42.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 -- 172.21.15.87:0/2796121724 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3835902025 0 0) 0x7f241c0057e0 con 0x7f2430159050 2023-03-30T08:11:42.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 -- 172.21.15.87:0/2796121724 >> v2:172.21.15.115:3300/0 conn(0x7f24300cabc0 msgr2=0x7f2430069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:42.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 --2- 172.21.15.87:0/2796121724 >> v2:172.21.15.115:3300/0 conn(0x7f24300cabc0 0x7f2430069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 -- 172.21.15.87:0/2796121724 >> v1:172.21.15.115:6789/0 conn(0x7f243015cba0 legacy=0x7f24300ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 -- 172.21.15.87:0/2796121724 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243015d3f0 con 0x7f2430159050 2023-03-30T08:11:42.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 -- 172.21.15.87:0/2796121724 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f242c001670 con 0x7f2430159050 2023-03-30T08:11:42.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 -- 172.21.15.87:0/2796121724 >> v1:172.21.15.87:6789/0 conn(0x7f2430159050 legacy=0x7f24300cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 --2- 172.21.15.87:0/2796121724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f241c005c30 0x7f241c006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:42.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 --2- 172.21.15.87:0/2796121724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f241c006a80 0x7f241c006ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:42.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 --2- 172.21.15.87:0/2796121724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f241c007430 0x7f241c00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:42.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 -- 172.21.15.87:0/2796121724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24300afb10 con 0x7f241c005c30 2023-03-30T08:11:42.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 -- 172.21.15.87:0/2796121724 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c00e2b0 con 0x7f241c006a80 2023-03-30T08:11:42.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 -- 172.21.15.87:0/2796121724 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c00e470 con 0x7f241c007430 2023-03-30T08:11:42.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2436356700 1 --2- 172.21.15.87:0/2796121724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f241c005c30 0x7f241c006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:42.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2436b57700 1 --2- 172.21.15.87:0/2796121724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f241c007430 0x7f241c00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:42.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435b55700 1 --2- 172.21.15.87:0/2796121724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f241c006a80 0x7f241c006ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:42.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2436356700 1 -- 172.21.15.87:0/2796121724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f241c007430 msgr2=0x7f241c00dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:42.728 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2436356700 1 --2- 172.21.15.87:0/2796121724 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f241c007430 0x7f241c00dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.728 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2436356700 1 -- 172.21.15.87:0/2796121724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f241c006a80 msgr2=0x7f241c006ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:42.728 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2436356700 1 --2- 172.21.15.87:0/2796121724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f241c006a80 0x7f241c006ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.728 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2436356700 1 -- 172.21.15.87:0/2796121724 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c0057e0 con 0x7f241c005c30 2023-03-30T08:11:42.728 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2436b57700 1 -- 172.21.15.87:0/2796121724 reap_dead start 2023-03-30T08:11:42.728 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2436356700 1 --2- 172.21.15.87:0/2796121724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f241c005c30 0x7f241c006040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f242c00c320 tx=0x7f241c007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38629c76c292dc89 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:42.728 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 -- 172.21.15.87:0/2796121724 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c007c30 con 0x7f241c005c30 2023-03-30T08:11:42.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 -- 172.21.15.87:0/2796121724 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c00ce00 con 0x7f241c005c30 2023-03-30T08:11:42.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.720+0000 7f2435354700 1 -- 172.21.15.87:0/2796121724 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c005bc0 con 0x7f241c005c30 2023-03-30T08:11:42.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.724+0000 7f2437358700 1 -- 172.21.15.87:0/2796121724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f241c005c30 msgr2=0x7f241c006040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.724+0000 7f2437358700 1 --2- 172.21.15.87:0/2796121724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f241c005c30 0x7f241c006040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f242c00c320 tx=0x7f241c007ab0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.724+0000 7f2437358700 1 -- 172.21.15.87:0/2796121724 shutdown_connections 2023-03-30T08:11:42.730 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.724+0000 7f2437358700 1 --2- 172.21.15.87:0/2796121724 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f241c005c30 0x7f241c006040 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.730 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.724+0000 7f2437358700 1 -- 172.21.15.87:0/2796121724 >> 172.21.15.87:0/2796121724 conn(0x7f24300cf410 msgr2=0x7f24300cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:42.730 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.724+0000 7f2437358700 1 -- 172.21.15.87:0/2796121724 shutdown_connections 2023-03-30T08:11:42.730 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.724+0000 7f2437358700 1 -- 172.21.15.87:0/2796121724 wait complete. 2023-03-30T08:11:42.730 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.724+0000 7f2437358700 1 Processor -- start 2023-03-30T08:11:42.731 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2437358700 1 -- start start 2023-03-30T08:11:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2437358700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f241c005c30 0x7f24301541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2437358700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24300b2010 0x7f24300b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2437358700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24300c9c60 0x7f24300ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:42.732 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2437358700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24300b29c0 con 0x7f24300b2010 2023-03-30T08:11:42.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2437358700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24300ca610 con 0x7f241c005c30 2023-03-30T08:11:42.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2437358700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2430154700 con 0x7f24300c9c60 2023-03-30T08:11:42.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2435b55700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24300b2010 0x7f24300b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:42.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2435b55700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24300b2010 0x7f24300b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55804/0 (socket says 172.21.15.87:55804) 2023-03-30T08:11:42.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2435b55700 1 -- 172.21.15.87:0/3539785626 learned_addr learned my addr 172.21.15.87:0/3539785626 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:42.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2436356700 1 --2- 172.21.15.87:0/3539785626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f241c005c30 0x7f24301541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:42.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2436b57700 1 --2- 172.21.15.87:0/3539785626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24300c9c60 0x7f24300ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:42.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2435b55700 1 -- 172.21.15.87:0/3539785626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24300c9c60 msgr2=0x7f24300ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2435b55700 1 --2- 172.21.15.87:0/3539785626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24300c9c60 0x7f24300ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2435b55700 1 -- 172.21.15.87:0/3539785626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f241c005c30 msgr2=0x7f24301541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2435b55700 1 --2- 172.21.15.87:0/3539785626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f241c005c30 0x7f24301541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2435b55700 1 -- 172.21.15.87:0/3539785626 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243015d9b0 con 0x7f24300b2010 2023-03-30T08:11:42.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2435b55700 1 --2- 172.21.15.87:0/3539785626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24300b2010 0x7f24300b2480 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f242000f820 tx=0x7f242000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:42.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2426ffd700 1 -- 172.21.15.87:0/3539785626 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24200052e0 con 0x7f24300b2010 2023-03-30T08:11:42.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2426ffd700 1 -- 172.21.15.87:0/3539785626 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2420005440 con 0x7f24300b2010 2023-03-30T08:11:42.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2426ffd700 1 -- 172.21.15.87:0/3539785626 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24200038c0 con 0x7f24300b2010 2023-03-30T08:11:42.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2437358700 1 -- 172.21.15.87:0/3539785626 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243015d6d0 con 0x7f24300b2010 2023-03-30T08:11:42.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.728+0000 7f2437358700 1 -- 172.21.15.87:0/3539785626 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2430159420 con 0x7f24300b2010 2023-03-30T08:11:42.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.732+0000 7f2437358700 1 -- 172.21.15.87:0/3539785626 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2430159a10 con 0x7f24300b2010 2023-03-30T08:11:42.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.732+0000 7f2426ffd700 1 -- 172.21.15.87:0/3539785626 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f2420003a20 con 0x7f24300b2010 2023-03-30T08:11:42.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.732+0000 7f2426ffd700 1 --2- 172.21.15.87:0/3539785626 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24140653f0 0x7f24140678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:42.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.732+0000 7f2426ffd700 1 -- 172.21.15.87:0/3539785626 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2420082980 con 0x7f24300b2010 2023-03-30T08:11:42.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.732+0000 7f2436356700 1 --2- 172.21.15.87:0/3539785626 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24140653f0 0x7f24140678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:42.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.736+0000 7f2436356700 1 --2- 172.21.15.87:0/3539785626 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24140653f0 0x7f24140678a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f242c000c00 tx=0x7f242c006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:42.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.736+0000 7f2426ffd700 1 -- 172.21.15.87:0/3539785626 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f2420050230 con 0x7f24300b2010 2023-03-30T08:11:42.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.904+0000 7f2437358700 1 -- 172.21.15.87:0/3539785626 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2430159c20 con 0x7f24300b2010 2023-03-30T08:11:42.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.904+0000 7f2426ffd700 1 -- 172.21.15.87:0/3539785626 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2420053850 con 0x7f24300b2010 2023-03-30T08:11:42.910 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:42.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.908+0000 7f2437358700 1 -- 172.21.15.87:0/3539785626 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24140653f0 msgr2=0x7f24140678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.908+0000 7f2437358700 1 --2- 172.21.15.87:0/3539785626 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24140653f0 0x7f24140678a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f242c000c00 tx=0x7f242c006040 comp rx=0 tx=0).stop 2023-03-30T08:11:42.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.908+0000 7f2437358700 1 -- 172.21.15.87:0/3539785626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24300b2010 msgr2=0x7f24300b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:42.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.908+0000 7f2437358700 1 --2- 172.21.15.87:0/3539785626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24300b2010 0x7f24300b2480 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f242000f820 tx=0x7f242000fb30 comp rx=0 tx=0).stop 2023-03-30T08:11:42.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.908+0000 7f2437358700 1 -- 172.21.15.87:0/3539785626 shutdown_connections 2023-03-30T08:11:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.908+0000 7f2437358700 1 --2- 172.21.15.87:0/3539785626 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24140653f0 0x7f24140678a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.908+0000 7f2437358700 1 --2- 172.21.15.87:0/3539785626 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24300c9c60 0x7f24300ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.908+0000 7f2437358700 1 --2- 172.21.15.87:0/3539785626 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24300b2010 0x7f24300b2480 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.908+0000 7f2437358700 1 --2- 172.21.15.87:0/3539785626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f241c005c30 0x7f24301541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.908+0000 7f2437358700 1 -- 172.21.15.87:0/3539785626 >> 172.21.15.87:0/3539785626 conn(0x7f24300cf410 msgr2=0x7f243006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:42.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.908+0000 7f2437358700 1 -- 172.21.15.87:0/3539785626 shutdown_connections 2023-03-30T08:11:42.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:42.908+0000 7f2437358700 1 -- 172.21.15.87:0/3539785626 wait complete. 2023-03-30T08:11:42.932 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:43.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.084+0000 7effc32d8700 1 Processor -- start 2023-03-30T08:11:43.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.088+0000 7effc32d8700 1 -- start start 2023-03-30T08:11:43.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.088+0000 7effc32d8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7effbc0b41c0 0x7effbc0cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.088+0000 7effc32d8700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc15e8c0 con 0x7effbc070b30 2023-03-30T08:11:43.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.088+0000 7effc32d8700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc0c96b0 con 0x7effbc0c8fb0 2023-03-30T08:11:43.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.088+0000 7effc32d8700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc15ed50 con 0x7effbc0b41c0 2023-03-30T08:11:43.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.088+0000 7effc1875700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7effbc070b30 0x7effbc0cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59818/0 (socket says 172.21.15.87:59818) 2023-03-30T08:11:43.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.088+0000 7effc1875700 1 -- 172.21.15.87:0/2091716345 learned_addr learned my addr 172.21.15.87:0/2091716345 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:43.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.088+0000 7effc1074700 1 --2- 172.21.15.87:0/2091716345 >> v2:172.21.15.115:3300/0 conn(0x7effbc0b41c0 0x7effbc0cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.088+0000 7effb3fff700 1 -- 172.21.15.87:0/2091716345 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846930129 0 0) 0x7effbc15e8c0 con 0x7effbc070b30 2023-03-30T08:11:43.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.088+0000 7effb3fff700 1 -- 172.21.15.87:0/2091716345 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa80035d0 con 0x7effbc070b30 2023-03-30T08:11:43.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.088+0000 7effc1074700 1 -- 172.21.15.87:0/2091716345 >> v1:172.21.15.115:6789/0 conn(0x7effbc0c8fb0 legacy=0x7effbc070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.088+0000 7effc1074700 1 -- 172.21.15.87:0/2091716345 >> v1:172.21.15.87:6789/0 conn(0x7effbc070b30 legacy=0x7effbc0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.088+0000 7effc1074700 1 -- 172.21.15.87:0/2091716345 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc0c9430 con 0x7effbc0b41c0 2023-03-30T08:11:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.092+0000 7effc1074700 1 --2- 172.21.15.87:0/2091716345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effbc0b41c0 0x7effbc0cab10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7effb8009850 tx=0x7effb8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bffe42bc1ba8921e server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.092+0000 7effb3fff700 1 -- 172.21.15.87:0/2091716345 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8011830 con 0x7effbc0b41c0 2023-03-30T08:11:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.092+0000 7effb3fff700 1 -- 172.21.15.87:0/2091716345 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb8011990 con 0x7effbc0b41c0 2023-03-30T08:11:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.092+0000 7effb3fff700 1 -- 172.21.15.87:0/2091716345 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8011d40 con 0x7effbc0b41c0 2023-03-30T08:11:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.092+0000 7effc32d8700 1 -- 172.21.15.87:0/2091716345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effbc0b41c0 msgr2=0x7effbc0cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.092+0000 7effc32d8700 1 --2- 172.21.15.87:0/2091716345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effbc0b41c0 0x7effbc0cab10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7effb8009850 tx=0x7effb8009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.092+0000 7effc32d8700 1 -- 172.21.15.87:0/2091716345 shutdown_connections 2023-03-30T08:11:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.092+0000 7effc32d8700 1 --2- 172.21.15.87:0/2091716345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effbc0b41c0 0x7effbc0cab10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.092+0000 7effc32d8700 1 -- 172.21.15.87:0/2091716345 >> 172.21.15.87:0/2091716345 conn(0x7effbc0ce960 msgr2=0x7effbc0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:43.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.092+0000 7effc32d8700 1 -- 172.21.15.87:0/2091716345 shutdown_connections 2023-03-30T08:11:43.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.092+0000 7effc32d8700 1 -- 172.21.15.87:0/2091716345 wait complete. 2023-03-30T08:11:43.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.092+0000 7effc32d8700 1 Processor -- start 2023-03-30T08:11:43.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc32d8700 1 -- start start 2023-03-30T08:11:43.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc32d8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effbc070b30 0x7effbc14dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc32d8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effbc0b41c0 0x7effbc0c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc32d8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effbc0c8fb0 0x7effbc0afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc32d8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc14e2c0 con 0x7effbc0c8fb0 2023-03-30T08:11:43.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc32d8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc15b7b0 con 0x7effbc0b41c0 2023-03-30T08:11:43.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc32d8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0b08c0 con 0x7effbc070b30 2023-03-30T08:11:43.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc1875700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effbc0c8fb0 0x7effbc0afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc1875700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effbc0c8fb0 0x7effbc0afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55812/0 (socket says 172.21.15.87:55812) 2023-03-30T08:11:43.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc1875700 1 -- 172.21.15.87:0/1157405230 learned_addr learned my addr 172.21.15.87:0/1157405230 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:43.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc1074700 1 --2- 172.21.15.87:0/1157405230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effbc070b30 0x7effbc14dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc0873700 1 --2- 172.21.15.87:0/1157405230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effbc0b41c0 0x7effbc0c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc1875700 1 -- 172.21.15.87:0/1157405230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effbc070b30 msgr2=0x7effbc14dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc1875700 1 --2- 172.21.15.87:0/1157405230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effbc070b30 0x7effbc14dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc1875700 1 -- 172.21.15.87:0/1157405230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effbc0b41c0 msgr2=0x7effbc0c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc1875700 1 --2- 172.21.15.87:0/1157405230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effbc0b41c0 0x7effbc0c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc1875700 1 -- 172.21.15.87:0/1157405230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb80094b0 con 0x7effbc0c8fb0 2023-03-30T08:11:43.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc1875700 1 --2- 172.21.15.87:0/1157405230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effbc0c8fb0 0x7effbc0afbf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7effb400cb40 tx=0x7effb400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:43.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effb1ffb700 1 -- 172.21.15.87:0/1157405230 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4007500 con 0x7effbc0c8fb0 2023-03-30T08:11:43.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effb1ffb700 1 -- 172.21.15.87:0/1157405230 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb4007660 con 0x7effbc0c8fb0 2023-03-30T08:11:43.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effb1ffb700 1 -- 172.21.15.87:0/1157405230 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb40079f0 con 0x7effbc0c8fb0 2023-03-30T08:11:43.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.096+0000 7effc32d8700 1 -- 172.21.15.87:0/1157405230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc15df90 con 0x7effbc0c8fb0 2023-03-30T08:11:43.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.100+0000 7effc32d8700 1 -- 172.21.15.87:0/1157405230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc0ce720 con 0x7effbc0c8fb0 2023-03-30T08:11:43.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.100+0000 7effc32d8700 1 -- 172.21.15.87:0/1157405230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc15e270 con 0x7effbc0c8fb0 2023-03-30T08:11:43.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.100+0000 7effb1ffb700 1 -- 172.21.15.87:0/1157405230 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7effb401b3b0 con 0x7effbc0c8fb0 2023-03-30T08:11:43.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.104+0000 7effb1ffb700 1 --2- 172.21.15.87:0/1157405230 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7effa00653f0 0x7effa00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.104+0000 7effb1ffb700 1 -- 172.21.15.87:0/1157405230 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7effb4082670 con 0x7effbc0c8fb0 2023-03-30T08:11:43.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.104+0000 7effc1074700 1 --2- 172.21.15.87:0/1157405230 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7effa00653f0 0x7effa00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.104+0000 7effc1074700 1 --2- 172.21.15.87:0/1157405230 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7effa00653f0 0x7effa00678a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7effb80090b0 tx=0x7effb8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:43.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.108+0000 7effb1ffb700 1 -- 172.21.15.87:0/1157405230 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7effb404fec0 con 0x7effbc0c8fb0 2023-03-30T08:11:43.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.284+0000 7effc32d8700 1 -- 172.21.15.87:0/1157405230 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effbc073ee0 con 0x7effbc0c8fb0 2023-03-30T08:11:43.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.284+0000 7effb1ffb700 1 -- 172.21.15.87:0/1157405230 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+19747 (secure 0 0 0) 0x7effb40534e0 con 0x7effbc0c8fb0 2023-03-30T08:11:43.290 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:43.291 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:39.157903+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:43.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.288+0000 7effc32d8700 1 -- 172.21.15.87:0/1157405230 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7effa00653f0 msgr2=0x7effa00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.288+0000 7effc32d8700 1 --2- 172.21.15.87:0/1157405230 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7effa00653f0 0x7effa00678a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7effb80090b0 tx=0x7effb8008030 comp rx=0 tx=0).stop 2023-03-30T08:11:43.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.288+0000 7effc32d8700 1 -- 172.21.15.87:0/1157405230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effbc0c8fb0 msgr2=0x7effbc0afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.288+0000 7effc32d8700 1 --2- 172.21.15.87:0/1157405230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effbc0c8fb0 0x7effbc0afbf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7effb400cb40 tx=0x7effb400cb70 comp rx=0 tx=0).stop 2023-03-30T08:11:43.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.288+0000 7effc32d8700 1 -- 172.21.15.87:0/1157405230 shutdown_connections 2023-03-30T08:11:43.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.288+0000 7effc32d8700 1 --2- 172.21.15.87:0/1157405230 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7effa00653f0 0x7effa00678a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.288+0000 7effc32d8700 1 --2- 172.21.15.87:0/1157405230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effbc0c8fb0 0x7effbc0afbf0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.288+0000 7effc32d8700 1 --2- 172.21.15.87:0/1157405230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effbc0b41c0 0x7effbc0c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.288+0000 7effc32d8700 1 --2- 172.21.15.87:0/1157405230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7effbc070b30 0x7effbc14dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.288+0000 7effc32d8700 1 -- 172.21.15.87:0/1157405230 >> 172.21.15.87:0/1157405230 conn(0x7effbc0ce960 msgr2=0x7effbc06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:43.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.288+0000 7effc32d8700 1 -- 172.21.15.87:0/1157405230 shutdown_connections 2023-03-30T08:11:43.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.288+0000 7effc32d8700 1 -- 172.21.15.87:0/1157405230 wait complete. 2023-03-30T08:11:43.314 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-30T08:10:56.407927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-30T08:10:57.359214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-30T08:11:00.430972+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-30T08:11:43.315 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T08:11:43.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.468+0000 7f08a5a12700 1 Processor -- start 2023-03-30T08:11:43.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.468+0000 7f08a5a12700 1 -- start start 2023-03-30T08:11:43.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.472+0000 7f08a5a12700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08a0159050 0x7f08a0069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.472+0000 7f08a5a12700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f08a00ca4b0 0x7f08a00ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.472+0000 7f08a5a12700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a00afca0 con 0x7f08a015cba0 2023-03-30T08:11:43.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.472+0000 7f08a5a12700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a00afb10 con 0x7f08a00ca4b0 2023-03-30T08:11:43.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.472+0000 7f08a5a12700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a00cae70 con 0x7f08a0159050 2023-03-30T08:11:43.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.472+0000 7f0897fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f08a015cba0 0x7f08a00cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59822/0 (socket says 172.21.15.87:59822) 2023-03-30T08:11:43.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.472+0000 7f0897fff700 1 -- 172.21.15.87:0/1997100926 learned_addr learned my addr 172.21.15.87:0/1997100926 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:43.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.472+0000 7f08a4a10700 1 --2- 172.21.15.87:0/1997100926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08a0159050 0x7f08a0069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.472+0000 7f08a5211700 1 --2- 172.21.15.87:0/1997100926 >> v2:172.21.15.115:3300/0 conn(0x7f08a00ca4b0 0x7f08a00ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.472+0000 7f08977fe700 1 -- 172.21.15.87:0/1997100926 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687024696 0 0) 0x7f08a00afca0 con 0x7f08a015cba0 2023-03-30T08:11:43.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.472+0000 7f08977fe700 1 -- 172.21.15.87:0/1997100926 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08880035d0 con 0x7f08a015cba0 2023-03-30T08:11:43.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.472+0000 7f08a5211700 1 -- 172.21.15.87:0/1997100926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08a0159050 msgr2=0x7f08a0069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:43.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.472+0000 7f08a5211700 1 --2- 172.21.15.87:0/1997100926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08a0159050 0x7f08a0069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.472+0000 7f08a5211700 1 -- 172.21.15.87:0/1997100926 >> v1:172.21.15.87:6789/0 conn(0x7f08a015cba0 legacy=0x7f08a00cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.472+0000 7f08a5211700 1 -- 172.21.15.87:0/1997100926 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a015d110 con 0x7f08a00ca4b0 2023-03-30T08:11:43.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.476+0000 7f08a5211700 1 --2- 172.21.15.87:0/1997100926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a00ca4b0 0x7f08a00ca930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0898009d90 tx=0x7f089800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5264e76773d1f5a server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:43.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.476+0000 7f08977fe700 1 -- 172.21.15.87:0/1997100926 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089800e070 con 0x7f08a00ca4b0 2023-03-30T08:11:43.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.476+0000 7f08977fe700 1 -- 172.21.15.87:0/1997100926 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089800bb20 con 0x7f08a00ca4b0 2023-03-30T08:11:43.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.476+0000 7f08977fe700 1 -- 172.21.15.87:0/1997100926 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0898012430 con 0x7f08a00ca4b0 2023-03-30T08:11:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.476+0000 7f08a5a12700 1 -- 172.21.15.87:0/1997100926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a00ca4b0 msgr2=0x7f08a00ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.476+0000 7f08a5a12700 1 --2- 172.21.15.87:0/1997100926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a00ca4b0 0x7f08a00ca930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0898009d90 tx=0x7f089800b330 comp rx=0 tx=0).stop 2023-03-30T08:11:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.476+0000 7f08a5a12700 1 -- 172.21.15.87:0/1997100926 shutdown_connections 2023-03-30T08:11:43.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.476+0000 7f08a5a12700 1 --2- 172.21.15.87:0/1997100926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a00ca4b0 0x7f08a00ca930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.476+0000 7f08a5a12700 1 --2- 172.21.15.87:0/1997100926 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08a0159050 0x7f08a0069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.476+0000 7f08a5a12700 1 -- 172.21.15.87:0/1997100926 >> 172.21.15.87:0/1997100926 conn(0x7f08a00cf410 msgr2=0x7f08a00cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.476+0000 7f08a5a12700 1 -- 172.21.15.87:0/1997100926 shutdown_connections 2023-03-30T08:11:43.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.476+0000 7f08a5a12700 1 -- 172.21.15.87:0/1997100926 wait complete. 2023-03-30T08:11:43.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.480+0000 7f08a5a12700 1 Processor -- start 2023-03-30T08:11:43.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.480+0000 7f08a5a12700 1 -- start start 2023-03-30T08:11:43.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.480+0000 7f08a5a12700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a00ca4b0 0x7f08a00b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.480+0000 7f08a5a12700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08a0159050 0x7f08a0147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.480+0000 7f08a5a12700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08a015cba0 0x7f08a006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.480+0000 7f08a5a12700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a01540c0 con 0x7f08a015cba0 2023-03-30T08:11:43.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.480+0000 7f08a5a12700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a00b1650 con 0x7f08a00ca4b0 2023-03-30T08:11:43.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.480+0000 7f08a5a12700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a00b1ef0 con 0x7f08a0159050 2023-03-30T08:11:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.480+0000 7f08a5211700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08a015cba0 0x7f08a006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.480+0000 7f08a5211700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08a015cba0 0x7f08a006ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55820/0 (socket says 172.21.15.87:55820) 2023-03-30T08:11:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.480+0000 7f08a5211700 1 -- 172.21.15.87:0/766634388 learned_addr learned my addr 172.21.15.87:0/766634388 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:43.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.480+0000 7f08a4a10700 1 --2- 172.21.15.87:0/766634388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a00ca4b0 0x7f08a00b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.480+0000 7f0897fff700 1 --2- 172.21.15.87:0/766634388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08a0159050 0x7f08a0147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.484+0000 7f08a5211700 1 -- 172.21.15.87:0/766634388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08a0159050 msgr2=0x7f08a0147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.484+0000 7f08a5211700 1 --2- 172.21.15.87:0/766634388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08a0159050 0x7f08a0147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.484+0000 7f08a5211700 1 -- 172.21.15.87:0/766634388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a00ca4b0 msgr2=0x7f08a00b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.484+0000 7f08a5211700 1 --2- 172.21.15.87:0/766634388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a00ca4b0 0x7f08a00b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.484+0000 7f08a5211700 1 -- 172.21.15.87:0/766634388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0898009a70 con 0x7f08a015cba0 2023-03-30T08:11:43.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.484+0000 7f08a5211700 1 --2- 172.21.15.87:0/766634388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08a015cba0 0x7f08a006ccd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0898014040 tx=0x7f0898004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:43.490 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.484+0000 7f08957fa700 1 -- 172.21.15.87:0/766634388 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0898012430 con 0x7f08a015cba0 2023-03-30T08:11:43.490 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.484+0000 7f08957fa700 1 -- 172.21.15.87:0/766634388 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0898020070 con 0x7f08a015cba0 2023-03-30T08:11:43.490 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.484+0000 7f08957fa700 1 -- 172.21.15.87:0/766634388 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08980098f0 con 0x7f08a015cba0 2023-03-30T08:11:43.490 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.484+0000 7f08a5a12700 1 -- 172.21.15.87:0/766634388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a015d6d0 con 0x7f08a015cba0 2023-03-30T08:11:43.490 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.484+0000 7f08a5a12700 1 -- 172.21.15.87:0/766634388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a015d3f0 con 0x7f08a015cba0 2023-03-30T08:11:43.490 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.484+0000 7f08a5a12700 1 -- 172.21.15.87:0/766634388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a015d9b0 con 0x7f08a015cba0 2023-03-30T08:11:43.491 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.488+0000 7f08957fa700 1 -- 172.21.15.87:0/766634388 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f0898004040 con 0x7f08a015cba0 2023-03-30T08:11:43.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.488+0000 7f08957fa700 1 --2- 172.21.15.87:0/766634388 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f088c065420 0x7f088c0678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.488+0000 7f08957fa700 1 -- 172.21.15.87:0/766634388 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0898022070 con 0x7f08a015cba0 2023-03-30T08:11:43.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.488+0000 7f08a4a10700 1 --2- 172.21.15.87:0/766634388 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f088c065420 0x7f088c0678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.488+0000 7f08a4a10700 1 --2- 172.21.15.87:0/766634388 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f088c065420 0x7f088c0678d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f089c009bf0 tx=0x7f089c009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:43.497 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.492+0000 7f08957fa700 1 -- 172.21.15.87:0/766634388 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f0898055fa0 con 0x7f08a015cba0 2023-03-30T08:11:43.665 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.660+0000 7f08a5a12700 1 -- 172.21.15.87:0/766634388 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f08a00b2060 con 0x7f08a015cba0 2023-03-30T08:11:43.665 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.660+0000 7f08957fa700 1 -- 172.21.15.87:0/766634388 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f089802c0a0 con 0x7f08a015cba0 2023-03-30T08:11:43.666 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T08:11:43.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.664+0000 7f08a5a12700 1 -- 172.21.15.87:0/766634388 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f088c065420 msgr2=0x7f088c0678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.664+0000 7f08a5a12700 1 --2- 172.21.15.87:0/766634388 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f088c065420 0x7f088c0678d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f089c009bf0 tx=0x7f089c009240 comp rx=0 tx=0).stop 2023-03-30T08:11:43.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.664+0000 7f08a5a12700 1 -- 172.21.15.87:0/766634388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08a015cba0 msgr2=0x7f08a006ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.664+0000 7f08a5a12700 1 --2- 172.21.15.87:0/766634388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08a015cba0 0x7f08a006ccd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0898014040 tx=0x7f0898004af0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.664+0000 7f08a5a12700 1 -- 172.21.15.87:0/766634388 shutdown_connections 2023-03-30T08:11:43.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.664+0000 7f08a5a12700 1 --2- 172.21.15.87:0/766634388 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f088c065420 0x7f088c0678d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.664+0000 7f08a5a12700 1 --2- 172.21.15.87:0/766634388 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f08a015cba0 0x7f08a006ccd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.664+0000 7f08a5a12700 1 --2- 172.21.15.87:0/766634388 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08a0159050 0x7f08a0147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.664+0000 7f08a5a12700 1 --2- 172.21.15.87:0/766634388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08a00ca4b0 0x7f08a00b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.664+0000 7f08a5a12700 1 -- 172.21.15.87:0/766634388 >> 172.21.15.87:0/766634388 conn(0x7f08a00cf410 msgr2=0x7f08a0158240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:43.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.664+0000 7f08a5a12700 1 -- 172.21.15.87:0/766634388 shutdown_connections 2023-03-30T08:11:43.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.664+0000 7f08a5a12700 1 -- 172.21.15.87:0/766634388 wait complete. 2023-03-30T08:11:43.691 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T08:11:43.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.848+0000 7feb0759e700 1 Processor -- start 2023-03-30T08:11:43.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.848+0000 7feb0759e700 1 -- start start 2023-03-30T08:11:43.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feb0759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080b3f30 0x7feb080b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feb0759e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feb0806a6e0 0x7feb080aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feb0759e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0806b670 con 0x7feb080af180 2023-03-30T08:11:43.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feb0759e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb080af600 con 0x7feb0806a6e0 2023-03-30T08:11:43.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feb0759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0806b0b0 con 0x7feb080b3f30 2023-03-30T08:11:43.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feb06d9d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7feb080af180 0x7feb0815ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59826/0 (socket says 172.21.15.87:59826) 2023-03-30T08:11:43.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feb06d9d700 1 -- 172.21.15.87:0/1573134547 learned_addr learned my addr 172.21.15.87:0/1573134547 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:43.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feb0659c700 1 --2- 172.21.15.87:0/1573134547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080b3f30 0x7feb080b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feafffff700 1 --2- 172.21.15.87:0/1573134547 >> v2:172.21.15.115:3300/0 conn(0x7feb0806a6e0 0x7feb080aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feb05d9b700 1 -- 172.21.15.87:0/1573134547 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424905415 0 0) 0x7feb0806b670 con 0x7feb080af180 2023-03-30T08:11:43.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feb05d9b700 1 -- 172.21.15.87:0/1573134547 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaf40035d0 con 0x7feb080af180 2023-03-30T08:11:43.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feb0659c700 1 -- 172.21.15.87:0/1573134547 >> v2:172.21.15.115:3300/0 conn(0x7feb0806a6e0 msgr2=0x7feb080aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:43.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feb0659c700 1 --2- 172.21.15.87:0/1573134547 >> v2:172.21.15.115:3300/0 conn(0x7feb0806a6e0 0x7feb080aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feb0659c700 1 -- 172.21.15.87:0/1573134547 >> v1:172.21.15.87:6789/0 conn(0x7feb080af180 legacy=0x7feb0815ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feb0659c700 1 -- 172.21.15.87:0/1573134547 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0806b390 con 0x7feb080b3f30 2023-03-30T08:11:43.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.852+0000 7feb0659c700 1 --2- 172.21.15.87:0/1573134547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080b3f30 0x7feb080b0c10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009850 tx=0x7feaf8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1895a6fdafedbcc server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:43.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.856+0000 7feb05d9b700 1 -- 172.21.15.87:0/1573134547 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8011830 con 0x7feb080b3f30 2023-03-30T08:11:43.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.856+0000 7feb05d9b700 1 -- 172.21.15.87:0/1573134547 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf8011990 con 0x7feb080b3f30 2023-03-30T08:11:43.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.856+0000 7feb05d9b700 1 -- 172.21.15.87:0/1573134547 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8011d00 con 0x7feb080b3f30 2023-03-30T08:11:43.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.856+0000 7feb0759e700 1 -- 172.21.15.87:0/1573134547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080b3f30 msgr2=0x7feb080b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.856+0000 7feb0759e700 1 --2- 172.21.15.87:0/1573134547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080b3f30 0x7feb080b0c10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009850 tx=0x7feaf8009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:43.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.856+0000 7feb0759e700 1 -- 172.21.15.87:0/1573134547 shutdown_connections 2023-03-30T08:11:43.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.856+0000 7feb0759e700 1 --2- 172.21.15.87:0/1573134547 >> v2:172.21.15.115:3300/0 conn(0x7feb0806a6e0 0x7feb080aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.856+0000 7feb0759e700 1 --2- 172.21.15.87:0/1573134547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080b3f30 0x7feb080b0c10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.856+0000 7feb0759e700 1 -- 172.21.15.87:0/1573134547 >> 172.21.15.87:0/1573134547 conn(0x7feb080cf410 msgr2=0x7feb080cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:43.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.856+0000 7feb0759e700 1 -- 172.21.15.87:0/1573134547 shutdown_connections 2023-03-30T08:11:43.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.856+0000 7feb0759e700 1 -- 172.21.15.87:0/1573134547 wait complete. 2023-03-30T08:11:43.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.860+0000 7feb0759e700 1 Processor -- start 2023-03-30T08:11:43.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.860+0000 7feb0759e700 1 -- start start 2023-03-30T08:11:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.860+0000 7feb0759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb0806a6e0 0x7feb08155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.860+0000 7feb0759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb080af180 0x7feb080c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.860+0000 7feb0759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080b3f30 0x7feb08156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.860+0000 7feb0759e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb081564d0 con 0x7feb0806a6e0 2023-03-30T08:11:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.860+0000 7feb0759e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb080ca660 con 0x7feb080af180 2023-03-30T08:11:43.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.860+0000 7feb0759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb080ca130 con 0x7feb080b3f30 2023-03-30T08:11:43.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.860+0000 7feb0659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb0806a6e0 0x7feb08155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.860+0000 7feb0659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb0806a6e0 0x7feb08155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55834/0 (socket says 172.21.15.87:55834) 2023-03-30T08:11:43.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.860+0000 7feb0659c700 1 -- 172.21.15.87:0/3620699143 learned_addr learned my addr 172.21.15.87:0/3620699143 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:43.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.860+0000 7feafffff700 1 --2- 172.21.15.87:0/3620699143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb080af180 0x7feb080c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.860+0000 7feb06d9d700 1 --2- 172.21.15.87:0/3620699143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080b3f30 0x7feb08156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.864+0000 7feb0659c700 1 -- 172.21.15.87:0/3620699143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080b3f30 msgr2=0x7feb08156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.864+0000 7feb0659c700 1 --2- 172.21.15.87:0/3620699143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080b3f30 0x7feb08156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.864+0000 7feb0659c700 1 -- 172.21.15.87:0/3620699143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb080af180 msgr2=0x7feb080c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:43.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.864+0000 7feb0659c700 1 --2- 172.21.15.87:0/3620699143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb080af180 0x7feb080c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:43.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.864+0000 7feb0659c700 1 -- 172.21.15.87:0/3620699143 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf80094b0 con 0x7feb0806a6e0 2023-03-30T08:11:43.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.864+0000 7feb0659c700 1 --2- 172.21.15.87:0/3620699143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb0806a6e0 0x7feb08155f90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feb0806b800 tx=0x7feaf8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:43.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.864+0000 7feafeffd700 1 -- 172.21.15.87:0/3620699143 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8004450 con 0x7feb0806a6e0 2023-03-30T08:11:43.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.864+0000 7feafeffd700 1 -- 172.21.15.87:0/3620699143 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf801e070 con 0x7feb0806a6e0 2023-03-30T08:11:43.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.864+0000 7feafeffd700 1 -- 172.21.15.87:0/3620699143 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8003900 con 0x7feb0806a6e0 2023-03-30T08:11:43.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.864+0000 7feb0759e700 1 -- 172.21.15.87:0/3620699143 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb080ae1b0 con 0x7feb0806a6e0 2023-03-30T08:11:43.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.864+0000 7feb0759e700 1 -- 172.21.15.87:0/3620699143 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb080aded0 con 0x7feb0806a6e0 2023-03-30T08:11:43.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.864+0000 7feb0759e700 1 -- 172.21.15.87:0/3620699143 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb080b4300 con 0x7feb0806a6e0 2023-03-30T08:11:43.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.868+0000 7feafeffd700 1 -- 172.21.15.87:0/3620699143 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7feaf8003a60 con 0x7feb0806a6e0 2023-03-30T08:11:43.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.868+0000 7feafeffd700 1 --2- 172.21.15.87:0/3620699143 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feae80653f0 0x7feae80678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:43.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.868+0000 7feafeffd700 1 -- 172.21.15.87:0/3620699143 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feaf8083a60 con 0x7feb0806a6e0 2023-03-30T08:11:43.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.868+0000 7feafffff700 1 --2- 172.21.15.87:0/3620699143 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feae80653f0 0x7feae80678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:43.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.868+0000 7feafffff700 1 --2- 172.21.15.87:0/3620699143 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feae80653f0 0x7feae80678a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feb080cdf30 tx=0x7feaf0009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:43.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:43.872+0000 7feafeffd700 1 -- 172.21.15.87:0/3620699143 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7feaf8051440 con 0x7feb0806a6e0 2023-03-30T08:11:44.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.040+0000 7feb0759e700 1 -- 172.21.15.87:0/3620699143 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feb080733a0 con 0x7feb0806a6e0 2023-03-30T08:11:44.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.040+0000 7feafeffd700 1 -- 172.21.15.87:0/3620699143 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7feaf80200a0 con 0x7feb0806a6e0 2023-03-30T08:11:44.046 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T08:11:44.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.044+0000 7feb0759e700 1 -- 172.21.15.87:0/3620699143 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feae80653f0 msgr2=0x7feae80678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.044+0000 7feb0759e700 1 --2- 172.21.15.87:0/3620699143 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feae80653f0 0x7feae80678a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feb080cdf30 tx=0x7feaf0009240 comp rx=0 tx=0).stop 2023-03-30T08:11:44.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.044+0000 7feb0759e700 1 -- 172.21.15.87:0/3620699143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb0806a6e0 msgr2=0x7feb08155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.044+0000 7feb0759e700 1 --2- 172.21.15.87:0/3620699143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb0806a6e0 0x7feb08155f90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feb0806b800 tx=0x7feaf8004770 comp rx=0 tx=0).stop 2023-03-30T08:11:44.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.044+0000 7feb0759e700 1 -- 172.21.15.87:0/3620699143 shutdown_connections 2023-03-30T08:11:44.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.044+0000 7feb0759e700 1 --2- 172.21.15.87:0/3620699143 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feae80653f0 0x7feae80678a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.044+0000 7feb0759e700 1 --2- 172.21.15.87:0/3620699143 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb080b3f30 0x7feb08156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.044+0000 7feb0759e700 1 --2- 172.21.15.87:0/3620699143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb080af180 0x7feb080c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.044+0000 7feb0759e700 1 --2- 172.21.15.87:0/3620699143 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb0806a6e0 0x7feb08155f90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.044+0000 7feb0759e700 1 -- 172.21.15.87:0/3620699143 >> 172.21.15.87:0/3620699143 conn(0x7feb080cf410 msgr2=0x7feb080cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:44.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.044+0000 7feb0759e700 1 -- 172.21.15.87:0/3620699143 shutdown_connections 2023-03-30T08:11:44.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.044+0000 7feb0759e700 1 -- 172.21.15.87:0/3620699143 wait complete. 2023-03-30T08:11:44.068 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-30T08:11:44.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.228+0000 7f8e3759e700 1 Processor -- start 2023-03-30T08:11:44.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.228+0000 7f8e3759e700 1 -- start start 2023-03-30T08:11:44.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.228+0000 7f8e3759e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8e38159050 0x7f8e38069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.228+0000 7f8e3759e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8e3815cba0 0x7f8e380cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e3759e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e380afca0 con 0x7f8e380ca4b0 2023-03-30T08:11:44.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e3759e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e380afb10 con 0x7f8e3815cba0 2023-03-30T08:11:44.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e3759e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3815d110 con 0x7f8e38159050 2023-03-30T08:11:44.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e36d9d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8e380ca4b0 0x7f8e380b0130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59834/0 (socket says 172.21.15.87:59834) 2023-03-30T08:11:44.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e36d9d700 1 -- 172.21.15.87:0/630757440 learned_addr learned my addr 172.21.15.87:0/630757440 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:44.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e2dd9b700 1 --2- 172.21.15.87:0/630757440 >> v2:172.21.15.87:3300/0 conn(0x7f8e3815cba0 0x7f8e380cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e3659c700 1 --2- 172.21.15.87:0/630757440 >> v2:172.21.15.115:3300/0 conn(0x7f8e38159050 0x7f8e38069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e35d9b700 1 -- 172.21.15.87:0/630757440 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088982339 0 0) 0x7f8e380afca0 con 0x7f8e380ca4b0 2023-03-30T08:11:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e35d9b700 1 -- 172.21.15.87:0/630757440 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e240035d0 con 0x7f8e380ca4b0 2023-03-30T08:11:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e2dd9b700 1 -- 172.21.15.87:0/630757440 >> v2:172.21.15.115:3300/0 conn(0x7f8e38159050 msgr2=0x7f8e38069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e2dd9b700 1 --2- 172.21.15.87:0/630757440 >> v2:172.21.15.115:3300/0 conn(0x7f8e38159050 0x7f8e38069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e2dd9b700 1 -- 172.21.15.87:0/630757440 >> v1:172.21.15.87:6789/0 conn(0x7f8e380ca4b0 legacy=0x7f8e380b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e2dd9b700 1 -- 172.21.15.87:0/630757440 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3815d3f0 con 0x7f8e3815cba0 2023-03-30T08:11:44.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e2dd9b700 1 --2- 172.21.15.87:0/630757440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3815cba0 0x7f8e380cbb20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8e3806fb30 tx=0x7f8e2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8806fe7f6643266e server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:44.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e35d9b700 1 -- 172.21.15.87:0/630757440 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000e070 con 0x7f8e3815cba0 2023-03-30T08:11:44.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e35d9b700 1 -- 172.21.15.87:0/630757440 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2000bb20 con 0x7f8e3815cba0 2023-03-30T08:11:44.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e35d9b700 1 -- 172.21.15.87:0/630757440 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000be90 con 0x7f8e3815cba0 2023-03-30T08:11:44.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e3759e700 1 -- 172.21.15.87:0/630757440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3815cba0 msgr2=0x7f8e380cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e3759e700 1 --2- 172.21.15.87:0/630757440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3815cba0 0x7f8e380cbb20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8e3806fb30 tx=0x7f8e2000b330 comp rx=0 tx=0).stop 2023-03-30T08:11:44.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e3759e700 1 -- 172.21.15.87:0/630757440 shutdown_connections 2023-03-30T08:11:44.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e3759e700 1 --2- 172.21.15.87:0/630757440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3815cba0 0x7f8e380cbb20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e3759e700 1 --2- 172.21.15.87:0/630757440 >> v2:172.21.15.115:3300/0 conn(0x7f8e38159050 0x7f8e38069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e3759e700 1 -- 172.21.15.87:0/630757440 >> 172.21.15.87:0/630757440 conn(0x7f8e380cf410 msgr2=0x7f8e380cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:44.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e3759e700 1 -- 172.21.15.87:0/630757440 shutdown_connections 2023-03-30T08:11:44.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.232+0000 7f8e3759e700 1 -- 172.21.15.87:0/630757440 wait complete. 2023-03-30T08:11:44.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.236+0000 7f8e3759e700 1 Processor -- start 2023-03-30T08:11:44.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.236+0000 7f8e3759e700 1 -- start start 2023-03-30T08:11:44.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e3759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e380ca4b0 0x7f8e38153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e3759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e38159050 0x7f8e380c2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e3759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3815cba0 0x7f8e380c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e3759e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380b41d0 con 0x7f8e3815cba0 2023-03-30T08:11:44.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e3759e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380b2060 con 0x7f8e380ca4b0 2023-03-30T08:11:44.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e3759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380b2340 con 0x7f8e38159050 2023-03-30T08:11:44.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e36d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3815cba0 0x7f8e380c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e36d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3815cba0 0x7f8e380c2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55844/0 (socket says 172.21.15.87:55844) 2023-03-30T08:11:44.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e36d9d700 1 -- 172.21.15.87:0/4080407327 learned_addr learned my addr 172.21.15.87:0/4080407327 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:44.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e3659c700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e380ca4b0 0x7f8e38153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e2dd9b700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e38159050 0x7f8e380c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e36d9d700 1 -- 172.21.15.87:0/4080407327 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e38159050 msgr2=0x7f8e380c2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e36d9d700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e38159050 0x7f8e380c2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e36d9d700 1 -- 172.21.15.87:0/4080407327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e380ca4b0 msgr2=0x7f8e38153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e36d9d700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e380ca4b0 0x7f8e38153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e36d9d700 1 -- 172.21.15.87:0/4080407327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e20009a70 con 0x7f8e3815cba0 2023-03-30T08:11:44.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e2dd9b700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e38159050 0x7f8e380c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:44.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e3659c700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e380ca4b0 0x7f8e38153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:44.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e36d9d700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3815cba0 0x7f8e380c2ca0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000c4f0 tx=0x7f8e3000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:44.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e2f7fe700 1 -- 172.21.15.87:0/4080407327 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30005d90 con 0x7f8e3815cba0 2023-03-30T08:11:44.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e2f7fe700 1 -- 172.21.15.87:0/4080407327 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e300070d0 con 0x7f8e3815cba0 2023-03-30T08:11:44.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e2f7fe700 1 -- 172.21.15.87:0/4080407327 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30007460 con 0x7f8e3815cba0 2023-03-30T08:11:44.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e3759e700 1 -- 172.21.15.87:0/4080407327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3815d9b0 con 0x7f8e3815cba0 2023-03-30T08:11:44.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.240+0000 7f8e3759e700 1 -- 172.21.15.87:0/4080407327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3815d6d0 con 0x7f8e3815cba0 2023-03-30T08:11:44.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.244+0000 7f8e3759e700 1 -- 172.21.15.87:0/4080407327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e38159420 con 0x7f8e3815cba0 2023-03-30T08:11:44.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.244+0000 7f8e2f7fe700 1 -- 172.21.15.87:0/4080407327 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f8e300075c0 con 0x7f8e3815cba0 2023-03-30T08:11:44.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.244+0000 7f8e2f7fe700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8e180653f0 0x7f8e180678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.248+0000 7f8e2f7fe700 1 -- 172.21.15.87:0/4080407327 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8e300821a0 con 0x7f8e3815cba0 2023-03-30T08:11:44.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.248+0000 7f8e3659c700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8e180653f0 0x7f8e180678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.248+0000 7f8e3659c700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8e180653f0 0x7f8e180678a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009c40 tx=0x7f8e28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:44.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.252+0000 7f8e2f7fe700 1 -- 172.21.15.87:0/4080407327 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f8e3004fa50 con 0x7f8e3815cba0 2023-03-30T08:11:44.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.416+0000 7f8e3759e700 1 -- 172.21.15.87:0/4080407327 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e380733a0 con 0x7f8e3815cba0 2023-03-30T08:11:44.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.420+0000 7f8e2f7fe700 1 -- 172.21.15.87:0/4080407327 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e30053070 con 0x7f8e3815cba0 2023-03-30T08:11:44.423 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:44.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.420+0000 7f8e3759e700 1 -- 172.21.15.87:0/4080407327 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8e180653f0 msgr2=0x7f8e180678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.420+0000 7f8e3759e700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8e180653f0 0x7f8e180678a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009c40 tx=0x7f8e28008040 comp rx=0 tx=0).stop 2023-03-30T08:11:44.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.420+0000 7f8e3759e700 1 -- 172.21.15.87:0/4080407327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3815cba0 msgr2=0x7f8e380c2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.420+0000 7f8e3759e700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3815cba0 0x7f8e380c2ca0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000c4f0 tx=0x7f8e3000c8b0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.420+0000 7f8e3759e700 1 -- 172.21.15.87:0/4080407327 shutdown_connections 2023-03-30T08:11:44.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.420+0000 7f8e3759e700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8e180653f0 0x7f8e180678a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.420+0000 7f8e3759e700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8e3815cba0 0x7f8e380c2ca0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.420+0000 7f8e3759e700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e38159050 0x7f8e380c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.420+0000 7f8e3759e700 1 --2- 172.21.15.87:0/4080407327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e380ca4b0 0x7f8e38153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.420+0000 7f8e3759e700 1 -- 172.21.15.87:0/4080407327 >> 172.21.15.87:0/4080407327 conn(0x7f8e380cf410 msgr2=0x7f8e38158080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:44.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.420+0000 7f8e3759e700 1 -- 172.21.15.87:0/4080407327 shutdown_connections 2023-03-30T08:11:44.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.420+0000 7f8e3759e700 1 -- 172.21.15.87:0/4080407327 wait complete. 2023-03-30T08:11:44.446 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-30T08:11:44.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.612+0000 7fa59df97700 1 Processor -- start 2023-03-30T08:11:44.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.612+0000 7fa59df97700 1 -- start start 2023-03-30T08:11:44.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59df97700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5980d27e0 0x7fa5980d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59df97700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa59806a3e0 0x7fa5980d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59df97700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa598160ef0 con 0x7fa5980b8380 2023-03-30T08:11:44.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59df97700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5980cd6a0 con 0x7fa59806a3e0 2023-03-30T08:11:44.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59df97700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5980cd3a0 con 0x7fa5980d27e0 2023-03-30T08:11:44.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59d796700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa59806a3e0 0x7fa5980d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59d796700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa59806a3e0 0x7fa5980d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55850/0 (socket says 172.21.15.87:55850) 2023-03-30T08:11:44.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59d796700 1 -- 172.21.15.87:0/3006856742 learned_addr learned my addr 172.21.15.87:0/3006856742 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:44.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa597fff700 1 --2- 172.21.15.87:0/3006856742 >> v2:172.21.15.115:3300/0 conn(0x7fa5980d27e0 0x7fa5980d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59d796700 1 -- 172.21.15.87:0/3006856742 >> v2:172.21.15.115:3300/0 conn(0x7fa5980d27e0 msgr2=0x7fa5980d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:44.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59d796700 1 --2- 172.21.15.87:0/3006856742 >> v2:172.21.15.115:3300/0 conn(0x7fa5980d27e0 0x7fa5980d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59d796700 1 -- 172.21.15.87:0/3006856742 >> v1:172.21.15.115:6789/0 conn(0x7fa5980b8380 legacy=0x7fa598069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:44.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59d796700 1 -- 172.21.15.87:0/3006856742 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5980cef00 con 0x7fa59806a3e0 2023-03-30T08:11:44.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59d796700 1 --2- 172.21.15.87:0/3006856742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa59806a3e0 0x7fa5980d0880 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa590009e50 tx=0x7fa59000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3576c03338e1aba server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:44.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa5977fe700 1 -- 172.21.15.87:0/3006856742 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59000e070 con 0x7fa59806a3e0 2023-03-30T08:11:44.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa5977fe700 1 -- 172.21.15.87:0/3006856742 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa590003a40 con 0x7fa59806a3e0 2023-03-30T08:11:44.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa5977fe700 1 -- 172.21.15.87:0/3006856742 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa590003df0 con 0x7fa59806a3e0 2023-03-30T08:11:44.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59df97700 1 -- 172.21.15.87:0/3006856742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa59806a3e0 msgr2=0x7fa5980d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59df97700 1 --2- 172.21.15.87:0/3006856742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa59806a3e0 0x7fa5980d0880 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa590009e50 tx=0x7fa59000b330 comp rx=0 tx=0).stop 2023-03-30T08:11:44.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59df97700 1 -- 172.21.15.87:0/3006856742 shutdown_connections 2023-03-30T08:11:44.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59df97700 1 --2- 172.21.15.87:0/3006856742 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa59806a3e0 0x7fa5980d0880 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59df97700 1 --2- 172.21.15.87:0/3006856742 >> v2:172.21.15.115:3300/0 conn(0x7fa5980d27e0 0x7fa5980d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59df97700 1 -- 172.21.15.87:0/3006856742 >> 172.21.15.87:0/3006856742 conn(0x7fa5980b53f0 msgr2=0x7fa5980cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:44.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59df97700 1 -- 172.21.15.87:0/3006856742 shutdown_connections 2023-03-30T08:11:44.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.616+0000 7fa59df97700 1 -- 172.21.15.87:0/3006856742 wait complete. 2023-03-30T08:11:44.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.620+0000 7fa59df97700 1 Processor -- start 2023-03-30T08:11:44.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.620+0000 7fa59df97700 1 -- start start 2023-03-30T08:11:44.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa59df97700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa59806a3e0 0x7fa5980c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa59df97700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5980b8380 0x7fa5980c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa59df97700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5981f19c0 0x7fa59815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa59df97700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5981f1e50 con 0x7fa5980b8380 2023-03-30T08:11:44.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa59df97700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5981f2130 con 0x7fa59806a3e0 2023-03-30T08:11:44.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa59df97700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5981f2410 con 0x7fa5981f19c0 2023-03-30T08:11:44.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa597fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5980b8380 0x7fa5980c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa597fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5980b8380 0x7fa5980c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55860/0 (socket says 172.21.15.87:55860) 2023-03-30T08:11:44.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa597fff700 1 -- 172.21.15.87:0/46298365 learned_addr learned my addr 172.21.15.87:0/46298365 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:44.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa59d796700 1 --2- 172.21.15.87:0/46298365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5981f19c0 0x7fa59815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa59cf95700 1 --2- 172.21.15.87:0/46298365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa59806a3e0 0x7fa5980c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa597fff700 1 -- 172.21.15.87:0/46298365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5981f19c0 msgr2=0x7fa59815ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa597fff700 1 --2- 172.21.15.87:0/46298365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5981f19c0 0x7fa59815ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa597fff700 1 -- 172.21.15.87:0/46298365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa59806a3e0 msgr2=0x7fa5980c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa597fff700 1 --2- 172.21.15.87:0/46298365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa59806a3e0 0x7fa5980c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa597fff700 1 -- 172.21.15.87:0/46298365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa590009b30 con 0x7fa5980b8380 2023-03-30T08:11:44.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa597fff700 1 --2- 172.21.15.87:0/46298365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5980b8380 0x7fa5980c8f10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa58400d7d0 tx=0x7fa58400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:44.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa5957fa700 1 -- 172.21.15.87:0/46298365 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa584017070 con 0x7fa5980b8380 2023-03-30T08:11:44.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa5957fa700 1 -- 172.21.15.87:0/46298365 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa584004020 con 0x7fa5980b8380 2023-03-30T08:11:44.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa59df97700 1 -- 172.21.15.87:0/46298365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5980cf480 con 0x7fa5980b8380 2023-03-30T08:11:44.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa5957fa700 1 -- 172.21.15.87:0/46298365 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5840041b0 con 0x7fa5980b8380 2023-03-30T08:11:44.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.624+0000 7fa59df97700 1 -- 172.21.15.87:0/46298365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5980cf1a0 con 0x7fa5980b8380 2023-03-30T08:11:44.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.628+0000 7fa59df97700 1 -- 172.21.15.87:0/46298365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5980b8750 con 0x7fa5980b8380 2023-03-30T08:11:44.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.628+0000 7fa5957fa700 1 -- 172.21.15.87:0/46298365 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa584004310 con 0x7fa5980b8380 2023-03-30T08:11:44.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.632+0000 7fa5957fa700 1 --2- 172.21.15.87:0/46298365 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa57c065420 0x7fa57c0678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.632+0000 7fa5957fa700 1 -- 172.21.15.87:0/46298365 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa584082490 con 0x7fa5980b8380 2023-03-30T08:11:44.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.632+0000 7fa59cf95700 1 --2- 172.21.15.87:0/46298365 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa57c065420 0x7fa57c0678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.632+0000 7fa59cf95700 1 --2- 172.21.15.87:0/46298365 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa57c065420 0x7fa57c0678d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa58c005150 tx=0x7fa58c007ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:44.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.636+0000 7fa5957fa700 1 -- 172.21.15.87:0/46298365 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fa58404fe70 con 0x7fa5980b8380 2023-03-30T08:11:44.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.804+0000 7fa59df97700 1 -- 172.21.15.87:0/46298365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa598072cf0 con 0x7fa5980b8380 2023-03-30T08:11:44.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.804+0000 7fa5957fa700 1 -- 172.21.15.87:0/46298365 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa584053490 con 0x7fa5980b8380 2023-03-30T08:11:44.809 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-03-30T08:11:44.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.808+0000 7fa59df97700 1 -- 172.21.15.87:0/46298365 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa57c065420 msgr2=0x7fa57c0678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.808+0000 7fa59df97700 1 --2- 172.21.15.87:0/46298365 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa57c065420 0x7fa57c0678d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa58c005150 tx=0x7fa58c007ee0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.808+0000 7fa59df97700 1 -- 172.21.15.87:0/46298365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5980b8380 msgr2=0x7fa5980c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.808+0000 7fa59df97700 1 --2- 172.21.15.87:0/46298365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5980b8380 0x7fa5980c8f10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa58400d7d0 tx=0x7fa58400dae0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.808+0000 7fa59df97700 1 -- 172.21.15.87:0/46298365 shutdown_connections 2023-03-30T08:11:44.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.808+0000 7fa59df97700 1 --2- 172.21.15.87:0/46298365 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa57c065420 0x7fa57c0678d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.808+0000 7fa59df97700 1 --2- 172.21.15.87:0/46298365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5981f19c0 0x7fa59815ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.808+0000 7fa59df97700 1 --2- 172.21.15.87:0/46298365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa5980b8380 0x7fa5980c8f10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.808+0000 7fa59df97700 1 --2- 172.21.15.87:0/46298365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa59806a3e0 0x7fa5980c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.808+0000 7fa59df97700 1 -- 172.21.15.87:0/46298365 >> 172.21.15.87:0/46298365 conn(0x7fa5980b53f0 msgr2=0x7fa5980d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:44.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.808+0000 7fa59df97700 1 -- 172.21.15.87:0/46298365 shutdown_connections 2023-03-30T08:11:44.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.808+0000 7fa59df97700 1 -- 172.21.15.87:0/46298365 wait complete. 2023-03-30T08:11:44.831 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-30T08:11:44.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.980+0000 7f6a4d901700 1 Processor -- start 2023-03-30T08:11:44.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.980+0000 7f6a4d901700 1 -- start start 2023-03-30T08:11:44.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.980+0000 7f6a4d901700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a480b8380 0x7f6a480d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.980+0000 7f6a4d901700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6a4806a3e0 0x7f6a480d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.980+0000 7f6a4d901700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a48160ef0 con 0x7f6a480d27e0 2023-03-30T08:11:44.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.980+0000 7f6a4d901700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a480cd6a0 con 0x7f6a4806a3e0 2023-03-30T08:11:44.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.980+0000 7f6a4d901700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a480cd3a0 con 0x7f6a480b8380 2023-03-30T08:11:44.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.980+0000 7f6a46ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a480b8380 0x7f6a480d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a477fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6a4806a3e0 0x7f6a480d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a46ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a480b8380 0x7f6a480d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:53966/0 (socket says 172.21.15.87:53966) 2023-03-30T08:11:44.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a46ffd700 1 -- 172.21.15.87:0/3004847090 learned_addr learned my addr 172.21.15.87:0/3004847090 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:44.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a477fe700 1 -- 172.21.15.87:0/3004847090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a480b8380 msgr2=0x7f6a480d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:44.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a477fe700 1 --2- 172.21.15.87:0/3004847090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a480b8380 0x7f6a480d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a477fe700 1 -- 172.21.15.87:0/3004847090 >> v1:172.21.15.115:6789/0 conn(0x7f6a480d27e0 legacy=0x7f6a48069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a477fe700 1 -- 172.21.15.87:0/3004847090 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a480cef00 con 0x7f6a4806a3e0 2023-03-30T08:11:44.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a477fe700 1 --2- 172.21.15.87:0/3004847090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a4806a3e0 0x7f6a480d0880 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009d90 tx=0x7f6a4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4763e3dc407ac16b server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:44.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a45ffb700 1 -- 172.21.15.87:0/3004847090 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000e070 con 0x7f6a4806a3e0 2023-03-30T08:11:44.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a45ffb700 1 -- 172.21.15.87:0/3004847090 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4000bb20 con 0x7f6a4806a3e0 2023-03-30T08:11:44.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a45ffb700 1 -- 172.21.15.87:0/3004847090 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40012430 con 0x7f6a4806a3e0 2023-03-30T08:11:44.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a4d901700 1 -- 172.21.15.87:0/3004847090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a4806a3e0 msgr2=0x7f6a480d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a4d901700 1 --2- 172.21.15.87:0/3004847090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a4806a3e0 0x7f6a480d0880 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009d90 tx=0x7f6a4000b330 comp rx=0 tx=0).stop 2023-03-30T08:11:44.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a4d901700 1 -- 172.21.15.87:0/3004847090 shutdown_connections 2023-03-30T08:11:44.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a4d901700 1 --2- 172.21.15.87:0/3004847090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a4806a3e0 0x7f6a480d0880 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a4d901700 1 --2- 172.21.15.87:0/3004847090 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a480b8380 0x7f6a480d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a4d901700 1 -- 172.21.15.87:0/3004847090 >> 172.21.15.87:0/3004847090 conn(0x7f6a480b53f0 msgr2=0x7f6a480cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:44.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a4d901700 1 -- 172.21.15.87:0/3004847090 shutdown_connections 2023-03-30T08:11:44.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.984+0000 7f6a4d901700 1 -- 172.21.15.87:0/3004847090 wait complete. 2023-03-30T08:11:44.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.988+0000 7f6a4d901700 1 Processor -- start 2023-03-30T08:11:44.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.988+0000 7f6a4d901700 1 -- start start 2023-03-30T08:11:44.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a4d901700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a4806a3e0 0x7f6a480c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a4d901700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a480b8380 0x7f6a481f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a4d901700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a481f2410 0x7f6a48158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:44.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a4d901700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a481f2e70 con 0x7f6a481f2410 2023-03-30T08:11:44.997 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a4d901700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a480c94e0 con 0x7f6a4806a3e0 2023-03-30T08:11:44.997 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a4d901700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a481f4c70 con 0x7f6a480b8380 2023-03-30T08:11:44.997 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a477fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a481f2410 0x7f6a48158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a477fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a481f2410 0x7f6a48158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55862/0 (socket says 172.21.15.87:55862) 2023-03-30T08:11:44.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a477fe700 1 -- 172.21.15.87:0/2308646630 learned_addr learned my addr 172.21.15.87:0/2308646630 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:44.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a46ffd700 1 --2- 172.21.15.87:0/2308646630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a4806a3e0 0x7f6a480c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a467fc700 1 --2- 172.21.15.87:0/2308646630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a480b8380 0x7f6a481f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:44.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a477fe700 1 -- 172.21.15.87:0/2308646630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a480b8380 msgr2=0x7f6a481f1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a477fe700 1 --2- 172.21.15.87:0/2308646630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a480b8380 0x7f6a481f1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a477fe700 1 -- 172.21.15.87:0/2308646630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a4806a3e0 msgr2=0x7f6a480c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:44.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a477fe700 1 --2- 172.21.15.87:0/2308646630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a4806a3e0 0x7f6a480c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:44.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a477fe700 1 -- 172.21.15.87:0/2308646630 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a40009a70 con 0x7f6a481f2410 2023-03-30T08:11:44.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a477fe700 1 --2- 172.21.15.87:0/2308646630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a481f2410 0x7f6a48158ce0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6a40013000 tx=0x7f6a40004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:44.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a2ffff700 1 -- 172.21.15.87:0/2308646630 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40012430 con 0x7f6a481f2410 2023-03-30T08:11:45.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a2ffff700 1 -- 172.21.15.87:0/2308646630 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a40020070 con 0x7f6a481f2410 2023-03-30T08:11:45.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a4d901700 1 -- 172.21.15.87:0/2308646630 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a480cf480 con 0x7f6a481f2410 2023-03-30T08:11:45.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a2ffff700 1 -- 172.21.15.87:0/2308646630 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40004040 con 0x7f6a481f2410 2023-03-30T08:11:45.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.992+0000 7f6a4d901700 1 -- 172.21.15.87:0/2308646630 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a480cf1a0 con 0x7f6a481f2410 2023-03-30T08:11:45.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.996+0000 7f6a4d901700 1 -- 172.21.15.87:0/2308646630 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a480b8750 con 0x7f6a481f2410 2023-03-30T08:11:45.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:44.996+0000 7f6a2ffff700 1 -- 172.21.15.87:0/2308646630 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6a400041a0 con 0x7f6a481f2410 2023-03-30T08:11:45.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.000+0000 7f6a2ffff700 1 --2- 172.21.15.87:0/2308646630 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6a340653f0 0x7f6a340678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:45.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.000+0000 7f6a2ffff700 1 -- 172.21.15.87:0/2308646630 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6a40022070 con 0x7f6a481f2410 2023-03-30T08:11:45.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.000+0000 7f6a46ffd700 1 --2- 172.21.15.87:0/2308646630 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6a340653f0 0x7f6a340678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:45.005 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.000+0000 7f6a46ffd700 1 --2- 172.21.15.87:0/2308646630 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6a340653f0 0x7f6a340678a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6a4806a3b0 tx=0x7f6a380092e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:45.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.004+0000 7f6a2ffff700 1 -- 172.21.15.87:0/2308646630 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f6a40052290 con 0x7f6a481f2410 2023-03-30T08:11:45.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.180+0000 7f6a4d901700 1 -- 172.21.15.87:0/2308646630 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6a48072cf0 con 0x7f6a481f2410 2023-03-30T08:11:45.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.180+0000 7f6a2ffff700 1 -- 172.21.15.87:0/2308646630 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6a400558b0 con 0x7f6a481f2410 2023-03-30T08:11:45.186 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:45.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.184+0000 7f6a4d901700 1 -- 172.21.15.87:0/2308646630 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6a340653f0 msgr2=0x7f6a340678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:45.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.184+0000 7f6a4d901700 1 --2- 172.21.15.87:0/2308646630 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6a340653f0 0x7f6a340678a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6a4806a3b0 tx=0x7f6a380092e0 comp rx=0 tx=0).stop 2023-03-30T08:11:45.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.184+0000 7f6a4d901700 1 -- 172.21.15.87:0/2308646630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a481f2410 msgr2=0x7f6a48158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:45.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.184+0000 7f6a4d901700 1 --2- 172.21.15.87:0/2308646630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a481f2410 0x7f6a48158ce0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6a40013000 tx=0x7f6a40004af0 comp rx=0 tx=0).stop 2023-03-30T08:11:45.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.184+0000 7f6a4d901700 1 -- 172.21.15.87:0/2308646630 shutdown_connections 2023-03-30T08:11:45.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.184+0000 7f6a4d901700 1 --2- 172.21.15.87:0/2308646630 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f6a340653f0 0x7f6a340678a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:45.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.184+0000 7f6a4d901700 1 --2- 172.21.15.87:0/2308646630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6a481f2410 0x7f6a48158ce0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:45.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.184+0000 7f6a4d901700 1 --2- 172.21.15.87:0/2308646630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6a480b8380 0x7f6a481f1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:45.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.184+0000 7f6a4d901700 1 --2- 172.21.15.87:0/2308646630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a4806a3e0 0x7f6a480c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:45.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.184+0000 7f6a4d901700 1 -- 172.21.15.87:0/2308646630 >> 172.21.15.87:0/2308646630 conn(0x7f6a480b53f0 msgr2=0x7f6a480cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:45.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.184+0000 7f6a4d901700 1 -- 172.21.15.87:0/2308646630 shutdown_connections 2023-03-30T08:11:45.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.184+0000 7f6a4d901700 1 -- 172.21.15.87:0/2308646630 wait complete. 2023-03-30T08:11:45.256 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-03-30T08:11:45.257 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-03-30T08:11:45.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.416+0000 7f35a240f700 1 Processor -- start 2023-03-30T08:11:45.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.416+0000 7f35a240f700 1 -- start start 2023-03-30T08:11:45.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.416+0000 7f35a240f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f359c164190 0x7f359c0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:45.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.416+0000 7f35a240f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f359c0aea30 0x7f359c06a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:45.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.416+0000 7f35a240f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c069f00 con 0x7f359c163dc0 2023-03-30T08:11:45.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.416+0000 7f35a240f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c06d810 con 0x7f359c164190 2023-03-30T08:11:45.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.416+0000 7f35a240f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0cc1d0 con 0x7f359c0aea30 2023-03-30T08:11:45.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f35a0c0c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f359c164190 0x7f359c0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:45.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f35a140d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f359c163dc0 0x7f359c0c95c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59844/0 (socket says 172.21.15.87:59844) 2023-03-30T08:11:45.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f35a140d700 1 -- 172.21.15.87:0/1831233063 learned_addr learned my addr 172.21.15.87:0/1831233063 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:45.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f35a1c0e700 1 --2- 172.21.15.87:0/1831233063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f359c0aea30 0x7f359c06a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:45.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f3593fff700 1 -- 172.21.15.87:0/1831233063 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629109631 0 0) 0x7f359c069f00 con 0x7f359c163dc0 2023-03-30T08:11:45.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f3593fff700 1 -- 172.21.15.87:0/1831233063 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35880035d0 con 0x7f359c163dc0 2023-03-30T08:11:45.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f35a0c0c700 1 -- 172.21.15.87:0/1831233063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f359c0aea30 msgr2=0x7f359c06a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:45.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f35a0c0c700 1 --2- 172.21.15.87:0/1831233063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f359c0aea30 0x7f359c06a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:45.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f35a0c0c700 1 -- 172.21.15.87:0/1831233063 >> v1:172.21.15.87:6789/0 conn(0x7f359c163dc0 legacy=0x7f359c0c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:45.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f35a0c0c700 1 -- 172.21.15.87:0/1831233063 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c06cf70 con 0x7f359c164190 2023-03-30T08:11:45.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f35a0c0c700 1 --2- 172.21.15.87:0/1831233063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359c164190 0x7f359c0c9cd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f358c009850 tx=0x7f358c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b79843afff54a server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:45.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f3593fff700 1 -- 172.21.15.87:0/1831233063 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c011830 con 0x7f359c164190 2023-03-30T08:11:45.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f3593fff700 1 -- 172.21.15.87:0/1831233063 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c011990 con 0x7f359c164190 2023-03-30T08:11:45.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f3593fff700 1 -- 172.21.15.87:0/1831233063 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c011d40 con 0x7f359c164190 2023-03-30T08:11:45.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f35a240f700 1 -- 172.21.15.87:0/1831233063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359c164190 msgr2=0x7f359c0c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f35a240f700 1 --2- 172.21.15.87:0/1831233063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359c164190 0x7f359c0c9cd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f358c009850 tx=0x7f358c009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f35a240f700 1 -- 172.21.15.87:0/1831233063 shutdown_connections 2023-03-30T08:11:45.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f35a240f700 1 --2- 172.21.15.87:0/1831233063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f359c0aea30 0x7f359c06a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:45.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f35a240f700 1 --2- 172.21.15.87:0/1831233063 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359c164190 0x7f359c0c9cd0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:45.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.420+0000 7f35a240f700 1 -- 172.21.15.87:0/1831233063 >> 172.21.15.87:0/1831233063 conn(0x7f359c0cf410 msgr2=0x7f359c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:45.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.424+0000 7f35a240f700 1 -- 172.21.15.87:0/1831233063 shutdown_connections 2023-03-30T08:11:45.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.424+0000 7f35a240f700 1 -- 172.21.15.87:0/1831233063 wait complete. 2023-03-30T08:11:45.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.424+0000 7f35a240f700 1 Processor -- start 2023-03-30T08:11:45.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.424+0000 7f35a240f700 1 -- start start 2023-03-30T08:11:45.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.424+0000 7f35a240f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f359c0aea30 0x7f359c15c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:45.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.424+0000 7f35a240f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359c163dc0 0x7f359c0c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:45.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.424+0000 7f35a240f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f359c164190 0x7f359c0c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:45.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.424+0000 7f35a240f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c154750 con 0x7f359c163dc0 2023-03-30T08:11:45.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.424+0000 7f35a240f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0c2010 con 0x7f359c0aea30 2023-03-30T08:11:45.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.424+0000 7f35a240f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0c22b0 con 0x7f359c164190 2023-03-30T08:11:45.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f35a0c0c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359c163dc0 0x7f359c0c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:45.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f35a0c0c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359c163dc0 0x7f359c0c2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55876/0 (socket says 172.21.15.87:55876) 2023-03-30T08:11:45.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f35a0c0c700 1 -- 172.21.15.87:0/56391548 learned_addr learned my addr 172.21.15.87:0/56391548 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:45.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f35a140d700 1 --2- 172.21.15.87:0/56391548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f359c0aea30 0x7f359c15c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:45.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f35a1c0e700 1 --2- 172.21.15.87:0/56391548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f359c164190 0x7f359c0c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:45.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f35a0c0c700 1 -- 172.21.15.87:0/56391548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f359c164190 msgr2=0x7f359c0c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:45.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f35a0c0c700 1 --2- 172.21.15.87:0/56391548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f359c164190 0x7f359c0c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:45.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f35a0c0c700 1 -- 172.21.15.87:0/56391548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f359c0aea30 msgr2=0x7f359c15c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:45.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f35a0c0c700 1 --2- 172.21.15.87:0/56391548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f359c0aea30 0x7f359c15c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:45.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f35a0c0c700 1 -- 172.21.15.87:0/56391548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c0094b0 con 0x7f359c163dc0 2023-03-30T08:11:45.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f35a0c0c700 1 --2- 172.21.15.87:0/56391548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359c163dc0 0x7f359c0c2d90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f358c0090b0 tx=0x7f358c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:45.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f3591ffb700 1 -- 172.21.15.87:0/56391548 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c004480 con 0x7f359c163dc0 2023-03-30T08:11:45.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f3591ffb700 1 -- 172.21.15.87:0/56391548 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c01f070 con 0x7f359c163dc0 2023-03-30T08:11:45.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f35a240f700 1 -- 172.21.15.87:0/56391548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c06d530 con 0x7f359c163dc0 2023-03-30T08:11:45.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f3591ffb700 1 -- 172.21.15.87:0/56391548 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c003900 con 0x7f359c163dc0 2023-03-30T08:11:45.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f35a240f700 1 -- 172.21.15.87:0/56391548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c06d250 con 0x7f359c163dc0 2023-03-30T08:11:45.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.428+0000 7f35a240f700 1 -- 172.21.15.87:0/56391548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c06cc40 con 0x7f359c163dc0 2023-03-30T08:11:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.432+0000 7f3591ffb700 1 -- 172.21.15.87:0/56391548 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f358c021030 con 0x7f359c163dc0 2023-03-30T08:11:45.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.432+0000 7f3591ffb700 1 --2- 172.21.15.87:0/56391548 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f35800653f0 0x7f35800678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:45.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.432+0000 7f3591ffb700 1 -- 172.21.15.87:0/56391548 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f358c083f50 con 0x7f359c163dc0 2023-03-30T08:11:45.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.432+0000 7f35a140d700 1 --2- 172.21.15.87:0/56391548 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f35800653f0 0x7f35800678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:45.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.432+0000 7f35a140d700 1 --2- 172.21.15.87:0/56391548 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f35800653f0 0x7f35800678a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3598001560 tx=0x7f3598009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:45.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.440+0000 7f3591ffb700 1 -- 172.21.15.87:0/56391548 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f358c051890 con 0x7f359c163dc0 2023-03-30T08:11:45.674 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:45.668+0000 7f35a240f700 1 -- 172.21.15.87:0/56391548 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f359c0733a0 con 0x7f359c163dc0 2023-03-30T08:11:46.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.224+0000 7f3591ffb700 1 -- 172.21.15.87:0/56391548 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v66) v1 ==== 147+0+0 (secure 0 0 0) 0x7f358c006ce0 con 0x7f359c163dc0 2023-03-30T08:11:46.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.228+0000 7f35a240f700 1 -- 172.21.15.87:0/56391548 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f35800653f0 msgr2=0x7f35800678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:46.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.228+0000 7f35a240f700 1 --2- 172.21.15.87:0/56391548 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f35800653f0 0x7f35800678a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3598001560 tx=0x7f3598009040 comp rx=0 tx=0).stop 2023-03-30T08:11:46.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.228+0000 7f35a240f700 1 -- 172.21.15.87:0/56391548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359c163dc0 msgr2=0x7f359c0c2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:46.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.228+0000 7f35a240f700 1 --2- 172.21.15.87:0/56391548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359c163dc0 0x7f359c0c2d90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f358c0090b0 tx=0x7f358c004770 comp rx=0 tx=0).stop 2023-03-30T08:11:46.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.228+0000 7f35a240f700 1 -- 172.21.15.87:0/56391548 shutdown_connections 2023-03-30T08:11:46.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.228+0000 7f35a240f700 1 --2- 172.21.15.87:0/56391548 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f35800653f0 0x7f35800678a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:46.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.228+0000 7f35a240f700 1 --2- 172.21.15.87:0/56391548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f359c164190 0x7f359c0c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:46.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.228+0000 7f35a240f700 1 --2- 172.21.15.87:0/56391548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f359c163dc0 0x7f359c0c2d90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:46.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.228+0000 7f35a240f700 1 --2- 172.21.15.87:0/56391548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f359c0aea30 0x7f359c15c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:46.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.228+0000 7f35a240f700 1 -- 172.21.15.87:0/56391548 >> 172.21.15.87:0/56391548 conn(0x7f359c0cf410 msgr2=0x7f359c0c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:46.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.228+0000 7f35a240f700 1 -- 172.21.15.87:0/56391548 shutdown_connections 2023-03-30T08:11:46.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.228+0000 7f35a240f700 1 -- 172.21.15.87:0/56391548 wait complete. 2023-03-30T08:11:46.255 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-03-30T08:11:46.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.416+0000 7fdae5676700 1 Processor -- start 2023-03-30T08:11:46.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.416+0000 7fdae5676700 1 -- start start 2023-03-30T08:11:46.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.416+0000 7fdae5676700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdae0164190 0x7fdae00c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:46.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.416+0000 7fdae5676700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae00aea30 0x7fdae006a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:46.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.416+0000 7fdae5676700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae0069f00 con 0x7fdae0163dc0 2023-03-30T08:11:46.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.416+0000 7fdae5676700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae006d810 con 0x7fdae0164190 2023-03-30T08:11:46.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.416+0000 7fdae5676700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00cc1d0 con 0x7fdae00aea30 2023-03-30T08:11:46.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.416+0000 7fdadffff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fdae0163dc0 0x7fdae00c95c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59858/0 (socket says 172.21.15.87:59858) 2023-03-30T08:11:46.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdadffff700 1 -- 172.21.15.87:0/3622813624 learned_addr learned my addr 172.21.15.87:0/3622813624 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:46.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdae4e75700 1 --2- 172.21.15.87:0/3622813624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae00aea30 0x7fdae006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:46.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdadf7fe700 1 --2- 172.21.15.87:0/3622813624 >> v2:172.21.15.115:3300/0 conn(0x7fdae0164190 0x7fdae00c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:46.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdadf7fe700 1 -- 172.21.15.87:0/3622813624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae00aea30 msgr2=0x7fdae006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:46.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdadf7fe700 1 --2- 172.21.15.87:0/3622813624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae00aea30 0x7fdae006a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:46.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdadf7fe700 1 -- 172.21.15.87:0/3622813624 >> v1:172.21.15.87:6789/0 conn(0x7fdae0163dc0 legacy=0x7fdae00c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:46.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdadf7fe700 1 -- 172.21.15.87:0/3622813624 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae006cf70 con 0x7fdae0164190 2023-03-30T08:11:46.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdadeffd700 1 -- 172.21.15.87:0/3622813624 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456199283 0 0) 0x7fdae0069f00 con 0x7fdae0163dc0 2023-03-30T08:11:46.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdadf7fe700 1 --2- 172.21.15.87:0/3622813624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdae0164190 0x7fdae00c9cd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009850 tx=0x7fdad4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ff160be2049901d server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:46.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdadeffd700 1 -- 172.21.15.87:0/3622813624 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4011830 con 0x7fdae0164190 2023-03-30T08:11:46.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdadeffd700 1 -- 172.21.15.87:0/3622813624 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad4011990 con 0x7fdae0164190 2023-03-30T08:11:46.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdadeffd700 1 -- 172.21.15.87:0/3622813624 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4011d40 con 0x7fdae0164190 2023-03-30T08:11:46.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdae5676700 1 -- 172.21.15.87:0/3622813624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdae0164190 msgr2=0x7fdae00c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:46.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdae5676700 1 --2- 172.21.15.87:0/3622813624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdae0164190 0x7fdae00c9cd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009850 tx=0x7fdad4009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:46.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdae5676700 1 -- 172.21.15.87:0/3622813624 shutdown_connections 2023-03-30T08:11:46.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdae5676700 1 --2- 172.21.15.87:0/3622813624 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae00aea30 0x7fdae006a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:46.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdae5676700 1 --2- 172.21.15.87:0/3622813624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdae0164190 0x7fdae00c9cd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:46.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdae5676700 1 -- 172.21.15.87:0/3622813624 >> 172.21.15.87:0/3622813624 conn(0x7fdae00cf410 msgr2=0x7fdae00cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:46.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdae5676700 1 -- 172.21.15.87:0/3622813624 shutdown_connections 2023-03-30T08:11:46.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.420+0000 7fdae5676700 1 -- 172.21.15.87:0/3622813624 wait complete. 2023-03-30T08:11:46.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.424+0000 7fdae5676700 1 Processor -- start 2023-03-30T08:11:46.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.424+0000 7fdae5676700 1 -- start start 2023-03-30T08:11:46.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.424+0000 7fdae5676700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdae00aea30 0x7fdae015a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:46.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.424+0000 7fdae5676700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdae0163dc0 0x7fdae0158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:46.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.424+0000 7fdae5676700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae0164190 0x7fdae015c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:46.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdae5676700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae015a390 con 0x7fdae00aea30 2023-03-30T08:11:46.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdae5676700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae01597b0 con 0x7fdae0163dc0 2023-03-30T08:11:46.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdae5676700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae0159a60 con 0x7fdae0164190 2023-03-30T08:11:46.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdadffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdae00aea30 0x7fdae015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdadffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdae00aea30 0x7fdae015a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55886/0 (socket says 172.21.15.87:55886) 2023-03-30T08:11:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdadffff700 1 -- 172.21.15.87:0/2981305369 learned_addr learned my addr 172.21.15.87:0/2981305369 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdadf7fe700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdae0163dc0 0x7fdae0158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdadffff700 1 -- 172.21.15.87:0/2981305369 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae0164190 msgr2=0x7fdae015c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdae4e75700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae0164190 0x7fdae015c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdadffff700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae0164190 0x7fdae015c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:46.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdadffff700 1 -- 172.21.15.87:0/2981305369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdae0163dc0 msgr2=0x7fdae0158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdadffff700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdae0163dc0 0x7fdae0158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdadffff700 1 -- 172.21.15.87:0/2981305369 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40094b0 con 0x7fdae00aea30 2023-03-30T08:11:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdadf7fe700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdae0163dc0 0x7fdae0158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdae4e75700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae0164190 0x7fdae015c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdadffff700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdae00aea30 0x7fdae015a820 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdad000c580 tx=0x7fdad000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdadcff9700 1 -- 172.21.15.87:0/2981305369 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad0004ca0 con 0x7fdae00aea30 2023-03-30T08:11:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdadcff9700 1 -- 172.21.15.87:0/2981305369 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad0004e20 con 0x7fdae00aea30 2023-03-30T08:11:46.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdae5676700 1 -- 172.21.15.87:0/2981305369 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae006d530 con 0x7fdae00aea30 2023-03-30T08:11:46.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdadcff9700 1 -- 172.21.15.87:0/2981305369 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad0007310 con 0x7fdae00aea30 2023-03-30T08:11:46.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdae5676700 1 -- 172.21.15.87:0/2981305369 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae006d250 con 0x7fdae00aea30 2023-03-30T08:11:46.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.428+0000 7fdae5676700 1 -- 172.21.15.87:0/2981305369 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae006cc40 con 0x7fdae00aea30 2023-03-30T08:11:46.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.432+0000 7fdadcff9700 1 -- 172.21.15.87:0/2981305369 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fdad0007470 con 0x7fdae00aea30 2023-03-30T08:11:46.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.432+0000 7fdadcff9700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdacc0653f0 0x7fdacc0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:46.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.432+0000 7fdadcff9700 1 -- 172.21.15.87:0/2981305369 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdad0082980 con 0x7fdae00aea30 2023-03-30T08:11:46.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.432+0000 7fdadf7fe700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdacc0653f0 0x7fdacc0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:46.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.432+0000 7fdadf7fe700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdacc0653f0 0x7fdacc0678a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdae0164560 tx=0x7fdad4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:46.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.436+0000 7fdadcff9700 1 -- 172.21.15.87:0/2981305369 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fdad00502c0 con 0x7fdae00aea30 2023-03-30T08:11:46.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.608+0000 7fdae5676700 1 -- 172.21.15.87:0/2981305369 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdae00733a0 con 0x7fdae00aea30 2023-03-30T08:11:46.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.616+0000 7fdadcff9700 1 -- 172.21.15.87:0/2981305369 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdad0007720 con 0x7fdae00aea30 2023-03-30T08:11:46.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.620+0000 7fdae5676700 1 -- 172.21.15.87:0/2981305369 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdacc0653f0 msgr2=0x7fdacc0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:46.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.620+0000 7fdae5676700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdacc0653f0 0x7fdacc0678a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdae0164560 tx=0x7fdad4008030 comp rx=0 tx=0).stop 2023-03-30T08:11:46.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.620+0000 7fdae5676700 1 -- 172.21.15.87:0/2981305369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdae00aea30 msgr2=0x7fdae015a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:46.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.620+0000 7fdae5676700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdae00aea30 0x7fdae015a820 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdad000c580 tx=0x7fdad000c940 comp rx=0 tx=0).stop 2023-03-30T08:11:46.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.620+0000 7fdae5676700 1 -- 172.21.15.87:0/2981305369 shutdown_connections 2023-03-30T08:11:46.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.620+0000 7fdae5676700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdacc0653f0 0x7fdacc0678a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:46.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.620+0000 7fdae5676700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdae0164190 0x7fdae015c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:46.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.620+0000 7fdae5676700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdae0163dc0 0x7fdae0158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:46.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.620+0000 7fdae5676700 1 --2- 172.21.15.87:0/2981305369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdae00aea30 0x7fdae015a820 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:46.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.620+0000 7fdae5676700 1 -- 172.21.15.87:0/2981305369 >> 172.21.15.87:0/2981305369 conn(0x7fdae00cf410 msgr2=0x7fdae00b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:46.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.620+0000 7fdae5676700 1 -- 172.21.15.87:0/2981305369 shutdown_connections 2023-03-30T08:11:46.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:46.620+0000 7fdae5676700 1 -- 172.21.15.87:0/2981305369 wait complete. 2023-03-30T08:11:46.643 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-03-30T08:11:46.644 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-30T08:11:46.681 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-30T08:11:46.720 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-03-30T08:11:46.721 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:11:46.721 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:46.737 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:11:46.737 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:46.797 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:11:46.798 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:46.858 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:47.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.060+0000 7f2347098700 1 Processor -- start 2023-03-30T08:11:47.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.064+0000 7f2347098700 1 -- start start 2023-03-30T08:11:47.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.064+0000 7f2347098700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2340164190 0x7f23400c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.064+0000 7f2347098700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2340069f00 con 0x7f2340163dc0 2023-03-30T08:11:47.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.064+0000 7f2347098700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234006cf70 con 0x7f23400aea30 2023-03-30T08:11:47.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.064+0000 7f2347098700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234006d810 con 0x7f2340164190 2023-03-30T08:11:47.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.064+0000 7f2346096700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2340163dc0 0x7f23400c95c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59872/0 (socket says 172.21.15.87:59872) 2023-03-30T08:11:47.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.064+0000 7f2346096700 1 -- 172.21.15.87:0/1035995831 learned_addr learned my addr 172.21.15.87:0/1035995831 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:47.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.064+0000 7f2345895700 1 --2- 172.21.15.87:0/1035995831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2340164190 0x7f23400c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 -- 172.21.15.87:0/1035995831 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145542992 0 0) 0x7f2340069f00 con 0x7f2340163dc0 2023-03-30T08:11:47.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 -- 172.21.15.87:0/1035995831 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f232c0035d0 con 0x7f2340163dc0 2023-03-30T08:11:47.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 -- 172.21.15.87:0/1035995831 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2607191290 0 0) 0x7f232c0035d0 con 0x7f2340163dc0 2023-03-30T08:11:47.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 -- 172.21.15.87:0/1035995831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2340164190 msgr2=0x7f23400c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:47.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 --2- 172.21.15.87:0/1035995831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2340164190 0x7f23400c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 -- 172.21.15.87:0/1035995831 >> v1:172.21.15.115:6789/0 conn(0x7f23400aea30 legacy=0x7f234006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 -- 172.21.15.87:0/1035995831 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234006d250 con 0x7f2340163dc0 2023-03-30T08:11:47.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 -- 172.21.15.87:0/1035995831 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f233c001670 con 0x7f2340163dc0 2023-03-30T08:11:47.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 -- 172.21.15.87:0/1035995831 >> v1:172.21.15.87:6789/0 conn(0x7f2340163dc0 legacy=0x7f23400c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 --2- 172.21.15.87:0/1035995831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f232c003a50 0x7f232c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 --2- 172.21.15.87:0/1035995831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2340164190 0x7f232c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 --2- 172.21.15.87:0/1035995831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f232c004db0 0x7f232c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 -- 172.21.15.87:0/1035995831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234006d810 con 0x7f232c003a50 2023-03-30T08:11:47.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 -- 172.21.15.87:0/1035995831 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c00bae0 con 0x7f232c004db0 2023-03-30T08:11:47.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 -- 172.21.15.87:0/1035995831 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c00bc70 con 0x7f2340164190 2023-03-30T08:11:47.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2346096700 1 --2- 172.21.15.87:0/1035995831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f232c003a50 0x7f232c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2346897700 1 --2- 172.21.15.87:0/1035995831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f232c004db0 0x7f232c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345895700 1 --2- 172.21.15.87:0/1035995831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2340164190 0x7f232c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2346096700 1 -- 172.21.15.87:0/1035995831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2340164190 msgr2=0x7f232c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:47.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2346096700 1 --2- 172.21.15.87:0/1035995831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2340164190 0x7f232c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2346096700 1 -- 172.21.15.87:0/1035995831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f232c004db0 msgr2=0x7f232c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:47.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2346096700 1 --2- 172.21.15.87:0/1035995831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f232c004db0 0x7f232c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2346096700 1 -- 172.21.15.87:0/1035995831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c0035d0 con 0x7f232c003a50 2023-03-30T08:11:47.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2346897700 1 --2- 172.21.15.87:0/1035995831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f232c004db0 0x7f232c005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:47.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2346096700 1 --2- 172.21.15.87:0/1035995831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f232c003a50 0x7f232c003e60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f233c00c320 tx=0x7f232c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57312f935f919b2c server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:47.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 -- 172.21.15.87:0/1035995831 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c007c30 con 0x7f232c003a50 2023-03-30T08:11:47.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 -- 172.21.15.87:0/1035995831 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c00ce80 con 0x7f232c003a50 2023-03-30T08:11:47.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2345094700 1 -- 172.21.15.87:0/1035995831 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c005bc0 con 0x7f232c003a50 2023-03-30T08:11:47.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2347098700 1 -- 172.21.15.87:0/1035995831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f232c003a50 msgr2=0x7f232c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2347098700 1 --2- 172.21.15.87:0/1035995831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f232c003a50 0x7f232c003e60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f233c00c320 tx=0x7f232c0058a0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.068+0000 7f2346897700 1 -- 172.21.15.87:0/1035995831 reap_dead start 2023-03-30T08:11:47.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.072+0000 7f2347098700 1 -- 172.21.15.87:0/1035995831 shutdown_connections 2023-03-30T08:11:47.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.072+0000 7f2347098700 1 -- 172.21.15.87:0/1035995831 >> 172.21.15.87:0/1035995831 conn(0x7f23400cf410 msgr2=0x7f23400cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:47.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.072+0000 7f2347098700 1 -- 172.21.15.87:0/1035995831 shutdown_connections 2023-03-30T08:11:47.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.072+0000 7f2347098700 1 -- 172.21.15.87:0/1035995831 wait complete. 2023-03-30T08:11:47.079 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.072+0000 7f2347098700 1 Processor -- start 2023-03-30T08:11:47.079 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.072+0000 7f2347098700 1 -- start start 2023-03-30T08:11:47.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.072+0000 7f2347098700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f232c003a50 0x7f23401fa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.072+0000 7f2347098700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23400c2fc0 0x7f2340153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.072+0000 7f2347098700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2340160830 0x7f23400c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.072+0000 7f2347098700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23400c5dc0 con 0x7f232c003a50 2023-03-30T08:11:47.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.072+0000 7f2347098700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23400c3430 con 0x7f23400c2fc0 2023-03-30T08:11:47.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.072+0000 7f2347098700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23400c36f0 con 0x7f2340160830 2023-03-30T08:11:47.081 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.072+0000 7f2346096700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f232c003a50 0x7f23401fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2346096700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f232c003a50 0x7f23401fa540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55908/0 (socket says 172.21.15.87:55908) 2023-03-30T08:11:47.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2346096700 1 -- 172.21.15.87:0/2403921051 learned_addr learned my addr 172.21.15.87:0/2403921051 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:47.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2345895700 1 --2- 172.21.15.87:0/2403921051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23400c2fc0 0x7f2340153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2346897700 1 --2- 172.21.15.87:0/2403921051 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2340160830 0x7f23400c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2346096700 1 -- 172.21.15.87:0/2403921051 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2340160830 msgr2=0x7f23400c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2346096700 1 --2- 172.21.15.87:0/2403921051 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2340160830 0x7f23400c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2346096700 1 -- 172.21.15.87:0/2403921051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23400c2fc0 msgr2=0x7f2340153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2346096700 1 --2- 172.21.15.87:0/2403921051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23400c2fc0 0x7f2340153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2346096700 1 -- 172.21.15.87:0/2403921051 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234006cc40 con 0x7f232c003a50 2023-03-30T08:11:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2346897700 1 --2- 172.21.15.87:0/2403921051 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2340160830 0x7f23400c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2346096700 1 --2- 172.21.15.87:0/2403921051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f232c003a50 0x7f23401fa540 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f232c0047c0 tx=0x7f233c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2336ffd700 1 -- 172.21.15.87:0/2403921051 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c004ca0 con 0x7f232c003a50 2023-03-30T08:11:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2336ffd700 1 -- 172.21.15.87:0/2403921051 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c004e00 con 0x7f232c003a50 2023-03-30T08:11:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2347098700 1 -- 172.21.15.87:0/2403921051 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234006d530 con 0x7f232c003a50 2023-03-30T08:11:47.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2336ffd700 1 -- 172.21.15.87:0/2403921051 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c007310 con 0x7f232c003a50 2023-03-30T08:11:47.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2347098700 1 -- 172.21.15.87:0/2403921051 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23400c1530 con 0x7f232c003a50 2023-03-30T08:11:47.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.076+0000 7f2347098700 1 -- 172.21.15.87:0/2403921051 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23400733a0 con 0x7f232c003a50 2023-03-30T08:11:47.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.080+0000 7f2336ffd700 1 -- 172.21.15.87:0/2403921051 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f233c007470 con 0x7f232c003a50 2023-03-30T08:11:47.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.080+0000 7f2336ffd700 1 --2- 172.21.15.87:0/2403921051 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f23240653f0 0x7f23240678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.080+0000 7f2336ffd700 1 -- 172.21.15.87:0/2403921051 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f233c083d70 con 0x7f232c003a50 2023-03-30T08:11:47.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.080+0000 7f2345895700 1 --2- 172.21.15.87:0/2403921051 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f23240653f0 0x7f23240678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.080+0000 7f2345895700 1 --2- 172.21.15.87:0/2403921051 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f23240653f0 0x7f23240678a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f23400ae540 tx=0x7f2330008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:47.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.084+0000 7f2336ffd700 1 -- 172.21.15.87:0/2403921051 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f233c051630 con 0x7f232c003a50 2023-03-30T08:11:47.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.260+0000 7f2347098700 1 -- 172.21.15.87:0/2403921051 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23400cbd20 con 0x7f232c003a50 2023-03-30T08:11:47.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.264+0000 7f2336ffd700 1 -- 172.21.15.87:0/2403921051 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+19747 (secure 0 0 0) 0x7f233c017090 con 0x7f232c003a50 2023-03-30T08:11:47.268 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:47.268 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:39.157903+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:47.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.264+0000 7f2347098700 1 -- 172.21.15.87:0/2403921051 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f23240653f0 msgr2=0x7f23240678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.264+0000 7f2347098700 1 --2- 172.21.15.87:0/2403921051 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f23240653f0 0x7f23240678a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f23400ae540 tx=0x7f2330008040 comp rx=0 tx=0).stop 2023-03-30T08:11:47.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.264+0000 7f2347098700 1 -- 172.21.15.87:0/2403921051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f232c003a50 msgr2=0x7f23401fa540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.264+0000 7f2347098700 1 --2- 172.21.15.87:0/2403921051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f232c003a50 0x7f23401fa540 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f232c0047c0 tx=0x7f233c001a00 comp rx=0 tx=0).stop 2023-03-30T08:11:47.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.264+0000 7f2347098700 1 -- 172.21.15.87:0/2403921051 shutdown_connections 2023-03-30T08:11:47.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.264+0000 7f2347098700 1 --2- 172.21.15.87:0/2403921051 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f23240653f0 0x7f23240678a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.264+0000 7f2347098700 1 --2- 172.21.15.87:0/2403921051 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2340160830 0x7f23400c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.264+0000 7f2347098700 1 --2- 172.21.15.87:0/2403921051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23400c2fc0 0x7f2340153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.264+0000 7f2347098700 1 --2- 172.21.15.87:0/2403921051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f232c003a50 0x7f23401fa540 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.264+0000 7f2347098700 1 -- 172.21.15.87:0/2403921051 >> 172.21.15.87:0/2403921051 conn(0x7f23400cf410 msgr2=0x7f23400b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:47.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.264+0000 7f2347098700 1 -- 172.21.15.87:0/2403921051 shutdown_connections 2023-03-30T08:11:47.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.268+0000 7f2347098700 1 -- 172.21.15.87:0/2403921051 wait complete. 2023-03-30T08:11:47.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-30T08:10:56.407927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-30T08:10:57.359214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-30T08:11:00.430972+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-30T08:11:47.292 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T08:11:47.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.452+0000 7fc0932e6700 1 Processor -- start 2023-03-30T08:11:47.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.452+0000 7fc0932e6700 1 -- start start 2023-03-30T08:11:47.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc0932e6700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc08c06bd80 0x7fc08c070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc0932e6700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc08c070960 0x7fc08c15a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc0932e6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08c070d80 con 0x7fc08c0c1dc0 2023-03-30T08:11:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc0932e6700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08c164520 con 0x7fc08c06bd80 2023-03-30T08:11:47.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc0932e6700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08c164800 con 0x7fc08c070960 2023-03-30T08:11:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc091082700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc08c0c1dc0 0x7fc08c0cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59888/0 (socket says 172.21.15.87:59888) 2023-03-30T08:11:47.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc091082700 1 -- 172.21.15.87:0/1525658547 learned_addr learned my addr 172.21.15.87:0/1525658547 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc090881700 1 --2- 172.21.15.87:0/1525658547 >> v2:172.21.15.87:3300/0 conn(0x7fc08c06bd80 0x7fc08c070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc091883700 1 --2- 172.21.15.87:0/1525658547 >> v2:172.21.15.115:3300/0 conn(0x7fc08c070960 0x7fc08c15a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 -- 172.21.15.87:0/1525658547 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497928752 0 0) 0x7fc08c070d80 con 0x7fc08c0c1dc0 2023-03-30T08:11:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 -- 172.21.15.87:0/1525658547 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0780035d0 con 0x7fc08c0c1dc0 2023-03-30T08:11:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 -- 172.21.15.87:0/1525658547 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3472519448 0 0) 0x7fc0780035d0 con 0x7fc08c0c1dc0 2023-03-30T08:11:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 -- 172.21.15.87:0/1525658547 >> v2:172.21.15.115:3300/0 conn(0x7fc08c070960 msgr2=0x7fc08c15a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:47.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 --2- 172.21.15.87:0/1525658547 >> v2:172.21.15.115:3300/0 conn(0x7fc08c070960 0x7fc08c15a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 -- 172.21.15.87:0/1525658547 >> v2:172.21.15.87:3300/0 conn(0x7fc08c06bd80 msgr2=0x7fc08c070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:47.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 --2- 172.21.15.87:0/1525658547 >> v2:172.21.15.87:3300/0 conn(0x7fc08c06bd80 0x7fc08c070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 -- 172.21.15.87:0/1525658547 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c164ae0 con 0x7fc08c0c1dc0 2023-03-30T08:11:47.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 -- 172.21.15.87:0/1525658547 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7fc088001670 con 0x7fc08c0c1dc0 2023-03-30T08:11:47.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 -- 172.21.15.87:0/1525658547 >> v1:172.21.15.87:6789/0 conn(0x7fc08c0c1dc0 legacy=0x7fc08c0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 --2- 172.21.15.87:0/1525658547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc078003a20 0x7fc078003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 --2- 172.21.15.87:0/1525658547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc078004870 0x7fc078004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 --2- 172.21.15.87:0/1525658547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc078005220 0x7fc07800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.465 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 -- 172.21.15.87:0/1525658547 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c164520 con 0x7fc078005220 2023-03-30T08:11:47.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 -- 172.21.15.87:0/1525658547 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c164800 con 0x7fc078003a20 2023-03-30T08:11:47.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc083fff700 1 -- 172.21.15.87:0/1525658547 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07800c020 con 0x7fc078004870 2023-03-30T08:11:47.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc091883700 1 --2- 172.21.15.87:0/1525658547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc078005220 0x7fc07800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc091082700 1 --2- 172.21.15.87:0/1525658547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc078003a20 0x7fc078003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.456+0000 7fc090881700 1 --2- 172.21.15.87:0/1525658547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc078004870 0x7fc078004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc091883700 1 -- 172.21.15.87:0/1525658547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc078004870 msgr2=0x7fc078004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:47.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc091883700 1 --2- 172.21.15.87:0/1525658547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc078004870 0x7fc078004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc091883700 1 -- 172.21.15.87:0/1525658547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc078003a20 msgr2=0x7fc078003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:47.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc091883700 1 --2- 172.21.15.87:0/1525658547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc078003a20 0x7fc078003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc091883700 1 -- 172.21.15.87:0/1525658547 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780035d0 con 0x7fc078005220 2023-03-30T08:11:47.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc090881700 1 --2- 172.21.15.87:0/1525658547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc078004870 0x7fc078004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:47.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc091883700 1 -- 172.21.15.87:0/1525658547 reap_dead start 2023-03-30T08:11:47.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc091883700 1 --2- 172.21.15.87:0/1525658547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc078005220 0x7fc07800ba30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc084009fc0 tx=0x7fc0780058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d8d92c87d35415 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:47.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc083fff700 1 -- 172.21.15.87:0/1525658547 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084003a40 con 0x7fc078005220 2023-03-30T08:11:47.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc083fff700 1 -- 172.21.15.87:0/1525658547 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08400f040 con 0x7fc078005220 2023-03-30T08:11:47.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc083fff700 1 -- 172.21.15.87:0/1525658547 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084003e00 con 0x7fc078005220 2023-03-30T08:11:47.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc0932e6700 1 -- 172.21.15.87:0/1525658547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc078005220 msgr2=0x7fc07800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc0932e6700 1 --2- 172.21.15.87:0/1525658547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc078005220 0x7fc07800ba30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc084009fc0 tx=0x7fc0780058a0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc0932e6700 1 -- 172.21.15.87:0/1525658547 shutdown_connections 2023-03-30T08:11:47.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc0932e6700 1 --2- 172.21.15.87:0/1525658547 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc078005220 0x7fc07800ba30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc0932e6700 1 -- 172.21.15.87:0/1525658547 >> 172.21.15.87:0/1525658547 conn(0x7fc08c0ce960 msgr2=0x7fc08c0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:47.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc0932e6700 1 -- 172.21.15.87:0/1525658547 shutdown_connections 2023-03-30T08:11:47.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.460+0000 7fc0932e6700 1 -- 172.21.15.87:0/1525658547 wait complete. 2023-03-30T08:11:47.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc0932e6700 1 Processor -- start 2023-03-30T08:11:47.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc0932e6700 1 -- start start 2023-03-30T08:11:47.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc0932e6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc078005220 0x7fc08c0c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc0932e6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc08c0af6f0 0x7fc08c0b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc0932e6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc08c0afb60 0x7fc08c0b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc0932e6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c15c3b0 con 0x7fc08c0af6f0 2023-03-30T08:11:47.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc0932e6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c0b1bc0 con 0x7fc08c0afb60 2023-03-30T08:11:47.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc0932e6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c0b1ea0 con 0x7fc078005220 2023-03-30T08:11:47.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc090881700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc08c0af6f0 0x7fc08c0b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc090881700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc08c0af6f0 0x7fc08c0b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55946/0 (socket says 172.21.15.87:55946) 2023-03-30T08:11:47.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc090881700 1 -- 172.21.15.87:0/3647984765 learned_addr learned my addr 172.21.15.87:0/3647984765 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:47.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc091883700 1 --2- 172.21.15.87:0/3647984765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc08c0afb60 0x7fc08c0b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc091082700 1 --2- 172.21.15.87:0/3647984765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc078005220 0x7fc08c0c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc090881700 1 -- 172.21.15.87:0/3647984765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc078005220 msgr2=0x7fc08c0c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc090881700 1 --2- 172.21.15.87:0/3647984765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc078005220 0x7fc08c0c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc090881700 1 -- 172.21.15.87:0/3647984765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc08c0afb60 msgr2=0x7fc08c0b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc090881700 1 --2- 172.21.15.87:0/3647984765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc08c0afb60 0x7fc08c0b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc090881700 1 -- 172.21.15.87:0/3647984765 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c1650a0 con 0x7fc08c0af6f0 2023-03-30T08:11:47.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc091082700 1 --2- 172.21.15.87:0/3647984765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc078005220 0x7fc08c0c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:47.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc090881700 1 --2- 172.21.15.87:0/3647984765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc08c0af6f0 0x7fc08c0b2c60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0108c0 tx=0x7fc07c010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:47.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc081ffb700 1 -- 172.21.15.87:0/3647984765 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c010ec0 con 0x7fc08c0af6f0 2023-03-30T08:11:47.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc081ffb700 1 -- 172.21.15.87:0/3647984765 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c004020 con 0x7fc08c0af6f0 2023-03-30T08:11:47.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc0932e6700 1 -- 172.21.15.87:0/3647984765 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08c164dc0 con 0x7fc08c0af6f0 2023-03-30T08:11:47.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc081ffb700 1 -- 172.21.15.87:0/3647984765 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c0043b0 con 0x7fc08c0af6f0 2023-03-30T08:11:47.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.464+0000 7fc0932e6700 1 -- 172.21.15.87:0/3647984765 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c0ce540 con 0x7fc08c0af6f0 2023-03-30T08:11:47.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.468+0000 7fc0932e6700 1 -- 172.21.15.87:0/3647984765 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08c073ee0 con 0x7fc08c0af6f0 2023-03-30T08:11:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.468+0000 7fc081ffb700 1 -- 172.21.15.87:0/3647984765 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc07c00e870 con 0x7fc08c0af6f0 2023-03-30T08:11:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.468+0000 7fc081ffb700 1 --2- 172.21.15.87:0/3647984765 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc070065420 0x7fc0700678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.468+0000 7fc081ffb700 1 -- 172.21.15.87:0/3647984765 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc07c082b60 con 0x7fc08c0af6f0 2023-03-30T08:11:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.468+0000 7fc091082700 1 --2- 172.21.15.87:0/3647984765 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc070065420 0x7fc0700678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.468+0000 7fc091082700 1 --2- 172.21.15.87:0/3647984765 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc070065420 0x7fc0700678d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc088000fb0 tx=0x7fc088009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:47.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.476+0000 7fc081ffb700 1 -- 172.21.15.87:0/3647984765 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fc07c050410 con 0x7fc08c0af6f0 2023-03-30T08:11:47.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.644+0000 7fc0932e6700 1 -- 172.21.15.87:0/3647984765 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc08c06aff0 con 0x7fc08c0af6f0 2023-03-30T08:11:47.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.648+0000 7fc081ffb700 1 -- 172.21.15.87:0/3647984765 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc07c053a30 con 0x7fc08c0af6f0 2023-03-30T08:11:47.651 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T08:11:47.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.652+0000 7fc0932e6700 1 -- 172.21.15.87:0/3647984765 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc070065420 msgr2=0x7fc0700678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.652+0000 7fc0932e6700 1 --2- 172.21.15.87:0/3647984765 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc070065420 0x7fc0700678d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc088000fb0 tx=0x7fc088009040 comp rx=0 tx=0).stop 2023-03-30T08:11:47.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.652+0000 7fc0932e6700 1 -- 172.21.15.87:0/3647984765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc08c0af6f0 msgr2=0x7fc08c0b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.652+0000 7fc0932e6700 1 --2- 172.21.15.87:0/3647984765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc08c0af6f0 0x7fc08c0b2c60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0108c0 tx=0x7fc07c010c80 comp rx=0 tx=0).stop 2023-03-30T08:11:47.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.652+0000 7fc0932e6700 1 -- 172.21.15.87:0/3647984765 shutdown_connections 2023-03-30T08:11:47.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.652+0000 7fc0932e6700 1 --2- 172.21.15.87:0/3647984765 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc070065420 0x7fc0700678d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.652+0000 7fc0932e6700 1 --2- 172.21.15.87:0/3647984765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc08c0afb60 0x7fc08c0b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.652+0000 7fc0932e6700 1 --2- 172.21.15.87:0/3647984765 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc08c0af6f0 0x7fc08c0b2c60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.652+0000 7fc0932e6700 1 --2- 172.21.15.87:0/3647984765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc078005220 0x7fc08c0c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.652+0000 7fc0932e6700 1 -- 172.21.15.87:0/3647984765 >> 172.21.15.87:0/3647984765 conn(0x7fc08c0ce960 msgr2=0x7fc08c1636f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:47.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.652+0000 7fc0932e6700 1 -- 172.21.15.87:0/3647984765 shutdown_connections 2023-03-30T08:11:47.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.652+0000 7fc0932e6700 1 -- 172.21.15.87:0/3647984765 wait complete. 2023-03-30T08:11:47.674 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T08:11:47.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.828+0000 7f5615ba5700 1 Processor -- start 2023-03-30T08:11:47.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.828+0000 7f5615ba5700 1 -- start start 2023-03-30T08:11:47.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.832+0000 7f5615ba5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5610070b30 0x7f56100c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.832+0000 7f5615ba5700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561006c710 con 0x7f56100cd8e0 2023-03-30T08:11:47.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.832+0000 7f5615ba5700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561006be20 con 0x7f56100adb80 2023-03-30T08:11:47.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.832+0000 7f5615ba5700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56100adf50 con 0x7f5610070b30 2023-03-30T08:11:47.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.832+0000 7f560ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5610070b30 0x7f56100c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.832+0000 7f560effd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f56100cd8e0 0x7f5610070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59896/0 (socket says 172.21.15.87:59896) 2023-03-30T08:11:47.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.832+0000 7f560effd700 1 -- 172.21.15.87:0/437377914 learned_addr learned my addr 172.21.15.87:0/437377914 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:47.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.832+0000 7f560e7fc700 1 -- 172.21.15.87:0/437377914 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460859854 0 0) 0x7f561006c710 con 0x7f56100cd8e0 2023-03-30T08:11:47.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.832+0000 7f560ffff700 1 -- 172.21.15.87:0/437377914 >> v1:172.21.15.115:6789/0 conn(0x7f56100adb80 legacy=0x7f561006cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.832+0000 7f560ffff700 1 -- 172.21.15.87:0/437377914 >> v1:172.21.15.87:6789/0 conn(0x7f56100cd8e0 legacy=0x7f5610070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.832+0000 7f560ffff700 1 -- 172.21.15.87:0/437377914 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561006c0c0 con 0x7f5610070b30 2023-03-30T08:11:47.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.832+0000 7f560ffff700 1 --2- 172.21.15.87:0/437377914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5610070b30 0x7f56100c9ac0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5608009d90 tx=0x7f560800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f672ce2d7cb4b095 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:47.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.832+0000 7f560e7fc700 1 -- 172.21.15.87:0/437377914 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560800e070 con 0x7f5610070b30 2023-03-30T08:11:47.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.832+0000 7f560e7fc700 1 -- 172.21.15.87:0/437377914 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560800bbd0 con 0x7f5610070b30 2023-03-30T08:11:47.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.832+0000 7f560e7fc700 1 -- 172.21.15.87:0/437377914 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608012430 con 0x7f5610070b30 2023-03-30T08:11:47.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.836+0000 7f5615ba5700 1 -- 172.21.15.87:0/437377914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5610070b30 msgr2=0x7f56100c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.836+0000 7f5615ba5700 1 --2- 172.21.15.87:0/437377914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5610070b30 0x7f56100c9ac0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5608009d90 tx=0x7f560800b330 comp rx=0 tx=0).stop 2023-03-30T08:11:47.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.836+0000 7f5615ba5700 1 -- 172.21.15.87:0/437377914 shutdown_connections 2023-03-30T08:11:47.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.836+0000 7f5615ba5700 1 --2- 172.21.15.87:0/437377914 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5610070b30 0x7f56100c9ac0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.836+0000 7f5615ba5700 1 -- 172.21.15.87:0/437377914 >> 172.21.15.87:0/437377914 conn(0x7f56100ce960 msgr2=0x7f56100ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:47.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.836+0000 7f5615ba5700 1 -- 172.21.15.87:0/437377914 shutdown_connections 2023-03-30T08:11:47.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.836+0000 7f5615ba5700 1 -- 172.21.15.87:0/437377914 wait complete. 2023-03-30T08:11:47.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.836+0000 7f5615ba5700 1 Processor -- start 2023-03-30T08:11:47.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.836+0000 7f5615ba5700 1 -- start start 2023-03-30T08:11:47.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f5615ba5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5610070b30 0x7f5610151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f5615ba5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56100adb80 0x7f5610150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f5615ba5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56100cd8e0 0x7f561014e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f5615ba5700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56100c5260 con 0x7f56100adb80 2023-03-30T08:11:47.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f5615ba5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56100c2c20 con 0x7f56100cd8e0 2023-03-30T08:11:47.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f5615ba5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56101507b0 con 0x7f5610070b30 2023-03-30T08:11:47.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f560effd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56100adb80 0x7f5610150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f560effd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56100adb80 0x7f5610150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55960/0 (socket says 172.21.15.87:55960) 2023-03-30T08:11:47.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f560effd700 1 -- 172.21.15.87:0/777701690 learned_addr learned my addr 172.21.15.87:0/777701690 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:47.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f560ffff700 1 --2- 172.21.15.87:0/777701690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56100cd8e0 0x7f561014e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f560f7fe700 1 --2- 172.21.15.87:0/777701690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5610070b30 0x7f5610151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f560effd700 1 -- 172.21.15.87:0/777701690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5610070b30 msgr2=0x7f5610151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f560effd700 1 --2- 172.21.15.87:0/777701690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5610070b30 0x7f5610151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f560effd700 1 -- 172.21.15.87:0/777701690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56100cd8e0 msgr2=0x7f561014e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:47.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f560effd700 1 --2- 172.21.15.87:0/777701690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56100cd8e0 0x7f561014e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:47.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f560effd700 1 -- 172.21.15.87:0/777701690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5608009a70 con 0x7f56100adb80 2023-03-30T08:11:47.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f560effd700 1 --2- 172.21.15.87:0/777701690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56100adb80 0x7f5610150270 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f560400c750 tx=0x7f560400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:47.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f55f7fff700 1 -- 172.21.15.87:0/777701690 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604004ca0 con 0x7f56100adb80 2023-03-30T08:11:47.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f55f7fff700 1 -- 172.21.15.87:0/777701690 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5604004e00 con 0x7f56100adb80 2023-03-30T08:11:47.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f5615ba5700 1 -- 172.21.15.87:0/777701690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56100cde30 con 0x7f56100adb80 2023-03-30T08:11:47.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f55f7fff700 1 -- 172.21.15.87:0/777701690 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604007310 con 0x7f56100adb80 2023-03-30T08:11:47.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.840+0000 7f5615ba5700 1 -- 172.21.15.87:0/777701690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561006c3a0 con 0x7f56100adb80 2023-03-30T08:11:47.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.844+0000 7f5615ba5700 1 -- 172.21.15.87:0/777701690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56100cdfc0 con 0x7f56100adb80 2023-03-30T08:11:47.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.844+0000 7f55f7fff700 1 -- 172.21.15.87:0/777701690 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f5604007470 con 0x7f56100adb80 2023-03-30T08:11:47.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.844+0000 7f55f7fff700 1 --2- 172.21.15.87:0/777701690 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f55fc0653f0 0x7f55fc0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:47.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.844+0000 7f55f7fff700 1 -- 172.21.15.87:0/777701690 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5604082890 con 0x7f56100adb80 2023-03-30T08:11:47.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.844+0000 7f560f7fe700 1 --2- 172.21.15.87:0/777701690 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f55fc0653f0 0x7f55fc0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:47.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.848+0000 7f560f7fe700 1 --2- 172.21.15.87:0/777701690 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f55fc0653f0 0x7f55fc0678a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5600000f60 tx=0x7f5600009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:47.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:47.852+0000 7f55f7fff700 1 -- 172.21.15.87:0/777701690 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f56040501d0 con 0x7f56100adb80 2023-03-30T08:11:48.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.020+0000 7f5615ba5700 1 -- 172.21.15.87:0/777701690 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f56100c2d60 con 0x7f56100adb80 2023-03-30T08:11:48.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.020+0000 7f55f7fff700 1 -- 172.21.15.87:0/777701690 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f56100c2d60 con 0x7f56100adb80 2023-03-30T08:11:48.024 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T08:11:48.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.020+0000 7f5615ba5700 1 -- 172.21.15.87:0/777701690 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f55fc0653f0 msgr2=0x7f55fc0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.020+0000 7f5615ba5700 1 --2- 172.21.15.87:0/777701690 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f55fc0653f0 0x7f55fc0678a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5600000f60 tx=0x7f5600009040 comp rx=0 tx=0).stop 2023-03-30T08:11:48.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.020+0000 7f5615ba5700 1 -- 172.21.15.87:0/777701690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56100adb80 msgr2=0x7f5610150270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.020+0000 7f5615ba5700 1 --2- 172.21.15.87:0/777701690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56100adb80 0x7f5610150270 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f560400c750 tx=0x7f560400ca60 comp rx=0 tx=0).stop 2023-03-30T08:11:48.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.024+0000 7f5615ba5700 1 -- 172.21.15.87:0/777701690 shutdown_connections 2023-03-30T08:11:48.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.024+0000 7f5615ba5700 1 --2- 172.21.15.87:0/777701690 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f55fc0653f0 0x7f55fc0678a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.024+0000 7f5615ba5700 1 --2- 172.21.15.87:0/777701690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56100cd8e0 0x7f561014e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.024+0000 7f5615ba5700 1 --2- 172.21.15.87:0/777701690 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f56100adb80 0x7f5610150270 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.024+0000 7f5615ba5700 1 --2- 172.21.15.87:0/777701690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5610070b30 0x7f5610151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.024+0000 7f5615ba5700 1 -- 172.21.15.87:0/777701690 >> 172.21.15.87:0/777701690 conn(0x7f56100ce960 msgr2=0x7f561006d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:48.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.024+0000 7f5615ba5700 1 -- 172.21.15.87:0/777701690 shutdown_connections 2023-03-30T08:11:48.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.024+0000 7f5615ba5700 1 -- 172.21.15.87:0/777701690 wait complete. 2023-03-30T08:11:48.045 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-30T08:11:48.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.196+0000 7f3a30a2f700 1 Processor -- start 2023-03-30T08:11:48.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.196+0000 7f3a30a2f700 1 -- start start 2023-03-30T08:11:48.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a30a2f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a2c06c270 0x7f3a2c0ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a30a2f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3a2c0aea20 0x7f3a2c0cde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a30a2f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2c0af1e0 con 0x7f3a2c0ce3b0 2023-03-30T08:11:48.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a30a2f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2c0b09e0 con 0x7f3a2c0aea20 2023-03-30T08:11:48.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a30a2f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c15ca40 con 0x7f3a2c06c270 2023-03-30T08:11:48.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a2affd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3a2c0aea20 0x7f3a2c0cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a2affd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3a2c0aea20 0x7f3a2c0cde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55964/0 (socket says 172.21.15.87:55964) 2023-03-30T08:11:48.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a2affd700 1 -- 172.21.15.87:0/1732410369 learned_addr learned my addr 172.21.15.87:0/1732410369 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:48.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a2b7fe700 1 --2- 172.21.15.87:0/1732410369 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a2c06c270 0x7f3a2c0ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a2affd700 1 -- 172.21.15.87:0/1732410369 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a2c06c270 msgr2=0x7f3a2c0ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:48.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a2affd700 1 --2- 172.21.15.87:0/1732410369 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a2c06c270 0x7f3a2c0ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a2affd700 1 -- 172.21.15.87:0/1732410369 >> v1:172.21.15.115:6789/0 conn(0x7f3a2c0ce3b0 legacy=0x7f3a2c0b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a2affd700 1 -- 172.21.15.87:0/1732410369 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c0b0420 con 0x7f3a2c0aea20 2023-03-30T08:11:48.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a2affd700 1 --2- 172.21.15.87:0/1732410369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a2c0aea20 0x7f3a2c0cde70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009940 tx=0x7f3a20009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569d40170141ab17 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:48.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a2a7fc700 1 -- 172.21.15.87:0/1732410369 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2000ba20 con 0x7f3a2c0aea20 2023-03-30T08:11:48.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.200+0000 7f3a2a7fc700 1 -- 172.21.15.87:0/1732410369 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a20009e90 con 0x7f3a2c0aea20 2023-03-30T08:11:48.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.204+0000 7f3a2a7fc700 1 -- 172.21.15.87:0/1732410369 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2000bda0 con 0x7f3a2c0aea20 2023-03-30T08:11:48.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.204+0000 7f3a30a2f700 1 -- 172.21.15.87:0/1732410369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a2c0aea20 msgr2=0x7f3a2c0cde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.204+0000 7f3a30a2f700 1 --2- 172.21.15.87:0/1732410369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a2c0aea20 0x7f3a2c0cde70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009940 tx=0x7f3a20009c50 comp rx=0 tx=0).stop 2023-03-30T08:11:48.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.204+0000 7f3a30a2f700 1 -- 172.21.15.87:0/1732410369 shutdown_connections 2023-03-30T08:11:48.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.204+0000 7f3a30a2f700 1 --2- 172.21.15.87:0/1732410369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a2c0aea20 0x7f3a2c0cde70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.204+0000 7f3a30a2f700 1 --2- 172.21.15.87:0/1732410369 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a2c06c270 0x7f3a2c0ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.204+0000 7f3a30a2f700 1 -- 172.21.15.87:0/1732410369 >> 172.21.15.87:0/1732410369 conn(0x7f3a2c0b28c0 msgr2=0x7f3a2c0b2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:48.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.204+0000 7f3a30a2f700 1 -- 172.21.15.87:0/1732410369 shutdown_connections 2023-03-30T08:11:48.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.204+0000 7f3a30a2f700 1 -- 172.21.15.87:0/1732410369 wait complete. 2023-03-30T08:11:48.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.204+0000 7f3a30a2f700 1 Processor -- start 2023-03-30T08:11:48.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.204+0000 7f3a30a2f700 1 -- start start 2023-03-30T08:11:48.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a30a2f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a2c06c270 0x7f3a2c09c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a30a2f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a2c0aea20 0x7f3a2c15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a30a2f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a2c0ce3b0 0x7f3a2c1507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a30a2f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c15eba0 con 0x7f3a2c0aea20 2023-03-30T08:11:48.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a30a2f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c15e110 con 0x7f3a2c0ce3b0 2023-03-30T08:11:48.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a30a2f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c1f18a0 con 0x7f3a2c06c270 2023-03-30T08:11:48.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a2affd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a2c0aea20 0x7f3a2c15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a2affd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a2c0aea20 0x7f3a2c15dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55974/0 (socket says 172.21.15.87:55974) 2023-03-30T08:11:48.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a2affd700 1 -- 172.21.15.87:0/1044124124 learned_addr learned my addr 172.21.15.87:0/1044124124 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:48.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a2b7fe700 1 --2- 172.21.15.87:0/1044124124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a2c06c270 0x7f3a2c09c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a2bfff700 1 --2- 172.21.15.87:0/1044124124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a2c0ce3b0 0x7f3a2c1507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a2affd700 1 -- 172.21.15.87:0/1044124124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a2c06c270 msgr2=0x7f3a2c09c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a2affd700 1 --2- 172.21.15.87:0/1044124124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a2c06c270 0x7f3a2c09c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a2affd700 1 -- 172.21.15.87:0/1044124124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a2c0ce3b0 msgr2=0x7f3a2c1507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a2affd700 1 --2- 172.21.15.87:0/1044124124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a2c0ce3b0 0x7f3a2c1507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a2affd700 1 -- 172.21.15.87:0/1044124124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a20009570 con 0x7f3a2c0aea20 2023-03-30T08:11:48.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a2bfff700 1 --2- 172.21.15.87:0/1044124124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a2c0ce3b0 0x7f3a2c1507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:48.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a2affd700 1 --2- 172.21.15.87:0/1044124124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a2c0aea20 0x7f3a2c15dbd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c06ff60 tx=0x7f3a20004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:48.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a13fff700 1 -- 172.21.15.87:0/1044124124 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20004550 con 0x7f3a2c0aea20 2023-03-30T08:11:48.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a13fff700 1 -- 172.21.15.87:0/1044124124 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2001f070 con 0x7f3a2c0aea20 2023-03-30T08:11:48.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a30a2f700 1 -- 172.21.15.87:0/1044124124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c0cc370 con 0x7f3a2c0aea20 2023-03-30T08:11:48.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a13fff700 1 -- 172.21.15.87:0/1044124124 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20003900 con 0x7f3a2c0aea20 2023-03-30T08:11:48.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.208+0000 7f3a30a2f700 1 -- 172.21.15.87:0/1044124124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c0b0700 con 0x7f3a2c0aea20 2023-03-30T08:11:48.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.212+0000 7f3a30a2f700 1 -- 172.21.15.87:0/1044124124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c0cc650 con 0x7f3a2c0aea20 2023-03-30T08:11:48.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.212+0000 7f3a13fff700 1 -- 172.21.15.87:0/1044124124 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f3a20003a60 con 0x7f3a2c0aea20 2023-03-30T08:11:48.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.212+0000 7f3a13fff700 1 --2- 172.21.15.87:0/1044124124 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3a180653f0 0x7f3a180678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.212+0000 7f3a13fff700 1 -- 172.21.15.87:0/1044124124 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3a20021070 con 0x7f3a2c0aea20 2023-03-30T08:11:48.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.212+0000 7f3a2b7fe700 1 --2- 172.21.15.87:0/1044124124 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3a180653f0 0x7f3a180678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.212+0000 7f3a2b7fe700 1 --2- 172.21.15.87:0/1044124124 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3a180653f0 0x7f3a180678a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009950 tx=0x7f3a1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:48.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.216+0000 7f3a13fff700 1 -- 172.21.15.87:0/1044124124 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f3a200b45e0 con 0x7f3a2c0aea20 2023-03-30T08:11:48.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.384+0000 7f3a30a2f700 1 -- 172.21.15.87:0/1044124124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a2c072cf0 con 0x7f3a2c0aea20 2023-03-30T08:11:48.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.388+0000 7f3a13fff700 1 -- 172.21.15.87:0/1044124124 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a20051b40 con 0x7f3a2c0aea20 2023-03-30T08:11:48.392 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:48.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.392+0000 7f3a30a2f700 1 -- 172.21.15.87:0/1044124124 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3a180653f0 msgr2=0x7f3a180678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.392+0000 7f3a30a2f700 1 --2- 172.21.15.87:0/1044124124 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3a180653f0 0x7f3a180678a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009950 tx=0x7f3a1c008040 comp rx=0 tx=0).stop 2023-03-30T08:11:48.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.392+0000 7f3a30a2f700 1 -- 172.21.15.87:0/1044124124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a2c0aea20 msgr2=0x7f3a2c15dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.392+0000 7f3a30a2f700 1 --2- 172.21.15.87:0/1044124124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a2c0aea20 0x7f3a2c15dbd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c06ff60 tx=0x7f3a20004770 comp rx=0 tx=0).stop 2023-03-30T08:11:48.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.392+0000 7f3a30a2f700 1 -- 172.21.15.87:0/1044124124 shutdown_connections 2023-03-30T08:11:48.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.392+0000 7f3a30a2f700 1 --2- 172.21.15.87:0/1044124124 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3a180653f0 0x7f3a180678a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.392+0000 7f3a30a2f700 1 --2- 172.21.15.87:0/1044124124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a2c0ce3b0 0x7f3a2c1507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.392+0000 7f3a30a2f700 1 --2- 172.21.15.87:0/1044124124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a2c0aea20 0x7f3a2c15dbd0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.392+0000 7f3a30a2f700 1 --2- 172.21.15.87:0/1044124124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a2c06c270 0x7f3a2c09c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.392+0000 7f3a30a2f700 1 -- 172.21.15.87:0/1044124124 >> 172.21.15.87:0/1044124124 conn(0x7f3a2c0b28c0 msgr2=0x7f3a2c15bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:48.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.392+0000 7f3a30a2f700 1 -- 172.21.15.87:0/1044124124 shutdown_connections 2023-03-30T08:11:48.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.392+0000 7f3a30a2f700 1 -- 172.21.15.87:0/1044124124 wait complete. 2023-03-30T08:11:48.416 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-30T08:11:48.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.572+0000 7f785b59e700 1 Processor -- start 2023-03-30T08:11:48.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.572+0000 7f785b59e700 1 -- start start 2023-03-30T08:11:48.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f785b59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f785c0b0c10 0x7f785c0aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f785b59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f785c0af180 0x7f785c06c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f785b59e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c06b670 con 0x7f785c0b3f30 2023-03-30T08:11:48.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f785b59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785c0b1090 con 0x7f785c0af180 2023-03-30T08:11:48.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f785b59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785c0af600 con 0x7f785c0b0c10 2023-03-30T08:11:48.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f785a59c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f785c0b3f30 0x7f785c06a6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:34742/0 (socket says 172.21.15.87:34742) 2023-03-30T08:11:48.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f785a59c700 1 -- 172.21.15.87:0/3210121747 learned_addr learned my addr 172.21.15.87:0/3210121747 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:48.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f785ad9d700 1 --2- 172.21.15.87:0/3210121747 >> v2:172.21.15.87:3300/0 conn(0x7f785c0af180 0x7f785c06c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f7859d9b700 1 --2- 172.21.15.87:0/3210121747 >> v2:172.21.15.115:3300/0 conn(0x7f785c0b0c10 0x7f785c0aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f785959a700 1 -- 172.21.15.87:0/3210121747 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094232709 0 0) 0x7f785c06b670 con 0x7f785c0b3f30 2023-03-30T08:11:48.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f785959a700 1 -- 172.21.15.87:0/3210121747 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78440035d0 con 0x7f785c0b3f30 2023-03-30T08:11:48.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f785ad9d700 1 -- 172.21.15.87:0/3210121747 >> v2:172.21.15.115:3300/0 conn(0x7f785c0b0c10 msgr2=0x7f785c0aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:48.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f785ad9d700 1 --2- 172.21.15.87:0/3210121747 >> v2:172.21.15.115:3300/0 conn(0x7f785c0b0c10 0x7f785c0aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f785ad9d700 1 -- 172.21.15.87:0/3210121747 >> v1:172.21.15.115:6789/0 conn(0x7f785c0b3f30 legacy=0x7f785c06a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f785ad9d700 1 -- 172.21.15.87:0/3210121747 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c06b0b0 con 0x7f785c0af180 2023-03-30T08:11:48.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.576+0000 7f785ad9d700 1 --2- 172.21.15.87:0/3210121747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f785c0af180 0x7f785c06c310 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f785c0ce750 tx=0x7f7854009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9167fef9bf8c02f6 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:48.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.580+0000 7f785959a700 1 -- 172.21.15.87:0/3210121747 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854011830 con 0x7f785c0af180 2023-03-30T08:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.580+0000 7f785959a700 1 -- 172.21.15.87:0/3210121747 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7854011990 con 0x7f785c0af180 2023-03-30T08:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.580+0000 7f785959a700 1 -- 172.21.15.87:0/3210121747 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854011d20 con 0x7f785c0af180 2023-03-30T08:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.580+0000 7f785b59e700 1 -- 172.21.15.87:0/3210121747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f785c0af180 msgr2=0x7f785c06c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.580+0000 7f785b59e700 1 --2- 172.21.15.87:0/3210121747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f785c0af180 0x7f785c06c310 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f785c0ce750 tx=0x7f7854009b30 comp rx=0 tx=0).stop 2023-03-30T08:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.580+0000 7f785b59e700 1 -- 172.21.15.87:0/3210121747 shutdown_connections 2023-03-30T08:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.580+0000 7f785b59e700 1 --2- 172.21.15.87:0/3210121747 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f785c0af180 0x7f785c06c310 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.580+0000 7f785b59e700 1 --2- 172.21.15.87:0/3210121747 >> v2:172.21.15.115:3300/0 conn(0x7f785c0b0c10 0x7f785c0aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.580+0000 7f785b59e700 1 -- 172.21.15.87:0/3210121747 >> 172.21.15.87:0/3210121747 conn(0x7f785c0cf410 msgr2=0x7f785c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.580+0000 7f785b59e700 1 -- 172.21.15.87:0/3210121747 shutdown_connections 2023-03-30T08:11:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.580+0000 7f785b59e700 1 -- 172.21.15.87:0/3210121747 wait complete. 2023-03-30T08:11:48.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785b59e700 1 Processor -- start 2023-03-30T08:11:48.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785b59e700 1 -- start start 2023-03-30T08:11:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785b59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f785c0af180 0x7f785c1f0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785b59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f785c0b0c10 0x7f785c1548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f785c0b3f30 0x7f785c0c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c1f0bb0 con 0x7f785c0b3f30 2023-03-30T08:11:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785b59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c157760 con 0x7f785c0af180 2023-03-30T08:11:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785b59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0b17f0 con 0x7f785c0b0c10 2023-03-30T08:11:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785ad9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f785c0b3f30 0x7f785c0c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785ad9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f785c0b3f30 0x7f785c0c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55994/0 (socket says 172.21.15.87:55994) 2023-03-30T08:11:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785ad9d700 1 -- 172.21.15.87:0/748920821 learned_addr learned my addr 172.21.15.87:0/748920821 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785a59c700 1 --2- 172.21.15.87:0/748920821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f785c0af180 0x7f785c1f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f7859d9b700 1 --2- 172.21.15.87:0/748920821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f785c0b0c10 0x7f785c1548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785ad9d700 1 -- 172.21.15.87:0/748920821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f785c0b0c10 msgr2=0x7f785c1548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785ad9d700 1 --2- 172.21.15.87:0/748920821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f785c0b0c10 0x7f785c1548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785ad9d700 1 -- 172.21.15.87:0/748920821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f785c0af180 msgr2=0x7f785c1f0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785ad9d700 1 --2- 172.21.15.87:0/748920821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f785c0af180 0x7f785c1f0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f785ad9d700 1 -- 172.21.15.87:0/748920821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78540094b0 con 0x7f785c0b3f30 2023-03-30T08:11:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.584+0000 7f7859d9b700 1 --2- 172.21.15.87:0/748920821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f785c0b0c10 0x7f785c1548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.588+0000 7f785ad9d700 1 --2- 172.21.15.87:0/748920821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f785c0b3f30 0x7f785c0c4120 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f78540090b0 tx=0x7f7854004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:48.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.588+0000 7f784affd700 1 -- 172.21.15.87:0/748920821 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78540045d0 con 0x7f785c0b3f30 2023-03-30T08:11:48.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.588+0000 7f784affd700 1 -- 172.21.15.87:0/748920821 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785401e070 con 0x7f785c0b3f30 2023-03-30T08:11:48.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.588+0000 7f784affd700 1 -- 172.21.15.87:0/748920821 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854003900 con 0x7f785c0b3f30 2023-03-30T08:11:48.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.588+0000 7f785b59e700 1 -- 172.21.15.87:0/748920821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785c0aded0 con 0x7f785c0b3f30 2023-03-30T08:11:48.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.588+0000 7f785b59e700 1 -- 172.21.15.87:0/748920821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785c06b390 con 0x7f785c0b3f30 2023-03-30T08:11:48.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.588+0000 7f785b59e700 1 -- 172.21.15.87:0/748920821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785c0ae1b0 con 0x7f785c0b3f30 2023-03-30T08:11:48.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.588+0000 7f784affd700 1 -- 172.21.15.87:0/748920821 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f7854003a60 con 0x7f785c0b3f30 2023-03-30T08:11:48.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.592+0000 7f784affd700 1 --2- 172.21.15.87:0/748920821 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f783c0653f0 0x7f783c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.592+0000 7f784affd700 1 -- 172.21.15.87:0/748920821 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7854083ad0 con 0x7f785c0b3f30 2023-03-30T08:11:48.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.592+0000 7f785a59c700 1 --2- 172.21.15.87:0/748920821 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f783c0653f0 0x7f783c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.592+0000 7f785a59c700 1 --2- 172.21.15.87:0/748920821 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f783c0653f0 0x7f783c0678a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f784c001560 tx=0x7f784c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:48.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.600+0000 7f784affd700 1 -- 172.21.15.87:0/748920821 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f7854051410 con 0x7f785c0b3f30 2023-03-30T08:11:48.773 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.768+0000 7f785b59e700 1 -- 172.21.15.87:0/748920821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f785c0733a0 con 0x7f785c0b3f30 2023-03-30T08:11:48.773 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.768+0000 7f784affd700 1 -- 172.21.15.87:0/748920821 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f78540200a0 con 0x7f785c0b3f30 2023-03-30T08:11:48.774 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-03-30T08:11:48.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.772+0000 7f785b59e700 1 -- 172.21.15.87:0/748920821 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f783c0653f0 msgr2=0x7f783c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.772+0000 7f785b59e700 1 --2- 172.21.15.87:0/748920821 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f783c0653f0 0x7f783c0678a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f784c001560 tx=0x7f784c009040 comp rx=0 tx=0).stop 2023-03-30T08:11:48.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.772+0000 7f785b59e700 1 -- 172.21.15.87:0/748920821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f785c0b3f30 msgr2=0x7f785c0c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.772+0000 7f785b59e700 1 --2- 172.21.15.87:0/748920821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f785c0b3f30 0x7f785c0c4120 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f78540090b0 tx=0x7f7854004770 comp rx=0 tx=0).stop 2023-03-30T08:11:48.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.772+0000 7f785b59e700 1 -- 172.21.15.87:0/748920821 shutdown_connections 2023-03-30T08:11:48.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.772+0000 7f785b59e700 1 --2- 172.21.15.87:0/748920821 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f783c0653f0 0x7f783c0678a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.772+0000 7f785b59e700 1 --2- 172.21.15.87:0/748920821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f785c0b3f30 0x7f785c0c4120 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.772+0000 7f785b59e700 1 --2- 172.21.15.87:0/748920821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f785c0b0c10 0x7f785c1548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.772+0000 7f785b59e700 1 --2- 172.21.15.87:0/748920821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f785c0af180 0x7f785c1f0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.772+0000 7f785b59e700 1 -- 172.21.15.87:0/748920821 >> 172.21.15.87:0/748920821 conn(0x7f785c0cf410 msgr2=0x7f785c0cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:48.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.772+0000 7f785b59e700 1 -- 172.21.15.87:0/748920821 shutdown_connections 2023-03-30T08:11:48.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.772+0000 7f785b59e700 1 -- 172.21.15.87:0/748920821 wait complete. 2023-03-30T08:11:48.797 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-30T08:11:48.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.952+0000 7feb056b1700 1 Processor -- start 2023-03-30T08:11:48.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.952+0000 7feb056b1700 1 -- start start 2023-03-30T08:11:48.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feb056b1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feb000d27e0 0x7feb000d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feb056b1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feb0006a3e0 0x7feb000d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feb056b1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb00160ef0 con 0x7feb000b8380 2023-03-30T08:11:48.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feb056b1700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb000cd6a0 con 0x7feb000d27e0 2023-03-30T08:11:48.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feb056b1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb000cd3a0 con 0x7feb0006a3e0 2023-03-30T08:11:48.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feafffff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7feb000b8380 0x7feb00069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59904/0 (socket says 172.21.15.87:59904) 2023-03-30T08:11:48.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feafffff700 1 -- 172.21.15.87:0/3512010820 learned_addr learned my addr 172.21.15.87:0/3512010820 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:48.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feaf77fe700 1 --2- 172.21.15.87:0/3512010820 >> v2:172.21.15.87:3300/0 conn(0x7feb000d27e0 0x7feb000d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feb04eb0700 1 --2- 172.21.15.87:0/3512010820 >> v2:172.21.15.115:3300/0 conn(0x7feb0006a3e0 0x7feb000d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feaff7fe700 1 -- 172.21.15.87:0/3512010820 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195025522 0 0) 0x7feb00160ef0 con 0x7feb000b8380 2023-03-30T08:11:48.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feaff7fe700 1 -- 172.21.15.87:0/3512010820 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaec0035d0 con 0x7feb000b8380 2023-03-30T08:11:48.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feaf77fe700 1 -- 172.21.15.87:0/3512010820 >> v2:172.21.15.115:3300/0 conn(0x7feb0006a3e0 msgr2=0x7feb000d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:48.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feaf77fe700 1 --2- 172.21.15.87:0/3512010820 >> v2:172.21.15.115:3300/0 conn(0x7feb0006a3e0 0x7feb000d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feaf77fe700 1 -- 172.21.15.87:0/3512010820 >> v1:172.21.15.87:6789/0 conn(0x7feb000b8380 legacy=0x7feb00069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feaff7fe700 1 -- 172.21.15.87:0/3512010820 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4092088428 0 0) 0x7feaec0035d0 con 0x7feb000b8380 2023-03-30T08:11:48.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feaf77fe700 1 -- 172.21.15.87:0/3512010820 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb000cef00 con 0x7feb000d27e0 2023-03-30T08:11:48.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feaf77fe700 1 --2- 172.21.15.87:0/3512010820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb000d27e0 0x7feb000d2200 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7feae8009850 tx=0x7feae8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacf936998739db server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:48.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feaff7fe700 1 -- 172.21.15.87:0/3512010820 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf00019f0 con 0x7feb000d27e0 2023-03-30T08:11:48.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feaff7fe700 1 -- 172.21.15.87:0/3512010820 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae8004030 con 0x7feb000d27e0 2023-03-30T08:11:48.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.956+0000 7feaff7fe700 1 -- 172.21.15.87:0/3512010820 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae80043c0 con 0x7feb000d27e0 2023-03-30T08:11:48.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.960+0000 7feb056b1700 1 -- 172.21.15.87:0/3512010820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb000d27e0 msgr2=0x7feb000d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.960+0000 7feb056b1700 1 --2- 172.21.15.87:0/3512010820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb000d27e0 0x7feb000d2200 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7feae8009850 tx=0x7feae8009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:48.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.960+0000 7feb056b1700 1 -- 172.21.15.87:0/3512010820 shutdown_connections 2023-03-30T08:11:48.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.960+0000 7feb056b1700 1 --2- 172.21.15.87:0/3512010820 >> v2:172.21.15.115:3300/0 conn(0x7feb0006a3e0 0x7feb000d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.960+0000 7feb056b1700 1 --2- 172.21.15.87:0/3512010820 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb000d27e0 0x7feb000d2200 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.960+0000 7feb056b1700 1 -- 172.21.15.87:0/3512010820 >> 172.21.15.87:0/3512010820 conn(0x7feb000b53f0 msgr2=0x7feb000cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:48.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.960+0000 7feb056b1700 1 -- 172.21.15.87:0/3512010820 shutdown_connections 2023-03-30T08:11:48.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.960+0000 7feb056b1700 1 -- 172.21.15.87:0/3512010820 wait complete. 2023-03-30T08:11:48.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.964+0000 7feb056b1700 1 Processor -- start 2023-03-30T08:11:48.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.964+0000 7feb056b1700 1 -- start start 2023-03-30T08:11:48.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.964+0000 7feb056b1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb0006a3e0 0x7feb001f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.964+0000 7feb056b1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb000b8380 0x7feb000cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.964+0000 7feb056b1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb000d0860 0x7feb000d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.964+0000 7feb056b1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0015dcc0 con 0x7feb000b8380 2023-03-30T08:11:48.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.964+0000 7feb056b1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb000d11d0 con 0x7feb000d0860 2023-03-30T08:11:48.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.964+0000 7feb056b1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb001f2a70 con 0x7feb0006a3e0 2023-03-30T08:11:48.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.964+0000 7feaf77fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb000b8380 0x7feb000cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.964+0000 7feaf77fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb000b8380 0x7feb000cc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56012/0 (socket says 172.21.15.87:56012) 2023-03-30T08:11:48.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.964+0000 7feaf77fe700 1 -- 172.21.15.87:0/293010568 learned_addr learned my addr 172.21.15.87:0/293010568 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:48.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.964+0000 7feafffff700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb0006a3e0 0x7feb001f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.968+0000 7feaf77fe700 1 -- 172.21.15.87:0/293010568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb0006a3e0 msgr2=0x7feb001f2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.968+0000 7feaf77fe700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb0006a3e0 0x7feb001f2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.968+0000 7feaf77fe700 1 -- 172.21.15.87:0/293010568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb000d0860 msgr2=0x7feb000d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:48.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.968+0000 7feb04eb0700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb000d0860 0x7feb000d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.968+0000 7feaf77fe700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb000d0860 0x7feb000d0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:48.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.968+0000 7feaf77fe700 1 -- 172.21.15.87:0/293010568 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae80094b0 con 0x7feb000b8380 2023-03-30T08:11:48.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.968+0000 7feafffff700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb0006a3e0 0x7feb001f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:48.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.968+0000 7feb04eb0700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb000d0860 0x7feb000d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:48.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.968+0000 7feaf77fe700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb000b8380 0x7feb000cc240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feae8004000 tx=0x7feae8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:48.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.968+0000 7feafd7fa700 1 -- 172.21.15.87:0/293010568 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8006ea0 con 0x7feb000b8380 2023-03-30T08:11:48.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.968+0000 7feafd7fa700 1 -- 172.21.15.87:0/293010568 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae8011850 con 0x7feb000b8380 2023-03-30T08:11:48.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.968+0000 7feb056b1700 1 -- 172.21.15.87:0/293010568 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb000cf480 con 0x7feb000b8380 2023-03-30T08:11:48.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.968+0000 7feafd7fa700 1 -- 172.21.15.87:0/293010568 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8011c00 con 0x7feb000b8380 2023-03-30T08:11:48.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.968+0000 7feb056b1700 1 -- 172.21.15.87:0/293010568 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb000cf1a0 con 0x7feb000b8380 2023-03-30T08:11:48.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.968+0000 7feb056b1700 1 -- 172.21.15.87:0/293010568 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb000b8750 con 0x7feb000b8380 2023-03-30T08:11:48.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.972+0000 7feafd7fa700 1 -- 172.21.15.87:0/293010568 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7feae801b440 con 0x7feb000b8380 2023-03-30T08:11:48.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.972+0000 7feafd7fa700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feae00653f0 0x7feae00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:48.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.972+0000 7feafd7fa700 1 -- 172.21.15.87:0/293010568 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feae8084210 con 0x7feb000b8380 2023-03-30T08:11:48.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.972+0000 7feafffff700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feae00653f0 0x7feae00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:48.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.972+0000 7feafffff700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feae00653f0 0x7feae00678a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feb000d1450 tx=0x7feaf0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:48.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:48.980+0000 7feafd7fa700 1 -- 172.21.15.87:0/293010568 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7feae8051af0 con 0x7feb000b8380 2023-03-30T08:11:49.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.156+0000 7feb056b1700 1 -- 172.21.15.87:0/293010568 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7feb00072cf0 con 0x7feb000b8380 2023-03-30T08:11:49.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.156+0000 7feafd7fa700 1 -- 172.21.15.87:0/293010568 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7feae8003e60 con 0x7feb000b8380 2023-03-30T08:11:49.162 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:49.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.160+0000 7feb056b1700 1 -- 172.21.15.87:0/293010568 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feae00653f0 msgr2=0x7feae00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:49.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.160+0000 7feb056b1700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feae00653f0 0x7feae00678a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feb000d1450 tx=0x7feaf0009040 comp rx=0 tx=0).stop 2023-03-30T08:11:49.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.160+0000 7feb056b1700 1 -- 172.21.15.87:0/293010568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb000b8380 msgr2=0x7feb000cc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:49.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.160+0000 7feb056b1700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb000b8380 0x7feb000cc240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feae8004000 tx=0x7feae8004770 comp rx=0 tx=0).stop 2023-03-30T08:11:49.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.160+0000 7feb056b1700 1 -- 172.21.15.87:0/293010568 shutdown_connections 2023-03-30T08:11:49.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.160+0000 7feb056b1700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feae00653f0 0x7feae00678a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.160+0000 7feb056b1700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feb000d0860 0x7feb000d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.160+0000 7feb056b1700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feb000b8380 0x7feb000cc240 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.160+0000 7feb056b1700 1 --2- 172.21.15.87:0/293010568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feb0006a3e0 0x7feb001f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.160+0000 7feb056b1700 1 -- 172.21.15.87:0/293010568 >> 172.21.15.87:0/293010568 conn(0x7feb000b53f0 msgr2=0x7feb000cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:49.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.160+0000 7feb056b1700 1 -- 172.21.15.87:0/293010568 shutdown_connections 2023-03-30T08:11:49.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.160+0000 7feb056b1700 1 -- 172.21.15.87:0/293010568 wait complete. 2023-03-30T08:11:49.188 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-30T08:11:49.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.344+0000 7f2f811d2700 1 Processor -- start 2023-03-30T08:11:49.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.344+0000 7f2f811d2700 1 -- start start 2023-03-30T08:11:49.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.344+0000 7f2f811d2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f7c0afcb0 0x7f2f7c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:49.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.344+0000 7f2f811d2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2f7c0b0080 0x7f2f7c0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:49.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.344+0000 7f2f811d2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2f7c06eff0 0x7f2f7c0b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:49.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.344+0000 7f2f811d2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7c0cb110 con 0x7f2f7c0b0080 2023-03-30T08:11:49.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.344+0000 7f2f811d2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7c06f570 con 0x7f2f7c06eff0 2023-03-30T08:11:49.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.344+0000 7f2f811d2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c06f850 con 0x7f2f7c0afcb0 2023-03-30T08:11:49.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f7bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f7c0afcb0 0x7f2f7c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:49.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f737fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2f7c0b0080 0x7f2f7c0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:49.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f7bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f7c0afcb0 0x7f2f7c0ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:54080/0 (socket says 172.21.15.87:54080) 2023-03-30T08:11:49.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f7bfff700 1 -- 172.21.15.87:0/3182724427 learned_addr learned my addr 172.21.15.87:0/3182724427 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:49.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f809d1700 1 --2- 172.21.15.87:0/3182724427 >> v2:172.21.15.115:3300/0 conn(0x7f2f7c06eff0 0x7f2f7c0b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:49.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f7bfff700 1 -- 172.21.15.87:0/3182724427 >> v2:172.21.15.115:3300/0 conn(0x7f2f7c06eff0 msgr2=0x7f2f7c0b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:49.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f7bfff700 1 --2- 172.21.15.87:0/3182724427 >> v2:172.21.15.115:3300/0 conn(0x7f2f7c06eff0 0x7f2f7c0b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f7bfff700 1 -- 172.21.15.87:0/3182724427 >> v2:172.21.15.87:3300/0 conn(0x7f2f7c0b0080 msgr2=0x7f2f7c0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:49.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f7bfff700 1 --2- 172.21.15.87:0/3182724427 >> v2:172.21.15.87:3300/0 conn(0x7f2f7c0b0080 0x7f2f7c0cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f7bfff700 1 -- 172.21.15.87:0/3182724427 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c06fb30 con 0x7f2f7c0afcb0 2023-03-30T08:11:49.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f737fe700 1 --2- 172.21.15.87:0/3182724427 >> v2:172.21.15.87:3300/0 conn(0x7f2f7c0b0080 0x7f2f7c0cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:49.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f7bfff700 1 --2- 172.21.15.87:0/3182724427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f7c0afcb0 0x7f2f7c0ce680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0b3540 tx=0x7f2f6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62a07d92a2a7f142 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:49.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f7b7fe700 1 -- 172.21.15.87:0/3182724427 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00e070 con 0x7f2f7c0afcb0 2023-03-30T08:11:49.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f7b7fe700 1 -- 172.21.15.87:0/3182724427 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c0090d0 con 0x7f2f7c0afcb0 2023-03-30T08:11:49.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f7b7fe700 1 -- 172.21.15.87:0/3182724427 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00bb50 con 0x7f2f7c0afcb0 2023-03-30T08:11:49.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f811d2700 1 -- 172.21.15.87:0/3182724427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f7c0afcb0 msgr2=0x7f2f7c0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:49.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f811d2700 1 --2- 172.21.15.87:0/3182724427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f7c0afcb0 0x7f2f7c0ce680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0b3540 tx=0x7f2f6c00b330 comp rx=0 tx=0).stop 2023-03-30T08:11:49.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f811d2700 1 -- 172.21.15.87:0/3182724427 shutdown_connections 2023-03-30T08:11:49.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f811d2700 1 --2- 172.21.15.87:0/3182724427 >> v2:172.21.15.115:3300/0 conn(0x7f2f7c06eff0 0x7f2f7c0b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f811d2700 1 --2- 172.21.15.87:0/3182724427 >> v2:172.21.15.87:3300/0 conn(0x7f2f7c0b0080 0x7f2f7c0cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f811d2700 1 --2- 172.21.15.87:0/3182724427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f7c0afcb0 0x7f2f7c0ce680 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f811d2700 1 -- 172.21.15.87:0/3182724427 >> 172.21.15.87:0/3182724427 conn(0x7f2f7c099d00 msgr2=0x7f2f7c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:49.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f811d2700 1 -- 172.21.15.87:0/3182724427 shutdown_connections 2023-03-30T08:11:49.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.348+0000 7f2f811d2700 1 -- 172.21.15.87:0/3182724427 wait complete. 2023-03-30T08:11:49.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.352+0000 7f2f811d2700 1 Processor -- start 2023-03-30T08:11:49.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.352+0000 7f2f811d2700 1 -- start start 2023-03-30T08:11:49.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.352+0000 7f2f811d2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f7c06eff0 0x7f2f7c15c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:49.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.352+0000 7f2f811d2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f7c0afcb0 0x7f2f7c15a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:49.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.352+0000 7f2f811d2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f7c0b0080 0x7f2f7c157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:49.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.352+0000 7f2f811d2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c15b330 con 0x7f2f7c0b0080 2023-03-30T08:11:49.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.352+0000 7f2f811d2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c15b610 con 0x7f2f7c06eff0 2023-03-30T08:11:49.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.352+0000 7f2f811d2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c15b8f0 con 0x7f2f7c0afcb0 2023-03-30T08:11:49.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f809d1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f7c0b0080 0x7f2f7c157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:49.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f809d1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f7c0b0080 0x7f2f7c157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56022/0 (socket says 172.21.15.87:56022) 2023-03-30T08:11:49.360 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f809d1700 1 -- 172.21.15.87:0/1213938776 learned_addr learned my addr 172.21.15.87:0/1213938776 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:49.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f7bfff700 1 --2- 172.21.15.87:0/1213938776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f7c06eff0 0x7f2f7c15c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:49.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f737fe700 1 --2- 172.21.15.87:0/1213938776 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f7c0afcb0 0x7f2f7c15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:49.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f809d1700 1 -- 172.21.15.87:0/1213938776 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f7c0afcb0 msgr2=0x7f2f7c15a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:49.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f809d1700 1 --2- 172.21.15.87:0/1213938776 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f7c0afcb0 0x7f2f7c15a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f809d1700 1 -- 172.21.15.87:0/1213938776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f7c06eff0 msgr2=0x7f2f7c15c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:49.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f809d1700 1 --2- 172.21.15.87:0/1213938776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f7c06eff0 0x7f2f7c15c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f809d1700 1 -- 172.21.15.87:0/1213938776 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f640094b0 con 0x7f2f7c0b0080 2023-03-30T08:11:49.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f809d1700 1 --2- 172.21.15.87:0/1213938776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f7c0b0080 0x7f2f7c157870 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400e8e0 tx=0x7f2f7400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:49.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f797fa700 1 -- 172.21.15.87:0/1213938776 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f740096c0 con 0x7f2f7c0b0080 2023-03-30T08:11:49.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f797fa700 1 -- 172.21.15.87:0/1213938776 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f74013680 con 0x7f2f7c0b0080 2023-03-30T08:11:49.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f811d2700 1 -- 172.21.15.87:0/1213938776 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c009b30 con 0x7f2f7c0b0080 2023-03-30T08:11:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f797fa700 1 -- 172.21.15.87:0/1213938776 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74013a10 con 0x7f2f7c0b0080 2023-03-30T08:11:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.356+0000 7f2f811d2700 1 -- 172.21.15.87:0/1213938776 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c0d1790 con 0x7f2f7c0b0080 2023-03-30T08:11:49.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.360+0000 7f2f811d2700 1 -- 172.21.15.87:0/1213938776 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7c06fe10 con 0x7f2f7c0b0080 2023-03-30T08:11:49.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.360+0000 7f2f797fa700 1 -- 172.21.15.87:0/1213938776 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f2f74013b70 con 0x7f2f7c0b0080 2023-03-30T08:11:49.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.364+0000 7f2f797fa700 1 --2- 172.21.15.87:0/1213938776 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2f5c0653f0 0x7f2f5c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:49.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.364+0000 7f2f797fa700 1 -- 172.21.15.87:0/1213938776 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2f74082ad0 con 0x7f2f7c0b0080 2023-03-30T08:11:49.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.364+0000 7f2f7bfff700 1 --2- 172.21.15.87:0/1213938776 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2f5c0653f0 0x7f2f5c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:49.369 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.364+0000 7f2f7bfff700 1 --2- 172.21.15.87:0/1213938776 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2f5c0653f0 0x7f2f5c0678a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c000f80 tx=0x7f2f6c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:49.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.368+0000 7f2f797fa700 1 -- 172.21.15.87:0/1213938776 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f2f74053dc0 con 0x7f2f7c0b0080 2023-03-30T08:11:49.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.548+0000 7f2f811d2700 1 -- 172.21.15.87:0/1213938776 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2f7c0d1920 con 0x7f2f7c0b0080 2023-03-30T08:11:49.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.552+0000 7f2f797fa700 1 -- 172.21.15.87:0/1213938776 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2f7c0d1920 con 0x7f2f7c0b0080 2023-03-30T08:11:49.559 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.556+0000 7f2f811d2700 1 -- 172.21.15.87:0/1213938776 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2f5c0653f0 msgr2=0x7f2f5c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:49.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.556+0000 7f2f811d2700 1 --2- 172.21.15.87:0/1213938776 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2f5c0653f0 0x7f2f5c0678a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c000f80 tx=0x7f2f6c009000 comp rx=0 tx=0).stop 2023-03-30T08:11:49.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.556+0000 7f2f811d2700 1 -- 172.21.15.87:0/1213938776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f7c0b0080 msgr2=0x7f2f7c157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:49.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.556+0000 7f2f811d2700 1 --2- 172.21.15.87:0/1213938776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f7c0b0080 0x7f2f7c157870 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400e8e0 tx=0x7f2f7400ebf0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.556+0000 7f2f811d2700 1 -- 172.21.15.87:0/1213938776 shutdown_connections 2023-03-30T08:11:49.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.556+0000 7f2f811d2700 1 --2- 172.21.15.87:0/1213938776 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2f5c0653f0 0x7f2f5c0678a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.556+0000 7f2f811d2700 1 --2- 172.21.15.87:0/1213938776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2f7c0b0080 0x7f2f7c157870 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.556+0000 7f2f811d2700 1 --2- 172.21.15.87:0/1213938776 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2f7c0afcb0 0x7f2f7c15a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.556+0000 7f2f811d2700 1 --2- 172.21.15.87:0/1213938776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f7c06eff0 0x7f2f7c15c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:49.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.556+0000 7f2f811d2700 1 -- 172.21.15.87:0/1213938776 >> 172.21.15.87:0/1213938776 conn(0x7f2f7c099d00 msgr2=0x7f2f7c0b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:49.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.556+0000 7f2f811d2700 1 -- 172.21.15.87:0/1213938776 shutdown_connections 2023-03-30T08:11:49.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:49.556+0000 7f2f811d2700 1 -- 172.21.15.87:0/1213938776 wait complete. 2023-03-30T08:11:49.563 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2023-03-30T08:11:49.582 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-03-30T08:11:49.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:49.583 DEBUG:teuthology.orchestra.run.smithi087:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-03-30T08:11:49.783 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2023-03-30T08:11:49.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:49.784 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-03-30T08:11:49.802 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:11:49.802 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:49.818 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:11:49.819 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:49.877 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:11:49.877 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:49.937 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:50.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.099+0000 7fd834977700 1 Processor -- start 2023-03-30T08:11:50.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.099+0000 7fd834977700 1 -- start start 2023-03-30T08:11:50.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd834977700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd8300b4cf0 0x7fd8300cd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd834977700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8300cd1b0 con 0x7fd8300b84c0 2023-03-30T08:11:50.107 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd834977700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd830160f70 con 0x7fd8300d0220 2023-03-30T08:11:50.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd834977700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8300d2250 con 0x7fd8300b4cf0 2023-03-30T08:11:50.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd82effd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd8300b4cf0 0x7fd8300cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd82effd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd8300b4cf0 0x7fd8300cd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37094/0 (socket says 172.21.15.87:37094) 2023-03-30T08:11:50.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd82effd700 1 -- 172.21.15.87:0/842456192 learned_addr learned my addr 172.21.15.87:0/842456192 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:50.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd82f7fe700 1 --1- 172.21.15.87:0/842456192 >> v1:172.21.15.87:6789/0 conn(0x7fd8300b84c0 0x7fd8300b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40166/0 (socket says 172.21.15.87:40166) 2023-03-30T08:11:50.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd82effd700 1 -- 172.21.15.87:0/842456192 >> v1:172.21.15.115:6789/0 conn(0x7fd8300d0220 legacy=0x7fd8300d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:50.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd82effd700 1 -- 172.21.15.87:0/842456192 >> v1:172.21.15.87:6789/0 conn(0x7fd8300b84c0 legacy=0x7fd8300b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd82effd700 1 -- 172.21.15.87:0/842456192 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8300d2530 con 0x7fd8300b4cf0 2023-03-30T08:11:50.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd82effd700 1 --2- 172.21.15.87:0/842456192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8300b4cf0 0x7fd8300cd640 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd824009910 tx=0x7fd824009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988db6011d1b8750 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:50.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd82e7fc700 1 -- 172.21.15.87:0/842456192 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824004230 con 0x7fd8300b4cf0 2023-03-30T08:11:50.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd82e7fc700 1 -- 172.21.15.87:0/842456192 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd824004390 con 0x7fd8300b4cf0 2023-03-30T08:11:50.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd82e7fc700 1 -- 172.21.15.87:0/842456192 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824009e60 con 0x7fd8300b4cf0 2023-03-30T08:11:50.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd834977700 1 -- 172.21.15.87:0/842456192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8300b4cf0 msgr2=0x7fd8300cd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd834977700 1 --2- 172.21.15.87:0/842456192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8300b4cf0 0x7fd8300cd640 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd824009910 tx=0x7fd824009c20 comp rx=0 tx=0).stop 2023-03-30T08:11:50.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd834977700 1 -- 172.21.15.87:0/842456192 shutdown_connections 2023-03-30T08:11:50.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd834977700 1 --2- 172.21.15.87:0/842456192 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8300b4cf0 0x7fd8300cd640 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.111 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd834977700 1 -- 172.21.15.87:0/842456192 >> 172.21.15.87:0/842456192 conn(0x7fd83006a910 msgr2=0x7fd8300cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:50.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd834977700 1 -- 172.21.15.87:0/842456192 shutdown_connections 2023-03-30T08:11:50.112 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.103+0000 7fd834977700 1 -- 172.21.15.87:0/842456192 wait complete. 2023-03-30T08:11:50.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.107+0000 7fd834977700 1 Processor -- start 2023-03-30T08:11:50.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.107+0000 7fd834977700 1 -- start start 2023-03-30T08:11:50.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd834977700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8300b4cf0 0x7fd8301f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd834977700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8300b84c0 0x7fd830149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.116 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd834977700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8300d0220 0x7fd8300d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd834977700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300ca320 con 0x7fd8300b84c0 2023-03-30T08:11:50.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd834977700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8301f6280 con 0x7fd8300b4cf0 2023-03-30T08:11:50.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd834977700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300cc710 con 0x7fd8300d0220 2023-03-30T08:11:50.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd82effd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8300b84c0 0x7fd830149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd82effd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8300b84c0 0x7fd830149100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37106/0 (socket says 172.21.15.87:37106) 2023-03-30T08:11:50.117 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd82effd700 1 -- 172.21.15.87:0/3416459383 learned_addr learned my addr 172.21.15.87:0/3416459383 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:50.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd82f7fe700 1 --2- 172.21.15.87:0/3416459383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8300b4cf0 0x7fd8301f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd82ffff700 1 --2- 172.21.15.87:0/3416459383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8300d0220 0x7fd8300d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd82effd700 1 -- 172.21.15.87:0/3416459383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8300d0220 msgr2=0x7fd8300d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd82effd700 1 --2- 172.21.15.87:0/3416459383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8300d0220 0x7fd8300d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd82effd700 1 -- 172.21.15.87:0/3416459383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8300b4cf0 msgr2=0x7fd8301f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd82effd700 1 --2- 172.21.15.87:0/3416459383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8300b4cf0 0x7fd8301f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd82effd700 1 -- 172.21.15.87:0/3416459383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd824009570 con 0x7fd8300b84c0 2023-03-30T08:11:50.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd82effd700 1 --2- 172.21.15.87:0/3416459383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8300b84c0 0x7fd830149100 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd824004000 tx=0x7fd824004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:50.119 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd817fff700 1 -- 172.21.15.87:0/3416459383 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82400be00 con 0x7fd8300b84c0 2023-03-30T08:11:50.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd817fff700 1 -- 172.21.15.87:0/3416459383 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82401f070 con 0x7fd8300b84c0 2023-03-30T08:11:50.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd834977700 1 -- 172.21.15.87:0/3416459383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd830160b40 con 0x7fd8300b84c0 2023-03-30T08:11:50.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd817fff700 1 -- 172.21.15.87:0/3416459383 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824003900 con 0x7fd8300b84c0 2023-03-30T08:11:50.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.111+0000 7fd834977700 1 -- 172.21.15.87:0/3416459383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8300d2810 con 0x7fd8300b84c0 2023-03-30T08:11:50.120 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.115+0000 7fd834977700 1 -- 172.21.15.87:0/3416459383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd830160cd0 con 0x7fd8300b84c0 2023-03-30T08:11:50.121 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.115+0000 7fd817fff700 1 -- 172.21.15.87:0/3416459383 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd824021030 con 0x7fd8300b84c0 2023-03-30T08:11:50.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.119+0000 7fd817fff700 1 --2- 172.21.15.87:0/3416459383 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd81c0653f0 0x7fd81c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.119+0000 7fd817fff700 1 -- 172.21.15.87:0/3416459383 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd8240842f0 con 0x7fd8300b84c0 2023-03-30T08:11:50.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.119+0000 7fd82f7fe700 1 --2- 172.21.15.87:0/3416459383 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd81c0653f0 0x7fd81c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.119+0000 7fd82f7fe700 1 --2- 172.21.15.87:0/3416459383 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd81c0653f0 0x7fd81c0678a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd820000f60 tx=0x7fd820007d70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:50.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.123+0000 7fd817fff700 1 -- 172.21.15.87:0/3416459383 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fd824051c30 con 0x7fd8300b84c0 2023-03-30T08:11:50.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.295+0000 7fd834977700 1 -- 172.21.15.87:0/3416459383 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd830160cd0 con 0x7fd8300b84c0 2023-03-30T08:11:50.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.299+0000 7fd817fff700 1 -- 172.21.15.87:0/3416459383 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+19747 (secure 0 0 0) 0x7fd824055250 con 0x7fd8300b84c0 2023-03-30T08:11:50.304 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:50.304 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:39.157903+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:50.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.303+0000 7fd834977700 1 -- 172.21.15.87:0/3416459383 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd81c0653f0 msgr2=0x7fd81c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.303+0000 7fd834977700 1 --2- 172.21.15.87:0/3416459383 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd81c0653f0 0x7fd81c0678a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd820000f60 tx=0x7fd820007d70 comp rx=0 tx=0).stop 2023-03-30T08:11:50.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.303+0000 7fd834977700 1 -- 172.21.15.87:0/3416459383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8300b84c0 msgr2=0x7fd830149100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.303+0000 7fd834977700 1 --2- 172.21.15.87:0/3416459383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8300b84c0 0x7fd830149100 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd824004000 tx=0x7fd824004770 comp rx=0 tx=0).stop 2023-03-30T08:11:50.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.303+0000 7fd834977700 1 -- 172.21.15.87:0/3416459383 shutdown_connections 2023-03-30T08:11:50.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.303+0000 7fd834977700 1 --2- 172.21.15.87:0/3416459383 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd81c0653f0 0x7fd81c0678a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.303+0000 7fd834977700 1 --2- 172.21.15.87:0/3416459383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8300d0220 0x7fd8300d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.303+0000 7fd834977700 1 --2- 172.21.15.87:0/3416459383 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd8300b84c0 0x7fd830149100 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.303+0000 7fd834977700 1 --2- 172.21.15.87:0/3416459383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8300b4cf0 0x7fd8301f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.303+0000 7fd834977700 1 -- 172.21.15.87:0/3416459383 >> 172.21.15.87:0/3416459383 conn(0x7fd83006a910 msgr2=0x7fd83015c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:50.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.303+0000 7fd834977700 1 -- 172.21.15.87:0/3416459383 shutdown_connections 2023-03-30T08:11:50.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.303+0000 7fd834977700 1 -- 172.21.15.87:0/3416459383 wait complete. 2023-03-30T08:11:50.325 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-30T08:10:56.407927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-30T08:10:57.359214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-30T08:11:00.430972+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-30T08:11:50.326 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T08:11:50.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d8f70700 1 Processor -- start 2023-03-30T08:11:50.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d8f70700 1 -- start start 2023-03-30T08:11:50.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d8f70700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f66d40b3f30 0x7f66d40b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d8f70700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f66d40af350 0x7f66d406c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d8f70700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d406b670 con 0x7f66d406a6e0 2023-03-30T08:11:50.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d8f70700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d406b0b0 con 0x7f66d40af350 2023-03-30T08:11:50.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d8f70700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d406b390 con 0x7f66d40b3f30 2023-03-30T08:11:50.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d3fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f66d40af350 0x7f66d406c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d3fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f66d40af350 0x7f66d406c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37112/0 (socket says 172.21.15.87:37112) 2023-03-30T08:11:50.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d3fff700 1 -- 172.21.15.87:0/1424338791 learned_addr learned my addr 172.21.15.87:0/1424338791 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:50.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d37fe700 1 --2- 172.21.15.87:0/1424338791 >> v2:172.21.15.115:3300/0 conn(0x7f66d40b3f30 0x7f66d40b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d3fff700 1 -- 172.21.15.87:0/1424338791 >> v2:172.21.15.115:3300/0 conn(0x7f66d40b3f30 msgr2=0x7f66d40b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:50.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d3fff700 1 --2- 172.21.15.87:0/1424338791 >> v2:172.21.15.115:3300/0 conn(0x7f66d40b3f30 0x7f66d40b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d3fff700 1 -- 172.21.15.87:0/1424338791 >> v1:172.21.15.87:6789/0 conn(0x7f66d406a6e0 legacy=0x7f66d40aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d3fff700 1 -- 172.21.15.87:0/1424338791 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d40aded0 con 0x7f66d40af350 2023-03-30T08:11:50.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.487+0000 7f66d37fe700 1 --2- 172.21.15.87:0/1424338791 >> v2:172.21.15.115:3300/0 conn(0x7f66d40b3f30 0x7f66d40b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:50.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.491+0000 7f66d3fff700 1 --2- 172.21.15.87:0/1424338791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d40af350 0x7f66d406c310 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f66d40cafe0 tx=0x7f66cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218936cf68b66a88 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:50.497 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.491+0000 7f66d27fc700 1 -- 172.21.15.87:0/1424338791 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc00e070 con 0x7f66d40af350 2023-03-30T08:11:50.497 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.491+0000 7f66d27fc700 1 -- 172.21.15.87:0/1424338791 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc00b9c0 con 0x7f66d40af350 2023-03-30T08:11:50.497 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.491+0000 7f66d27fc700 1 -- 172.21.15.87:0/1424338791 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc00bd70 con 0x7f66d40af350 2023-03-30T08:11:50.498 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.491+0000 7f66d8f70700 1 -- 172.21.15.87:0/1424338791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d40af350 msgr2=0x7f66d406c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.498 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.491+0000 7f66d8f70700 1 --2- 172.21.15.87:0/1424338791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d40af350 0x7f66d406c310 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f66d40cafe0 tx=0x7f66cc00b330 comp rx=0 tx=0).stop 2023-03-30T08:11:50.498 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.491+0000 7f66d8f70700 1 -- 172.21.15.87:0/1424338791 shutdown_connections 2023-03-30T08:11:50.498 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.491+0000 7f66d8f70700 1 --2- 172.21.15.87:0/1424338791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d40af350 0x7f66d406c310 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.498 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.491+0000 7f66d8f70700 1 --2- 172.21.15.87:0/1424338791 >> v2:172.21.15.115:3300/0 conn(0x7f66d40b3f30 0x7f66d40b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.498 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.491+0000 7f66d8f70700 1 -- 172.21.15.87:0/1424338791 >> 172.21.15.87:0/1424338791 conn(0x7f66d40cf410 msgr2=0x7f66d40cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:50.499 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.491+0000 7f66d8f70700 1 -- 172.21.15.87:0/1424338791 shutdown_connections 2023-03-30T08:11:50.499 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.491+0000 7f66d8f70700 1 -- 172.21.15.87:0/1424338791 wait complete. 2023-03-30T08:11:50.499 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d8f70700 1 Processor -- start 2023-03-30T08:11:50.499 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d8f70700 1 -- start start 2023-03-30T08:11:50.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d8f70700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66d406a6e0 0x7f66d4155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d8f70700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66d40af350 0x7f66d415c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d8f70700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d40b3f30 0x7f66d415c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d8f70700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d40c7120 con 0x7f66d40b3f30 2023-03-30T08:11:50.502 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d8f70700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d40c6510 con 0x7f66d40af350 2023-03-30T08:11:50.502 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d8f70700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d40c67f0 con 0x7f66d406a6e0 2023-03-30T08:11:50.502 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d3fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d40b3f30 0x7f66d415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.502 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d3fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d40b3f30 0x7f66d415c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37118/0 (socket says 172.21.15.87:37118) 2023-03-30T08:11:50.502 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d3fff700 1 -- 172.21.15.87:0/1668123537 learned_addr learned my addr 172.21.15.87:0/1668123537 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:50.503 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d2ffd700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66d40af350 0x7f66d415c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.503 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d37fe700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66d406a6e0 0x7f66d4155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.503 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d3fff700 1 -- 172.21.15.87:0/1668123537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66d406a6e0 msgr2=0x7f66d4155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.503 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d3fff700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66d406a6e0 0x7f66d4155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.504 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d3fff700 1 -- 172.21.15.87:0/1668123537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66d40af350 msgr2=0x7f66d415c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.504 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d3fff700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66d40af350 0x7f66d415c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.504 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d3fff700 1 -- 172.21.15.87:0/1668123537 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc009b30 con 0x7f66d40b3f30 2023-03-30T08:11:50.504 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d37fe700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66d406a6e0 0x7f66d4155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:50.504 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d2ffd700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66d40af350 0x7f66d415c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:50.504 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d3fff700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d40b3f30 0x7f66d415c680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f66d40cb160 tx=0x7f66cc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:50.504 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66cbfff700 1 -- 172.21.15.87:0/1668123537 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0092e0 con 0x7f66d40b3f30 2023-03-30T08:11:50.504 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66cbfff700 1 -- 172.21.15.87:0/1668123537 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc01b430 con 0x7f66d40b3f30 2023-03-30T08:11:50.505 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d8f70700 1 -- 172.21.15.87:0/1668123537 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d40b4300 con 0x7f66d40b3f30 2023-03-30T08:11:50.505 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66cbfff700 1 -- 172.21.15.87:0/1668123537 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc01b800 con 0x7f66d40b3f30 2023-03-30T08:11:50.505 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.495+0000 7f66d8f70700 1 -- 172.21.15.87:0/1668123537 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d40ae1b0 con 0x7f66d40b3f30 2023-03-30T08:11:50.506 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.499+0000 7f66d8f70700 1 -- 172.21.15.87:0/1668123537 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d406ab60 con 0x7f66d40b3f30 2023-03-30T08:11:50.506 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.499+0000 7f66cbfff700 1 -- 172.21.15.87:0/1668123537 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f66cc01b960 con 0x7f66d40b3f30 2023-03-30T08:11:50.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.503+0000 7f66cbfff700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f66b40653f0 0x7f66b40678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.503+0000 7f66cbfff700 1 -- 172.21.15.87:0/1668123537 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f66cc084250 con 0x7f66d40b3f30 2023-03-30T08:11:50.508 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.503+0000 7f66d37fe700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f66b40653f0 0x7f66b40678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.508 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.503+0000 7f66d37fe700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f66b40653f0 0x7f66b40678a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f66c40089d0 tx=0x7f66c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:50.512 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.507+0000 7f66cbfff700 1 -- 172.21.15.87:0/1668123537 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f66cc051b90 con 0x7f66d40b3f30 2023-03-30T08:11:50.674 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.667+0000 7f66d8f70700 1 -- 172.21.15.87:0/1668123537 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f66d40733a0 con 0x7f66d40b3f30 2023-03-30T08:11:50.675 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.667+0000 7f66cbfff700 1 -- 172.21.15.87:0/1668123537 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66cc0551b0 con 0x7f66d40b3f30 2023-03-30T08:11:50.675 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T08:11:50.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.671+0000 7f66d8f70700 1 -- 172.21.15.87:0/1668123537 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f66b40653f0 msgr2=0x7f66b40678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.671+0000 7f66d8f70700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f66b40653f0 0x7f66b40678a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f66c40089d0 tx=0x7f66c4008040 comp rx=0 tx=0).stop 2023-03-30T08:11:50.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.671+0000 7f66d8f70700 1 -- 172.21.15.87:0/1668123537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d40b3f30 msgr2=0x7f66d415c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.671+0000 7f66d8f70700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d40b3f30 0x7f66d415c680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f66d40cb160 tx=0x7f66cc004af0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.671+0000 7f66d8f70700 1 -- 172.21.15.87:0/1668123537 shutdown_connections 2023-03-30T08:11:50.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.671+0000 7f66d8f70700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f66b40653f0 0x7f66b40678a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.671+0000 7f66d8f70700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f66d40b3f30 0x7f66d415c680 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.671+0000 7f66d8f70700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66d40af350 0x7f66d415c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.671+0000 7f66d8f70700 1 --2- 172.21.15.87:0/1668123537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f66d406a6e0 0x7f66d4155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.671+0000 7f66d8f70700 1 -- 172.21.15.87:0/1668123537 >> 172.21.15.87:0/1668123537 conn(0x7f66d40cf410 msgr2=0x7f66d40b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:50.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.671+0000 7f66d8f70700 1 -- 172.21.15.87:0/1668123537 shutdown_connections 2023-03-30T08:11:50.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.671+0000 7f66d8f70700 1 -- 172.21.15.87:0/1668123537 wait complete. 2023-03-30T08:11:50.695 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T08:11:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.859+0000 7fd92ec45700 1 Processor -- start 2023-03-30T08:11:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.859+0000 7fd92ec45700 1 -- start start 2023-03-30T08:11:50.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92ec45700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd928071350 0x7fd9280cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92ec45700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9280cd4a0 con 0x7fd92815c270 2023-03-30T08:11:50.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92ec45700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9280717e0 con 0x7fd9280cef90 2023-03-30T08:11:50.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92ec45700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9280cc970 con 0x7fd928071350 2023-03-30T08:11:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92dc43700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd92815c270 0x7fd9280c9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40186/0 (socket says 172.21.15.87:40186) 2023-03-30T08:11:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92dc43700 1 -- 172.21.15.87:0/41282679 learned_addr learned my addr 172.21.15.87:0/41282679 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92d442700 1 --2- 172.21.15.87:0/41282679 >> v2:172.21.15.115:3300/0 conn(0x7fd928071350 0x7fd9280cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92cc41700 1 -- 172.21.15.87:0/41282679 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699201377 0 0) 0x7fd9280cd4a0 con 0x7fd92815c270 2023-03-30T08:11:50.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92cc41700 1 -- 172.21.15.87:0/41282679 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9140035d0 con 0x7fd92815c270 2023-03-30T08:11:50.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92cc41700 1 -- 172.21.15.87:0/41282679 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373294373 0 0) 0x7fd9280717e0 con 0x7fd9280cef90 2023-03-30T08:11:50.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92cc41700 1 -- 172.21.15.87:0/41282679 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9280cd4a0 con 0x7fd9280cef90 2023-03-30T08:11:50.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92d442700 1 -- 172.21.15.87:0/41282679 >> v1:172.21.15.115:6789/0 conn(0x7fd9280cef90 legacy=0x7fd9280cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92d442700 1 -- 172.21.15.87:0/41282679 >> v1:172.21.15.87:6789/0 conn(0x7fd92815c270 legacy=0x7fd9280c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92d442700 1 -- 172.21.15.87:0/41282679 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9280ccc00 con 0x7fd928071350 2023-03-30T08:11:50.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92d442700 1 --2- 172.21.15.87:0/41282679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd928071350 0x7fd9280cc430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd918009850 tx=0x7fd918009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=343d81d21336b596 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:50.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92cc41700 1 -- 172.21.15.87:0/41282679 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd918011830 con 0x7fd928071350 2023-03-30T08:11:50.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92cc41700 1 -- 172.21.15.87:0/41282679 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd918011990 con 0x7fd928071350 2023-03-30T08:11:50.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92cc41700 1 -- 172.21.15.87:0/41282679 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd918011d00 con 0x7fd928071350 2023-03-30T08:11:50.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92ec45700 1 -- 172.21.15.87:0/41282679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd928071350 msgr2=0x7fd9280cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92ec45700 1 --2- 172.21.15.87:0/41282679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd928071350 0x7fd9280cc430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd918009850 tx=0x7fd918009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:50.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92ec45700 1 -- 172.21.15.87:0/41282679 shutdown_connections 2023-03-30T08:11:50.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92ec45700 1 --2- 172.21.15.87:0/41282679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd928071350 0x7fd9280cc430 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.863+0000 7fd92ec45700 1 -- 172.21.15.87:0/41282679 >> 172.21.15.87:0/41282679 conn(0x7fd9280b0b80 msgr2=0x7fd9280b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:50.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.867+0000 7fd92ec45700 1 -- 172.21.15.87:0/41282679 shutdown_connections 2023-03-30T08:11:50.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.867+0000 7fd92ec45700 1 -- 172.21.15.87:0/41282679 wait complete. 2023-03-30T08:11:50.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.867+0000 7fd92ec45700 1 Processor -- start 2023-03-30T08:11:50.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.867+0000 7fd92ec45700 1 -- start start 2023-03-30T08:11:50.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.867+0000 7fd92ec45700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd928071350 0x7fd928155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.867+0000 7fd92ec45700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9280cef90 0x7fd9280c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.867+0000 7fd92ec45700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd92815c270 0x7fd928069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.867+0000 7fd92ec45700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9280c5d00 con 0x7fd9280cef90 2023-03-30T08:11:50.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.867+0000 7fd92ec45700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd928156190 con 0x7fd92815c270 2023-03-30T08:11:50.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.867+0000 7fd92ec45700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd928158260 con 0x7fd928071350 2023-03-30T08:11:50.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.867+0000 7fd92d442700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9280cef90 0x7fd9280c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.867+0000 7fd92d442700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9280cef90 0x7fd9280c4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37122/0 (socket says 172.21.15.87:37122) 2023-03-30T08:11:50.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.867+0000 7fd92d442700 1 -- 172.21.15.87:0/2456721185 learned_addr learned my addr 172.21.15.87:0/2456721185 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:50.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.867+0000 7fd92dc43700 1 --2- 172.21.15.87:0/2456721185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd928071350 0x7fd928155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.871+0000 7fd92e444700 1 --2- 172.21.15.87:0/2456721185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd92815c270 0x7fd928069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.871+0000 7fd92d442700 1 -- 172.21.15.87:0/2456721185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd928071350 msgr2=0x7fd928155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.871+0000 7fd92d442700 1 --2- 172.21.15.87:0/2456721185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd928071350 0x7fd928155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.871+0000 7fd92d442700 1 -- 172.21.15.87:0/2456721185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd92815c270 msgr2=0x7fd928069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:50.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.871+0000 7fd92d442700 1 --2- 172.21.15.87:0/2456721185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd92815c270 0x7fd928069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:50.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.871+0000 7fd92d442700 1 -- 172.21.15.87:0/2456721185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9180094b0 con 0x7fd9280cef90 2023-03-30T08:11:50.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.871+0000 7fd92e444700 1 --2- 172.21.15.87:0/2456721185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd92815c270 0x7fd928069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:50.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.871+0000 7fd92d442700 1 --2- 172.21.15.87:0/2456721185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9280cef90 0x7fd9280c4f40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd9180090b0 tx=0x7fd918004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:50.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.871+0000 7fd91e7fc700 1 -- 172.21.15.87:0/2456721185 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd918004480 con 0x7fd9280cef90 2023-03-30T08:11:50.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.871+0000 7fd91e7fc700 1 -- 172.21.15.87:0/2456721185 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91801f070 con 0x7fd9280cef90 2023-03-30T08:11:50.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.871+0000 7fd92ec45700 1 -- 172.21.15.87:0/2456721185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9280cd1c0 con 0x7fd9280cef90 2023-03-30T08:11:50.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.871+0000 7fd91e7fc700 1 -- 172.21.15.87:0/2456721185 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd918003900 con 0x7fd9280cef90 2023-03-30T08:11:50.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.871+0000 7fd92ec45700 1 -- 172.21.15.87:0/2456721185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9280ccee0 con 0x7fd9280cef90 2023-03-30T08:11:50.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.871+0000 7fd92ec45700 1 -- 172.21.15.87:0/2456721185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9280cec70 con 0x7fd9280cef90 2023-03-30T08:11:50.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.871+0000 7fd91e7fc700 1 -- 172.21.15.87:0/2456721185 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd918021030 con 0x7fd9280cef90 2023-03-30T08:11:50.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.875+0000 7fd91e7fc700 1 --2- 172.21.15.87:0/2456721185 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd90c0653f0 0x7fd90c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:50.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.875+0000 7fd91e7fc700 1 -- 172.21.15.87:0/2456721185 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd918083eb0 con 0x7fd9280cef90 2023-03-30T08:11:50.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.875+0000 7fd92dc43700 1 --2- 172.21.15.87:0/2456721185 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd90c0653f0 0x7fd90c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:50.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.875+0000 7fd92dc43700 1 --2- 172.21.15.87:0/2456721185 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd90c0653f0 0x7fd90c0678a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd924000f60 tx=0x7fd924009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:50.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:50.879+0000 7fd91e7fc700 1 -- 172.21.15.87:0/2456721185 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fd918051890 con 0x7fd9280cef90 2023-03-30T08:11:51.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.047+0000 7fd92ec45700 1 -- 172.21.15.87:0/2456721185 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd9280733a0 con 0x7fd9280cef90 2023-03-30T08:11:51.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.047+0000 7fd91e7fc700 1 -- 172.21.15.87:0/2456721185 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd9180150a0 con 0x7fd9280cef90 2023-03-30T08:11:51.054 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T08:11:51.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.051+0000 7fd92ec45700 1 -- 172.21.15.87:0/2456721185 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd90c0653f0 msgr2=0x7fd90c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:51.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.051+0000 7fd92ec45700 1 --2- 172.21.15.87:0/2456721185 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd90c0653f0 0x7fd90c0678a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd924000f60 tx=0x7fd924009040 comp rx=0 tx=0).stop 2023-03-30T08:11:51.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.051+0000 7fd92ec45700 1 -- 172.21.15.87:0/2456721185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9280cef90 msgr2=0x7fd9280c4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:51.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.051+0000 7fd92ec45700 1 --2- 172.21.15.87:0/2456721185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9280cef90 0x7fd9280c4f40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd9180090b0 tx=0x7fd918004770 comp rx=0 tx=0).stop 2023-03-30T08:11:51.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.051+0000 7fd92ec45700 1 -- 172.21.15.87:0/2456721185 shutdown_connections 2023-03-30T08:11:51.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.051+0000 7fd92ec45700 1 --2- 172.21.15.87:0/2456721185 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd90c0653f0 0x7fd90c0678a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.051+0000 7fd92ec45700 1 --2- 172.21.15.87:0/2456721185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd92815c270 0x7fd928069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.051+0000 7fd92ec45700 1 --2- 172.21.15.87:0/2456721185 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9280cef90 0x7fd9280c4f40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.051+0000 7fd92ec45700 1 --2- 172.21.15.87:0/2456721185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd928071350 0x7fd928155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.051+0000 7fd92ec45700 1 -- 172.21.15.87:0/2456721185 >> 172.21.15.87:0/2456721185 conn(0x7fd9280b0b80 msgr2=0x7fd9280b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:51.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.051+0000 7fd92ec45700 1 -- 172.21.15.87:0/2456721185 shutdown_connections 2023-03-30T08:11:51.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.051+0000 7fd92ec45700 1 -- 172.21.15.87:0/2456721185 wait complete. 2023-03-30T08:11:51.075 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-30T08:11:51.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.231+0000 7fd97759e700 1 Processor -- start 2023-03-30T08:11:51.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.231+0000 7fd97759e700 1 -- start start 2023-03-30T08:11:51.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.231+0000 7fd97759e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd978159050 0x7fd978069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:51.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.231+0000 7fd97759e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd97815cba0 0x7fd9780cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:51.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.231+0000 7fd97759e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9780afca0 con 0x7fd9780ca4b0 2023-03-30T08:11:51.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.231+0000 7fd97759e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9780afb10 con 0x7fd97815cba0 2023-03-30T08:11:51.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.231+0000 7fd97759e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97815d110 con 0x7fd978159050 2023-03-30T08:11:51.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.231+0000 7fd976d9d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd9780ca4b0 0x7fd9780b0130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40202/0 (socket says 172.21.15.87:40202) 2023-03-30T08:11:51.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.231+0000 7fd976d9d700 1 -- 172.21.15.87:0/3712517152 learned_addr learned my addr 172.21.15.87:0/3712517152 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:51.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd96dd9b700 1 --2- 172.21.15.87:0/3712517152 >> v2:172.21.15.87:3300/0 conn(0x7fd97815cba0 0x7fd9780cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:51.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd97659c700 1 --2- 172.21.15.87:0/3712517152 >> v2:172.21.15.115:3300/0 conn(0x7fd978159050 0x7fd978069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:51.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 -- 172.21.15.87:0/3712517152 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114481702 0 0) 0x7fd9780afca0 con 0x7fd9780ca4b0 2023-03-30T08:11:51.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 -- 172.21.15.87:0/3712517152 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9640035d0 con 0x7fd9780ca4b0 2023-03-30T08:11:51.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 -- 172.21.15.87:0/3712517152 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2183333217 0 0) 0x7fd9640035d0 con 0x7fd9780ca4b0 2023-03-30T08:11:51.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 -- 172.21.15.87:0/3712517152 >> v2:172.21.15.115:3300/0 conn(0x7fd978159050 msgr2=0x7fd978069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:51.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 --2- 172.21.15.87:0/3712517152 >> v2:172.21.15.115:3300/0 conn(0x7fd978159050 0x7fd978069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 -- 172.21.15.87:0/3712517152 >> v2:172.21.15.87:3300/0 conn(0x7fd97815cba0 msgr2=0x7fd9780cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:51.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 --2- 172.21.15.87:0/3712517152 >> v2:172.21.15.87:3300/0 conn(0x7fd97815cba0 0x7fd9780cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 -- 172.21.15.87:0/3712517152 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97815d3f0 con 0x7fd9780ca4b0 2023-03-30T08:11:51.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 -- 172.21.15.87:0/3712517152 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7fd9700019f0 con 0x7fd9780ca4b0 2023-03-30T08:11:51.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 -- 172.21.15.87:0/3712517152 >> v1:172.21.15.87:6789/0 conn(0x7fd9780ca4b0 legacy=0x7fd9780b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:51.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 --2- 172.21.15.87:0/3712517152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd964003a20 0x7fd964003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:51.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 --2- 172.21.15.87:0/3712517152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd964004870 0x7fd964004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:51.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 --2- 172.21.15.87:0/3712517152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd964005220 0x7fd96400dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:51.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 -- 172.21.15.87:0/3712517152 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9780afb10 con 0x7fd964004870 2023-03-30T08:11:51.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 -- 172.21.15.87:0/3712517152 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97815d110 con 0x7fd964003a20 2023-03-30T08:11:51.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 -- 172.21.15.87:0/3712517152 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96400e1b0 con 0x7fd964005220 2023-03-30T08:11:51.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd96dd9b700 1 --2- 172.21.15.87:0/3712517152 >> v2:172.21.15.87:3300/0 conn(0x7fd97815cba0 0x7fd9780cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:51.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd96dd9b700 1 --2- 172.21.15.87:0/3712517152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd964004870 0x7fd964004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:51.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd97659c700 1 --2- 172.21.15.87:0/3712517152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd964003a20 0x7fd964003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:51.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd976d9d700 1 --2- 172.21.15.87:0/3712517152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd964005220 0x7fd96400dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:51.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd96dd9b700 1 -- 172.21.15.87:0/3712517152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd964005220 msgr2=0x7fd96400dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:51.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd96dd9b700 1 --2- 172.21.15.87:0/3712517152 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd964005220 0x7fd96400dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd96dd9b700 1 -- 172.21.15.87:0/3712517152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd964003a20 msgr2=0x7fd964003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:51.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd96dd9b700 1 --2- 172.21.15.87:0/3712517152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd964003a20 0x7fd964003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd96dd9b700 1 -- 172.21.15.87:0/3712517152 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9640035d0 con 0x7fd964004870 2023-03-30T08:11:51.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd976d9d700 1 -- 172.21.15.87:0/3712517152 reap_dead start 2023-03-30T08:11:51.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd96dd9b700 1 --2- 172.21.15.87:0/3712517152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd964004870 0x7fd964004ce0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd960009d20 tx=0x7fd9640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac351926f36589c server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:51.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 -- 172.21.15.87:0/3712517152 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd960009e70 con 0x7fd964004870 2023-03-30T08:11:51.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 -- 172.21.15.87:0/3712517152 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96000e9a0 con 0x7fd964004870 2023-03-30T08:11:51.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.235+0000 7fd975d9b700 1 -- 172.21.15.87:0/3712517152 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96000ed10 con 0x7fd964004870 2023-03-30T08:11:51.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.239+0000 7fd97759e700 1 -- 172.21.15.87:0/3712517152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd964004870 msgr2=0x7fd964004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:51.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.239+0000 7fd97759e700 1 --2- 172.21.15.87:0/3712517152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd964004870 0x7fd964004ce0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd960009d20 tx=0x7fd9640058a0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.239+0000 7fd97759e700 1 -- 172.21.15.87:0/3712517152 shutdown_connections 2023-03-30T08:11:51.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.239+0000 7fd97759e700 1 --2- 172.21.15.87:0/3712517152 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd964004870 0x7fd964004ce0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.239+0000 7fd97759e700 1 -- 172.21.15.87:0/3712517152 >> 172.21.15.87:0/3712517152 conn(0x7fd9780cf410 msgr2=0x7fd9780cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:51.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.239+0000 7fd97759e700 1 -- 172.21.15.87:0/3712517152 shutdown_connections 2023-03-30T08:11:51.246 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.239+0000 7fd97759e700 1 -- 172.21.15.87:0/3712517152 wait complete. 2023-03-30T08:11:51.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.239+0000 7fd97759e700 1 Processor -- start 2023-03-30T08:11:51.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97759e700 1 -- start start 2023-03-30T08:11:51.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97759e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd964004870 0x7fd978147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:51.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97759e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9780b2670 0x7fd9780b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:51.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9780cc960 0x7fd9780ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:51.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97759e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9780cd310 con 0x7fd964004870 2023-03-30T08:11:51.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97759e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9780b3cd0 con 0x7fd9780cc960 2023-03-30T08:11:51.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97759e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9780b30c0 con 0x7fd9780b2670 2023-03-30T08:11:51.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd964004870 0x7fd978147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:51.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd964004870 0x7fd978147f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37142/0 (socket says 172.21.15.87:37142) 2023-03-30T08:11:51.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97659c700 1 -- 172.21.15.87:0/3833828214 learned_addr learned my addr 172.21.15.87:0/3833828214 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:51.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd976d9d700 1 --2- 172.21.15.87:0/3833828214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9780cc960 0x7fd9780ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:51.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd96dd9b700 1 --2- 172.21.15.87:0/3833828214 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9780b2670 0x7fd9780b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:51.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97659c700 1 -- 172.21.15.87:0/3833828214 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9780b2670 msgr2=0x7fd9780b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:51.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97659c700 1 --2- 172.21.15.87:0/3833828214 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9780b2670 0x7fd9780b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97659c700 1 -- 172.21.15.87:0/3833828214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9780cc960 msgr2=0x7fd9780ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:51.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97659c700 1 --2- 172.21.15.87:0/3833828214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9780cc960 0x7fd9780ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97659c700 1 -- 172.21.15.87:0/3833828214 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97815d9b0 con 0x7fd964004870 2023-03-30T08:11:51.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd96dd9b700 1 --2- 172.21.15.87:0/3833828214 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9780b2670 0x7fd9780b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:51.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97659c700 1 --2- 172.21.15.87:0/3833828214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd964004870 0x7fd978147f40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd968011a20 tx=0x7fd968011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:51.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd96f7fe700 1 -- 172.21.15.87:0/3833828214 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96800fa00 con 0x7fd964004870 2023-03-30T08:11:51.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd96f7fe700 1 -- 172.21.15.87:0/3833828214 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96800fb60 con 0x7fd964004870 2023-03-30T08:11:51.251 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97759e700 1 -- 172.21.15.87:0/3833828214 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97815d6d0 con 0x7fd964004870 2023-03-30T08:11:51.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd96f7fe700 1 -- 172.21.15.87:0/3833828214 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968014440 con 0x7fd964004870 2023-03-30T08:11:51.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.243+0000 7fd97759e700 1 -- 172.21.15.87:0/3833828214 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd978159420 con 0x7fd964004870 2023-03-30T08:11:51.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.247+0000 7fd97759e700 1 -- 172.21.15.87:0/3833828214 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9780733a0 con 0x7fd964004870 2023-03-30T08:11:51.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.247+0000 7fd96f7fe700 1 -- 172.21.15.87:0/3833828214 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd9680145a0 con 0x7fd964004870 2023-03-30T08:11:51.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.247+0000 7fd96f7fe700 1 --2- 172.21.15.87:0/3833828214 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd9580653f0 0x7fd9580678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:51.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.247+0000 7fd96f7fe700 1 -- 172.21.15.87:0/3833828214 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd968083210 con 0x7fd964004870 2023-03-30T08:11:51.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.247+0000 7fd96dd9b700 1 --2- 172.21.15.87:0/3833828214 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd9580653f0 0x7fd9580678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:51.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.251+0000 7fd96dd9b700 1 --2- 172.21.15.87:0/3833828214 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd9580653f0 0x7fd9580678a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd9780b4020 tx=0x7fd960008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:51.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.255+0000 7fd96f7fe700 1 -- 172.21.15.87:0/3833828214 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fd968050bb0 con 0x7fd964004870 2023-03-30T08:11:51.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.423+0000 7fd97759e700 1 -- 172.21.15.87:0/3833828214 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd97806af80 con 0x7fd964004870 2023-03-30T08:11:51.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.423+0000 7fd96f7fe700 1 -- 172.21.15.87:0/3833828214 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd9680541d0 con 0x7fd964004870 2023-03-30T08:11:51.515 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:51.516 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.427+0000 7fd97759e700 1 -- 172.21.15.87:0/3833828214 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd9580653f0 msgr2=0x7fd9580678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:51.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.427+0000 7fd97759e700 1 --2- 172.21.15.87:0/3833828214 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd9580653f0 0x7fd9580678a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd9780b4020 tx=0x7fd960008030 comp rx=0 tx=0).stop 2023-03-30T08:11:51.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.427+0000 7fd97759e700 1 -- 172.21.15.87:0/3833828214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd964004870 msgr2=0x7fd978147f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:51.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.427+0000 7fd97759e700 1 --2- 172.21.15.87:0/3833828214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd964004870 0x7fd978147f40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd968011a20 tx=0x7fd968011de0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.427+0000 7fd97759e700 1 -- 172.21.15.87:0/3833828214 shutdown_connections 2023-03-30T08:11:51.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.427+0000 7fd97759e700 1 --2- 172.21.15.87:0/3833828214 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd9580653f0 0x7fd9580678a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.427+0000 7fd97759e700 1 --2- 172.21.15.87:0/3833828214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9780cc960 0x7fd9780ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.427+0000 7fd97759e700 1 --2- 172.21.15.87:0/3833828214 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9780b2670 0x7fd9780b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.427+0000 7fd97759e700 1 --2- 172.21.15.87:0/3833828214 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd964004870 0x7fd978147f40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.427+0000 7fd97759e700 1 -- 172.21.15.87:0/3833828214 >> 172.21.15.87:0/3833828214 conn(0x7fd9780cf410 msgr2=0x7fd9780cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:51.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.427+0000 7fd97759e700 1 -- 172.21.15.87:0/3833828214 shutdown_connections 2023-03-30T08:11:51.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.427+0000 7fd97759e700 1 -- 172.21.15.87:0/3833828214 wait complete. 2023-03-30T08:11:51.518 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-30T08:11:51.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.675+0000 7fa919453700 1 Processor -- start 2023-03-30T08:11:51.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.675+0000 7fa919453700 1 -- start start 2023-03-30T08:11:51.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa919453700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa91415cec0 0x7fa9140cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:51.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa919453700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9140b46b0 0x7fa9140b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:51.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa919453700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa91415d9a0 con 0x7fa9140b5330 2023-03-30T08:11:51.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa919453700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9140b5070 con 0x7fa91415cec0 2023-03-30T08:11:51.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa919453700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140cd280 con 0x7fa9140b46b0 2023-03-30T08:11:51.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa913fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa91415cec0 0x7fa9140cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:51.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa913fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa91415cec0 0x7fa9140cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37152/0 (socket says 172.21.15.87:37152) 2023-03-30T08:11:51.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa913fff700 1 -- 172.21.15.87:0/320872282 learned_addr learned my addr 172.21.15.87:0/320872282 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:51.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa918c52700 1 --2- 172.21.15.87:0/320872282 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9140b46b0 0x7fa9140b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:51.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa913fff700 1 -- 172.21.15.87:0/320872282 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9140b46b0 msgr2=0x7fa9140b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:51.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa913fff700 1 --2- 172.21.15.87:0/320872282 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9140b46b0 0x7fa9140b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa913fff700 1 -- 172.21.15.87:0/320872282 >> v1:172.21.15.115:6789/0 conn(0x7fa9140b5330 legacy=0x7fa91415d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:51.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa913fff700 1 -- 172.21.15.87:0/320872282 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9140cd520 con 0x7fa91415cec0 2023-03-30T08:11:51.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa913fff700 1 --2- 172.21.15.87:0/320872282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa91415cec0 0x7fa9140cf9b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa904009910 tx=0x7fa904009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b36f3685c73300d server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:51.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa912ffd700 1 -- 172.21.15.87:0/320872282 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90400ba60 con 0x7fa91415cec0 2023-03-30T08:11:51.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa912ffd700 1 -- 172.21.15.87:0/320872282 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90400bbc0 con 0x7fa91415cec0 2023-03-30T08:11:51.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa912ffd700 1 -- 172.21.15.87:0/320872282 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa904009e60 con 0x7fa91415cec0 2023-03-30T08:11:51.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa919453700 1 -- 172.21.15.87:0/320872282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa91415cec0 msgr2=0x7fa9140cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:51.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa919453700 1 --2- 172.21.15.87:0/320872282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa91415cec0 0x7fa9140cf9b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa904009910 tx=0x7fa904009c20 comp rx=0 tx=0).stop 2023-03-30T08:11:51.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa919453700 1 -- 172.21.15.87:0/320872282 shutdown_connections 2023-03-30T08:11:51.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa919453700 1 --2- 172.21.15.87:0/320872282 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa9140b46b0 0x7fa9140b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa919453700 1 --2- 172.21.15.87:0/320872282 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa91415cec0 0x7fa9140cf9b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa919453700 1 -- 172.21.15.87:0/320872282 >> 172.21.15.87:0/320872282 conn(0x7fa91406b1b0 msgr2=0x7fa91406b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:51.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa919453700 1 -- 172.21.15.87:0/320872282 shutdown_connections 2023-03-30T08:11:51.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.679+0000 7fa919453700 1 -- 172.21.15.87:0/320872282 wait complete. 2023-03-30T08:11:51.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.683+0000 7fa919453700 1 Processor -- start 2023-03-30T08:11:51.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.683+0000 7fa919453700 1 -- start start 2023-03-30T08:11:51.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.683+0000 7fa919453700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9140b46b0 0x7fa9140a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:51.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.683+0000 7fa919453700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9140b5330 0x7fa9141f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:51.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.683+0000 7fa919453700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa91415cec0 0x7fa9140b8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:51.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.683+0000 7fa919453700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa914146740 con 0x7fa9140b5330 2023-03-30T08:11:51.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.683+0000 7fa919453700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140aa0a0 con 0x7fa9140b46b0 2023-03-30T08:11:51.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.683+0000 7fa919453700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140aa380 con 0x7fa91415cec0 2023-03-30T08:11:51.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.683+0000 7fa9137fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9140b5330 0x7fa9141f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:51.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.683+0000 7fa9137fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9140b5330 0x7fa9141f1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37166/0 (socket says 172.21.15.87:37166) 2023-03-30T08:11:51.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.683+0000 7fa9137fe700 1 -- 172.21.15.87:0/1005048858 learned_addr learned my addr 172.21.15.87:0/1005048858 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:51.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.683+0000 7fa913fff700 1 --2- 172.21.15.87:0/1005048858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9140b46b0 0x7fa9140a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:51.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.683+0000 7fa918c52700 1 --2- 172.21.15.87:0/1005048858 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa91415cec0 0x7fa9140b8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:51.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.687+0000 7fa9137fe700 1 -- 172.21.15.87:0/1005048858 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa91415cec0 msgr2=0x7fa9140b8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:51.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.687+0000 7fa9137fe700 1 --2- 172.21.15.87:0/1005048858 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa91415cec0 0x7fa9140b8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.687+0000 7fa9137fe700 1 -- 172.21.15.87:0/1005048858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9140b46b0 msgr2=0x7fa9140a94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:51.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.687+0000 7fa9137fe700 1 --2- 172.21.15.87:0/1005048858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9140b46b0 0x7fa9140a94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.687+0000 7fa9137fe700 1 -- 172.21.15.87:0/1005048858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa904009570 con 0x7fa9140b5330 2023-03-30T08:11:51.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.687+0000 7fa9137fe700 1 --2- 172.21.15.87:0/1005048858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9140b5330 0x7fa9141f1590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa90800c4d0 tx=0x7fa90800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:51.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.687+0000 7fa910ff9700 1 -- 172.21.15.87:0/1005048858 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9080052d0 con 0x7fa9140b5330 2023-03-30T08:11:51.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.687+0000 7fa910ff9700 1 -- 172.21.15.87:0/1005048858 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa908005430 con 0x7fa9140b5330 2023-03-30T08:11:51.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.687+0000 7fa919453700 1 -- 172.21.15.87:0/1005048858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9140cf1b0 con 0x7fa9140b5330 2023-03-30T08:11:51.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.687+0000 7fa910ff9700 1 -- 172.21.15.87:0/1005048858 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9080055a0 con 0x7fa9140b5330 2023-03-30T08:11:51.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.687+0000 7fa919453700 1 -- 172.21.15.87:0/1005048858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9140cd800 con 0x7fa9140b5330 2023-03-30T08:11:51.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.687+0000 7fa919453700 1 -- 172.21.15.87:0/1005048858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9140cf490 con 0x7fa9140b5330 2023-03-30T08:11:51.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.691+0000 7fa910ff9700 1 -- 172.21.15.87:0/1005048858 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa9080038c0 con 0x7fa9140b5330 2023-03-30T08:11:51.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.691+0000 7fa910ff9700 1 --2- 172.21.15.87:0/1005048858 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa9000653f0 0x7fa9000678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:51.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.691+0000 7fa910ff9700 1 -- 172.21.15.87:0/1005048858 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa908081f80 con 0x7fa9140b5330 2023-03-30T08:11:51.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.691+0000 7fa913fff700 1 --2- 172.21.15.87:0/1005048858 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa9000653f0 0x7fa9000678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:51.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.691+0000 7fa913fff700 1 --2- 172.21.15.87:0/1005048858 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa9000653f0 0x7fa9000678a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa904000c00 tx=0x7fa904008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:51.702 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.695+0000 7fa910ff9700 1 -- 172.21.15.87:0/1005048858 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fa90804f8c0 con 0x7fa9140b5330 2023-03-30T08:11:51.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.863+0000 7fa919453700 1 -- 172.21.15.87:0/1005048858 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9140d0880 con 0x7fa9140b5330 2023-03-30T08:11:51.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.863+0000 7fa910ff9700 1 -- 172.21.15.87:0/1005048858 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa908052ee0 con 0x7fa9140b5330 2023-03-30T08:11:51.869 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-03-30T08:11:51.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.867+0000 7fa919453700 1 -- 172.21.15.87:0/1005048858 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa9000653f0 msgr2=0x7fa9000678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:51.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.867+0000 7fa919453700 1 --2- 172.21.15.87:0/1005048858 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa9000653f0 0x7fa9000678a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa904000c00 tx=0x7fa904008030 comp rx=0 tx=0).stop 2023-03-30T08:11:51.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.867+0000 7fa919453700 1 -- 172.21.15.87:0/1005048858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9140b5330 msgr2=0x7fa9141f1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:51.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.867+0000 7fa919453700 1 --2- 172.21.15.87:0/1005048858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9140b5330 0x7fa9141f1590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa90800c4d0 tx=0x7fa90800c7e0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.867+0000 7fa919453700 1 -- 172.21.15.87:0/1005048858 shutdown_connections 2023-03-30T08:11:51.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.867+0000 7fa919453700 1 --2- 172.21.15.87:0/1005048858 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa9000653f0 0x7fa9000678a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.867+0000 7fa919453700 1 --2- 172.21.15.87:0/1005048858 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa91415cec0 0x7fa9140b8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.867+0000 7fa919453700 1 --2- 172.21.15.87:0/1005048858 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa9140b5330 0x7fa9141f1590 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.867+0000 7fa919453700 1 --2- 172.21.15.87:0/1005048858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9140b46b0 0x7fa9140a94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:51.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.867+0000 7fa919453700 1 -- 172.21.15.87:0/1005048858 >> 172.21.15.87:0/1005048858 conn(0x7fa91406b1b0 msgr2=0x7fa9140d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:51.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.867+0000 7fa919453700 1 -- 172.21.15.87:0/1005048858 shutdown_connections 2023-03-30T08:11:51.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:51.867+0000 7fa919453700 1 -- 172.21.15.87:0/1005048858 wait complete. 2023-03-30T08:11:51.892 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-30T08:11:52.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.051+0000 7fd402190700 1 Processor -- start 2023-03-30T08:11:52.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.051+0000 7fd402190700 1 -- start start 2023-03-30T08:11:52.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd402190700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3fc0b8380 0x7fd3fc0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:52.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd402190700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd3fc06a3e0 0x7fd3fc0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:52.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd402190700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3fc160ef0 con 0x7fd3fc0d27e0 2023-03-30T08:11:52.060 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd402190700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3fc0cd6a0 con 0x7fd3fc06a3e0 2023-03-30T08:11:52.060 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd402190700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc0cd3a0 con 0x7fd3fc0b8380 2023-03-30T08:11:52.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd40198f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd3fc06a3e0 0x7fd3fc0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:52.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd40198f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd3fc06a3e0 0x7fd3fc0d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:50818/0 (socket says 172.21.15.87:50818) 2023-03-30T08:11:52.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd40198f700 1 -- 172.21.15.87:0/1942456785 learned_addr learned my addr 172.21.15.87:0/1942456785 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:52.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd40118e700 1 --2- 172.21.15.87:0/1942456785 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3fc0b8380 0x7fd3fc0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:52.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd40198f700 1 -- 172.21.15.87:0/1942456785 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3fc0b8380 msgr2=0x7fd3fc0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:52.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd40198f700 1 --2- 172.21.15.87:0/1942456785 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3fc0b8380 0x7fd3fc0d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd40198f700 1 -- 172.21.15.87:0/1942456785 >> v1:172.21.15.115:6789/0 conn(0x7fd3fc0d27e0 legacy=0x7fd3fc069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:52.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd40198f700 1 -- 172.21.15.87:0/1942456785 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc0cef00 con 0x7fd3fc06a3e0 2023-03-30T08:11:52.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd40198f700 1 --2- 172.21.15.87:0/1942456785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3fc06a3e0 0x7fd3fc0d0880 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009e50 tx=0x7fd3f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79176af37c814957 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:52.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd3f3fff700 1 -- 172.21.15.87:0/1942456785 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f400e070 con 0x7fd3fc06a3e0 2023-03-30T08:11:52.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd3f3fff700 1 -- 172.21.15.87:0/1942456785 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f400b910 con 0x7fd3fc06a3e0 2023-03-30T08:11:52.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.055+0000 7fd3f3fff700 1 -- 172.21.15.87:0/1942456785 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f400bcc0 con 0x7fd3fc06a3e0 2023-03-30T08:11:52.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.059+0000 7fd402190700 1 -- 172.21.15.87:0/1942456785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3fc06a3e0 msgr2=0x7fd3fc0d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:52.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.059+0000 7fd402190700 1 --2- 172.21.15.87:0/1942456785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3fc06a3e0 0x7fd3fc0d0880 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009e50 tx=0x7fd3f400b330 comp rx=0 tx=0).stop 2023-03-30T08:11:52.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.059+0000 7fd402190700 1 -- 172.21.15.87:0/1942456785 shutdown_connections 2023-03-30T08:11:52.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.059+0000 7fd402190700 1 --2- 172.21.15.87:0/1942456785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3fc06a3e0 0x7fd3fc0d0880 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.059+0000 7fd402190700 1 --2- 172.21.15.87:0/1942456785 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3fc0b8380 0x7fd3fc0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.059+0000 7fd402190700 1 -- 172.21.15.87:0/1942456785 >> 172.21.15.87:0/1942456785 conn(0x7fd3fc0b53f0 msgr2=0x7fd3fc0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:52.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.059+0000 7fd402190700 1 -- 172.21.15.87:0/1942456785 shutdown_connections 2023-03-30T08:11:52.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.059+0000 7fd402190700 1 -- 172.21.15.87:0/1942456785 wait complete. 2023-03-30T08:11:52.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd402190700 1 Processor -- start 2023-03-30T08:11:52.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd402190700 1 -- start start 2023-03-30T08:11:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd402190700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3fc06a3e0 0x7fd3fc14cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd402190700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3fc0b8380 0x7fd3fc15f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd402190700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3fc15f940 0x7fd3fc0b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd402190700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc0c76d0 con 0x7fd3fc0b8380 2023-03-30T08:11:52.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd402190700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc0c67e0 con 0x7fd3fc06a3e0 2023-03-30T08:11:52.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd402190700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc0c6ac0 con 0x7fd3fc15f940 2023-03-30T08:11:52.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd40098d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3fc0b8380 0x7fd3fc15f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:52.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd40118e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3fc06a3e0 0x7fd3fc14cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:52.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd40198f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3fc15f940 0x7fd3fc0b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:52.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd40198f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3fc15f940 0x7fd3fc0b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:51448/0 (socket says 172.21.15.87:51448) 2023-03-30T08:11:52.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd40198f700 1 -- 172.21.15.87:0/1766124372 learned_addr learned my addr 172.21.15.87:0/1766124372 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:52.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd40098d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3fc0b8380 0x7fd3fc15f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37182/0 (socket says 172.21.15.87:37182) 2023-03-30T08:11:52.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd40198f700 1 -- 172.21.15.87:0/1766124372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3fc06a3e0 msgr2=0x7fd3fc14cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:52.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd40198f700 1 --2- 172.21.15.87:0/1766124372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3fc06a3e0 0x7fd3fc14cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd40198f700 1 -- 172.21.15.87:0/1766124372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3fc0b8380 msgr2=0x7fd3fc15f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:52.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd40198f700 1 --2- 172.21.15.87:0/1766124372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3fc0b8380 0x7fd3fc15f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd40198f700 1 -- 172.21.15.87:0/1766124372 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f4009b30 con 0x7fd3fc15f940 2023-03-30T08:11:52.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.063+0000 7fd40198f700 1 --2- 172.21.15.87:0/1766124372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3fc15f940 0x7fd3fc0b2b90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4012000 tx=0x7fd3f4004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:52.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.067+0000 7fd3f1ffb700 1 -- 172.21.15.87:0/1766124372 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4004800 con 0x7fd3fc15f940 2023-03-30T08:11:52.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.067+0000 7fd3f1ffb700 1 -- 172.21.15.87:0/1766124372 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f40092e0 con 0x7fd3fc15f940 2023-03-30T08:11:52.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.067+0000 7fd3f1ffb700 1 -- 172.21.15.87:0/1766124372 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f401c660 con 0x7fd3fc15f940 2023-03-30T08:11:52.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.067+0000 7fd402190700 1 -- 172.21.15.87:0/1766124372 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3fc0cf480 con 0x7fd3fc15f940 2023-03-30T08:11:52.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.067+0000 7fd402190700 1 -- 172.21.15.87:0/1766124372 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3fc0cf1a0 con 0x7fd3fc15f940 2023-03-30T08:11:52.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.067+0000 7fd402190700 1 -- 172.21.15.87:0/1766124372 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3fc0b8750 con 0x7fd3fc15f940 2023-03-30T08:11:52.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.067+0000 7fd3f1ffb700 1 -- 172.21.15.87:0/1766124372 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd3f401c7c0 con 0x7fd3fc15f940 2023-03-30T08:11:52.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.071+0000 7fd3f1ffb700 1 --2- 172.21.15.87:0/1766124372 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd3e00653f0 0x7fd3e00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:52.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.071+0000 7fd3f1ffb700 1 -- 172.21.15.87:0/1766124372 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd3f4084390 con 0x7fd3fc15f940 2023-03-30T08:11:52.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.071+0000 7fd40118e700 1 --2- 172.21.15.87:0/1766124372 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd3e00653f0 0x7fd3e00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:52.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.071+0000 7fd40118e700 1 --2- 172.21.15.87:0/1766124372 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd3e00653f0 0x7fd3e00678a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009bf0 tx=0x7fd3f8009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:52.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.079+0000 7fd3f1ffb700 1 -- 172.21.15.87:0/1766124372 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fd3f4051d70 con 0x7fd3fc15f940 2023-03-30T08:11:52.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.247+0000 7fd402190700 1 -- 172.21.15.87:0/1766124372 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd3fc072cf0 con 0x7fd3fc15f940 2023-03-30T08:11:52.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.247+0000 7fd3f1ffb700 1 -- 172.21.15.87:0/1766124372 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd3f4055390 con 0x7fd3fc15f940 2023-03-30T08:11:52.255 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:52.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.251+0000 7fd402190700 1 -- 172.21.15.87:0/1766124372 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd3e00653f0 msgr2=0x7fd3e00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:52.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.255+0000 7fd402190700 1 --2- 172.21.15.87:0/1766124372 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd3e00653f0 0x7fd3e00678a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009bf0 tx=0x7fd3f8009240 comp rx=0 tx=0).stop 2023-03-30T08:11:52.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.255+0000 7fd402190700 1 -- 172.21.15.87:0/1766124372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3fc15f940 msgr2=0x7fd3fc0b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:52.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.255+0000 7fd402190700 1 --2- 172.21.15.87:0/1766124372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3fc15f940 0x7fd3fc0b2b90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4012000 tx=0x7fd3f4004af0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.255+0000 7fd402190700 1 -- 172.21.15.87:0/1766124372 shutdown_connections 2023-03-30T08:11:52.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.255+0000 7fd402190700 1 --2- 172.21.15.87:0/1766124372 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd3e00653f0 0x7fd3e00678a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.255+0000 7fd402190700 1 --2- 172.21.15.87:0/1766124372 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd3fc15f940 0x7fd3fc0b2b90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.255+0000 7fd402190700 1 --2- 172.21.15.87:0/1766124372 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd3fc0b8380 0x7fd3fc15f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.255+0000 7fd402190700 1 --2- 172.21.15.87:0/1766124372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3fc06a3e0 0x7fd3fc14cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.255+0000 7fd402190700 1 -- 172.21.15.87:0/1766124372 >> 172.21.15.87:0/1766124372 conn(0x7fd3fc0b53f0 msgr2=0x7fd3fc0b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:52.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.255+0000 7fd402190700 1 -- 172.21.15.87:0/1766124372 shutdown_connections 2023-03-30T08:11:52.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.255+0000 7fd402190700 1 -- 172.21.15.87:0/1766124372 wait complete. 2023-03-30T08:11:52.280 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-30T08:11:52.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.435+0000 7f0295db4700 1 Processor -- start 2023-03-30T08:11:52.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.435+0000 7f0295db4700 1 -- start start 2023-03-30T08:11:52.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.435+0000 7f0295db4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f02900b3f30 0x7f02900b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:52.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.435+0000 7f0295db4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f029006a6e0 0x7f02900aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:52.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.435+0000 7f0295db4700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029006b670 con 0x7f02900af180 2023-03-30T08:11:52.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.435+0000 7f0295db4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02900af600 con 0x7f02900b3f30 2023-03-30T08:11:52.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.435+0000 7f0295db4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029006b0b0 con 0x7f029006a6e0 2023-03-30T08:11:52.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.435+0000 7f02955b3700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f02900af180 0x7f029015ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40214/0 (socket says 172.21.15.87:40214) 2023-03-30T08:11:52.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.435+0000 7f02955b3700 1 -- 172.21.15.87:0/1997306031 learned_addr learned my addr 172.21.15.87:0/1997306031 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:52.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.435+0000 7f0294db2700 1 --2- 172.21.15.87:0/1997306031 >> v2:172.21.15.87:3300/0 conn(0x7f02900b3f30 0x7f02900b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:52.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.435+0000 7f028ffff700 1 --2- 172.21.15.87:0/1997306031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f029006a6e0 0x7f02900aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:52.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.435+0000 7f0294db2700 1 -- 172.21.15.87:0/1997306031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f029006a6e0 msgr2=0x7f02900aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:52.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.435+0000 7f0294db2700 1 --2- 172.21.15.87:0/1997306031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f029006a6e0 0x7f02900aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.435+0000 7f0294db2700 1 -- 172.21.15.87:0/1997306031 >> v1:172.21.15.87:6789/0 conn(0x7f02900af180 legacy=0x7f029015ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:52.443 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.435+0000 7f0294db2700 1 -- 172.21.15.87:0/1997306031 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029006b390 con 0x7f02900b3f30 2023-03-30T08:11:52.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.439+0000 7f0294db2700 1 --2- 172.21.15.87:0/1997306031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02900b3f30 0x7f02900b0c10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0284009850 tx=0x7f0284009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200edab2de353347 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:52.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.439+0000 7f028f7fe700 1 -- 172.21.15.87:0/1997306031 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284011830 con 0x7f02900b3f30 2023-03-30T08:11:52.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.439+0000 7f028f7fe700 1 -- 172.21.15.87:0/1997306031 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0284011990 con 0x7f02900b3f30 2023-03-30T08:11:52.444 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.439+0000 7f028f7fe700 1 -- 172.21.15.87:0/1997306031 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284011d20 con 0x7f02900b3f30 2023-03-30T08:11:52.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.439+0000 7f0295db4700 1 -- 172.21.15.87:0/1997306031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02900b3f30 msgr2=0x7f02900b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:52.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.439+0000 7f0295db4700 1 --2- 172.21.15.87:0/1997306031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02900b3f30 0x7f02900b0c10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0284009850 tx=0x7f0284009b60 comp rx=0 tx=0).stop 2023-03-30T08:11:52.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.439+0000 7f0295db4700 1 -- 172.21.15.87:0/1997306031 shutdown_connections 2023-03-30T08:11:52.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.439+0000 7f0295db4700 1 --2- 172.21.15.87:0/1997306031 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f029006a6e0 0x7f02900aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.439+0000 7f0295db4700 1 --2- 172.21.15.87:0/1997306031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02900b3f30 0x7f02900b0c10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.439+0000 7f0295db4700 1 -- 172.21.15.87:0/1997306031 >> 172.21.15.87:0/1997306031 conn(0x7f02900cf410 msgr2=0x7f02900cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:52.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.439+0000 7f0295db4700 1 -- 172.21.15.87:0/1997306031 shutdown_connections 2023-03-30T08:11:52.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.439+0000 7f0295db4700 1 -- 172.21.15.87:0/1997306031 wait complete. 2023-03-30T08:11:52.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.439+0000 7f0295db4700 1 Processor -- start 2023-03-30T08:11:52.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f0295db4700 1 -- start start 2023-03-30T08:11:52.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f0295db4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f029006a6e0 0x7f02900c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:52.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f0295db4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02900af180 0x7f0290146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:52.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f0295db4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02900b3f30 0x7f02900b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:52.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f0295db4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02900c3fb0 con 0x7f02900af180 2023-03-30T08:11:52.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f0295db4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02900c4290 con 0x7f029006a6e0 2023-03-30T08:11:52.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f0295db4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02900c4570 con 0x7f02900b3f30 2023-03-30T08:11:52.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f028ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02900af180 0x7f0290146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:52.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f028ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02900af180 0x7f0290146990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37190/0 (socket says 172.21.15.87:37190) 2023-03-30T08:11:52.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f028ffff700 1 -- 172.21.15.87:0/3263713010 learned_addr learned my addr 172.21.15.87:0/3263713010 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:52.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f0294db2700 1 --2- 172.21.15.87:0/3263713010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f029006a6e0 0x7f02900c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:52.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f02955b3700 1 --2- 172.21.15.87:0/3263713010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02900b3f30 0x7f02900b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:52.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f028ffff700 1 -- 172.21.15.87:0/3263713010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02900b3f30 msgr2=0x7f02900b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:52.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f028ffff700 1 --2- 172.21.15.87:0/3263713010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02900b3f30 0x7f02900b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f028ffff700 1 -- 172.21.15.87:0/3263713010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f029006a6e0 msgr2=0x7f02900c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:52.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f028ffff700 1 --2- 172.21.15.87:0/3263713010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f029006a6e0 0x7f02900c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f028ffff700 1 -- 172.21.15.87:0/3263713010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02840094b0 con 0x7f02900af180 2023-03-30T08:11:52.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f0294db2700 1 --2- 172.21.15.87:0/3263713010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f029006a6e0 0x7f02900c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:52.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f028ffff700 1 --2- 172.21.15.87:0/3263713010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02900af180 0x7f0290146990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f027c00d800 tx=0x7f027c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:52.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f028d7fa700 1 -- 172.21.15.87:0/3263713010 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c0125f0 con 0x7f02900af180 2023-03-30T08:11:52.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f028d7fa700 1 -- 172.21.15.87:0/3263713010 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c012750 con 0x7f02900af180 2023-03-30T08:11:52.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f028d7fa700 1 -- 172.21.15.87:0/3263713010 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c012ac0 con 0x7f02900af180 2023-03-30T08:11:52.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f0295db4700 1 -- 172.21.15.87:0/3263713010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02900ae1b0 con 0x7f02900af180 2023-03-30T08:11:52.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.443+0000 7f0295db4700 1 -- 172.21.15.87:0/3263713010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02900aded0 con 0x7f02900af180 2023-03-30T08:11:52.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.447+0000 7f0295db4700 1 -- 172.21.15.87:0/3263713010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02900b4300 con 0x7f02900af180 2023-03-30T08:11:52.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.447+0000 7f028d7fa700 1 -- 172.21.15.87:0/3263713010 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f027c012c20 con 0x7f02900af180 2023-03-30T08:11:52.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.451+0000 7f028d7fa700 1 --2- 172.21.15.87:0/3263713010 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02740653f0 0x7f02740678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:52.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.451+0000 7f028d7fa700 1 -- 172.21.15.87:0/3263713010 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f027c082f50 con 0x7f02900af180 2023-03-30T08:11:52.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.451+0000 7f0294db2700 1 --2- 172.21.15.87:0/3263713010 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02740653f0 0x7f02740678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:52.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.451+0000 7f0294db2700 1 --2- 172.21.15.87:0/3263713010 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02740653f0 0x7f02740678a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0284014040 tx=0x7f0284008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:52.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.455+0000 7f028d7fa700 1 -- 172.21.15.87:0/3263713010 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f027c054230 con 0x7f02900af180 2023-03-30T08:11:52.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.635+0000 7f0295db4700 1 -- 172.21.15.87:0/3263713010 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f02900733a0 con 0x7f02900af180 2023-03-30T08:11:52.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.639+0000 7f028d7fa700 1 -- 172.21.15.87:0/3263713010 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f027c012ed0 con 0x7f02900af180 2023-03-30T08:11:52.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.639+0000 7f0295db4700 1 -- 172.21.15.87:0/3263713010 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02740653f0 msgr2=0x7f02740678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:52.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.639+0000 7f0295db4700 1 --2- 172.21.15.87:0/3263713010 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02740653f0 0x7f02740678a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0284014040 tx=0x7f0284008030 comp rx=0 tx=0).stop 2023-03-30T08:11:52.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.639+0000 7f0295db4700 1 -- 172.21.15.87:0/3263713010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02900af180 msgr2=0x7f0290146990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:52.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.639+0000 7f0295db4700 1 --2- 172.21.15.87:0/3263713010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02900af180 0x7f0290146990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f027c00d800 tx=0x7f027c00dbc0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.639+0000 7f0295db4700 1 -- 172.21.15.87:0/3263713010 shutdown_connections 2023-03-30T08:11:52.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.639+0000 7f0295db4700 1 --2- 172.21.15.87:0/3263713010 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02740653f0 0x7f02740678a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.639+0000 7f0295db4700 1 --2- 172.21.15.87:0/3263713010 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f02900b3f30 0x7f02900b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.639+0000 7f0295db4700 1 --2- 172.21.15.87:0/3263713010 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f02900af180 0x7f0290146990 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.639+0000 7f0295db4700 1 --2- 172.21.15.87:0/3263713010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f029006a6e0 0x7f02900c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:52.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.639+0000 7f0295db4700 1 -- 172.21.15.87:0/3263713010 >> 172.21.15.87:0/3263713010 conn(0x7f02900cf410 msgr2=0x7f029006c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:52.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.639+0000 7f0295db4700 1 -- 172.21.15.87:0/3263713010 shutdown_connections 2023-03-30T08:11:52.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:52.639+0000 7f0295db4700 1 -- 172.21.15.87:0/3263713010 wait complete. 2023-03-30T08:11:52.649 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2023-03-30T08:11:52.664 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-03-30T08:11:52.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:52.665 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-03-30T08:11:52.797 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-03-30T08:11:52.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:52.797 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-03-30T08:11:52.824 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:11:52.825 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:52.841 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:11:52.841 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:52.903 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:11:52.903 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:52.963 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:53.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.171+0000 7ff105b64700 1 Processor -- start 2023-03-30T08:11:53.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.171+0000 7ff105b64700 1 -- start start 2023-03-30T08:11:53.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.171+0000 7ff105b64700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff100164190 0x7ff1000c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.171+0000 7ff105b64700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff1000aea30 0x7ff10006a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.171+0000 7ff105b64700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff100069f00 con 0x7ff100163dc0 2023-03-30T08:11:53.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.171+0000 7ff105b64700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10006d810 con 0x7ff1000aea30 2023-03-30T08:11:53.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff105b64700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1000cc1d0 con 0x7ff100164190 2023-03-30T08:11:53.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff104b62700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff100163dc0 0x7ff1000c95c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40228/0 (socket says 172.21.15.87:40228) 2023-03-30T08:11:53.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff104b62700 1 -- 172.21.15.87:0/3266074863 learned_addr learned my addr 172.21.15.87:0/3266074863 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:53.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff105363700 1 --2- 172.21.15.87:0/3266074863 >> v2:172.21.15.87:3300/0 conn(0x7ff1000aea30 0x7ff10006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff0f7fff700 1 --2- 172.21.15.87:0/3266074863 >> v2:172.21.15.115:3300/0 conn(0x7ff100164190 0x7ff1000c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff0f77fe700 1 -- 172.21.15.87:0/3266074863 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550482450 0 0) 0x7ff100069f00 con 0x7ff100163dc0 2023-03-30T08:11:53.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff0f77fe700 1 -- 172.21.15.87:0/3266074863 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e80035d0 con 0x7ff100163dc0 2023-03-30T08:11:53.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff0f7fff700 1 -- 172.21.15.87:0/3266074863 >> v2:172.21.15.87:3300/0 conn(0x7ff1000aea30 msgr2=0x7ff10006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:53.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff0f7fff700 1 --2- 172.21.15.87:0/3266074863 >> v2:172.21.15.87:3300/0 conn(0x7ff1000aea30 0x7ff10006a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff0f7fff700 1 -- 172.21.15.87:0/3266074863 >> v1:172.21.15.87:6789/0 conn(0x7ff100163dc0 legacy=0x7ff1000c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:53.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff0f7fff700 1 -- 172.21.15.87:0/3266074863 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10006cf70 con 0x7ff100164190 2023-03-30T08:11:53.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff0f7fff700 1 --2- 172.21.15.87:0/3266074863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff100164190 0x7ff1000c9cd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff10006c020 tx=0x7ff0fc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34a9af710dd442fb server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:53.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff0f77fe700 1 -- 172.21.15.87:0/3266074863 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc011830 con 0x7ff100164190 2023-03-30T08:11:53.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff0f77fe700 1 -- 172.21.15.87:0/3266074863 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc011990 con 0x7ff100164190 2023-03-30T08:11:53.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff0f77fe700 1 -- 172.21.15.87:0/3266074863 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc011d00 con 0x7ff100164190 2023-03-30T08:11:53.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff105b64700 1 -- 172.21.15.87:0/3266074863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff100164190 msgr2=0x7ff1000c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:53.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff105b64700 1 --2- 172.21.15.87:0/3266074863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff100164190 0x7ff1000c9cd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff10006c020 tx=0x7ff0fc009b30 comp rx=0 tx=0).stop 2023-03-30T08:11:53.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff105b64700 1 -- 172.21.15.87:0/3266074863 shutdown_connections 2023-03-30T08:11:53.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff105b64700 1 --2- 172.21.15.87:0/3266074863 >> v2:172.21.15.87:3300/0 conn(0x7ff1000aea30 0x7ff10006a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff105b64700 1 --2- 172.21.15.87:0/3266074863 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff100164190 0x7ff1000c9cd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff105b64700 1 -- 172.21.15.87:0/3266074863 >> 172.21.15.87:0/3266074863 conn(0x7ff1000cf410 msgr2=0x7ff1000cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:53.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff105b64700 1 -- 172.21.15.87:0/3266074863 shutdown_connections 2023-03-30T08:11:53.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.175+0000 7ff105b64700 1 -- 172.21.15.87:0/3266074863 wait complete. 2023-03-30T08:11:53.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.179+0000 7ff105b64700 1 Processor -- start 2023-03-30T08:11:53.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.179+0000 7ff105b64700 1 -- start start 2023-03-30T08:11:53.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.179+0000 7ff105b64700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1000aea30 0x7ff1000b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.179+0000 7ff105b64700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff100163dc0 0x7ff1000cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.179+0000 7ff105b64700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff100164190 0x7ff1000cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.179+0000 7ff105b64700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1000c4dc0 con 0x7ff100164190 2023-03-30T08:11:53.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.179+0000 7ff105b64700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1000c2300 con 0x7ff1000aea30 2023-03-30T08:11:53.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.179+0000 7ff105b64700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1000c25e0 con 0x7ff100163dc0 2023-03-30T08:11:53.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.179+0000 7ff105363700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff100164190 0x7ff1000cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.179+0000 7ff105363700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff100164190 0x7ff1000cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37208/0 (socket says 172.21.15.87:37208) 2023-03-30T08:11:53.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.179+0000 7ff105363700 1 -- 172.21.15.87:0/1367049599 learned_addr learned my addr 172.21.15.87:0/1367049599 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:53.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.183+0000 7ff104b62700 1 --2- 172.21.15.87:0/1367049599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1000aea30 0x7ff1000b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.183+0000 7ff0f7fff700 1 --2- 172.21.15.87:0/1367049599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff100163dc0 0x7ff1000cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.183+0000 7ff105363700 1 -- 172.21.15.87:0/1367049599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff100163dc0 msgr2=0x7ff1000cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:53.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.183+0000 7ff105363700 1 --2- 172.21.15.87:0/1367049599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff100163dc0 0x7ff1000cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.183+0000 7ff105363700 1 -- 172.21.15.87:0/1367049599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1000aea30 msgr2=0x7ff1000b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:53.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.183+0000 7ff105363700 1 --2- 172.21.15.87:0/1367049599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1000aea30 0x7ff1000b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.183+0000 7ff105363700 1 -- 172.21.15.87:0/1367049599 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc0094b0 con 0x7ff100164190 2023-03-30T08:11:53.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.183+0000 7ff104b62700 1 --2- 172.21.15.87:0/1367049599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1000aea30 0x7ff1000b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:53.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.183+0000 7ff105363700 1 --2- 172.21.15.87:0/1367049599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff100164190 0x7ff1000cda30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800ef90 tx=0x7ff0f8009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:53.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.183+0000 7ff0f57fa700 1 -- 172.21.15.87:0/1367049599 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8009b20 con 0x7ff100164190 2023-03-30T08:11:53.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.183+0000 7ff0f57fa700 1 -- 172.21.15.87:0/1367049599 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f800f040 con 0x7ff100164190 2023-03-30T08:11:53.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.183+0000 7ff105b64700 1 -- 172.21.15.87:0/1367049599 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10006d530 con 0x7ff100164190 2023-03-30T08:11:53.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.183+0000 7ff0f57fa700 1 -- 172.21.15.87:0/1367049599 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f800cd20 con 0x7ff100164190 2023-03-30T08:11:53.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.183+0000 7ff105b64700 1 -- 172.21.15.87:0/1367049599 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10006d250 con 0x7ff100164190 2023-03-30T08:11:53.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.183+0000 7ff105b64700 1 -- 172.21.15.87:0/1367049599 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10006cc40 con 0x7ff100164190 2023-03-30T08:11:53.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.187+0000 7ff0f57fa700 1 -- 172.21.15.87:0/1367049599 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ff0f8014480 con 0x7ff100164190 2023-03-30T08:11:53.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.187+0000 7ff0f57fa700 1 --2- 172.21.15.87:0/1367049599 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff0ec0653f0 0x7ff0ec0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.187+0000 7ff0f57fa700 1 -- 172.21.15.87:0/1367049599 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff0f80836c0 con 0x7ff100164190 2023-03-30T08:11:53.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.187+0000 7ff104b62700 1 --2- 172.21.15.87:0/1367049599 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff0ec0653f0 0x7ff0ec0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.191+0000 7ff104b62700 1 --2- 172.21.15.87:0/1367049599 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff0ec0653f0 0x7ff0ec0678a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0005930 tx=0x7ff0f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:53.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.195+0000 7ff0f57fa700 1 -- 172.21.15.87:0/1367049599 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7ff0f8050f10 con 0x7ff100164190 2023-03-30T08:11:53.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.367+0000 7ff105b64700 1 -- 172.21.15.87:0/1367049599 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff100067210 con 0x7ff100164190 2023-03-30T08:11:53.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.371+0000 7ff0f57fa700 1 -- 172.21.15.87:0/1367049599 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+19747 (secure 0 0 0) 0x7ff100067210 con 0x7ff100164190 2023-03-30T08:11:53.376 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:53.376 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:39.157903+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:53.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.371+0000 7ff105b64700 1 -- 172.21.15.87:0/1367049599 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff0ec0653f0 msgr2=0x7ff0ec0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:53.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.371+0000 7ff105b64700 1 --2- 172.21.15.87:0/1367049599 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff0ec0653f0 0x7ff0ec0678a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0005930 tx=0x7ff0f0009040 comp rx=0 tx=0).stop 2023-03-30T08:11:53.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.371+0000 7ff105b64700 1 -- 172.21.15.87:0/1367049599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff100164190 msgr2=0x7ff1000cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:53.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.371+0000 7ff105b64700 1 --2- 172.21.15.87:0/1367049599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff100164190 0x7ff1000cda30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800ef90 tx=0x7ff0f8009f60 comp rx=0 tx=0).stop 2023-03-30T08:11:53.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.375+0000 7ff105b64700 1 -- 172.21.15.87:0/1367049599 shutdown_connections 2023-03-30T08:11:53.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.375+0000 7ff105b64700 1 --2- 172.21.15.87:0/1367049599 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff0ec0653f0 0x7ff0ec0678a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.375+0000 7ff105b64700 1 --2- 172.21.15.87:0/1367049599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff100164190 0x7ff1000cda30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.375+0000 7ff105b64700 1 --2- 172.21.15.87:0/1367049599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff100163dc0 0x7ff1000cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.375+0000 7ff105b64700 1 --2- 172.21.15.87:0/1367049599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1000aea30 0x7ff1000b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.375+0000 7ff105b64700 1 -- 172.21.15.87:0/1367049599 >> 172.21.15.87:0/1367049599 conn(0x7ff1000cf410 msgr2=0x7ff10006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:53.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.375+0000 7ff105b64700 1 -- 172.21.15.87:0/1367049599 shutdown_connections 2023-03-30T08:11:53.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.375+0000 7ff105b64700 1 -- 172.21.15.87:0/1367049599 wait complete. 2023-03-30T08:11:53.400 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-30T08:10:56.407927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-30T08:10:57.359214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-30T08:11:00.430972+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-30T08:11:53.401 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T08:11:53.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.559+0000 7f7e373c3700 1 Processor -- start 2023-03-30T08:11:53.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.559+0000 7f7e373c3700 1 -- start start 2023-03-30T08:11:53.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.559+0000 7f7e373c3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7e30159050 0x7f7e30069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.559+0000 7f7e373c3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e300ca4b0 0x7f7e300ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.559+0000 7f7e373c3700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e300afca0 con 0x7f7e3015cba0 2023-03-30T08:11:53.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.559+0000 7f7e373c3700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e300afb10 con 0x7f7e30159050 2023-03-30T08:11:53.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.559+0000 7f7e373c3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e300cae70 con 0x7f7e300ca4b0 2023-03-30T08:11:53.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e35bc0700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7e3015cba0 0x7f7e300cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40236/0 (socket says 172.21.15.87:40236) 2023-03-30T08:11:53.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e35bc0700 1 -- 172.21.15.87:0/1490997568 learned_addr learned my addr 172.21.15.87:0/1490997568 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:53.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e36bc2700 1 --2- 172.21.15.87:0/1490997568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e300ca4b0 0x7f7e300ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e363c1700 1 --2- 172.21.15.87:0/1490997568 >> v2:172.21.15.115:3300/0 conn(0x7f7e30159050 0x7f7e30069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e353bf700 1 -- 172.21.15.87:0/1490997568 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557226325 0 0) 0x7f7e300afca0 con 0x7f7e3015cba0 2023-03-30T08:11:53.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e353bf700 1 -- 172.21.15.87:0/1490997568 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e1c0035d0 con 0x7f7e3015cba0 2023-03-30T08:11:53.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e36bc2700 1 -- 172.21.15.87:0/1490997568 >> v2:172.21.15.115:3300/0 conn(0x7f7e30159050 msgr2=0x7f7e30069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:53.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e36bc2700 1 --2- 172.21.15.87:0/1490997568 >> v2:172.21.15.115:3300/0 conn(0x7f7e30159050 0x7f7e30069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e353bf700 1 -- 172.21.15.87:0/1490997568 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2620662687 0 0) 0x7f7e1c0035d0 con 0x7f7e3015cba0 2023-03-30T08:11:53.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e36bc2700 1 -- 172.21.15.87:0/1490997568 >> v1:172.21.15.87:6789/0 conn(0x7f7e3015cba0 legacy=0x7f7e300cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:53.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e36bc2700 1 -- 172.21.15.87:0/1490997568 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3015d110 con 0x7f7e300ca4b0 2023-03-30T08:11:53.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e36bc2700 1 --2- 172.21.15.87:0/1490997568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e300ca4b0 0x7f7e300ca930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009d90 tx=0x7f7e2800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5e0821b157cc844 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:53.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e353bf700 1 -- 172.21.15.87:0/1490997568 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2800e070 con 0x7f7e300ca4b0 2023-03-30T08:11:53.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e353bf700 1 -- 172.21.15.87:0/1490997568 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e28003a40 con 0x7f7e300ca4b0 2023-03-30T08:11:53.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e353bf700 1 -- 172.21.15.87:0/1490997568 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20001670 con 0x7f7e300ca4b0 2023-03-30T08:11:53.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e373c3700 1 -- 172.21.15.87:0/1490997568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e300ca4b0 msgr2=0x7f7e300ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:53.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.563+0000 7f7e373c3700 1 --2- 172.21.15.87:0/1490997568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e300ca4b0 0x7f7e300ca930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009d90 tx=0x7f7e2800b330 comp rx=0 tx=0).stop 2023-03-30T08:11:53.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.567+0000 7f7e373c3700 1 -- 172.21.15.87:0/1490997568 shutdown_connections 2023-03-30T08:11:53.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.567+0000 7f7e373c3700 1 --2- 172.21.15.87:0/1490997568 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e300ca4b0 0x7f7e300ca930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.567+0000 7f7e373c3700 1 --2- 172.21.15.87:0/1490997568 >> v2:172.21.15.115:3300/0 conn(0x7f7e30159050 0x7f7e30069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.567+0000 7f7e373c3700 1 -- 172.21.15.87:0/1490997568 >> 172.21.15.87:0/1490997568 conn(0x7f7e300cf410 msgr2=0x7f7e300cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:53.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.567+0000 7f7e373c3700 1 -- 172.21.15.87:0/1490997568 shutdown_connections 2023-03-30T08:11:53.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.567+0000 7f7e373c3700 1 -- 172.21.15.87:0/1490997568 wait complete. 2023-03-30T08:11:53.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.567+0000 7f7e373c3700 1 Processor -- start 2023-03-30T08:11:53.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e373c3700 1 -- start start 2023-03-30T08:11:53.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e373c3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e300ca4b0 0x7f7e300cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e373c3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e30159050 0x7f7e300c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e373c3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e3015cba0 0x7f7e301554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e373c3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e300ce060 con 0x7f7e30159050 2023-03-30T08:11:53.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e373c3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e30145650 con 0x7f7e3015cba0 2023-03-30T08:11:53.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e373c3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e30145930 con 0x7f7e300ca4b0 2023-03-30T08:11:53.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e35bc0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e30159050 0x7f7e300c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e363c1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e300ca4b0 0x7f7e300cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e363c1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e300ca4b0 0x7f7e300cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:51518/0 (socket says 172.21.15.87:51518) 2023-03-30T08:11:53.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e363c1700 1 -- 172.21.15.87:0/964203891 learned_addr learned my addr 172.21.15.87:0/964203891 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:53.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e35bc0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e30159050 0x7f7e300c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37220/0 (socket says 172.21.15.87:37220) 2023-03-30T08:11:53.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e36bc2700 1 --2- 172.21.15.87:0/964203891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e3015cba0 0x7f7e301554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e363c1700 1 -- 172.21.15.87:0/964203891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e3015cba0 msgr2=0x7f7e301554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:53.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e363c1700 1 --2- 172.21.15.87:0/964203891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e3015cba0 0x7f7e301554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e363c1700 1 -- 172.21.15.87:0/964203891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e30159050 msgr2=0x7f7e300c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:53.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e363c1700 1 --2- 172.21.15.87:0/964203891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e30159050 0x7f7e300c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.571+0000 7f7e363c1700 1 -- 172.21.15.87:0/964203891 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e28009a70 con 0x7f7e300ca4b0 2023-03-30T08:11:53.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.575+0000 7f7e363c1700 1 --2- 172.21.15.87:0/964203891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e300ca4b0 0x7f7e300cd9d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00e9d0 tx=0x7f7e2c00ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:53.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.575+0000 7f7e26ffd700 1 -- 172.21.15.87:0/964203891 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c009720 con 0x7f7e300ca4b0 2023-03-30T08:11:53.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.575+0000 7f7e26ffd700 1 -- 172.21.15.87:0/964203891 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2c00ee70 con 0x7f7e300ca4b0 2023-03-30T08:11:53.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.575+0000 7f7e26ffd700 1 -- 172.21.15.87:0/964203891 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c00ca50 con 0x7f7e300ca4b0 2023-03-30T08:11:53.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.575+0000 7f7e373c3700 1 -- 172.21.15.87:0/964203891 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3015d6d0 con 0x7f7e300ca4b0 2023-03-30T08:11:53.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.575+0000 7f7e373c3700 1 -- 172.21.15.87:0/964203891 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3015d3f0 con 0x7f7e300ca4b0 2023-03-30T08:11:53.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.575+0000 7f7e373c3700 1 -- 172.21.15.87:0/964203891 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3015d9b0 con 0x7f7e300ca4b0 2023-03-30T08:11:53.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.579+0000 7f7e26ffd700 1 -- 172.21.15.87:0/964203891 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f7e2c00cbb0 con 0x7f7e300ca4b0 2023-03-30T08:11:53.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.579+0000 7f7e26ffd700 1 --2- 172.21.15.87:0/964203891 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7e140653f0 0x7f7e140678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.579+0000 7f7e26ffd700 1 -- 172.21.15.87:0/964203891 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7e2c0833b0 con 0x7f7e300ca4b0 2023-03-30T08:11:53.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.579+0000 7f7e35bc0700 1 --2- 172.21.15.87:0/964203891 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7e140653f0 0x7f7e140678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.579+0000 7f7e35bc0700 1 --2- 172.21.15.87:0/964203891 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7e140653f0 0x7f7e140678a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7e3006ab30 tx=0x7f7e20001da0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:53.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.587+0000 7f7e26ffd700 1 -- 172.21.15.87:0/964203891 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f7e2c054710 con 0x7f7e300ca4b0 2023-03-30T08:11:53.761 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.755+0000 7f7e373c3700 1 -- 172.21.15.87:0/964203891 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e300733a0 con 0x7f7e300ca4b0 2023-03-30T08:11:53.762 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.755+0000 7f7e26ffd700 1 -- 172.21.15.87:0/964203891 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e2c00ce60 con 0x7f7e300ca4b0 2023-03-30T08:11:53.762 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T08:11:53.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.759+0000 7f7e373c3700 1 -- 172.21.15.87:0/964203891 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7e140653f0 msgr2=0x7f7e140678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:53.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.759+0000 7f7e373c3700 1 --2- 172.21.15.87:0/964203891 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7e140653f0 0x7f7e140678a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7e3006ab30 tx=0x7f7e20001da0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.759+0000 7f7e373c3700 1 -- 172.21.15.87:0/964203891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e300ca4b0 msgr2=0x7f7e300cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:53.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.759+0000 7f7e373c3700 1 --2- 172.21.15.87:0/964203891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e300ca4b0 0x7f7e300cd9d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00e9d0 tx=0x7f7e2c00ece0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.759+0000 7f7e373c3700 1 -- 172.21.15.87:0/964203891 shutdown_connections 2023-03-30T08:11:53.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.759+0000 7f7e373c3700 1 --2- 172.21.15.87:0/964203891 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7e140653f0 0x7f7e140678a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.759+0000 7f7e373c3700 1 --2- 172.21.15.87:0/964203891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e3015cba0 0x7f7e301554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.759+0000 7f7e373c3700 1 --2- 172.21.15.87:0/964203891 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7e30159050 0x7f7e300c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.759+0000 7f7e373c3700 1 --2- 172.21.15.87:0/964203891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7e300ca4b0 0x7f7e300cd9d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.759+0000 7f7e373c3700 1 -- 172.21.15.87:0/964203891 >> 172.21.15.87:0/964203891 conn(0x7f7e300cf410 msgr2=0x7f7e3006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:53.769 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.759+0000 7f7e373c3700 1 -- 172.21.15.87:0/964203891 shutdown_connections 2023-03-30T08:11:53.769 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.759+0000 7f7e373c3700 1 -- 172.21.15.87:0/964203891 wait complete. 2023-03-30T08:11:53.786 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T08:11:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.947+0000 7fc612b9a700 1 Processor -- start 2023-03-30T08:11:53.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.947+0000 7fc612b9a700 1 -- start start 2023-03-30T08:11:53.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc612b9a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc60c0ca080 0x7fc60c0ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc612b9a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc60c158b00 0x7fc60c06a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc612b9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc60c06ac20 0x7fc60c0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc612b9a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60c0aff50 con 0x7fc60c0ca080 2023-03-30T08:11:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc612b9a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60c0ca990 con 0x7fc60c06ac20 2023-03-30T08:11:53.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc612b9a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c0af620 con 0x7fc60c158b00 2023-03-30T08:11:53.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc611b98700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc60c0ca080 0x7fc60c0ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc611b98700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc60c0ca080 0x7fc60c0ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37230/0 (socket says 172.21.15.87:37230) 2023-03-30T08:11:53.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc611b98700 1 -- 172.21.15.87:0/2444625417 learned_addr learned my addr 172.21.15.87:0/2444625417 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:53.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc611397700 1 --2- 172.21.15.87:0/2444625417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc60c158b00 0x7fc60c06a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc612399700 1 --2- 172.21.15.87:0/2444625417 >> v2:172.21.15.115:3300/0 conn(0x7fc60c06ac20 0x7fc60c0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc611b98700 1 -- 172.21.15.87:0/2444625417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc60c158b00 msgr2=0x7fc60c06a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:53.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc611b98700 1 --2- 172.21.15.87:0/2444625417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc60c158b00 0x7fc60c06a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc611b98700 1 -- 172.21.15.87:0/2444625417 >> v2:172.21.15.115:3300/0 conn(0x7fc60c06ac20 msgr2=0x7fc60c0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:53.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc611b98700 1 --2- 172.21.15.87:0/2444625417 >> v2:172.21.15.115:3300/0 conn(0x7fc60c06ac20 0x7fc60c0c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc611b98700 1 -- 172.21.15.87:0/2444625417 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c0af900 con 0x7fc60c0ca080 2023-03-30T08:11:53.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc611b98700 1 --2- 172.21.15.87:0/2444625417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60c0ca080 0x7fc60c0ca450 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc60c06b6a0 tx=0x7fc608009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b8b5dbe0768cc4 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:53.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc610b96700 1 -- 172.21.15.87:0/2444625417 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608011830 con 0x7fc60c0ca080 2023-03-30T08:11:53.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc610b96700 1 -- 172.21.15.87:0/2444625417 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc608011990 con 0x7fc60c0ca080 2023-03-30T08:11:53.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc610b96700 1 -- 172.21.15.87:0/2444625417 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608011d20 con 0x7fc60c0ca080 2023-03-30T08:11:53.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc612b9a700 1 -- 172.21.15.87:0/2444625417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60c0ca080 msgr2=0x7fc60c0ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:53.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.951+0000 7fc612b9a700 1 --2- 172.21.15.87:0/2444625417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60c0ca080 0x7fc60c0ca450 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc60c06b6a0 tx=0x7fc608009bf0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.955+0000 7fc612b9a700 1 -- 172.21.15.87:0/2444625417 shutdown_connections 2023-03-30T08:11:53.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.955+0000 7fc612b9a700 1 --2- 172.21.15.87:0/2444625417 >> v2:172.21.15.115:3300/0 conn(0x7fc60c06ac20 0x7fc60c0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.955+0000 7fc612b9a700 1 --2- 172.21.15.87:0/2444625417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc60c158b00 0x7fc60c06a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.955+0000 7fc612b9a700 1 --2- 172.21.15.87:0/2444625417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60c0ca080 0x7fc60c0ca450 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.955+0000 7fc612b9a700 1 -- 172.21.15.87:0/2444625417 >> 172.21.15.87:0/2444625417 conn(0x7fc60c0cf410 msgr2=0x7fc60c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:53.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.955+0000 7fc612b9a700 1 -- 172.21.15.87:0/2444625417 shutdown_connections 2023-03-30T08:11:53.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.955+0000 7fc612b9a700 1 -- 172.21.15.87:0/2444625417 wait complete. 2023-03-30T08:11:53.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.955+0000 7fc612b9a700 1 Processor -- start 2023-03-30T08:11:53.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.955+0000 7fc612b9a700 1 -- start start 2023-03-30T08:11:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc612b9a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60c06ac20 0x7fc60c15b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc612b9a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc60c0ca080 0x7fc60c0ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc612b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc60c0ace70 0x7fc60c1f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc612b9a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c0ad310 con 0x7fc60c06ac20 2023-03-30T08:11:53.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc612b9a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c0b1650 con 0x7fc60c0ace70 2023-03-30T08:11:53.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc612b9a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c0b1c10 con 0x7fc60c0ca080 2023-03-30T08:11:53.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc611b98700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60c06ac20 0x7fc60c15b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc611b98700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60c06ac20 0x7fc60c15b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37236/0 (socket says 172.21.15.87:37236) 2023-03-30T08:11:53.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc611b98700 1 -- 172.21.15.87:0/2893179771 learned_addr learned my addr 172.21.15.87:0/2893179771 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:53.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc612399700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc60c0ace70 0x7fc60c1f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc611397700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc60c0ca080 0x7fc60c0ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc611b98700 1 -- 172.21.15.87:0/2893179771 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc60c0ca080 msgr2=0x7fc60c0ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:53.965 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc611b98700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc60c0ca080 0x7fc60c0ac930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc611b98700 1 -- 172.21.15.87:0/2893179771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc60c0ace70 msgr2=0x7fc60c1f3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:53.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc611b98700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc60c0ace70 0x7fc60c1f3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:53.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc611b98700 1 -- 172.21.15.87:0/2893179771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc608009570 con 0x7fc60c06ac20 2023-03-30T08:11:53.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc612399700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc60c0ace70 0x7fc60c1f3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:53.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc611397700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc60c0ca080 0x7fc60c0ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:53.966 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc611b98700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60c06ac20 0x7fc60c15b780 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc60c06fdb0 tx=0x7fc608004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:53.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc6027fc700 1 -- 172.21.15.87:0/2893179771 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608004450 con 0x7fc60c06ac20 2023-03-30T08:11:53.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc6027fc700 1 -- 172.21.15.87:0/2893179771 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6080045b0 con 0x7fc60c06ac20 2023-03-30T08:11:53.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc6027fc700 1 -- 172.21.15.87:0/2893179771 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608003900 con 0x7fc60c06ac20 2023-03-30T08:11:53.967 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc612b9a700 1 -- 172.21.15.87:0/2893179771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60c0af240 con 0x7fc60c06ac20 2023-03-30T08:11:53.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.959+0000 7fc612b9a700 1 -- 172.21.15.87:0/2893179771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60c0afbe0 con 0x7fc60c06ac20 2023-03-30T08:11:53.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.963+0000 7fc612b9a700 1 -- 172.21.15.87:0/2893179771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60c0af3d0 con 0x7fc60c06ac20 2023-03-30T08:11:53.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.963+0000 7fc6027fc700 1 -- 172.21.15.87:0/2893179771 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc608021070 con 0x7fc60c06ac20 2023-03-30T08:11:53.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.963+0000 7fc6027fc700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc5f00653f0 0x7fc5f00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:53.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.963+0000 7fc6027fc700 1 -- 172.21.15.87:0/2893179771 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc6080840a0 con 0x7fc60c06ac20 2023-03-30T08:11:53.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.963+0000 7fc611397700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc5f00653f0 0x7fc5f00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:53.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.967+0000 7fc611397700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc5f00653f0 0x7fc5f00678a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc60c1581d0 tx=0x7fc5fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:53.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:53.971+0000 7fc6027fc700 1 -- 172.21.15.87:0/2893179771 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fc608051a80 con 0x7fc60c06ac20 2023-03-30T08:11:54.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.139+0000 7fc612b9a700 1 -- 172.21.15.87:0/2893179771 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc60c15bcc0 con 0x7fc60c06ac20 2023-03-30T08:11:54.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.139+0000 7fc6027fc700 1 -- 172.21.15.87:0/2893179771 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc6080550a0 con 0x7fc60c06ac20 2023-03-30T08:11:54.145 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T08:11:54.147 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.143+0000 7fc612b9a700 1 -- 172.21.15.87:0/2893179771 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc5f00653f0 msgr2=0x7fc5f00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:54.147 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.143+0000 7fc612b9a700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc5f00653f0 0x7fc5f00678a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc60c1581d0 tx=0x7fc5fc008040 comp rx=0 tx=0).stop 2023-03-30T08:11:54.147 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.143+0000 7fc612b9a700 1 -- 172.21.15.87:0/2893179771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60c06ac20 msgr2=0x7fc60c15b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:54.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.143+0000 7fc612b9a700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60c06ac20 0x7fc60c15b780 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc60c06fdb0 tx=0x7fc608004770 comp rx=0 tx=0).stop 2023-03-30T08:11:54.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.143+0000 7fc612b9a700 1 -- 172.21.15.87:0/2893179771 shutdown_connections 2023-03-30T08:11:54.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.143+0000 7fc612b9a700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc5f00653f0 0x7fc5f00678a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.143+0000 7fc612b9a700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc60c0ace70 0x7fc60c1f3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.143+0000 7fc612b9a700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc60c0ca080 0x7fc60c0ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.143+0000 7fc612b9a700 1 --2- 172.21.15.87:0/2893179771 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc60c06ac20 0x7fc60c15b780 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.143+0000 7fc612b9a700 1 -- 172.21.15.87:0/2893179771 >> 172.21.15.87:0/2893179771 conn(0x7fc60c0cf410 msgr2=0x7fc60c0cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:54.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.143+0000 7fc612b9a700 1 -- 172.21.15.87:0/2893179771 shutdown_connections 2023-03-30T08:11:54.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.143+0000 7fc612b9a700 1 -- 172.21.15.87:0/2893179771 wait complete. 2023-03-30T08:11:54.165 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-30T08:11:54.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.327+0000 7ffbd1cab700 1 Processor -- start 2023-03-30T08:11:54.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.327+0000 7ffbd1cab700 1 -- start start 2023-03-30T08:11:54.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd1cab700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffbcc0b8380 0x7ffbcc0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:54.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd1cab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbcc0d27e0 0x7ffbcc069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:54.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd1cab700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffbcc1609f0 0x7ffbcc06a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:54.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd1cab700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbcc160ef0 con 0x7ffbcc1609f0 2023-03-30T08:11:54.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd1cab700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbcc0cd6a0 con 0x7ffbcc0b8380 2023-03-30T08:11:54.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd1cab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0cd3a0 con 0x7ffbcc0d27e0 2023-03-30T08:11:54.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd14aa700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffbcc1609f0 0x7ffbcc06a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:54.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd14aa700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffbcc1609f0 0x7ffbcc06a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37242/0 (socket says 172.21.15.87:37242) 2023-03-30T08:11:54.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd14aa700 1 -- 172.21.15.87:0/3355954467 learned_addr learned my addr 172.21.15.87:0/3355954467 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:54.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbcbfff700 1 --2- 172.21.15.87:0/3355954467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbcc0d27e0 0x7ffbcc069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:54.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd0ca9700 1 --2- 172.21.15.87:0/3355954467 >> v2:172.21.15.115:3300/0 conn(0x7ffbcc0b8380 0x7ffbcc0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:54.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd14aa700 1 -- 172.21.15.87:0/3355954467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbcc0d27e0 msgr2=0x7ffbcc069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:54.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd14aa700 1 --2- 172.21.15.87:0/3355954467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbcc0d27e0 0x7ffbcc069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd14aa700 1 -- 172.21.15.87:0/3355954467 >> v2:172.21.15.115:3300/0 conn(0x7ffbcc0b8380 msgr2=0x7ffbcc0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:54.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd14aa700 1 --2- 172.21.15.87:0/3355954467 >> v2:172.21.15.115:3300/0 conn(0x7ffbcc0b8380 0x7ffbcc0d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd14aa700 1 -- 172.21.15.87:0/3355954467 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc0cef00 con 0x7ffbcc1609f0 2023-03-30T08:11:54.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd0ca9700 1 --2- 172.21.15.87:0/3355954467 >> v2:172.21.15.115:3300/0 conn(0x7ffbcc0b8380 0x7ffbcc0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:54.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbd14aa700 1 --2- 172.21.15.87:0/3355954467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbcc1609f0 0x7ffbcc06a210 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc06ad60 tx=0x7ffbc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90e66dc7ccfeff6 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:54.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbcb7fe700 1 -- 172.21.15.87:0/3355954467 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc400e070 con 0x7ffbcc1609f0 2023-03-30T08:11:54.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbcb7fe700 1 -- 172.21.15.87:0/3355954467 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc400b910 con 0x7ffbcc1609f0 2023-03-30T08:11:54.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.331+0000 7ffbcb7fe700 1 -- 172.21.15.87:0/3355954467 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc400bcc0 con 0x7ffbcc1609f0 2023-03-30T08:11:54.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.335+0000 7ffbd1cab700 1 -- 172.21.15.87:0/3355954467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbcc1609f0 msgr2=0x7ffbcc06a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:54.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.335+0000 7ffbd1cab700 1 --2- 172.21.15.87:0/3355954467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbcc1609f0 0x7ffbcc06a210 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc06ad60 tx=0x7ffbc400b330 comp rx=0 tx=0).stop 2023-03-30T08:11:54.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.335+0000 7ffbd1cab700 1 -- 172.21.15.87:0/3355954467 shutdown_connections 2023-03-30T08:11:54.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.335+0000 7ffbd1cab700 1 --2- 172.21.15.87:0/3355954467 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbcc1609f0 0x7ffbcc06a210 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.335+0000 7ffbd1cab700 1 --2- 172.21.15.87:0/3355954467 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbcc0d27e0 0x7ffbcc069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.335+0000 7ffbd1cab700 1 --2- 172.21.15.87:0/3355954467 >> v2:172.21.15.115:3300/0 conn(0x7ffbcc0b8380 0x7ffbcc0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.335+0000 7ffbd1cab700 1 -- 172.21.15.87:0/3355954467 >> 172.21.15.87:0/3355954467 conn(0x7ffbcc0b53f0 msgr2=0x7ffbcc0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:54.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.335+0000 7ffbd1cab700 1 -- 172.21.15.87:0/3355954467 shutdown_connections 2023-03-30T08:11:54.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.335+0000 7ffbd1cab700 1 -- 172.21.15.87:0/3355954467 wait complete. 2023-03-30T08:11:54.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.335+0000 7ffbd1cab700 1 Processor -- start 2023-03-30T08:11:54.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.335+0000 7ffbd1cab700 1 -- start start 2023-03-30T08:11:54.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbd1cab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbcc0b8380 0x7ffbcc159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:54.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbd1cab700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbcc1609f0 0x7ffbcc0d19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:54.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbd1cab700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbcc0caf30 0x7ffbcc0d1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:54.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbd1cab700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc159f20 con 0x7ffbcc1609f0 2023-03-30T08:11:54.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbd1cab700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc1f4de0 con 0x7ffbcc0caf30 2023-03-30T08:11:54.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbd1cab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc1f50c0 con 0x7ffbcc0b8380 2023-03-30T08:11:54.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbcbfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbcc1609f0 0x7ffbcc0d19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:54.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbcbfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbcc1609f0 0x7ffbcc0d19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37252/0 (socket says 172.21.15.87:37252) 2023-03-30T08:11:54.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbcbfff700 1 -- 172.21.15.87:0/1617791308 learned_addr learned my addr 172.21.15.87:0/1617791308 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:54.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbd0ca9700 1 --2- 172.21.15.87:0/1617791308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbcc0b8380 0x7ffbcc159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:54.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbd14aa700 1 --2- 172.21.15.87:0/1617791308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbcc0caf30 0x7ffbcc0d1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:54.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbcbfff700 1 -- 172.21.15.87:0/1617791308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbcc0b8380 msgr2=0x7ffbcc159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:54.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbcbfff700 1 --2- 172.21.15.87:0/1617791308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbcc0b8380 0x7ffbcc159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbcbfff700 1 -- 172.21.15.87:0/1617791308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbcc0caf30 msgr2=0x7ffbcc0d1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:54.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbcbfff700 1 --2- 172.21.15.87:0/1617791308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbcc0caf30 0x7ffbcc0d1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbcbfff700 1 -- 172.21.15.87:0/1617791308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc4009b30 con 0x7ffbcc1609f0 2023-03-30T08:11:54.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbd14aa700 1 --2- 172.21.15.87:0/1617791308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbcc0caf30 0x7ffbcc0d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:54.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbcbfff700 1 --2- 172.21.15.87:0/1617791308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbcc1609f0 0x7ffbcc0d19e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800e980 tx=0x7ffbb800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:54.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbc97fa700 1 -- 172.21.15.87:0/1617791308 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8009700 con 0x7ffbcc1609f0 2023-03-30T08:11:54.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbc97fa700 1 -- 172.21.15.87:0/1617791308 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb800eed0 con 0x7ffbcc1609f0 2023-03-30T08:11:54.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbc97fa700 1 -- 172.21.15.87:0/1617791308 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8004240 con 0x7ffbcc1609f0 2023-03-30T08:11:54.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbd1cab700 1 -- 172.21.15.87:0/1617791308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc0cf480 con 0x7ffbcc1609f0 2023-03-30T08:11:54.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.339+0000 7ffbd1cab700 1 -- 172.21.15.87:0/1617791308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc0cf1a0 con 0x7ffbcc1609f0 2023-03-30T08:11:54.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.343+0000 7ffbd1cab700 1 -- 172.21.15.87:0/1617791308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbcc0b8750 con 0x7ffbcc1609f0 2023-03-30T08:11:54.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.343+0000 7ffbc97fa700 1 -- 172.21.15.87:0/1617791308 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ffbb8004440 con 0x7ffbcc1609f0 2023-03-30T08:11:54.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.347+0000 7ffbc97fa700 1 --2- 172.21.15.87:0/1617791308 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffbb00653f0 0x7ffbb00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:54.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.347+0000 7ffbc97fa700 1 -- 172.21.15.87:0/1617791308 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffbb8082890 con 0x7ffbcc1609f0 2023-03-30T08:11:54.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.347+0000 7ffbd0ca9700 1 --2- 172.21.15.87:0/1617791308 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffbb00653f0 0x7ffbb00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:54.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.347+0000 7ffbd0ca9700 1 --2- 172.21.15.87:0/1617791308 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffbb00653f0 0x7ffbb00678a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc1f4d40 tx=0x7ffbc0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:54.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.351+0000 7ffbc97fa700 1 -- 172.21.15.87:0/1617791308 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7ffbb8053c10 con 0x7ffbcc1609f0 2023-03-30T08:11:54.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.519+0000 7ffbd1cab700 1 -- 172.21.15.87:0/1617791308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffbcc072cf0 con 0x7ffbcc1609f0 2023-03-30T08:11:54.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.523+0000 7ffbc97fa700 1 -- 172.21.15.87:0/1617791308 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffbb8053800 con 0x7ffbcc1609f0 2023-03-30T08:11:54.527 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:54.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.523+0000 7ffbd1cab700 1 -- 172.21.15.87:0/1617791308 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffbb00653f0 msgr2=0x7ffbb00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:54.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.523+0000 7ffbd1cab700 1 --2- 172.21.15.87:0/1617791308 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffbb00653f0 0x7ffbb00678a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc1f4d40 tx=0x7ffbc0008040 comp rx=0 tx=0).stop 2023-03-30T08:11:54.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.523+0000 7ffbd1cab700 1 -- 172.21.15.87:0/1617791308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbcc1609f0 msgr2=0x7ffbcc0d19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:54.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.523+0000 7ffbd1cab700 1 --2- 172.21.15.87:0/1617791308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbcc1609f0 0x7ffbcc0d19e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800e980 tx=0x7ffbb800ec90 comp rx=0 tx=0).stop 2023-03-30T08:11:54.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.523+0000 7ffbd1cab700 1 -- 172.21.15.87:0/1617791308 shutdown_connections 2023-03-30T08:11:54.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.523+0000 7ffbd1cab700 1 --2- 172.21.15.87:0/1617791308 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffbb00653f0 0x7ffbb00678a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.523+0000 7ffbd1cab700 1 --2- 172.21.15.87:0/1617791308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbcc0caf30 0x7ffbcc0d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.523+0000 7ffbd1cab700 1 --2- 172.21.15.87:0/1617791308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffbcc1609f0 0x7ffbcc0d19e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.523+0000 7ffbd1cab700 1 --2- 172.21.15.87:0/1617791308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffbcc0b8380 0x7ffbcc159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.523+0000 7ffbd1cab700 1 -- 172.21.15.87:0/1617791308 >> 172.21.15.87:0/1617791308 conn(0x7ffbcc0b53f0 msgr2=0x7ffbcc0b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:54.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.523+0000 7ffbd1cab700 1 -- 172.21.15.87:0/1617791308 shutdown_connections 2023-03-30T08:11:54.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.523+0000 7ffbd1cab700 1 -- 172.21.15.87:0/1617791308 wait complete. 2023-03-30T08:11:54.548 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-30T08:11:54.712 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.707+0000 7fecbdaf7700 1 Processor -- start 2023-03-30T08:11:54.712 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.707+0000 7fecbdaf7700 1 -- start start 2023-03-30T08:11:54.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.707+0000 7fecbdaf7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fecb815cec0 0x7fecb80cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:54.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.707+0000 7fecbdaf7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fecb80b5330 0x7fecb815d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:54.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.707+0000 7fecbdaf7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb80cd280 con 0x7fecb80b46b0 2023-03-30T08:11:54.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.707+0000 7fecbdaf7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb80cd520 con 0x7fecb815cec0 2023-03-30T08:11:54.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.707+0000 7fecbdaf7700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb80cd800 con 0x7fecb80b5330 2023-03-30T08:11:54.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.707+0000 7fecbcaf5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fecb815cec0 0x7fecb80cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:54.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.707+0000 7fecbcaf5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fecb815cec0 0x7fecb80cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37256/0 (socket says 172.21.15.87:37256) 2023-03-30T08:11:54.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.707+0000 7fecbcaf5700 1 -- 172.21.15.87:0/3570472864 learned_addr learned my addr 172.21.15.87:0/3570472864 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:54.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.707+0000 7fecb7fff700 1 --2- 172.21.15.87:0/3570472864 >> v2:172.21.15.115:3300/0 conn(0x7fecb80b5330 0x7fecb815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:54.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecbcaf5700 1 -- 172.21.15.87:0/3570472864 >> v2:172.21.15.115:3300/0 conn(0x7fecb80b5330 msgr2=0x7fecb815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:54.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecbcaf5700 1 --2- 172.21.15.87:0/3570472864 >> v2:172.21.15.115:3300/0 conn(0x7fecb80b5330 0x7fecb815d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecbcaf5700 1 -- 172.21.15.87:0/3570472864 >> v1:172.21.15.115:6789/0 conn(0x7fecb80b46b0 legacy=0x7fecb80d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:54.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecbcaf5700 1 -- 172.21.15.87:0/3570472864 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb80cf1b0 con 0x7fecb815cec0 2023-03-30T08:11:54.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecbcaf5700 1 --2- 172.21.15.87:0/3570472864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecb815cec0 0x7fecb80cf9b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fecb806bd80 tx=0x7fecac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e68e4049701f04c server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:54.717 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecb77fe700 1 -- 172.21.15.87:0/3570472864 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac004230 con 0x7fecb815cec0 2023-03-30T08:11:54.717 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecb77fe700 1 -- 172.21.15.87:0/3570472864 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac004390 con 0x7fecb815cec0 2023-03-30T08:11:54.717 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecb77fe700 1 -- 172.21.15.87:0/3570472864 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac0036c0 con 0x7fecb815cec0 2023-03-30T08:11:54.717 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecbdaf7700 1 -- 172.21.15.87:0/3570472864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecb815cec0 msgr2=0x7fecb80cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:54.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecbdaf7700 1 --2- 172.21.15.87:0/3570472864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecb815cec0 0x7fecb80cf9b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fecb806bd80 tx=0x7fecac009bf0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecbdaf7700 1 -- 172.21.15.87:0/3570472864 shutdown_connections 2023-03-30T08:11:54.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecbdaf7700 1 --2- 172.21.15.87:0/3570472864 >> v2:172.21.15.115:3300/0 conn(0x7fecb80b5330 0x7fecb815d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecbdaf7700 1 --2- 172.21.15.87:0/3570472864 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecb815cec0 0x7fecb80cf9b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecbdaf7700 1 -- 172.21.15.87:0/3570472864 >> 172.21.15.87:0/3570472864 conn(0x7fecb806b1b0 msgr2=0x7fecb806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:54.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecbdaf7700 1 -- 172.21.15.87:0/3570472864 shutdown_connections 2023-03-30T08:11:54.718 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.711+0000 7fecbdaf7700 1 -- 172.21.15.87:0/3570472864 wait complete. 2023-03-30T08:11:54.719 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecbdaf7700 1 Processor -- start 2023-03-30T08:11:54.720 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecbdaf7700 1 -- start start 2023-03-30T08:11:54.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecbdaf7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecb80b46b0 0x7fecb80c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:54.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecbdaf7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecb80b5330 0x7fecb81f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:54.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecbdaf7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb815cec0 0x7fecb814a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:54.721 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecbdaf7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80c9e10 con 0x7fecb80b5330 2023-03-30T08:11:54.722 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecbdaf7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80b8050 con 0x7fecb815cec0 2023-03-30T08:11:54.722 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecbdaf7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80c9320 con 0x7fecb80b46b0 2023-03-30T08:11:54.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecb7fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecb80b5330 0x7fecb81f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:54.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecb7fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecb80b5330 0x7fecb81f71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37260/0 (socket says 172.21.15.87:37260) 2023-03-30T08:11:54.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecb7fff700 1 -- 172.21.15.87:0/1602576622 learned_addr learned my addr 172.21.15.87:0/1602576622 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:54.723 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecbcaf5700 1 --2- 172.21.15.87:0/1602576622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecb80b46b0 0x7fecb80c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:54.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecbd2f6700 1 --2- 172.21.15.87:0/1602576622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb815cec0 0x7fecb814a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:54.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecb7fff700 1 -- 172.21.15.87:0/1602576622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecb80b46b0 msgr2=0x7fecb80c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:54.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecb7fff700 1 --2- 172.21.15.87:0/1602576622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecb80b46b0 0x7fecb80c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecb7fff700 1 -- 172.21.15.87:0/1602576622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb815cec0 msgr2=0x7fecb814a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:54.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecb7fff700 1 --2- 172.21.15.87:0/1602576622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb815cec0 0x7fecb814a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecb7fff700 1 -- 172.21.15.87:0/1602576622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac009570 con 0x7fecb80b5330 2023-03-30T08:11:54.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.715+0000 7fecb7fff700 1 --2- 172.21.15.87:0/1602576622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecb80b5330 0x7fecb81f71e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7feca400e840 tx=0x7feca400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:54.724 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.719+0000 7fecb57fa700 1 -- 172.21.15.87:0/1602576622 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca4013610 con 0x7fecb80b5330 2023-03-30T08:11:54.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.719+0000 7fecb57fa700 1 -- 172.21.15.87:0/1602576622 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca4013790 con 0x7fecb80b5330 2023-03-30T08:11:54.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.719+0000 7fecbdaf7700 1 -- 172.21.15.87:0/1602576622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb80cee80 con 0x7fecb80b5330 2023-03-30T08:11:54.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.719+0000 7fecb57fa700 1 -- 172.21.15.87:0/1602576622 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca4013b40 con 0x7fecb80b5330 2023-03-30T08:11:54.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.719+0000 7fecbdaf7700 1 -- 172.21.15.87:0/1602576622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb80cf490 con 0x7fecb80b5330 2023-03-30T08:11:54.725 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.719+0000 7fecbdaf7700 1 -- 172.21.15.87:0/1602576622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb80cfef0 con 0x7fecb80b5330 2023-03-30T08:11:54.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.719+0000 7fecb57fa700 1 -- 172.21.15.87:0/1602576622 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7feca4013ca0 con 0x7fecb80b5330 2023-03-30T08:11:54.727 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.723+0000 7fecb57fa700 1 --2- 172.21.15.87:0/1602576622 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fec9c065420 0x7fec9c0678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:54.728 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.723+0000 7fecb57fa700 1 -- 172.21.15.87:0/1602576622 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feca4082890 con 0x7fecb80b5330 2023-03-30T08:11:54.728 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.723+0000 7fecbcaf5700 1 --2- 172.21.15.87:0/1602576622 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fec9c065420 0x7fec9c0678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:54.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.723+0000 7fecbcaf5700 1 --2- 172.21.15.87:0/1602576622 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fec9c065420 0x7fec9c0678d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fecb806bd80 tx=0x7fecac008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:54.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.727+0000 7fecb57fa700 1 -- 172.21.15.87:0/1602576622 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7feca4053b70 con 0x7fecb80b5330 2023-03-30T08:11:54.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.895+0000 7fecbdaf7700 1 -- 172.21.15.87:0/1602576622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fecb806a7e0 con 0x7fecb80b5330 2023-03-30T08:11:54.900 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.895+0000 7fecb57fa700 1 -- 172.21.15.87:0/1602576622 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7feca4053760 con 0x7fecb80b5330 2023-03-30T08:11:54.901 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-03-30T08:11:54.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.895+0000 7fecbdaf7700 1 -- 172.21.15.87:0/1602576622 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fec9c065420 msgr2=0x7fec9c0678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:54.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.895+0000 7fecbdaf7700 1 --2- 172.21.15.87:0/1602576622 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fec9c065420 0x7fec9c0678d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fecb806bd80 tx=0x7fecac008030 comp rx=0 tx=0).stop 2023-03-30T08:11:54.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.895+0000 7fecbdaf7700 1 -- 172.21.15.87:0/1602576622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecb80b5330 msgr2=0x7fecb81f71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:54.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.895+0000 7fecbdaf7700 1 --2- 172.21.15.87:0/1602576622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecb80b5330 0x7fecb81f71e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7feca400e840 tx=0x7feca400eb50 comp rx=0 tx=0).stop 2023-03-30T08:11:54.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.899+0000 7fecbdaf7700 1 -- 172.21.15.87:0/1602576622 shutdown_connections 2023-03-30T08:11:54.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.899+0000 7fecbdaf7700 1 --2- 172.21.15.87:0/1602576622 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fec9c065420 0x7fec9c0678d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.899+0000 7fecbdaf7700 1 --2- 172.21.15.87:0/1602576622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecb815cec0 0x7fecb814a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.899+0000 7fecbdaf7700 1 --2- 172.21.15.87:0/1602576622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fecb80b5330 0x7fecb81f71e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.899+0000 7fecbdaf7700 1 --2- 172.21.15.87:0/1602576622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecb80b46b0 0x7fecb80c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:54.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.899+0000 7fecbdaf7700 1 -- 172.21.15.87:0/1602576622 >> 172.21.15.87:0/1602576622 conn(0x7fecb806b1b0 msgr2=0x7fecb8151920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:54.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.899+0000 7fecbdaf7700 1 -- 172.21.15.87:0/1602576622 shutdown_connections 2023-03-30T08:11:54.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:54.899+0000 7fecbdaf7700 1 -- 172.21.15.87:0/1602576622 wait complete. 2023-03-30T08:11:54.921 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-30T08:11:55.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.083+0000 7fdba600d700 1 Processor -- start 2023-03-30T08:11:55.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.083+0000 7fdba600d700 1 -- start start 2023-03-30T08:11:55.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.083+0000 7fdba600d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdba0163dc0 0x7fdba00c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:55.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.083+0000 7fdba600d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba0069f00 con 0x7fdba0164190 2023-03-30T08:11:55.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba600d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba006cf70 con 0x7fdba00aea30 2023-03-30T08:11:55.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba600d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba006d810 con 0x7fdba0163dc0 2023-03-30T08:11:55.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba480a700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fdba0164190 0x7fdba00c9b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40248/0 (socket says 172.21.15.87:40248) 2023-03-30T08:11:55.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba480a700 1 -- 172.21.15.87:0/1908314059 learned_addr learned my addr 172.21.15.87:0/1908314059 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:55.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba500b700 1 --2- 172.21.15.87:0/1908314059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdba0163dc0 0x7fdba00c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:55.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdb97fff700 1 -- 172.21.15.87:0/1908314059 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329751350 0 0) 0x7fdba0069f00 con 0x7fdba0164190 2023-03-30T08:11:55.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdb97fff700 1 -- 172.21.15.87:0/1908314059 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb8c0035d0 con 0x7fdba0164190 2023-03-30T08:11:55.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba500b700 1 -- 172.21.15.87:0/1908314059 >> v1:172.21.15.115:6789/0 conn(0x7fdba00aea30 legacy=0x7fdba006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:55.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba500b700 1 -- 172.21.15.87:0/1908314059 >> v1:172.21.15.87:6789/0 conn(0x7fdba0164190 legacy=0x7fdba00c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:55.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba500b700 1 -- 172.21.15.87:0/1908314059 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba006d250 con 0x7fdba0163dc0 2023-03-30T08:11:55.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba500b700 1 --2- 172.21.15.87:0/1908314059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdba0163dc0 0x7fdba00c95c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009880 tx=0x7fdb9c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45eedc0bf1a70dcd server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:55.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdb97fff700 1 -- 172.21.15.87:0/1908314059 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c011830 con 0x7fdba0163dc0 2023-03-30T08:11:55.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdb97fff700 1 -- 172.21.15.87:0/1908314059 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c011990 con 0x7fdba0163dc0 2023-03-30T08:11:55.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdb97fff700 1 -- 172.21.15.87:0/1908314059 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c011d20 con 0x7fdba0163dc0 2023-03-30T08:11:55.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba600d700 1 -- 172.21.15.87:0/1908314059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdba0163dc0 msgr2=0x7fdba00c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:55.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba600d700 1 --2- 172.21.15.87:0/1908314059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdba0163dc0 0x7fdba00c95c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009880 tx=0x7fdb9c009b90 comp rx=0 tx=0).stop 2023-03-30T08:11:55.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba600d700 1 -- 172.21.15.87:0/1908314059 shutdown_connections 2023-03-30T08:11:55.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba600d700 1 --2- 172.21.15.87:0/1908314059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdba0163dc0 0x7fdba00c95c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba600d700 1 -- 172.21.15.87:0/1908314059 >> 172.21.15.87:0/1908314059 conn(0x7fdba00cf410 msgr2=0x7fdba00cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:55.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba600d700 1 -- 172.21.15.87:0/1908314059 shutdown_connections 2023-03-30T08:11:55.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.087+0000 7fdba600d700 1 -- 172.21.15.87:0/1908314059 wait complete. 2023-03-30T08:11:55.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.091+0000 7fdba600d700 1 Processor -- start 2023-03-30T08:11:55.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.091+0000 7fdba600d700 1 -- start start 2023-03-30T08:11:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.091+0000 7fdba600d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdba00aea30 0x7fdba0154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.091+0000 7fdba600d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdba0163dc0 0x7fdba01585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.091+0000 7fdba600d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdba0164190 0x7fdba015dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.091+0000 7fdba600d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba015ecc0 con 0x7fdba0163dc0 2023-03-30T08:11:55.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.091+0000 7fdba600d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba015cc20 con 0x7fdba0164190 2023-03-30T08:11:55.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.091+0000 7fdba600d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba015cf00 con 0x7fdba00aea30 2023-03-30T08:11:55.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.091+0000 7fdba480a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdba0163dc0 0x7fdba01585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:55.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.091+0000 7fdba480a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdba0163dc0 0x7fdba01585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37262/0 (socket says 172.21.15.87:37262) 2023-03-30T08:11:55.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.091+0000 7fdba480a700 1 -- 172.21.15.87:0/1860525542 learned_addr learned my addr 172.21.15.87:0/1860525542 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:55.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.091+0000 7fdba500b700 1 --2- 172.21.15.87:0/1860525542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdba00aea30 0x7fdba0154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:55.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.091+0000 7fdba580c700 1 --2- 172.21.15.87:0/1860525542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdba0164190 0x7fdba015dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:55.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.095+0000 7fdba480a700 1 -- 172.21.15.87:0/1860525542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdba00aea30 msgr2=0x7fdba0154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:55.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.095+0000 7fdba480a700 1 --2- 172.21.15.87:0/1860525542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdba00aea30 0x7fdba0154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.095+0000 7fdba480a700 1 -- 172.21.15.87:0/1860525542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdba0164190 msgr2=0x7fdba015dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:55.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.095+0000 7fdba480a700 1 --2- 172.21.15.87:0/1860525542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdba0164190 0x7fdba015dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.095+0000 7fdba480a700 1 -- 172.21.15.87:0/1860525542 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c0094b0 con 0x7fdba0163dc0 2023-03-30T08:11:55.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.095+0000 7fdba580c700 1 --2- 172.21.15.87:0/1860525542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdba0164190 0x7fdba015dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:11:55.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.095+0000 7fdba480a700 1 --2- 172.21.15.87:0/1860525542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdba0163dc0 0x7fdba01585f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdb90005930 tx=0x7fdb9000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:55.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.095+0000 7fdb95ffb700 1 -- 172.21.15.87:0/1860525542 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90005d90 con 0x7fdba0163dc0 2023-03-30T08:11:55.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.095+0000 7fdb95ffb700 1 -- 172.21.15.87:0/1860525542 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb900070d0 con 0x7fdba0163dc0 2023-03-30T08:11:55.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.095+0000 7fdba600d700 1 -- 172.21.15.87:0/1860525542 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba006cc40 con 0x7fdba0163dc0 2023-03-30T08:11:55.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.095+0000 7fdb95ffb700 1 -- 172.21.15.87:0/1860525542 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90007480 con 0x7fdba0163dc0 2023-03-30T08:11:55.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.095+0000 7fdba600d700 1 -- 172.21.15.87:0/1860525542 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba006d530 con 0x7fdba0163dc0 2023-03-30T08:11:55.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.095+0000 7fdba600d700 1 -- 172.21.15.87:0/1860525542 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba00ca210 con 0x7fdba0163dc0 2023-03-30T08:11:55.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.099+0000 7fdb95ffb700 1 -- 172.21.15.87:0/1860525542 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fdb900075e0 con 0x7fdba0163dc0 2023-03-30T08:11:55.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.099+0000 7fdb95ffb700 1 --2- 172.21.15.87:0/1860525542 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdb840653f0 0x7fdb840678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.099+0000 7fdb95ffb700 1 -- 172.21.15.87:0/1860525542 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdb90082070 con 0x7fdba0163dc0 2023-03-30T08:11:55.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.099+0000 7fdba500b700 1 --2- 172.21.15.87:0/1860525542 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdb840653f0 0x7fdb840678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:55.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.099+0000 7fdba500b700 1 --2- 172.21.15.87:0/1860525542 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdb840653f0 0x7fdb840678a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0090b0 tx=0x7fdb9c010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:55.108 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.103+0000 7fdb95ffb700 1 -- 172.21.15.87:0/1860525542 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fdb9004f920 con 0x7fdba0163dc0 2023-03-30T08:11:55.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.267+0000 7fdba600d700 1 -- 172.21.15.87:0/1860525542 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdba00733a0 con 0x7fdba0163dc0 2023-03-30T08:11:55.275 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.271+0000 7fdb95ffb700 1 -- 172.21.15.87:0/1860525542 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdb90052f40 con 0x7fdba0163dc0 2023-03-30T08:11:55.276 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:55.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.271+0000 7fdba600d700 1 -- 172.21.15.87:0/1860525542 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdb840653f0 msgr2=0x7fdb840678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:55.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.271+0000 7fdba600d700 1 --2- 172.21.15.87:0/1860525542 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdb840653f0 0x7fdb840678a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0090b0 tx=0x7fdb9c010000 comp rx=0 tx=0).stop 2023-03-30T08:11:55.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.271+0000 7fdba600d700 1 -- 172.21.15.87:0/1860525542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdba0163dc0 msgr2=0x7fdba01585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:55.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.271+0000 7fdba600d700 1 --2- 172.21.15.87:0/1860525542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdba0163dc0 0x7fdba01585f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdb90005930 tx=0x7fdb9000c7b0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.271+0000 7fdba600d700 1 -- 172.21.15.87:0/1860525542 shutdown_connections 2023-03-30T08:11:55.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.271+0000 7fdba600d700 1 --2- 172.21.15.87:0/1860525542 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdb840653f0 0x7fdb840678a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.271+0000 7fdba600d700 1 --2- 172.21.15.87:0/1860525542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdba0164190 0x7fdba015dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.271+0000 7fdba600d700 1 --2- 172.21.15.87:0/1860525542 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdba0163dc0 0x7fdba01585f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.271+0000 7fdba600d700 1 --2- 172.21.15.87:0/1860525542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdba00aea30 0x7fdba0154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.275+0000 7fdba600d700 1 -- 172.21.15.87:0/1860525542 >> 172.21.15.87:0/1860525542 conn(0x7fdba00cf410 msgr2=0x7fdba00cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:55.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.275+0000 7fdba600d700 1 -- 172.21.15.87:0/1860525542 shutdown_connections 2023-03-30T08:11:55.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.275+0000 7fdba600d700 1 -- 172.21.15.87:0/1860525542 wait complete. 2023-03-30T08:11:55.298 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-30T08:11:55.465 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.459+0000 7f31cd546700 1 Processor -- start 2023-03-30T08:11:55.465 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.459+0000 7f31cd546700 1 -- start start 2023-03-30T08:11:55.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.459+0000 7f31cd546700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31c80ca080 0x7f31c80ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:55.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.459+0000 7f31cd546700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f31c8158b00 0x7f31c806a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:55.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31cd546700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c80aff50 con 0x7f31c806ac20 2023-03-30T08:11:55.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31cd546700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c80ca990 con 0x7f31c8158b00 2023-03-30T08:11:55.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31cd546700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80af620 con 0x7f31c80ca080 2023-03-30T08:11:55.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c77fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f31c806ac20 0x7f31c80c8dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40258/0 (socket says 172.21.15.87:40258) 2023-03-30T08:11:55.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c77fe700 1 -- 172.21.15.87:0/2574291970 learned_addr learned my addr 172.21.15.87:0/2574291970 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:55.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c67fc700 1 --2- 172.21.15.87:0/2574291970 >> v2:172.21.15.87:3300/0 conn(0x7f31c8158b00 0x7f31c806a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:55.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c6ffd700 1 --2- 172.21.15.87:0/2574291970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31c80ca080 0x7f31c80ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:55.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 -- 172.21.15.87:0/2574291970 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995522869 0 0) 0x7f31c80aff50 con 0x7f31c806ac20 2023-03-30T08:11:55.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 -- 172.21.15.87:0/2574291970 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b00057e0 con 0x7f31c806ac20 2023-03-30T08:11:55.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 -- 172.21.15.87:0/2574291970 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 517128461 0 0) 0x7f31b00057e0 con 0x7f31c806ac20 2023-03-30T08:11:55.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 -- 172.21.15.87:0/2574291970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31c80ca080 msgr2=0x7f31c80ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:55.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 --2- 172.21.15.87:0/2574291970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31c80ca080 0x7f31c80ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 -- 172.21.15.87:0/2574291970 >> v2:172.21.15.87:3300/0 conn(0x7f31c8158b00 msgr2=0x7f31c806a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:55.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 --2- 172.21.15.87:0/2574291970 >> v2:172.21.15.87:3300/0 conn(0x7f31c8158b00 0x7f31c806a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 -- 172.21.15.87:0/2574291970 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c80af900 con 0x7f31c806ac20 2023-03-30T08:11:55.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 -- 172.21.15.87:0/2574291970 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f31c00019f0 con 0x7f31c806ac20 2023-03-30T08:11:55.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 -- 172.21.15.87:0/2574291970 >> v1:172.21.15.87:6789/0 conn(0x7f31c806ac20 legacy=0x7f31c80c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:55.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 --2- 172.21.15.87:0/2574291970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31b0005c30 0x7f31b0006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:55.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 --2- 172.21.15.87:0/2574291970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31b0006580 0x7f31b0006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:55.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 --2- 172.21.15.87:0/2574291970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0006fc0 0x7f31b0007430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:55.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 -- 172.21.15.87:0/2574291970 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80ca990 con 0x7f31b0006fc0 2023-03-30T08:11:55.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 -- 172.21.15.87:0/2574291970 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80af620 con 0x7f31b0006580 2023-03-30T08:11:55.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 -- 172.21.15.87:0/2574291970 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b00102d0 con 0x7f31b0005c30 2023-03-30T08:11:55.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c77fe700 1 --2- 172.21.15.87:0/2574291970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0006fc0 0x7f31b0007430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:55.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c77fe700 1 -- 172.21.15.87:0/2574291970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31b0005c30 msgr2=0x7f31b0006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:55.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c77fe700 1 --2- 172.21.15.87:0/2574291970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31b0005c30 0x7f31b0006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c77fe700 1 -- 172.21.15.87:0/2574291970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31b0006580 msgr2=0x7f31b0006a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:55.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c77fe700 1 --2- 172.21.15.87:0/2574291970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31b0006580 0x7f31b0006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c77fe700 1 -- 172.21.15.87:0/2574291970 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b00057e0 con 0x7f31b0006fc0 2023-03-30T08:11:55.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c77fe700 1 --2- 172.21.15.87:0/2574291970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0006fc0 0x7f31b0007430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f31c806b800 tx=0x7f31b0007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96804c2f2814ba27 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:55.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 -- 172.21.15.87:0/2574291970 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c000a340 con 0x7f31b0006fc0 2023-03-30T08:11:55.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 -- 172.21.15.87:0/2574291970 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c00072d0 con 0x7f31b0006fc0 2023-03-30T08:11:55.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c5ffb700 1 -- 172.21.15.87:0/2574291970 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0007680 con 0x7f31b0006fc0 2023-03-30T08:11:55.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31cd546700 1 -- 172.21.15.87:0/2574291970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0006fc0 msgr2=0x7f31b0007430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:55.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31cd546700 1 --2- 172.21.15.87:0/2574291970 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0006fc0 0x7f31b0007430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f31c806b800 tx=0x7f31b0007ab0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31c77fe700 1 -- 172.21.15.87:0/2574291970 reap_dead start 2023-03-30T08:11:55.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31cd546700 1 -- 172.21.15.87:0/2574291970 shutdown_connections 2023-03-30T08:11:55.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.463+0000 7f31cd546700 1 -- 172.21.15.87:0/2574291970 >> 172.21.15.87:0/2574291970 conn(0x7f31c80cf410 msgr2=0x7f31c80cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:55.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.467+0000 7f31cd546700 1 -- 172.21.15.87:0/2574291970 shutdown_connections 2023-03-30T08:11:55.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.467+0000 7f31cd546700 1 -- 172.21.15.87:0/2574291970 wait complete. 2023-03-30T08:11:55.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.467+0000 7f31cd546700 1 Processor -- start 2023-03-30T08:11:55.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.467+0000 7f31cd546700 1 -- start start 2023-03-30T08:11:55.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31cd546700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0006fc0 0x7f31c80b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:55.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31cd546700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31c80c29f0 0x7f31c80c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:55.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31cd546700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c80c4490 0x7f31c80c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:55.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31cd546700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c81ed670 con 0x7f31b0006fc0 2023-03-30T08:11:55.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31cd546700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c81ed950 con 0x7f31c80c4490 2023-03-30T08:11:55.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31cd546700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c81edc30 con 0x7f31c80c29f0 2023-03-30T08:11:55.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31c6ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0006fc0 0x7f31c80b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:55.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31c6ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0006fc0 0x7f31c80b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37296/0 (socket says 172.21.15.87:37296) 2023-03-30T08:11:55.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31c6ffd700 1 -- 172.21.15.87:0/272085233 learned_addr learned my addr 172.21.15.87:0/272085233 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:55.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31c77fe700 1 --2- 172.21.15.87:0/272085233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c80c4490 0x7f31c80c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:55.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31c67fc700 1 --2- 172.21.15.87:0/272085233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31c80c29f0 0x7f31c80c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:55.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31c6ffd700 1 -- 172.21.15.87:0/272085233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31c80c29f0 msgr2=0x7f31c80c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:55.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31c6ffd700 1 --2- 172.21.15.87:0/272085233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31c80c29f0 0x7f31c80c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31c6ffd700 1 -- 172.21.15.87:0/272085233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c80c4490 msgr2=0x7f31c80c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:55.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31c6ffd700 1 --2- 172.21.15.87:0/272085233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c80c4490 0x7f31c80c4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31c6ffd700 1 -- 172.21.15.87:0/272085233 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c80af240 con 0x7f31b0006fc0 2023-03-30T08:11:55.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31c6ffd700 1 --2- 172.21.15.87:0/272085233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0006fc0 0x7f31c80b1ad0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f31b800e7a0 tx=0x7f31b800eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:55.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31af7fe700 1 -- 172.21.15.87:0/272085233 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8013680 con 0x7f31b0006fc0 2023-03-30T08:11:55.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31af7fe700 1 -- 172.21.15.87:0/272085233 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b8013800 con 0x7f31b0006fc0 2023-03-30T08:11:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31cd546700 1 -- 172.21.15.87:0/272085233 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c80afbe0 con 0x7f31b0006fc0 2023-03-30T08:11:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31af7fe700 1 -- 172.21.15.87:0/272085233 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8013bb0 con 0x7f31b0006fc0 2023-03-30T08:11:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31cd546700 1 -- 172.21.15.87:0/272085233 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c80af3d0 con 0x7f31b0006fc0 2023-03-30T08:11:55.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.471+0000 7f31cd546700 1 -- 172.21.15.87:0/272085233 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c80733a0 con 0x7f31b0006fc0 2023-03-30T08:11:55.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.475+0000 7f31af7fe700 1 -- 172.21.15.87:0/272085233 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f31b8013d10 con 0x7f31b0006fc0 2023-03-30T08:11:55.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.475+0000 7f31af7fe700 1 --2- 172.21.15.87:0/272085233 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f31b4065420 0x7f31b40678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:55.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.475+0000 7f31af7fe700 1 -- 172.21.15.87:0/272085233 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f31b8082dd0 con 0x7f31b0006fc0 2023-03-30T08:11:55.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.475+0000 7f31c67fc700 1 --2- 172.21.15.87:0/272085233 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f31b4065420 0x7f31b40678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:55.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.475+0000 7f31c67fc700 1 --2- 172.21.15.87:0/272085233 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f31b4065420 0x7f31b40678d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f31bc004860 tx=0x7f31bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:55.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.479+0000 7f31af7fe700 1 -- 172.21.15.87:0/272085233 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f31b8050680 con 0x7f31b0006fc0 2023-03-30T08:11:55.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.663+0000 7f31cd546700 1 -- 172.21.15.87:0/272085233 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f31c806cf80 con 0x7f31b0006fc0 2023-03-30T08:11:55.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.663+0000 7f31af7fe700 1 -- 172.21.15.87:0/272085233 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f31b8053ca0 con 0x7f31b0006fc0 2023-03-30T08:11:55.674 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.667+0000 7f31cd546700 1 -- 172.21.15.87:0/272085233 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f31b4065420 msgr2=0x7f31b40678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:55.675 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.667+0000 7f31cd546700 1 --2- 172.21.15.87:0/272085233 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f31b4065420 0x7f31b40678d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f31bc004860 tx=0x7f31bc008040 comp rx=0 tx=0).stop 2023-03-30T08:11:55.675 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.667+0000 7f31cd546700 1 -- 172.21.15.87:0/272085233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0006fc0 msgr2=0x7f31c80b1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:55.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.667+0000 7f31cd546700 1 --2- 172.21.15.87:0/272085233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0006fc0 0x7f31c80b1ad0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f31b800e7a0 tx=0x7f31b800eb60 comp rx=0 tx=0).stop 2023-03-30T08:11:55.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.671+0000 7f31cd546700 1 -- 172.21.15.87:0/272085233 shutdown_connections 2023-03-30T08:11:55.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.671+0000 7f31cd546700 1 --2- 172.21.15.87:0/272085233 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f31b4065420 0x7f31b40678d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.671+0000 7f31cd546700 1 --2- 172.21.15.87:0/272085233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31c80c4490 0x7f31c80c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.671+0000 7f31cd546700 1 --2- 172.21.15.87:0/272085233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31c80c29f0 0x7f31c80c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.671+0000 7f31cd546700 1 --2- 172.21.15.87:0/272085233 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31b0006fc0 0x7f31c80b1ad0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:55.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.671+0000 7f31cd546700 1 -- 172.21.15.87:0/272085233 >> 172.21.15.87:0/272085233 conn(0x7f31c80cf410 msgr2=0x7f31c806c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:55.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.671+0000 7f31cd546700 1 -- 172.21.15.87:0/272085233 shutdown_connections 2023-03-30T08:11:55.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:55.671+0000 7f31cd546700 1 -- 172.21.15.87:0/272085233 wait complete. 2023-03-30T08:11:55.677 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2023-03-30T08:11:55.695 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-03-30T08:11:55.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:55.696 DEBUG:teuthology.orchestra.run.smithi087:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-03-30T08:11:55.771 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2023-03-30T08:11:55.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:55.772 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-03-30T08:11:55.788 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:11:55.789 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:55.804 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:11:55.804 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:55.859 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T08:11:55.860 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:11:55.918 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:56.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.079+0000 7ff9cc93e700 1 Processor -- start 2023-03-30T08:11:56.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.079+0000 7ff9cc93e700 1 -- start start 2023-03-30T08:11:56.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9cc93e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff9c80cab10 0x7ff9c80c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9cc93e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c815e8c0 con 0x7ff9c80b41c0 2023-03-30T08:11:56.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9cc93e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c80c96b0 con 0x7ff9c8070b30 2023-03-30T08:11:56.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9cc93e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c815ed50 con 0x7ff9c80cab10 2023-03-30T08:11:56.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9c659c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff9c80b41c0 0x7ff9c8070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40260/0 (socket says 172.21.15.87:40260) 2023-03-30T08:11:56.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9c659c700 1 -- 172.21.15.87:0/3703871553 learned_addr learned my addr 172.21.15.87:0/3703871553 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:56.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9c6d9d700 1 --2- 172.21.15.87:0/3703871553 >> v2:172.21.15.115:3300/0 conn(0x7ff9c80cab10 0x7ff9c80c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:56.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9c5d9b700 1 -- 172.21.15.87:0/3703871553 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545656081 0 0) 0x7ff9c815e8c0 con 0x7ff9c80b41c0 2023-03-30T08:11:56.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9c5d9b700 1 -- 172.21.15.87:0/3703871553 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9b40035d0 con 0x7ff9c80b41c0 2023-03-30T08:11:56.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9c5d9b700 1 -- 172.21.15.87:0/3703871553 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899603097 0 0) 0x7ff9c80c96b0 con 0x7ff9c8070b30 2023-03-30T08:11:56.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9c5d9b700 1 -- 172.21.15.87:0/3703871553 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9c815e8c0 con 0x7ff9c8070b30 2023-03-30T08:11:56.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9c6d9d700 1 -- 172.21.15.87:0/3703871553 >> v1:172.21.15.115:6789/0 conn(0x7ff9c8070b30 legacy=0x7ff9c80cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9c6d9d700 1 -- 172.21.15.87:0/3703871553 >> v1:172.21.15.87:6789/0 conn(0x7ff9c80b41c0 legacy=0x7ff9c8070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9c6d9d700 1 -- 172.21.15.87:0/3703871553 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c80ce720 con 0x7ff9c80cab10 2023-03-30T08:11:56.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9c6d9d700 1 --2- 172.21.15.87:0/3703871553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9c80cab10 0x7ff9c80c8fb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0009d90 tx=0x7ff9c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77b1e8d22392c75f server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:56.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9c5d9b700 1 -- 172.21.15.87:0/3703871553 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c000e070 con 0x7ff9c80cab10 2023-03-30T08:11:56.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9c5d9b700 1 -- 172.21.15.87:0/3703871553 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c000bb20 con 0x7ff9c80cab10 2023-03-30T08:11:56.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.083+0000 7ff9c5d9b700 1 -- 172.21.15.87:0/3703871553 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0012430 con 0x7ff9c80cab10 2023-03-30T08:11:56.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.087+0000 7ff9cc93e700 1 -- 172.21.15.87:0/3703871553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9c80cab10 msgr2=0x7ff9c80c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.087+0000 7ff9cc93e700 1 --2- 172.21.15.87:0/3703871553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9c80cab10 0x7ff9c80c8fb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0009d90 tx=0x7ff9c000b330 comp rx=0 tx=0).stop 2023-03-30T08:11:56.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.087+0000 7ff9cc93e700 1 -- 172.21.15.87:0/3703871553 shutdown_connections 2023-03-30T08:11:56.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.087+0000 7ff9cc93e700 1 --2- 172.21.15.87:0/3703871553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9c80cab10 0x7ff9c80c8fb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.087+0000 7ff9cc93e700 1 -- 172.21.15.87:0/3703871553 >> 172.21.15.87:0/3703871553 conn(0x7ff9c80ce960 msgr2=0x7ff9c80ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:56.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.087+0000 7ff9cc93e700 1 -- 172.21.15.87:0/3703871553 shutdown_connections 2023-03-30T08:11:56.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.087+0000 7ff9cc93e700 1 -- 172.21.15.87:0/3703871553 wait complete. 2023-03-30T08:11:56.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9cc93e700 1 Processor -- start 2023-03-30T08:11:56.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9cc93e700 1 -- start start 2023-03-30T08:11:56.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9cc93e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9c8070b30 0x7ff9c81581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9cc93e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9c80b41c0 0x7ff9c815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9cc93e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9c80cab10 0x7ff9c815d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9cc93e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80c6890 con 0x7ff9c80cab10 2023-03-30T08:11:56.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9cc93e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c81efa30 con 0x7ff9c80b41c0 2023-03-30T08:11:56.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9cc93e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c815d5a0 con 0x7ff9c8070b30 2023-03-30T08:11:56.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9c6d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9c80cab10 0x7ff9c815d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:56.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9c6d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9c80cab10 0x7ff9c815d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37298/0 (socket says 172.21.15.87:37298) 2023-03-30T08:11:56.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9c6d9d700 1 -- 172.21.15.87:0/1850968872 learned_addr learned my addr 172.21.15.87:0/1850968872 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:56.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9c659c700 1 --2- 172.21.15.87:0/1850968872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9c8070b30 0x7ff9c81581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:56.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9bffff700 1 --2- 172.21.15.87:0/1850968872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9c80b41c0 0x7ff9c815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:56.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9c6d9d700 1 -- 172.21.15.87:0/1850968872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9c8070b30 msgr2=0x7ff9c81581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9c6d9d700 1 --2- 172.21.15.87:0/1850968872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9c8070b30 0x7ff9c81581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9c6d9d700 1 -- 172.21.15.87:0/1850968872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9c80b41c0 msgr2=0x7ff9c815cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9c6d9d700 1 --2- 172.21.15.87:0/1850968872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9c80b41c0 0x7ff9c815cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.091+0000 7ff9c6d9d700 1 -- 172.21.15.87:0/1850968872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c0009a70 con 0x7ff9c80cab10 2023-03-30T08:11:56.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.095+0000 7ff9c6d9d700 1 --2- 172.21.15.87:0/1850968872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9c80cab10 0x7ff9c815d060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0014040 tx=0x7ff9c0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:56.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.095+0000 7ff9beffd700 1 -- 172.21.15.87:0/1850968872 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0004780 con 0x7ff9c80cab10 2023-03-30T08:11:56.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.095+0000 7ff9beffd700 1 -- 172.21.15.87:0/1850968872 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c0020070 con 0x7ff9c80cab10 2023-03-30T08:11:56.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.095+0000 7ff9beffd700 1 -- 172.21.15.87:0/1850968872 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c00276c0 con 0x7ff9c80cab10 2023-03-30T08:11:56.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.095+0000 7ff9cc93e700 1 -- 172.21.15.87:0/1850968872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c815df90 con 0x7ff9c80cab10 2023-03-30T08:11:56.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.095+0000 7ff9cc93e700 1 -- 172.21.15.87:0/1850968872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c80caf00 con 0x7ff9c80cab10 2023-03-30T08:11:56.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.095+0000 7ff9cc93e700 1 -- 172.21.15.87:0/1850968872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c815e270 con 0x7ff9c80cab10 2023-03-30T08:11:56.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.099+0000 7ff9beffd700 1 -- 172.21.15.87:0/1850968872 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ff9c0012430 con 0x7ff9c80cab10 2023-03-30T08:11:56.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.099+0000 7ff9beffd700 1 --2- 172.21.15.87:0/1850968872 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff9a80653f0 0x7ff9a80678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.105 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.099+0000 7ff9beffd700 1 -- 172.21.15.87:0/1850968872 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff9c0022070 con 0x7ff9c80cab10 2023-03-30T08:11:56.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.099+0000 7ff9c659c700 1 --2- 172.21.15.87:0/1850968872 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff9a80653f0 0x7ff9a80678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:56.106 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.099+0000 7ff9c659c700 1 --2- 172.21.15.87:0/1850968872 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff9a80653f0 0x7ff9a80678a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8000f60 tx=0x7ff9b8007e20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:56.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.103+0000 7ff9beffd700 1 -- 172.21.15.87:0/1850968872 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7ff9c00520a0 con 0x7ff9c80cab10 2023-03-30T08:11:56.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.275+0000 7ff9cc93e700 1 -- 172.21.15.87:0/1850968872 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9c8073ee0 con 0x7ff9c80cab10 2023-03-30T08:11:56.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.279+0000 7ff9beffd700 1 -- 172.21.15.87:0/1850968872 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+19747 (secure 0 0 0) 0x7ff9c00556c0 con 0x7ff9c80cab10 2023-03-30T08:11:56.284 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:56.284 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:39.157903+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:56.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.279+0000 7ff9cc93e700 1 -- 172.21.15.87:0/1850968872 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff9a80653f0 msgr2=0x7ff9a80678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.279+0000 7ff9cc93e700 1 --2- 172.21.15.87:0/1850968872 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff9a80653f0 0x7ff9a80678a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8000f60 tx=0x7ff9b8007e20 comp rx=0 tx=0).stop 2023-03-30T08:11:56.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.279+0000 7ff9cc93e700 1 -- 172.21.15.87:0/1850968872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9c80cab10 msgr2=0x7ff9c815d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.279+0000 7ff9cc93e700 1 --2- 172.21.15.87:0/1850968872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9c80cab10 0x7ff9c815d060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0014040 tx=0x7ff9c0004af0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.279+0000 7ff9cc93e700 1 -- 172.21.15.87:0/1850968872 shutdown_connections 2023-03-30T08:11:56.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.279+0000 7ff9cc93e700 1 --2- 172.21.15.87:0/1850968872 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff9a80653f0 0x7ff9a80678a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.279+0000 7ff9cc93e700 1 --2- 172.21.15.87:0/1850968872 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff9c80cab10 0x7ff9c815d060 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.279+0000 7ff9cc93e700 1 --2- 172.21.15.87:0/1850968872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9c80b41c0 0x7ff9c815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.279+0000 7ff9cc93e700 1 --2- 172.21.15.87:0/1850968872 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9c8070b30 0x7ff9c81581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.279+0000 7ff9cc93e700 1 -- 172.21.15.87:0/1850968872 >> 172.21.15.87:0/1850968872 conn(0x7ff9c80ce960 msgr2=0x7ff9c806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:56.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.279+0000 7ff9cc93e700 1 -- 172.21.15.87:0/1850968872 shutdown_connections 2023-03-30T08:11:56.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.279+0000 7ff9cc93e700 1 -- 172.21.15.87:0/1850968872 wait complete. 2023-03-30T08:11:56.307 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-30T08:10:56.407927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-30T08:10:57.359214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-30T08:11:00.430972+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-30T08:11:56.308 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T08:11:56.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.467+0000 7fa13e49f700 1 Processor -- start 2023-03-30T08:11:56.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.467+0000 7fa13e49f700 1 -- start start 2023-03-30T08:11:56.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.471+0000 7fa13e49f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa1380d27e0 0x7fa1380d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.471+0000 7fa13e49f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa138160ef0 con 0x7fa13806a3e0 2023-03-30T08:11:56.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.471+0000 7fa13e49f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1380cd6a0 con 0x7fa1380b8380 2023-03-30T08:11:56.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.471+0000 7fa13e49f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1380cd3a0 con 0x7fa1380d27e0 2023-03-30T08:11:56.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.471+0000 7fa13dc9e700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa13806a3e0 0x7fa1380d0880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40266/0 (socket says 172.21.15.87:40266) 2023-03-30T08:11:56.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.471+0000 7fa13dc9e700 1 -- 172.21.15.87:0/728751252 learned_addr learned my addr 172.21.15.87:0/728751252 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:56.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.471+0000 7fa13cc9c700 1 --2- 172.21.15.87:0/728751252 >> v2:172.21.15.87:3300/0 conn(0x7fa1380d27e0 0x7fa1380d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:56.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.471+0000 7fa12ffff700 1 -- 172.21.15.87:0/728751252 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377664095 0 0) 0x7fa138160ef0 con 0x7fa13806a3e0 2023-03-30T08:11:56.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.471+0000 7fa12ffff700 1 -- 172.21.15.87:0/728751252 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1240035d0 con 0x7fa13806a3e0 2023-03-30T08:11:56.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.471+0000 7fa12ffff700 1 -- 172.21.15.87:0/728751252 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673959068 0 0) 0x7fa1380cd6a0 con 0x7fa1380b8380 2023-03-30T08:11:56.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.471+0000 7fa12ffff700 1 -- 172.21.15.87:0/728751252 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa138160ef0 con 0x7fa1380b8380 2023-03-30T08:11:56.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.471+0000 7fa13cc9c700 1 -- 172.21.15.87:0/728751252 >> v1:172.21.15.115:6789/0 conn(0x7fa1380b8380 legacy=0x7fa138069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.475+0000 7fa13cc9c700 1 -- 172.21.15.87:0/728751252 >> v1:172.21.15.87:6789/0 conn(0x7fa13806a3e0 legacy=0x7fa1380d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.475+0000 7fa13cc9c700 1 -- 172.21.15.87:0/728751252 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1380cef00 con 0x7fa1380d27e0 2023-03-30T08:11:56.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.475+0000 7fa13cc9c700 1 --2- 172.21.15.87:0/728751252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1380d27e0 0x7fa1380d2200 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa128009880 tx=0x7fa128009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fb8f13c0f2642f server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:56.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.475+0000 7fa12ffff700 1 -- 172.21.15.87:0/728751252 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128011830 con 0x7fa1380d27e0 2023-03-30T08:11:56.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.475+0000 7fa12ffff700 1 -- 172.21.15.87:0/728751252 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa128011990 con 0x7fa1380d27e0 2023-03-30T08:11:56.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.475+0000 7fa12ffff700 1 -- 172.21.15.87:0/728751252 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128011d20 con 0x7fa1380d27e0 2023-03-30T08:11:56.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.475+0000 7fa13e49f700 1 -- 172.21.15.87:0/728751252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1380d27e0 msgr2=0x7fa1380d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.475+0000 7fa13e49f700 1 --2- 172.21.15.87:0/728751252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1380d27e0 0x7fa1380d2200 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa128009880 tx=0x7fa128009b90 comp rx=0 tx=0).stop 2023-03-30T08:11:56.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.475+0000 7fa13e49f700 1 -- 172.21.15.87:0/728751252 shutdown_connections 2023-03-30T08:11:56.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.475+0000 7fa13e49f700 1 --2- 172.21.15.87:0/728751252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1380d27e0 0x7fa1380d2200 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.475+0000 7fa13e49f700 1 -- 172.21.15.87:0/728751252 >> 172.21.15.87:0/728751252 conn(0x7fa1380b53f0 msgr2=0x7fa1380cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:56.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.475+0000 7fa13e49f700 1 -- 172.21.15.87:0/728751252 shutdown_connections 2023-03-30T08:11:56.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.475+0000 7fa13e49f700 1 -- 172.21.15.87:0/728751252 wait complete. 2023-03-30T08:11:56.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.479+0000 7fa13e49f700 1 Processor -- start 2023-03-30T08:11:56.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.479+0000 7fa13e49f700 1 -- start start 2023-03-30T08:11:56.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.479+0000 7fa13e49f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa13806a3e0 0x7fa1380cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.479+0000 7fa13e49f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1380b8380 0x7fa1381487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.479+0000 7fa13e49f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa138148d00 0x7fa13814b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.479+0000 7fa13e49f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1380cb3b0 con 0x7fa138148d00 2023-03-30T08:11:56.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.479+0000 7fa13e49f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1380cb690 con 0x7fa1380b8380 2023-03-30T08:11:56.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.479+0000 7fa13e49f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1380cb970 con 0x7fa13806a3e0 2023-03-30T08:11:56.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.479+0000 7fa13dc9e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa138148d00 0x7fa13814b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:56.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.479+0000 7fa13dc9e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa138148d00 0x7fa13814b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37318/0 (socket says 172.21.15.87:37318) 2023-03-30T08:11:56.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.479+0000 7fa13dc9e700 1 -- 172.21.15.87:0/4271386521 learned_addr learned my addr 172.21.15.87:0/4271386521 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:56.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.479+0000 7fa13d49d700 1 --2- 172.21.15.87:0/4271386521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa13806a3e0 0x7fa1380cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:56.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.479+0000 7fa13cc9c700 1 --2- 172.21.15.87:0/4271386521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1380b8380 0x7fa1381487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:56.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.483+0000 7fa13dc9e700 1 -- 172.21.15.87:0/4271386521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa13806a3e0 msgr2=0x7fa1380cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.483+0000 7fa13dc9e700 1 --2- 172.21.15.87:0/4271386521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa13806a3e0 0x7fa1380cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.483+0000 7fa13dc9e700 1 -- 172.21.15.87:0/4271386521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1380b8380 msgr2=0x7fa1381487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.483+0000 7fa13dc9e700 1 --2- 172.21.15.87:0/4271386521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1380b8380 0x7fa1381487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.483+0000 7fa13dc9e700 1 -- 172.21.15.87:0/4271386521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1280094b0 con 0x7fa138148d00 2023-03-30T08:11:56.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.483+0000 7fa13dc9e700 1 --2- 172.21.15.87:0/4271386521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa138148d00 0x7fa13814b310 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa13000caa0 tx=0x7fa13000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:56.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.483+0000 7fa12dffb700 1 -- 172.21.15.87:0/4271386521 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130007480 con 0x7fa138148d00 2023-03-30T08:11:56.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.483+0000 7fa13e49f700 1 -- 172.21.15.87:0/4271386521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1380cf480 con 0x7fa138148d00 2023-03-30T08:11:56.490 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.483+0000 7fa12dffb700 1 -- 172.21.15.87:0/4271386521 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa130007600 con 0x7fa138148d00 2023-03-30T08:11:56.490 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.483+0000 7fa12dffb700 1 -- 172.21.15.87:0/4271386521 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1300079b0 con 0x7fa138148d00 2023-03-30T08:11:56.490 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.483+0000 7fa13e49f700 1 -- 172.21.15.87:0/4271386521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1380cf1a0 con 0x7fa138148d00 2023-03-30T08:11:56.490 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.483+0000 7fa13e49f700 1 -- 172.21.15.87:0/4271386521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1380b8750 con 0x7fa138148d00 2023-03-30T08:11:56.490 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.483+0000 7fa12dffb700 1 -- 172.21.15.87:0/4271386521 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa13001b3b0 con 0x7fa138148d00 2023-03-30T08:11:56.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.487+0000 7fa12dffb700 1 --2- 172.21.15.87:0/4271386521 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa11c0653f0 0x7fa11c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.487+0000 7fa12dffb700 1 -- 172.21.15.87:0/4271386521 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa130082520 con 0x7fa138148d00 2023-03-30T08:11:56.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.487+0000 7fa13d49d700 1 --2- 172.21.15.87:0/4271386521 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa11c0653f0 0x7fa11c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:56.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.487+0000 7fa13d49d700 1 --2- 172.21.15.87:0/4271386521 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa11c0653f0 0x7fa11c0678a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa1340011e0 tx=0x7fa134009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:56.498 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.491+0000 7fa12dffb700 1 -- 172.21.15.87:0/4271386521 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fa13004fd90 con 0x7fa138148d00 2023-03-30T08:11:56.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.659+0000 7fa13e49f700 1 -- 172.21.15.87:0/4271386521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa138072cf0 con 0x7fa138148d00 2023-03-30T08:11:56.665 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.659+0000 7fa12dffb700 1 -- 172.21.15.87:0/4271386521 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1300533b0 con 0x7fa138148d00 2023-03-30T08:11:56.665 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T08:11:56.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.663+0000 7fa13e49f700 1 -- 172.21.15.87:0/4271386521 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa11c0653f0 msgr2=0x7fa11c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.663+0000 7fa13e49f700 1 --2- 172.21.15.87:0/4271386521 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa11c0653f0 0x7fa11c0678a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa1340011e0 tx=0x7fa134009040 comp rx=0 tx=0).stop 2023-03-30T08:11:56.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.663+0000 7fa13e49f700 1 -- 172.21.15.87:0/4271386521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa138148d00 msgr2=0x7fa13814b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.663+0000 7fa13e49f700 1 --2- 172.21.15.87:0/4271386521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa138148d00 0x7fa13814b310 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa13000caa0 tx=0x7fa13000cad0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.663+0000 7fa13e49f700 1 -- 172.21.15.87:0/4271386521 shutdown_connections 2023-03-30T08:11:56.669 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.663+0000 7fa13e49f700 1 --2- 172.21.15.87:0/4271386521 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa11c0653f0 0x7fa11c0678a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.663+0000 7fa13e49f700 1 --2- 172.21.15.87:0/4271386521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa138148d00 0x7fa13814b310 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.663+0000 7fa13e49f700 1 --2- 172.21.15.87:0/4271386521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1380b8380 0x7fa1381487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.663+0000 7fa13e49f700 1 --2- 172.21.15.87:0/4271386521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa13806a3e0 0x7fa1380cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.663+0000 7fa13e49f700 1 -- 172.21.15.87:0/4271386521 >> 172.21.15.87:0/4271386521 conn(0x7fa1380b53f0 msgr2=0x7fa13806b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:56.670 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.663+0000 7fa13e49f700 1 -- 172.21.15.87:0/4271386521 shutdown_connections 2023-03-30T08:11:56.671 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.663+0000 7fa13e49f700 1 -- 172.21.15.87:0/4271386521 wait complete. 2023-03-30T08:11:56.686 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T08:11:56.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.843+0000 7f3b89206700 1 Processor -- start 2023-03-30T08:11:56.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.843+0000 7f3b89206700 1 -- start start 2023-03-30T08:11:56.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.847+0000 7f3b89206700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3b840cab90 0x7f3b840cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.847+0000 7f3b89206700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3b8415d790 0x7f3b840b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.847+0000 7f3b89206700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b840b18e0 0x7f3b84160050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.847+0000 7f3b89206700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8415c960 con 0x7f3b8415d790 2023-03-30T08:11:56.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.847+0000 7f3b89206700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b840b1d60 con 0x7f3b840cab90 2023-03-30T08:11:56.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.847+0000 7f3b89206700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b84071370 con 0x7f3b840b18e0 2023-03-30T08:11:56.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.847+0000 7f3b83fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3b840cab90 0x7f3b840cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:56.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.847+0000 7f3b83fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3b840cab90 0x7f3b840cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:51012/0 (socket says 172.21.15.87:51012) 2023-03-30T08:11:56.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.847+0000 7f3b83fff700 1 -- 172.21.15.87:0/1964565009 learned_addr learned my addr 172.21.15.87:0/1964565009 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:56.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.847+0000 7f3b7b7fe700 1 --2- 172.21.15.87:0/1964565009 >> v2:172.21.15.87:3300/0 conn(0x7f3b8415d790 0x7f3b840b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:56.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.847+0000 7f3b88a05700 1 --2- 172.21.15.87:0/1964565009 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b840b18e0 0x7f3b84160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:56.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.847+0000 7f3b83fff700 1 -- 172.21.15.87:0/1964565009 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b840b18e0 msgr2=0x7f3b84160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:56.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b83fff700 1 --2- 172.21.15.87:0/1964565009 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b840b18e0 0x7f3b84160050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b83fff700 1 -- 172.21.15.87:0/1964565009 >> v2:172.21.15.87:3300/0 conn(0x7f3b8415d790 msgr2=0x7f3b840b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:56.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b83fff700 1 --2- 172.21.15.87:0/1964565009 >> v2:172.21.15.87:3300/0 conn(0x7f3b8415d790 0x7f3b840b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b83fff700 1 -- 172.21.15.87:0/1964565009 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b84071630 con 0x7f3b840cab90 2023-03-30T08:11:56.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b7b7fe700 1 --2- 172.21.15.87:0/1964565009 >> v2:172.21.15.87:3300/0 conn(0x7f3b8415d790 0x7f3b840b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b83fff700 1 --2- 172.21.15.87:0/1964565009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b840cab90 0x7f3b840cd460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b840724b0 tx=0x7f3b7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b935d1ca13f81cb server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b837fe700 1 -- 172.21.15.87:0/1964565009 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7400e070 con 0x7f3b840cab90 2023-03-30T08:11:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b837fe700 1 -- 172.21.15.87:0/1964565009 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7400b910 con 0x7f3b840cab90 2023-03-30T08:11:56.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b837fe700 1 -- 172.21.15.87:0/1964565009 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7400bcc0 con 0x7f3b840cab90 2023-03-30T08:11:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b89206700 1 -- 172.21.15.87:0/1964565009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b840cab90 msgr2=0x7f3b840cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b89206700 1 --2- 172.21.15.87:0/1964565009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b840cab90 0x7f3b840cd460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b840724b0 tx=0x7f3b7400b330 comp rx=0 tx=0).stop 2023-03-30T08:11:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b89206700 1 -- 172.21.15.87:0/1964565009 shutdown_connections 2023-03-30T08:11:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b89206700 1 --2- 172.21.15.87:0/1964565009 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b840b18e0 0x7f3b84160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b89206700 1 --2- 172.21.15.87:0/1964565009 >> v2:172.21.15.87:3300/0 conn(0x7f3b8415d790 0x7f3b840b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b89206700 1 --2- 172.21.15.87:0/1964565009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b840cab90 0x7f3b840cd460 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b89206700 1 -- 172.21.15.87:0/1964565009 >> 172.21.15.87:0/1964565009 conn(0x7f3b840d05b0 msgr2=0x7f3b840cc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:56.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b89206700 1 -- 172.21.15.87:0/1964565009 shutdown_connections 2023-03-30T08:11:56.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.851+0000 7f3b89206700 1 -- 172.21.15.87:0/1964565009 wait complete. 2023-03-30T08:11:56.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b89206700 1 Processor -- start 2023-03-30T08:11:56.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b89206700 1 -- start start 2023-03-30T08:11:56.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b89206700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b840b18e0 0x7f3b840b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b89206700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b840cab90 0x7f3b840c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b89206700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b8415d790 0x7f3b8415e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b89206700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b84153d20 con 0x7f3b840b18e0 2023-03-30T08:11:56.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b89206700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b840c8ef0 con 0x7f3b840cab90 2023-03-30T08:11:56.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b89206700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b84153240 con 0x7f3b8415d790 2023-03-30T08:11:56.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b83fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b840b18e0 0x7f3b840b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:56.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b83fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b840b18e0 0x7f3b840b52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37338/0 (socket says 172.21.15.87:37338) 2023-03-30T08:11:56.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b83fff700 1 -- 172.21.15.87:0/2068545701 learned_addr learned my addr 172.21.15.87:0/2068545701 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:56.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b83fff700 1 -- 172.21.15.87:0/2068545701 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b8415d790 msgr2=0x7f3b8415e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b83fff700 1 --2- 172.21.15.87:0/2068545701 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b8415d790 0x7f3b8415e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b83fff700 1 -- 172.21.15.87:0/2068545701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b840cab90 msgr2=0x7f3b840c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:56.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b83fff700 1 --2- 172.21.15.87:0/2068545701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b840cab90 0x7f3b840c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:56.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b83fff700 1 -- 172.21.15.87:0/2068545701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c0094b0 con 0x7f3b840b18e0 2023-03-30T08:11:56.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b83fff700 1 --2- 172.21.15.87:0/2068545701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b840b18e0 0x7f3b840b52f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3b8415caa0 tx=0x7f3b74004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:56.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b817fa700 1 -- 172.21.15.87:0/2068545701 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74004250 con 0x7f3b840b18e0 2023-03-30T08:11:56.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b817fa700 1 -- 172.21.15.87:0/2068545701 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b740043d0 con 0x7f3b840b18e0 2023-03-30T08:11:56.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b89206700 1 -- 172.21.15.87:0/2068545701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b74009b30 con 0x7f3b840b18e0 2023-03-30T08:11:56.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b817fa700 1 -- 172.21.15.87:0/2068545701 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74004780 con 0x7f3b840b18e0 2023-03-30T08:11:56.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.855+0000 7f3b89206700 1 -- 172.21.15.87:0/2068545701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b84071bf0 con 0x7f3b840b18e0 2023-03-30T08:11:56.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.859+0000 7f3b89206700 1 -- 172.21.15.87:0/2068545701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b84071910 con 0x7f3b840b18e0 2023-03-30T08:11:56.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.859+0000 7f3b817fa700 1 -- 172.21.15.87:0/2068545701 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f3b7401c440 con 0x7f3b840b18e0 2023-03-30T08:11:56.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.859+0000 7f3b817fa700 1 --2- 172.21.15.87:0/2068545701 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3b640653f0 0x7f3b640678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:56.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.859+0000 7f3b817fa700 1 -- 172.21.15.87:0/2068545701 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3b74084110 con 0x7f3b840b18e0 2023-03-30T08:11:56.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.859+0000 7f3b7b7fe700 1 --2- 172.21.15.87:0/2068545701 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3b640653f0 0x7f3b640678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:56.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.859+0000 7f3b7b7fe700 1 --2- 172.21.15.87:0/2068545701 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3b640653f0 0x7f3b640678a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c006f30 tx=0x7f3b6c006e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:56.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:56.863+0000 7f3b817fa700 1 -- 172.21.15.87:0/2068545701 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f3b74051970 con 0x7f3b840b18e0 2023-03-30T08:11:57.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.027+0000 7f3b89206700 1 -- 172.21.15.87:0/2068545701 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3b84071ed0 con 0x7f3b840b18e0 2023-03-30T08:11:57.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.027+0000 7f3b817fa700 1 -- 172.21.15.87:0/2068545701 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3b74020020 con 0x7f3b840b18e0 2023-03-30T08:11:57.034 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T08:11:57.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.031+0000 7f3b89206700 1 -- 172.21.15.87:0/2068545701 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3b640653f0 msgr2=0x7f3b640678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.031+0000 7f3b89206700 1 --2- 172.21.15.87:0/2068545701 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3b640653f0 0x7f3b640678a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c006f30 tx=0x7f3b6c006e80 comp rx=0 tx=0).stop 2023-03-30T08:11:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.031+0000 7f3b89206700 1 -- 172.21.15.87:0/2068545701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b840b18e0 msgr2=0x7f3b840b52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.031+0000 7f3b89206700 1 --2- 172.21.15.87:0/2068545701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b840b18e0 0x7f3b840b52f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3b8415caa0 tx=0x7f3b74004af0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.031+0000 7f3b89206700 1 -- 172.21.15.87:0/2068545701 shutdown_connections 2023-03-30T08:11:57.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.031+0000 7f3b89206700 1 --2- 172.21.15.87:0/2068545701 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3b640653f0 0x7f3b640678a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.031+0000 7f3b89206700 1 --2- 172.21.15.87:0/2068545701 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3b8415d790 0x7f3b8415e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.031+0000 7f3b89206700 1 --2- 172.21.15.87:0/2068545701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b840cab90 0x7f3b840c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.031+0000 7f3b89206700 1 --2- 172.21.15.87:0/2068545701 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b840b18e0 0x7f3b840b52f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.031+0000 7f3b89206700 1 -- 172.21.15.87:0/2068545701 >> 172.21.15.87:0/2068545701 conn(0x7f3b840d05b0 msgr2=0x7f3b840cc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:57.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.031+0000 7f3b89206700 1 -- 172.21.15.87:0/2068545701 shutdown_connections 2023-03-30T08:11:57.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.031+0000 7f3b89206700 1 -- 172.21.15.87:0/2068545701 wait complete. 2023-03-30T08:11:57.056 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-30T08:11:57.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.219+0000 7fcdc41a0700 1 Processor -- start 2023-03-30T08:11:57.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.219+0000 7fcdc41a0700 1 -- start start 2023-03-30T08:11:57.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc41a0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdbc06aea0 0x7fcdbc163960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:57.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc41a0700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdbc069e90 con 0x7fcdbc070ca0 2023-03-30T08:11:57.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc41a0700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdbc06aa10 con 0x7fcdbc06ed20 2023-03-30T08:11:57.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc41a0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0cddf0 con 0x7fcdbc06aea0 2023-03-30T08:11:57.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc1f3c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fcdbc070ca0 0x7fcdbc071070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40278/0 (socket says 172.21.15.87:40278) 2023-03-30T08:11:57.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc1f3c700 1 -- 172.21.15.87:0/2729703640 learned_addr learned my addr 172.21.15.87:0/2729703640 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:57.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc273d700 1 --2- 172.21.15.87:0/2729703640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdbc06aea0 0x7fcdbc163960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:57.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc0f3a700 1 -- 172.21.15.87:0/2729703640 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605783826 0 0) 0x7fcdbc069e90 con 0x7fcdbc070ca0 2023-03-30T08:11:57.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc0f3a700 1 -- 172.21.15.87:0/2729703640 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcda80035d0 con 0x7fcdbc070ca0 2023-03-30T08:11:57.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc0f3a700 1 -- 172.21.15.87:0/2729703640 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705433712 0 0) 0x7fcdbc06aa10 con 0x7fcdbc06ed20 2023-03-30T08:11:57.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc0f3a700 1 -- 172.21.15.87:0/2729703640 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdbc069e90 con 0x7fcdbc06ed20 2023-03-30T08:11:57.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc0f3a700 1 -- 172.21.15.87:0/2729703640 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2432216620 0 0) 0x7fcda80035d0 con 0x7fcdbc070ca0 2023-03-30T08:11:57.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc273d700 1 -- 172.21.15.87:0/2729703640 >> v1:172.21.15.115:6789/0 conn(0x7fcdbc06ed20 legacy=0x7fcdbc0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc273d700 1 -- 172.21.15.87:0/2729703640 >> v1:172.21.15.87:6789/0 conn(0x7fcdbc070ca0 legacy=0x7fcdbc071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc273d700 1 -- 172.21.15.87:0/2729703640 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc158f00 con 0x7fcdbc06aea0 2023-03-30T08:11:57.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc273d700 1 --2- 172.21.15.87:0/2729703640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdbc06aea0 0x7fcdbc163960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400aed0 tx=0x7fcdb400c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f20283703e005a66 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:57.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc0f3a700 1 -- 172.21.15.87:0/2729703640 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400f070 con 0x7fcdbc06aea0 2023-03-30T08:11:57.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc0f3a700 1 -- 172.21.15.87:0/2729703640 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb400a2e0 con 0x7fcdbc06aea0 2023-03-30T08:11:57.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.223+0000 7fcdc0f3a700 1 -- 172.21.15.87:0/2729703640 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8001670 con 0x7fcdbc06aea0 2023-03-30T08:11:57.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.227+0000 7fcdc41a0700 1 -- 172.21.15.87:0/2729703640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdbc06aea0 msgr2=0x7fcdbc163960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.227+0000 7fcdc41a0700 1 --2- 172.21.15.87:0/2729703640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdbc06aea0 0x7fcdbc163960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400aed0 tx=0x7fcdb400c330 comp rx=0 tx=0).stop 2023-03-30T08:11:57.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.227+0000 7fcdc41a0700 1 -- 172.21.15.87:0/2729703640 shutdown_connections 2023-03-30T08:11:57.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.227+0000 7fcdc41a0700 1 --2- 172.21.15.87:0/2729703640 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdbc06aea0 0x7fcdbc163960 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.227+0000 7fcdc41a0700 1 -- 172.21.15.87:0/2729703640 >> 172.21.15.87:0/2729703640 conn(0x7fcdbc0cf120 msgr2=0x7fcdbc0cf4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:57.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.227+0000 7fcdc41a0700 1 -- 172.21.15.87:0/2729703640 shutdown_connections 2023-03-30T08:11:57.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.227+0000 7fcdc41a0700 1 -- 172.21.15.87:0/2729703640 wait complete. 2023-03-30T08:11:57.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.227+0000 7fcdc41a0700 1 Processor -- start 2023-03-30T08:11:57.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.227+0000 7fcdc41a0700 1 -- start start 2023-03-30T08:11:57.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc41a0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc06aea0 0x7fcdbc1521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:57.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc41a0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdbc06ed20 0x7fcdbc0b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:57.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc41a0700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdbc070ca0 0x7fcdbc0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:57.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc41a0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0ccbf0 con 0x7fcdbc06aea0 2023-03-30T08:11:57.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc41a0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0b2590 con 0x7fcdbc06ed20 2023-03-30T08:11:57.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc41a0700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0b2870 con 0x7fcdbc070ca0 2023-03-30T08:11:57.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc1f3c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc06aea0 0x7fcdbc1521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:57.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc1f3c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc06aea0 0x7fcdbc1521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37352/0 (socket says 172.21.15.87:37352) 2023-03-30T08:11:57.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc1f3c700 1 -- 172.21.15.87:0/2908363761 learned_addr learned my addr 172.21.15.87:0/2908363761 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:57.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc173b700 1 --2- 172.21.15.87:0/2908363761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdbc06ed20 0x7fcdbc0b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:57.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc1f3c700 1 -- 172.21.15.87:0/2908363761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdbc070ca0 msgr2=0x7fcdbc0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc1f3c700 1 --2- 172.21.15.87:0/2908363761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdbc070ca0 0x7fcdbc0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc1f3c700 1 -- 172.21.15.87:0/2908363761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdbc06ed20 msgr2=0x7fcdbc0b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc1f3c700 1 --2- 172.21.15.87:0/2908363761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdbc06ed20 0x7fcdbc0b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc1f3c700 1 -- 172.21.15.87:0/2908363761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb400ab80 con 0x7fcdbc06aea0 2023-03-30T08:11:57.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc1f3c700 1 --2- 172.21.15.87:0/2908363761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc06aea0 0x7fcdbc1521a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800c6b0 tx=0x7fcdb800ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:57.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdb27fc700 1 -- 172.21.15.87:0/2908363761 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8004ca0 con 0x7fcdbc06aea0 2023-03-30T08:11:57.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdb27fc700 1 -- 172.21.15.87:0/2908363761 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb8004e20 con 0x7fcdbc06aea0 2023-03-30T08:11:57.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdb27fc700 1 -- 172.21.15.87:0/2908363761 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8007310 con 0x7fcdbc06aea0 2023-03-30T08:11:57.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc41a0700 1 -- 172.21.15.87:0/2908363761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdbc06a3c0 con 0x7fcdbc06aea0 2023-03-30T08:11:57.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.231+0000 7fcdc41a0700 1 -- 172.21.15.87:0/2908363761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdbc06a0e0 con 0x7fcdbc06aea0 2023-03-30T08:11:57.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.235+0000 7fcdc41a0700 1 -- 172.21.15.87:0/2908363761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdbc06a6a0 con 0x7fcdbc06aea0 2023-03-30T08:11:57.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.235+0000 7fcdb27fc700 1 -- 172.21.15.87:0/2908363761 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fcdb8007470 con 0x7fcdbc06aea0 2023-03-30T08:11:57.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.235+0000 7fcdb27fc700 1 --2- 172.21.15.87:0/2908363761 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcda00653f0 0x7fcda00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:57.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.235+0000 7fcdb27fc700 1 -- 172.21.15.87:0/2908363761 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcdb80829a0 con 0x7fcdbc06aea0 2023-03-30T08:11:57.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.235+0000 7fcdc173b700 1 --2- 172.21.15.87:0/2908363761 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcda00653f0 0x7fcda00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:57.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.239+0000 7fcdc173b700 1 --2- 172.21.15.87:0/2908363761 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcda00653f0 0x7fcda00678a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcdac007fd0 tx=0x7fcdac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:57.247 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.243+0000 7fcdb27fc700 1 -- 172.21.15.87:0/2908363761 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fcdb8050250 con 0x7fcdbc06aea0 2023-03-30T08:11:57.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.415+0000 7fcdc41a0700 1 -- 172.21.15.87:0/2908363761 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcdbc0cda80 con 0x7fcdbc06aea0 2023-03-30T08:11:57.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.415+0000 7fcdb27fc700 1 -- 172.21.15.87:0/2908363761 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcdb8007720 con 0x7fcdbc06aea0 2023-03-30T08:11:57.423 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:57.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.419+0000 7fcdc41a0700 1 -- 172.21.15.87:0/2908363761 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcda00653f0 msgr2=0x7fcda00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.419+0000 7fcdc41a0700 1 --2- 172.21.15.87:0/2908363761 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcda00653f0 0x7fcda00678a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcdac007fd0 tx=0x7fcdac009040 comp rx=0 tx=0).stop 2023-03-30T08:11:57.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.419+0000 7fcdc41a0700 1 -- 172.21.15.87:0/2908363761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc06aea0 msgr2=0x7fcdbc1521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.419+0000 7fcdc41a0700 1 --2- 172.21.15.87:0/2908363761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc06aea0 0x7fcdbc1521a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800c6b0 tx=0x7fcdb800ca70 comp rx=0 tx=0).stop 2023-03-30T08:11:57.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.419+0000 7fcdc41a0700 1 -- 172.21.15.87:0/2908363761 shutdown_connections 2023-03-30T08:11:57.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.419+0000 7fcdc41a0700 1 --2- 172.21.15.87:0/2908363761 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcda00653f0 0x7fcda00678a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.419+0000 7fcdc41a0700 1 --2- 172.21.15.87:0/2908363761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcdbc070ca0 0x7fcdbc0cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.419+0000 7fcdc41a0700 1 --2- 172.21.15.87:0/2908363761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcdbc06ed20 0x7fcdbc0b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.419+0000 7fcdc41a0700 1 --2- 172.21.15.87:0/2908363761 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcdbc06aea0 0x7fcdbc1521a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.419+0000 7fcdc41a0700 1 -- 172.21.15.87:0/2908363761 >> 172.21.15.87:0/2908363761 conn(0x7fcdbc0cf120 msgr2=0x7fcdbc060870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.419+0000 7fcdc41a0700 1 -- 172.21.15.87:0/2908363761 shutdown_connections 2023-03-30T08:11:57.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.419+0000 7fcdc41a0700 1 -- 172.21.15.87:0/2908363761 wait complete. 2023-03-30T08:11:57.445 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-30T08:11:57.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.603+0000 7f7ff21d2700 1 Processor -- start 2023-03-30T08:11:57.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.603+0000 7f7ff21d2700 1 -- start start 2023-03-30T08:11:57.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.603+0000 7f7ff21d2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7fec06d320 0x7f7fec1650f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:57.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.603+0000 7f7ff21d2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fec06b670 con 0x7f7fec0b0c10 2023-03-30T08:11:57.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.603+0000 7f7ff21d2700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fec06b0b0 con 0x7f7fec0b3f30 2023-03-30T08:11:57.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.603+0000 7f7ff21d2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fec0b1090 con 0x7f7fec06d320 2023-03-30T08:11:57.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.603+0000 7f7ff09cf700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7fec0b0c10 0x7f7fec0aec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40292/0 (socket says 172.21.15.87:40292) 2023-03-30T08:11:57.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.603+0000 7f7ff09cf700 1 -- 172.21.15.87:0/315881266 learned_addr learned my addr 172.21.15.87:0/315881266 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:57.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.603+0000 7f7ff19d1700 1 --2- 172.21.15.87:0/315881266 >> v2:172.21.15.115:3300/0 conn(0x7f7fec06d320 0x7f7fec1650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:57.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7fe3fff700 1 -- 172.21.15.87:0/315881266 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837024617 0 0) 0x7f7fec06b670 con 0x7f7fec0b0c10 2023-03-30T08:11:57.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7fe3fff700 1 -- 172.21.15.87:0/315881266 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fd80035d0 con 0x7f7fec0b0c10 2023-03-30T08:11:57.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7ff19d1700 1 -- 172.21.15.87:0/315881266 >> v1:172.21.15.115:6789/0 conn(0x7f7fec0b3f30 legacy=0x7f7fec06a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7ff19d1700 1 -- 172.21.15.87:0/315881266 >> v1:172.21.15.87:6789/0 conn(0x7f7fec0b0c10 legacy=0x7f7fec0aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7ff19d1700 1 -- 172.21.15.87:0/315881266 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec06b390 con 0x7f7fec06d320 2023-03-30T08:11:57.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7ff19d1700 1 --2- 172.21.15.87:0/315881266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7fec06d320 0x7f7fec1650f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009d90 tx=0x7f7fe400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=851547c05be0518d server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:57.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7fe3fff700 1 -- 172.21.15.87:0/315881266 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400e070 con 0x7f7fec06d320 2023-03-30T08:11:57.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7fe3fff700 1 -- 172.21.15.87:0/315881266 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe400bb20 con 0x7f7fec06d320 2023-03-30T08:11:57.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7fe3fff700 1 -- 172.21.15.87:0/315881266 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4012430 con 0x7f7fec06d320 2023-03-30T08:11:57.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7ff21d2700 1 -- 172.21.15.87:0/315881266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7fec06d320 msgr2=0x7f7fec1650f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7ff21d2700 1 --2- 172.21.15.87:0/315881266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7fec06d320 0x7f7fec1650f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009d90 tx=0x7f7fe400b330 comp rx=0 tx=0).stop 2023-03-30T08:11:57.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7ff21d2700 1 -- 172.21.15.87:0/315881266 shutdown_connections 2023-03-30T08:11:57.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7ff21d2700 1 --2- 172.21.15.87:0/315881266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7fec06d320 0x7f7fec1650f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7ff21d2700 1 -- 172.21.15.87:0/315881266 >> 172.21.15.87:0/315881266 conn(0x7f7fec0cf410 msgr2=0x7f7fec0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:57.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7ff21d2700 1 -- 172.21.15.87:0/315881266 shutdown_connections 2023-03-30T08:11:57.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.607+0000 7f7ff21d2700 1 -- 172.21.15.87:0/315881266 wait complete. 2023-03-30T08:11:57.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.611+0000 7f7ff21d2700 1 Processor -- start 2023-03-30T08:11:57.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.611+0000 7f7ff21d2700 1 -- start start 2023-03-30T08:11:57.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.611+0000 7f7ff21d2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7fec06d320 0x7f7fec150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:57.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.611+0000 7f7ff21d2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7fec0b0c10 0x7f7fec14fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:57.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.611+0000 7f7ff21d2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec0b3f30 0x7f7fec1f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:57.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.611+0000 7f7ff21d2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec15d640 con 0x7f7fec0b3f30 2023-03-30T08:11:57.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.611+0000 7f7ff21d2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec151000 con 0x7f7fec06d320 2023-03-30T08:11:57.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.611+0000 7f7ff21d2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec153720 con 0x7f7fec0b0c10 2023-03-30T08:11:57.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.611+0000 7f7ff19d1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec0b3f30 0x7f7fec1f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:57.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.611+0000 7f7ff19d1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec0b3f30 0x7f7fec1f2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37356/0 (socket says 172.21.15.87:37356) 2023-03-30T08:11:57.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.611+0000 7f7ff19d1700 1 -- 172.21.15.87:0/4280532749 learned_addr learned my addr 172.21.15.87:0/4280532749 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:57.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.615+0000 7f7ff09cf700 1 --2- 172.21.15.87:0/4280532749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7fec0b0c10 0x7f7fec14fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:57.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.615+0000 7f7ff11d0700 1 --2- 172.21.15.87:0/4280532749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7fec06d320 0x7f7fec150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.615+0000 7f7ff19d1700 1 -- 172.21.15.87:0/4280532749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7fec0b0c10 msgr2=0x7f7fec14fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.615+0000 7f7ff19d1700 1 --2- 172.21.15.87:0/4280532749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7fec0b0c10 0x7f7fec14fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.615+0000 7f7ff19d1700 1 -- 172.21.15.87:0/4280532749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7fec06d320 msgr2=0x7f7fec150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.615+0000 7f7ff19d1700 1 --2- 172.21.15.87:0/4280532749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7fec06d320 0x7f7fec150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.615+0000 7f7ff19d1700 1 -- 172.21.15.87:0/4280532749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4009a70 con 0x7f7fec0b3f30 2023-03-30T08:11:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.615+0000 7f7ff11d0700 1 --2- 172.21.15.87:0/4280532749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7fec06d320 0x7f7fec150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.615+0000 7f7ff19d1700 1 --2- 172.21.15.87:0/4280532749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec0b3f30 0x7f7fec1f2f60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4014040 tx=0x7f7fe4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:57.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.615+0000 7f7fe1ffb700 1 -- 172.21.15.87:0/4280532749 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe40048e0 con 0x7f7fec0b3f30 2023-03-30T08:11:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.615+0000 7f7fe1ffb700 1 -- 172.21.15.87:0/4280532749 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe4020070 con 0x7f7fec0b3f30 2023-03-30T08:11:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.615+0000 7f7fe1ffb700 1 -- 172.21.15.87:0/4280532749 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe40276c0 con 0x7f7fec0b3f30 2023-03-30T08:11:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.615+0000 7f7ff21d2700 1 -- 172.21.15.87:0/4280532749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fec0ae1b0 con 0x7f7fec0b3f30 2023-03-30T08:11:57.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.615+0000 7f7ff21d2700 1 -- 172.21.15.87:0/4280532749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fec0aded0 con 0x7f7fec0b3f30 2023-03-30T08:11:57.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.615+0000 7f7ff21d2700 1 -- 172.21.15.87:0/4280532749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fec0b4300 con 0x7f7fec0b3f30 2023-03-30T08:11:57.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.619+0000 7f7fe1ffb700 1 -- 172.21.15.87:0/4280532749 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f7fe4012430 con 0x7f7fec0b3f30 2023-03-30T08:11:57.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.619+0000 7f7fe1ffb700 1 --2- 172.21.15.87:0/4280532749 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7fd0065420 0x7f7fd00678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:57.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.619+0000 7f7fe1ffb700 1 -- 172.21.15.87:0/4280532749 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7fe4022070 con 0x7f7fec0b3f30 2023-03-30T08:11:57.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.619+0000 7f7ff11d0700 1 --2- 172.21.15.87:0/4280532749 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7fd0065420 0x7f7fd00678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:57.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.619+0000 7f7ff11d0700 1 --2- 172.21.15.87:0/4280532749 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7fd0065420 0x7f7fd00678d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7fec1f2ec0 tx=0x7f7fe8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:57.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.623+0000 7f7fe1ffb700 1 -- 172.21.15.87:0/4280532749 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f7fe40522d0 con 0x7f7fec0b3f30 2023-03-30T08:11:57.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.799+0000 7f7ff21d2700 1 -- 172.21.15.87:0/4280532749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7fec0733a0 con 0x7f7fec0b3f30 2023-03-30T08:11:57.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.799+0000 7f7fe1ffb700 1 -- 172.21.15.87:0/4280532749 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7fe40558f0 con 0x7f7fec0b3f30 2023-03-30T08:11:57.805 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-03-30T08:11:57.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.799+0000 7f7ff21d2700 1 -- 172.21.15.87:0/4280532749 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7fd0065420 msgr2=0x7f7fd00678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.799+0000 7f7ff21d2700 1 --2- 172.21.15.87:0/4280532749 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7fd0065420 0x7f7fd00678d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7fec1f2ec0 tx=0x7f7fe8009040 comp rx=0 tx=0).stop 2023-03-30T08:11:57.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.803+0000 7f7ff21d2700 1 -- 172.21.15.87:0/4280532749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec0b3f30 msgr2=0x7f7fec1f2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:57.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.803+0000 7f7ff21d2700 1 --2- 172.21.15.87:0/4280532749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec0b3f30 0x7f7fec1f2f60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4014040 tx=0x7f7fe4004af0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.803+0000 7f7ff21d2700 1 -- 172.21.15.87:0/4280532749 shutdown_connections 2023-03-30T08:11:57.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.803+0000 7f7ff21d2700 1 --2- 172.21.15.87:0/4280532749 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7fd0065420 0x7f7fd00678d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.803+0000 7f7ff21d2700 1 --2- 172.21.15.87:0/4280532749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7fec0b3f30 0x7f7fec1f2f60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.803+0000 7f7ff21d2700 1 --2- 172.21.15.87:0/4280532749 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7fec0b0c10 0x7f7fec14fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.803+0000 7f7ff21d2700 1 --2- 172.21.15.87:0/4280532749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7fec06d320 0x7f7fec150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:57.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.803+0000 7f7ff21d2700 1 -- 172.21.15.87:0/4280532749 >> 172.21.15.87:0/4280532749 conn(0x7f7fec0cf410 msgr2=0x7f7fec0cc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:57.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.803+0000 7f7ff21d2700 1 -- 172.21.15.87:0/4280532749 shutdown_connections 2023-03-30T08:11:57.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.803+0000 7f7ff21d2700 1 -- 172.21.15.87:0/4280532749 wait complete. 2023-03-30T08:11:57.826 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-30T08:11:57.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.991+0000 7fef59c45700 1 Processor -- start 2023-03-30T08:11:57.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.991+0000 7fef59c45700 1 -- start start 2023-03-30T08:11:57.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.991+0000 7fef59c45700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fef540ceec0 0x7fef540cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:57.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.991+0000 7fef59c45700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fef5415a720 0x7fef5415ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:57.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef59c45700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef540c9680 con 0x7fef54154690 2023-03-30T08:11:57.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef59c45700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef540cf8a0 con 0x7fef540ceec0 2023-03-30T08:11:58.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef59c45700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef540719f0 con 0x7fef5415a720 2023-03-30T08:11:58.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef58c43700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fef54154690 0x7fef5415e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40296/0 (socket says 172.21.15.87:40296) 2023-03-30T08:11:58.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef58c43700 1 -- 172.21.15.87:0/2398044959 learned_addr learned my addr 172.21.15.87:0/2398044959 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:58.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef53fff700 1 --2- 172.21.15.87:0/2398044959 >> v2:172.21.15.87:3300/0 conn(0x7fef540ceec0 0x7fef540cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef59444700 1 --2- 172.21.15.87:0/2398044959 >> v2:172.21.15.115:3300/0 conn(0x7fef5415a720 0x7fef5415ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef53fff700 1 -- 172.21.15.87:0/2398044959 >> v2:172.21.15.115:3300/0 conn(0x7fef5415a720 msgr2=0x7fef5415ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:58.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef53fff700 1 --2- 172.21.15.87:0/2398044959 >> v2:172.21.15.115:3300/0 conn(0x7fef5415a720 0x7fef5415ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef53fff700 1 -- 172.21.15.87:0/2398044959 >> v1:172.21.15.87:6789/0 conn(0x7fef54154690 legacy=0x7fef5415e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:58.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef53fff700 1 -- 172.21.15.87:0/2398044959 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef540c98d0 con 0x7fef540ceec0 2023-03-30T08:11:58.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef53fff700 1 --2- 172.21.15.87:0/2398044959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef540ceec0 0x7fef540cf360 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fef541582f0 tx=0x7fef48009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdf071f991ddeee server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:58.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef537fe700 1 -- 172.21.15.87:0/2398044959 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48011830 con 0x7fef540ceec0 2023-03-30T08:11:58.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef537fe700 1 -- 172.21.15.87:0/2398044959 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef48011990 con 0x7fef540ceec0 2023-03-30T08:11:58.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef537fe700 1 -- 172.21.15.87:0/2398044959 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48011d40 con 0x7fef540ceec0 2023-03-30T08:11:58.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef59c45700 1 -- 172.21.15.87:0/2398044959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef540ceec0 msgr2=0x7fef540cf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:58.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef59c45700 1 --2- 172.21.15.87:0/2398044959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef540ceec0 0x7fef540cf360 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fef541582f0 tx=0x7fef48009b30 comp rx=0 tx=0).stop 2023-03-30T08:11:58.005 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef59c45700 1 -- 172.21.15.87:0/2398044959 shutdown_connections 2023-03-30T08:11:58.005 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef59c45700 1 --2- 172.21.15.87:0/2398044959 >> v2:172.21.15.115:3300/0 conn(0x7fef5415a720 0x7fef5415ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.005 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef59c45700 1 --2- 172.21.15.87:0/2398044959 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef540ceec0 0x7fef540cf360 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.005 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef59c45700 1 -- 172.21.15.87:0/2398044959 >> 172.21.15.87:0/2398044959 conn(0x7fef540b0b80 msgr2=0x7fef540b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:58.005 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef59c45700 1 -- 172.21.15.87:0/2398044959 shutdown_connections 2023-03-30T08:11:58.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.995+0000 7fef59c45700 1 -- 172.21.15.87:0/2398044959 wait complete. 2023-03-30T08:11:58.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.999+0000 7fef59c45700 1 Processor -- start 2023-03-30T08:11:58.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:57.999+0000 7fef59c45700 1 -- start start 2023-03-30T08:11:58.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef59c45700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef540ceec0 0x7fef54147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef59c45700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef54154690 0x7fef541f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef59c45700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef5415a720 0x7fef5415cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef59c45700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540abaf0 con 0x7fef54154690 2023-03-30T08:11:58.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef59c45700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef541f2ca0 con 0x7fef5415a720 2023-03-30T08:11:58.008 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef59c45700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540ccd30 con 0x7fef540ceec0 2023-03-30T08:11:58.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef53fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef54154690 0x7fef541f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef53fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef54154690 0x7fef541f2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37374/0 (socket says 172.21.15.87:37374) 2023-03-30T08:11:58.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef53fff700 1 -- 172.21.15.87:0/3865481704 learned_addr learned my addr 172.21.15.87:0/3865481704 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:58.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef58c43700 1 --2- 172.21.15.87:0/3865481704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef540ceec0 0x7fef54147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef59444700 1 --2- 172.21.15.87:0/3865481704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef5415a720 0x7fef5415cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef53fff700 1 -- 172.21.15.87:0/3865481704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef540ceec0 msgr2=0x7fef54147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:58.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef53fff700 1 --2- 172.21.15.87:0/3865481704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef540ceec0 0x7fef54147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef53fff700 1 -- 172.21.15.87:0/3865481704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef5415a720 msgr2=0x7fef5415cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:58.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef53fff700 1 --2- 172.21.15.87:0/3865481704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef5415a720 0x7fef5415cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef53fff700 1 -- 172.21.15.87:0/3865481704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef480094b0 con 0x7fef54154690 2023-03-30T08:11:58.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef53fff700 1 --2- 172.21.15.87:0/3865481704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef54154690 0x7fef541f2e60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fef48014040 tx=0x7fef48004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:58.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef517fa700 1 -- 172.21.15.87:0/3865481704 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480038c0 con 0x7fef54154690 2023-03-30T08:11:58.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef517fa700 1 -- 172.21.15.87:0/3865481704 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4801e070 con 0x7fef54154690 2023-03-30T08:11:58.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef517fa700 1 -- 172.21.15.87:0/3865481704 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48003c80 con 0x7fef54154690 2023-03-30T08:11:58.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef59c45700 1 -- 172.21.15.87:0/3865481704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef540cb0c0 con 0x7fef54154690 2023-03-30T08:11:58.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.003+0000 7fef59c45700 1 -- 172.21.15.87:0/3865481704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef54071c90 con 0x7fef54154690 2023-03-30T08:11:58.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.007+0000 7fef59c45700 1 -- 172.21.15.87:0/3865481704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5414ffc0 con 0x7fef54154690 2023-03-30T08:11:58.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.007+0000 7fef517fa700 1 -- 172.21.15.87:0/3865481704 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fef4801a420 con 0x7fef54154690 2023-03-30T08:11:58.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.011+0000 7fef517fa700 1 --2- 172.21.15.87:0/3865481704 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fef400653f0 0x7fef400678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.011+0000 7fef517fa700 1 -- 172.21.15.87:0/3865481704 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fef48020070 con 0x7fef54154690 2023-03-30T08:11:58.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.011+0000 7fef58c43700 1 --2- 172.21.15.87:0/3865481704 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fef400653f0 0x7fef400678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.011+0000 7fef58c43700 1 --2- 172.21.15.87:0/3865481704 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fef400653f0 0x7fef400678a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fef44005930 tx=0x7fef44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:58.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.015+0000 7fef517fa700 1 -- 172.21.15.87:0/3865481704 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fef48051c40 con 0x7fef54154690 2023-03-30T08:11:58.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.183+0000 7fef59c45700 1 -- 172.21.15.87:0/3865481704 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fef540c9bb0 con 0x7fef54154690 2023-03-30T08:11:58.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.183+0000 7fef517fa700 1 -- 172.21.15.87:0/3865481704 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fef4802d350 con 0x7fef54154690 2023-03-30T08:11:58.189 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:11:58.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.187+0000 7fef59c45700 1 -- 172.21.15.87:0/3865481704 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fef400653f0 msgr2=0x7fef400678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:58.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.187+0000 7fef59c45700 1 --2- 172.21.15.87:0/3865481704 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fef400653f0 0x7fef400678a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fef44005930 tx=0x7fef44009040 comp rx=0 tx=0).stop 2023-03-30T08:11:58.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.187+0000 7fef59c45700 1 -- 172.21.15.87:0/3865481704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef54154690 msgr2=0x7fef541f2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:58.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.187+0000 7fef59c45700 1 --2- 172.21.15.87:0/3865481704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef54154690 0x7fef541f2e60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fef48014040 tx=0x7fef48004770 comp rx=0 tx=0).stop 2023-03-30T08:11:58.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.187+0000 7fef59c45700 1 -- 172.21.15.87:0/3865481704 shutdown_connections 2023-03-30T08:11:58.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.187+0000 7fef59c45700 1 --2- 172.21.15.87:0/3865481704 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fef400653f0 0x7fef400678a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.187+0000 7fef59c45700 1 --2- 172.21.15.87:0/3865481704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef5415a720 0x7fef5415cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.187+0000 7fef59c45700 1 --2- 172.21.15.87:0/3865481704 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fef54154690 0x7fef541f2e60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.187+0000 7fef59c45700 1 --2- 172.21.15.87:0/3865481704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef540ceec0 0x7fef54147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.187+0000 7fef59c45700 1 -- 172.21.15.87:0/3865481704 >> 172.21.15.87:0/3865481704 conn(0x7fef540b0b80 msgr2=0x7fef54069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:58.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.187+0000 7fef59c45700 1 -- 172.21.15.87:0/3865481704 shutdown_connections 2023-03-30T08:11:58.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.187+0000 7fef59c45700 1 -- 172.21.15.87:0/3865481704 wait complete. 2023-03-30T08:11:58.210 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-30T08:11:58.376 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.371+0000 7fa88e04d700 1 Processor -- start 2023-03-30T08:11:58.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.371+0000 7fa88e04d700 1 -- start start 2023-03-30T08:11:58.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa88e04d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8880b41c0 0x7fa8880cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa88e04d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa888070b30 0x7fa8880cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa88e04d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88815e8c0 con 0x7fa8880c8fb0 2023-03-30T08:11:58.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa88e04d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88815ed50 con 0x7fa888070b30 2023-03-30T08:11:58.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa88e04d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880c96b0 con 0x7fa8880b41c0 2023-03-30T08:11:58.381 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa887fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa888070b30 0x7fa8880cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.381 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa8877fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8880b41c0 0x7fa8880cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.381 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa886ffd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa8880c8fb0 0x7fa888070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40298/0 (socket says 172.21.15.87:40298) 2023-03-30T08:11:58.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa886ffd700 1 -- 172.21.15.87:0/398320757 learned_addr learned my addr 172.21.15.87:0/398320757 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:58.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa887fff700 1 -- 172.21.15.87:0/398320757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8880b41c0 msgr2=0x7fa8880cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:58.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa887fff700 1 --2- 172.21.15.87:0/398320757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8880b41c0 0x7fa8880cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa887fff700 1 -- 172.21.15.87:0/398320757 >> v1:172.21.15.87:6789/0 conn(0x7fa8880c8fb0 legacy=0x7fa888070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:58.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa887fff700 1 -- 172.21.15.87:0/398320757 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8880c9400 con 0x7fa888070b30 2023-03-30T08:11:58.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa887fff700 1 --2- 172.21.15.87:0/398320757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa888070b30 0x7fa8880cc530 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa880009d90 tx=0x7fa88000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9b0d8970c1105b server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:58.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa8867fc700 1 -- 172.21.15.87:0/398320757 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000e070 con 0x7fa888070b30 2023-03-30T08:11:58.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa8867fc700 1 -- 172.21.15.87:0/398320757 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88000bb20 con 0x7fa888070b30 2023-03-30T08:11:58.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.375+0000 7fa8867fc700 1 -- 172.21.15.87:0/398320757 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa880012430 con 0x7fa888070b30 2023-03-30T08:11:58.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.379+0000 7fa88e04d700 1 -- 172.21.15.87:0/398320757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa888070b30 msgr2=0x7fa8880cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:58.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.379+0000 7fa88e04d700 1 --2- 172.21.15.87:0/398320757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa888070b30 0x7fa8880cc530 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa880009d90 tx=0x7fa88000b330 comp rx=0 tx=0).stop 2023-03-30T08:11:58.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.379+0000 7fa88e04d700 1 -- 172.21.15.87:0/398320757 shutdown_connections 2023-03-30T08:11:58.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.379+0000 7fa88e04d700 1 --2- 172.21.15.87:0/398320757 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa888070b30 0x7fa8880cc530 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.379+0000 7fa88e04d700 1 --2- 172.21.15.87:0/398320757 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8880b41c0 0x7fa8880cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.379+0000 7fa88e04d700 1 -- 172.21.15.87:0/398320757 >> 172.21.15.87:0/398320757 conn(0x7fa8880ce960 msgr2=0x7fa8880ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:58.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.379+0000 7fa88e04d700 1 -- 172.21.15.87:0/398320757 shutdown_connections 2023-03-30T08:11:58.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.379+0000 7fa88e04d700 1 -- 172.21.15.87:0/398320757 wait complete. 2023-03-30T08:11:58.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.379+0000 7fa88e04d700 1 Processor -- start 2023-03-30T08:11:58.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.379+0000 7fa88e04d700 1 -- start start 2023-03-30T08:11:58.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa88e04d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa888070b30 0x7fa888146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa88e04d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8880b41c0 0x7fa88815cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa88e04d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8880c8fb0 0x7fa88815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa88e04d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88815ddb0 con 0x7fa888070b30 2023-03-30T08:11:58.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa88e04d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88815d7f0 con 0x7fa8880b41c0 2023-03-30T08:11:58.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa88e04d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88815dad0 con 0x7fa8880c8fb0 2023-03-30T08:11:58.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa8877fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa888070b30 0x7fa888146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa8877fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa888070b30 0x7fa888146550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37392/0 (socket says 172.21.15.87:37392) 2023-03-30T08:11:58.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa8877fe700 1 -- 172.21.15.87:0/1829812070 learned_addr learned my addr 172.21.15.87:0/1829812070 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:58.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa887fff700 1 --2- 172.21.15.87:0/1829812070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8880c8fb0 0x7fa88815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa886ffd700 1 --2- 172.21.15.87:0/1829812070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8880b41c0 0x7fa88815cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa8877fe700 1 -- 172.21.15.87:0/1829812070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8880c8fb0 msgr2=0x7fa88815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:58.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa8877fe700 1 --2- 172.21.15.87:0/1829812070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8880c8fb0 0x7fa88815d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa8877fe700 1 -- 172.21.15.87:0/1829812070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8880b41c0 msgr2=0x7fa88815cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:58.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa8877fe700 1 --2- 172.21.15.87:0/1829812070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8880b41c0 0x7fa88815cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa8877fe700 1 -- 172.21.15.87:0/1829812070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa880009a70 con 0x7fa888070b30 2023-03-30T08:11:58.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa8877fe700 1 --2- 172.21.15.87:0/1829812070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa888070b30 0x7fa888146550 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa87800e9d0 tx=0x7fa87800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:58.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa86ffff700 1 -- 172.21.15.87:0/1829812070 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878009720 con 0x7fa888070b30 2023-03-30T08:11:58.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa86ffff700 1 -- 172.21.15.87:0/1829812070 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87800c850 con 0x7fa888070b30 2023-03-30T08:11:58.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa88e04d700 1 -- 172.21.15.87:0/1829812070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88815df90 con 0x7fa888070b30 2023-03-30T08:11:58.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa86ffff700 1 -- 172.21.15.87:0/1829812070 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87800cbc0 con 0x7fa888070b30 2023-03-30T08:11:58.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.383+0000 7fa88e04d700 1 -- 172.21.15.87:0/1829812070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8880ce720 con 0x7fa888070b30 2023-03-30T08:11:58.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.387+0000 7fa88e04d700 1 -- 172.21.15.87:0/1829812070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88815e250 con 0x7fa888070b30 2023-03-30T08:11:58.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.387+0000 7fa86ffff700 1 -- 172.21.15.87:0/1829812070 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa87800cd20 con 0x7fa888070b30 2023-03-30T08:11:58.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.387+0000 7fa86ffff700 1 --2- 172.21.15.87:0/1829812070 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa8740653f0 0x7fa8740678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.391+0000 7fa86ffff700 1 -- 172.21.15.87:0/1829812070 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa878082d20 con 0x7fa888070b30 2023-03-30T08:11:58.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.391+0000 7fa886ffd700 1 --2- 172.21.15.87:0/1829812070 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa8740653f0 0x7fa8740678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.391+0000 7fa886ffd700 1 --2- 172.21.15.87:0/1829812070 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa8740653f0 0x7fa8740678a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa888157c50 tx=0x7fa87c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:58.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.395+0000 7fa86ffff700 1 -- 172.21.15.87:0/1829812070 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fa878050600 con 0x7fa888070b30 2023-03-30T08:11:58.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.583+0000 7fa88e04d700 1 -- 172.21.15.87:0/1829812070 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa888073ee0 con 0x7fa888070b30 2023-03-30T08:11:58.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.583+0000 7fa86ffff700 1 -- 172.21.15.87:0/1829812070 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa878053c20 con 0x7fa888070b30 2023-03-30T08:11:58.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.587+0000 7fa88e04d700 1 -- 172.21.15.87:0/1829812070 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa8740653f0 msgr2=0x7fa8740678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:58.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.587+0000 7fa88e04d700 1 --2- 172.21.15.87:0/1829812070 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa8740653f0 0x7fa8740678a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa888157c50 tx=0x7fa87c009040 comp rx=0 tx=0).stop 2023-03-30T08:11:58.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.587+0000 7fa88e04d700 1 -- 172.21.15.87:0/1829812070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa888070b30 msgr2=0x7fa888146550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:58.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.587+0000 7fa88e04d700 1 --2- 172.21.15.87:0/1829812070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa888070b30 0x7fa888146550 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa87800e9d0 tx=0x7fa87800ed90 comp rx=0 tx=0).stop 2023-03-30T08:11:58.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.587+0000 7fa88e04d700 1 -- 172.21.15.87:0/1829812070 shutdown_connections 2023-03-30T08:11:58.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.587+0000 7fa88e04d700 1 --2- 172.21.15.87:0/1829812070 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa8740653f0 0x7fa8740678a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.587+0000 7fa88e04d700 1 --2- 172.21.15.87:0/1829812070 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8880c8fb0 0x7fa88815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.587+0000 7fa88e04d700 1 --2- 172.21.15.87:0/1829812070 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8880b41c0 0x7fa88815cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.587+0000 7fa88e04d700 1 --2- 172.21.15.87:0/1829812070 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa888070b30 0x7fa888146550 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.587+0000 7fa88e04d700 1 -- 172.21.15.87:0/1829812070 >> 172.21.15.87:0/1829812070 conn(0x7fa8880ce960 msgr2=0x7fa88806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:58.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.587+0000 7fa88e04d700 1 -- 172.21.15.87:0/1829812070 shutdown_connections 2023-03-30T08:11:58.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.587+0000 7fa88e04d700 1 -- 172.21.15.87:0/1829812070 wait complete. 2023-03-30T08:11:58.597 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2023-03-30T08:11:58.614 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-03-30T08:11:58.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:58.615 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-03-30T08:11:58.690 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-03-30T08:11:58.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:11:58.690 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-03-30T08:11:58.705 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-03-30T08:11:58.706 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T08:11:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.863+0000 7fd5027b4700 1 Processor -- start 2023-03-30T08:11:58.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.863+0000 7fd5027b4700 1 -- start start 2023-03-30T08:11:58.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd5027b4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd4fc0b8380 0x7fd4fc0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd5027b4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd4fc0d27e0 0x7fd4fc069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd5027b4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4fc1609f0 0x7fd4fc06a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd5027b4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc160ef0 con 0x7fd4fc0d27e0 2023-03-30T08:11:58.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd5027b4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc0cd6a0 con 0x7fd4fc0b8380 2023-03-30T08:11:58.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd5027b4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0cd3a0 con 0x7fd4fc1609f0 2023-03-30T08:11:58.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd500fb1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd4fc0d27e0 0x7fd4fc069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd500fb1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd4fc0d27e0 0x7fd4fc069cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37396/0 (socket says 172.21.15.87:37396) 2023-03-30T08:11:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd500fb1700 1 -- 172.21.15.87:0/316708924 learned_addr learned my addr 172.21.15.87:0/316708924 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd5017b2700 1 --2- 172.21.15.87:0/316708924 >> v2:172.21.15.115:3300/0 conn(0x7fd4fc0b8380 0x7fd4fc0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd501fb3700 1 --2- 172.21.15.87:0/316708924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4fc1609f0 0x7fd4fc06a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd500fb1700 1 -- 172.21.15.87:0/316708924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4fc1609f0 msgr2=0x7fd4fc06a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd500fb1700 1 --2- 172.21.15.87:0/316708924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4fc1609f0 0x7fd4fc06a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd500fb1700 1 -- 172.21.15.87:0/316708924 >> v2:172.21.15.115:3300/0 conn(0x7fd4fc0b8380 msgr2=0x7fd4fc0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:58.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd500fb1700 1 --2- 172.21.15.87:0/316708924 >> v2:172.21.15.115:3300/0 conn(0x7fd4fc0b8380 0x7fd4fc0d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd500fb1700 1 -- 172.21.15.87:0/316708924 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc0cef00 con 0x7fd4fc0d27e0 2023-03-30T08:11:58.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd5017b2700 1 --2- 172.21.15.87:0/316708924 >> v2:172.21.15.115:3300/0 conn(0x7fd4fc0b8380 0x7fd4fc0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:58.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd501fb3700 1 --2- 172.21.15.87:0/316708924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4fc1609f0 0x7fd4fc06a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:11:58.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd500fb1700 1 --2- 172.21.15.87:0/316708924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4fc0d27e0 0x7fd4fc069cd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc06ad60 tx=0x7fd4ec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ddc81d6f86aef3 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:58.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd4f3fff700 1 -- 172.21.15.87:0/316708924 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec00b8a0 con 0x7fd4fc0d27e0 2023-03-30T08:11:58.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd4f3fff700 1 -- 172.21.15.87:0/316708924 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec00ba00 con 0x7fd4fc0d27e0 2023-03-30T08:11:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd4f3fff700 1 -- 172.21.15.87:0/316708924 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec00bd90 con 0x7fd4fc0d27e0 2023-03-30T08:11:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd5027b4700 1 -- 172.21.15.87:0/316708924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4fc0d27e0 msgr2=0x7fd4fc069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:58.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.867+0000 7fd5027b4700 1 --2- 172.21.15.87:0/316708924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4fc0d27e0 0x7fd4fc069cd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc06ad60 tx=0x7fd4ec009bf0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.871+0000 7fd5027b4700 1 -- 172.21.15.87:0/316708924 shutdown_connections 2023-03-30T08:11:58.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.871+0000 7fd5027b4700 1 --2- 172.21.15.87:0/316708924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4fc1609f0 0x7fd4fc06a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.871+0000 7fd5027b4700 1 --2- 172.21.15.87:0/316708924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4fc0d27e0 0x7fd4fc069cd0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.871+0000 7fd5027b4700 1 --2- 172.21.15.87:0/316708924 >> v2:172.21.15.115:3300/0 conn(0x7fd4fc0b8380 0x7fd4fc0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.871+0000 7fd5027b4700 1 -- 172.21.15.87:0/316708924 >> 172.21.15.87:0/316708924 conn(0x7fd4fc0b53f0 msgr2=0x7fd4fc0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:58.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.871+0000 7fd5027b4700 1 -- 172.21.15.87:0/316708924 shutdown_connections 2023-03-30T08:11:58.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.871+0000 7fd5027b4700 1 -- 172.21.15.87:0/316708924 wait complete. 2023-03-30T08:11:58.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.871+0000 7fd5027b4700 1 Processor -- start 2023-03-30T08:11:58.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.871+0000 7fd5027b4700 1 -- start start 2023-03-30T08:11:58.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd5027b4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4fc0b8380 0x7fd4fc154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd5027b4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4fc1609f0 0x7fd4fc0d18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd5027b4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4fc0d1df0 0x7fd4fc15cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd5027b4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0d2290 con 0x7fd4fc1609f0 2023-03-30T08:11:58.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd5027b4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc155480 con 0x7fd4fc0b8380 2023-03-30T08:11:58.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd5027b4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0cb3f0 con 0x7fd4fc0d1df0 2023-03-30T08:11:58.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd500fb1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4fc1609f0 0x7fd4fc0d18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd500fb1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4fc1609f0 0x7fd4fc0d18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37406/0 (socket says 172.21.15.87:37406) 2023-03-30T08:11:58.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd500fb1700 1 -- 172.21.15.87:0/10756905 learned_addr learned my addr 172.21.15.87:0/10756905 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:58.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd5017b2700 1 --2- 172.21.15.87:0/10756905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4fc0b8380 0x7fd4fc154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd501fb3700 1 --2- 172.21.15.87:0/10756905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4fc0d1df0 0x7fd4fc15cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd500fb1700 1 -- 172.21.15.87:0/10756905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4fc0d1df0 msgr2=0x7fd4fc15cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:58.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd500fb1700 1 --2- 172.21.15.87:0/10756905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4fc0d1df0 0x7fd4fc15cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd500fb1700 1 -- 172.21.15.87:0/10756905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4fc0b8380 msgr2=0x7fd4fc154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:58.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd500fb1700 1 --2- 172.21.15.87:0/10756905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4fc0b8380 0x7fd4fc154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:58.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd500fb1700 1 -- 172.21.15.87:0/10756905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec009570 con 0x7fd4fc1609f0 2023-03-30T08:11:58.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd500fb1700 1 --2- 172.21.15.87:0/10756905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4fc1609f0 0x7fd4fc0d18b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc08bd10 tx=0x7fd4ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:58.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd4f1ffb700 1 -- 172.21.15.87:0/10756905 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec00bee0 con 0x7fd4fc1609f0 2023-03-30T08:11:58.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd4f1ffb700 1 -- 172.21.15.87:0/10756905 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec01f070 con 0x7fd4fc1609f0 2023-03-30T08:11:58.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd5027b4700 1 -- 172.21.15.87:0/10756905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc0cf480 con 0x7fd4fc1609f0 2023-03-30T08:11:58.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd4f1ffb700 1 -- 172.21.15.87:0/10756905 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec003b20 con 0x7fd4fc1609f0 2023-03-30T08:11:58.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.875+0000 7fd5027b4700 1 -- 172.21.15.87:0/10756905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc0cf1a0 con 0x7fd4fc1609f0 2023-03-30T08:11:58.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.879+0000 7fd5027b4700 1 -- 172.21.15.87:0/10756905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc0b8750 con 0x7fd4fc1609f0 2023-03-30T08:11:58.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.879+0000 7fd4f1ffb700 1 -- 172.21.15.87:0/10756905 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd4ec003c80 con 0x7fd4fc1609f0 2023-03-30T08:11:58.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.879+0000 7fd4f1ffb700 1 --2- 172.21.15.87:0/10756905 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4e00653f0 0x7fd4e00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:58.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.879+0000 7fd4f1ffb700 1 -- 172.21.15.87:0/10756905 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd4ec021070 con 0x7fd4fc1609f0 2023-03-30T08:11:58.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.883+0000 7fd5017b2700 1 --2- 172.21.15.87:0/10756905 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4e00653f0 0x7fd4e00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:58.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.883+0000 7fd5017b2700 1 --2- 172.21.15.87:0/10756905 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4e00653f0 0x7fd4e00678a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8007130 tx=0x7fd4f80077c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:58.891 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:58.887+0000 7fd4f1ffb700 1 -- 172.21.15.87:0/10756905 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fd4ec052090 con 0x7fd4fc1609f0 2023-03-30T08:11:59.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.091+0000 7fd5027b4700 1 -- 172.21.15.87:0/10756905 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4fc072cf0 con 0x7fd4fc1609f0 2023-03-30T08:11:59.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.095+0000 7fd4f1ffb700 1 -- 172.21.15.87:0/10756905 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7fd4ec0556b0 con 0x7fd4fc1609f0 2023-03-30T08:11:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:59.100 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2818344230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2818344230},{"type":"v1","addr":"172.21.15.115:6833","nonce":2818344230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3891185444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3891185444},{"type":"v1","addr":"172.21.15.87:6836","nonce":3891185444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3443119914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3443119914},{"type":"v1","addr":"172.21.15.87:6837","nonce":3443119914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-30T08:10:58.351331+0000","modified":"2023-03-30T08:11:17.023824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3640886103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3640886103},{"type":"v1","addr":"172.21.15.115:6835","nonce":3640886103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-30T08:11:59.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.095+0000 7fd5027b4700 1 -- 172.21.15.87:0/10756905 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4e00653f0 msgr2=0x7fd4e00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:59.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.095+0000 7fd5027b4700 1 --2- 172.21.15.87:0/10756905 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4e00653f0 0x7fd4e00678a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8007130 tx=0x7fd4f80077c0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.095+0000 7fd5027b4700 1 -- 172.21.15.87:0/10756905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4fc1609f0 msgr2=0x7fd4fc0d18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:59.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.095+0000 7fd5027b4700 1 --2- 172.21.15.87:0/10756905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4fc1609f0 0x7fd4fc0d18b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc08bd10 tx=0x7fd4ec004770 comp rx=0 tx=0).stop 2023-03-30T08:11:59.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.095+0000 7fd5027b4700 1 -- 172.21.15.87:0/10756905 shutdown_connections 2023-03-30T08:11:59.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.095+0000 7fd5027b4700 1 --2- 172.21.15.87:0/10756905 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4e00653f0 0x7fd4e00678a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.095+0000 7fd5027b4700 1 --2- 172.21.15.87:0/10756905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd4fc0d1df0 0x7fd4fc15cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.095+0000 7fd5027b4700 1 --2- 172.21.15.87:0/10756905 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd4fc1609f0 0x7fd4fc0d18b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.095+0000 7fd5027b4700 1 --2- 172.21.15.87:0/10756905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4fc0b8380 0x7fd4fc154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.095+0000 7fd5027b4700 1 -- 172.21.15.87:0/10756905 >> 172.21.15.87:0/10756905 conn(0x7fd4fc0b53f0 msgr2=0x7fd4fc0cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:59.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.095+0000 7fd5027b4700 1 -- 172.21.15.87:0/10756905 shutdown_connections 2023-03-30T08:11:59.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.095+0000 7fd5027b4700 1 -- 172.21.15.87:0/10756905 wait complete. 2023-03-30T08:11:59.104 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2023-03-30T08:11:59.124 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:11:59.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.271+0000 7f989f59e700 1 Processor -- start 2023-03-30T08:11:59.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.271+0000 7f989f59e700 1 -- start start 2023-03-30T08:11:59.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.271+0000 7f989f59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f98a00b3f30 0x7f98a00b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:59.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.271+0000 7f989f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98a006a6e0 0x7f98a00aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:59.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.271+0000 7f989f59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a006b670 con 0x7f98a00af180 2023-03-30T08:11:59.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.271+0000 7f989f59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a00af600 con 0x7f98a00b3f30 2023-03-30T08:11:59.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.271+0000 7f989f59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a006b0b0 con 0x7f98a006a6e0 2023-03-30T08:11:59.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989e59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f98a00b3f30 0x7f98a00b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:59.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989e59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f98a00b3f30 0x7f98a00b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37418/0 (socket says 172.21.15.87:37418) 2023-03-30T08:11:59.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989e59c700 1 -- 172.21.15.87:0/3775989271 learned_addr learned my addr 172.21.15.87:0/3775989271 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:59.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f9895d9b700 1 --2- 172.21.15.87:0/3775989271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98a006a6e0 0x7f98a00aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:59.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989e59c700 1 -- 172.21.15.87:0/3775989271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98a006a6e0 msgr2=0x7f98a00aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:59.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989e59c700 1 --2- 172.21.15.87:0/3775989271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98a006a6e0 0x7f98a00aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989e59c700 1 -- 172.21.15.87:0/3775989271 >> v1:172.21.15.87:6789/0 conn(0x7f98a00af180 legacy=0x7f98a015ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:59.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989e59c700 1 -- 172.21.15.87:0/3775989271 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a006b390 con 0x7f98a00b3f30 2023-03-30T08:11:59.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f9895d9b700 1 --2- 172.21.15.87:0/3775989271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98a006a6e0 0x7f98a00aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:11:59.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989e59c700 1 --2- 172.21.15.87:0/3775989271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98a00b3f30 0x7f98a00b0c10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9890009910 tx=0x7f9890009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b196befa79502743 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:59.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989dd9b700 1 -- 172.21.15.87:0/3775989271 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890011830 con 0x7f98a00b3f30 2023-03-30T08:11:59.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989dd9b700 1 -- 172.21.15.87:0/3775989271 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9890011990 con 0x7f98a00b3f30 2023-03-30T08:11:59.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989dd9b700 1 -- 172.21.15.87:0/3775989271 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890011d40 con 0x7f98a00b3f30 2023-03-30T08:11:59.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989f59e700 1 -- 172.21.15.87:0/3775989271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98a00b3f30 msgr2=0x7f98a00b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:59.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989f59e700 1 --2- 172.21.15.87:0/3775989271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98a00b3f30 0x7f98a00b0c10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9890009910 tx=0x7f9890009c20 comp rx=0 tx=0).stop 2023-03-30T08:11:59.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989f59e700 1 -- 172.21.15.87:0/3775989271 shutdown_connections 2023-03-30T08:11:59.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989f59e700 1 --2- 172.21.15.87:0/3775989271 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98a006a6e0 0x7f98a00aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989f59e700 1 --2- 172.21.15.87:0/3775989271 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98a00b3f30 0x7f98a00b0c10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989f59e700 1 -- 172.21.15.87:0/3775989271 >> 172.21.15.87:0/3775989271 conn(0x7f98a00cf410 msgr2=0x7f98a00cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:59.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989f59e700 1 -- 172.21.15.87:0/3775989271 shutdown_connections 2023-03-30T08:11:59.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.275+0000 7f989f59e700 1 -- 172.21.15.87:0/3775989271 wait complete. 2023-03-30T08:11:59.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.279+0000 7f989f59e700 1 Processor -- start 2023-03-30T08:11:59.286 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.279+0000 7f989f59e700 1 -- start start 2023-03-30T08:11:59.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98a006a6e0 0x7f98a0146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:59.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98a00af180 0x7f98a00ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:59.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989f59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98a00b3f30 0x7f98a00ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:59.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989f59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a0147700 con 0x7f98a00b3f30 2023-03-30T08:11:59.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989f59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a0147970 con 0x7f98a00af180 2023-03-30T08:11:59.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989f59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a0147c50 con 0x7f98a006a6e0 2023-03-30T08:11:59.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989ed9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98a00b3f30 0x7f98a00ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:59.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989ed9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98a00b3f30 0x7f98a00ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37430/0 (socket says 172.21.15.87:37430) 2023-03-30T08:11:59.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989ed9d700 1 -- 172.21.15.87:0/970936790 learned_addr learned my addr 172.21.15.87:0/970936790 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:59.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989e59c700 1 --2- 172.21.15.87:0/970936790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98a006a6e0 0x7f98a0146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:59.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f9895d9b700 1 --2- 172.21.15.87:0/970936790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98a00af180 0x7f98a00ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:59.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989ed9d700 1 -- 172.21.15.87:0/970936790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98a006a6e0 msgr2=0x7f98a0146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:59.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989ed9d700 1 --2- 172.21.15.87:0/970936790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98a006a6e0 0x7f98a0146e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989ed9d700 1 -- 172.21.15.87:0/970936790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98a00af180 msgr2=0x7f98a00ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:59.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989ed9d700 1 --2- 172.21.15.87:0/970936790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98a00af180 0x7f98a00ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989ed9d700 1 -- 172.21.15.87:0/970936790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98880094b0 con 0x7f98a00b3f30 2023-03-30T08:11:59.290 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989ed9d700 1 --2- 172.21.15.87:0/970936790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98a00b3f30 0x7f98a00ca930 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f989800cb50 tx=0x7f989800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:59.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f98977fe700 1 -- 172.21.15.87:0/970936790 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898003c20 con 0x7f98a00b3f30 2023-03-30T08:11:59.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f98977fe700 1 -- 172.21.15.87:0/970936790 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9898003d80 con 0x7f98a00b3f30 2023-03-30T08:11:59.291 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989f59e700 1 -- 172.21.15.87:0/970936790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9890009570 con 0x7f98a00b3f30 2023-03-30T08:11:59.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f98977fe700 1 -- 172.21.15.87:0/970936790 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989800aa20 con 0x7f98a00b3f30 2023-03-30T08:11:59.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.283+0000 7f989f59e700 1 -- 172.21.15.87:0/970936790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a00ae1b0 con 0x7f98a00b3f30 2023-03-30T08:11:59.292 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.287+0000 7f989f59e700 1 -- 172.21.15.87:0/970936790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a00aded0 con 0x7f98a00b3f30 2023-03-30T08:11:59.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.287+0000 7f98977fe700 1 -- 172.21.15.87:0/970936790 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f989800ab80 con 0x7f98a00b3f30 2023-03-30T08:11:59.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.287+0000 7f98977fe700 1 --2- 172.21.15.87:0/970936790 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f98800653f0 0x7f98800678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:59.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.287+0000 7f98977fe700 1 -- 172.21.15.87:0/970936790 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9898082c00 con 0x7f98a00b3f30 2023-03-30T08:11:59.294 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.287+0000 7f989e59c700 1 --2- 172.21.15.87:0/970936790 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f98800653f0 0x7f98800678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:59.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.291+0000 7f989e59c700 1 --2- 172.21.15.87:0/970936790 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f98800653f0 0x7f98800678a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9890000c00 tx=0x7f9890008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:59.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.295+0000 7f98977fe700 1 -- 172.21.15.87:0/970936790 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f9898050430 con 0x7f98a00b3f30 2023-03-30T08:11:59.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.463+0000 7f989f59e700 1 -- 172.21.15.87:0/970936790 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98a00b4300 con 0x7f98a00b3f30 2023-03-30T08:11:59.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.467+0000 7f98977fe700 1 -- 172.21.15.87:0/970936790 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+19747 (secure 0 0 0) 0x7f9898053a50 con 0x7f98a00b3f30 2023-03-30T08:11:59.474 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:11:59.475 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:39.157903+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:11:59.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.471+0000 7f989f59e700 1 -- 172.21.15.87:0/970936790 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f98800653f0 msgr2=0x7f98800678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:59.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.471+0000 7f989f59e700 1 --2- 172.21.15.87:0/970936790 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f98800653f0 0x7f98800678a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9890000c00 tx=0x7f9890008030 comp rx=0 tx=0).stop 2023-03-30T08:11:59.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.471+0000 7f989f59e700 1 -- 172.21.15.87:0/970936790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98a00b3f30 msgr2=0x7f98a00ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:59.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.471+0000 7f989f59e700 1 --2- 172.21.15.87:0/970936790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98a00b3f30 0x7f98a00ca930 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f989800cb50 tx=0x7f989800ce60 comp rx=0 tx=0).stop 2023-03-30T08:11:59.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.471+0000 7f989f59e700 1 -- 172.21.15.87:0/970936790 shutdown_connections 2023-03-30T08:11:59.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.471+0000 7f989f59e700 1 --2- 172.21.15.87:0/970936790 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f98800653f0 0x7f98800678a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.471+0000 7f989f59e700 1 --2- 172.21.15.87:0/970936790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98a00b3f30 0x7f98a00ca930 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.471+0000 7f989f59e700 1 --2- 172.21.15.87:0/970936790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98a00af180 0x7f98a00ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.471+0000 7f989f59e700 1 --2- 172.21.15.87:0/970936790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f98a006a6e0 0x7f98a0146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.471+0000 7f989f59e700 1 -- 172.21.15.87:0/970936790 >> 172.21.15.87:0/970936790 conn(0x7f98a00cf410 msgr2=0x7f98a006c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:59.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.471+0000 7f989f59e700 1 -- 172.21.15.87:0/970936790 shutdown_connections 2023-03-30T08:11:59.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.471+0000 7f989f59e700 1 -- 172.21.15.87:0/970936790 wait complete. 2023-03-30T08:11:59.500 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-30T08:10:56.407927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-30T08:10:57.359214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-30T08:11:00.430972+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-30T08:11:59.501 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T08:11:59.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.663+0000 7fccbd537700 1 Processor -- start 2023-03-30T08:11:59.668 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.663+0000 7fccbd537700 1 -- start start 2023-03-30T08:11:59.671 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.663+0000 7fccbd537700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fccb80adb80 0x7fccb806cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:59.671 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.663+0000 7fccbd537700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccb8070b30 0x7fccb80c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:59.671 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.663+0000 7fccbd537700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb806c710 con 0x7fccb80cd8e0 2023-03-30T08:11:59.671 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.667+0000 7fccbd537700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb806be20 con 0x7fccb80adb80 2023-03-30T08:11:59.671 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.667+0000 7fccbd537700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb80adf50 con 0x7fccb8070b30 2023-03-30T08:11:59.672 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.667+0000 7fccb6ffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fccb80adb80 0x7fccb806cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:59.672 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.667+0000 7fccb77fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccb8070b30 0x7fccb80c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:59.672 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.667+0000 7fccb67fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fccb80cd8e0 0x7fccb8070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:39428/0 (socket says 172.21.15.87:39428) 2023-03-30T08:11:59.672 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.667+0000 7fccb67fc700 1 -- 172.21.15.87:0/3939129434 learned_addr learned my addr 172.21.15.87:0/3939129434 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:11:59.673 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.667+0000 7fccb77fe700 1 -- 172.21.15.87:0/3939129434 >> v2:172.21.15.115:3300/0 conn(0x7fccb80adb80 msgr2=0x7fccb806cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:11:59.673 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.667+0000 7fccb77fe700 1 --2- 172.21.15.87:0/3939129434 >> v2:172.21.15.115:3300/0 conn(0x7fccb80adb80 0x7fccb806cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.673 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.667+0000 7fccb77fe700 1 -- 172.21.15.87:0/3939129434 >> v1:172.21.15.115:6789/0 conn(0x7fccb80cd8e0 legacy=0x7fccb8070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:59.673 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.667+0000 7fccb77fe700 1 -- 172.21.15.87:0/3939129434 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb806c0c0 con 0x7fccb8070b30 2023-03-30T08:11:59.674 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.667+0000 7fccb77fe700 1 --2- 172.21.15.87:0/3939129434 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccb8070b30 0x7fccb80c9ac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009d90 tx=0x7fccb000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ed149cc81435be0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:59.674 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.667+0000 7fccb5ffb700 1 -- 172.21.15.87:0/3939129434 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb000e070 con 0x7fccb8070b30 2023-03-30T08:11:59.674 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.667+0000 7fccb5ffb700 1 -- 172.21.15.87:0/3939129434 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb000bb20 con 0x7fccb8070b30 2023-03-30T08:11:59.674 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.667+0000 7fccb5ffb700 1 -- 172.21.15.87:0/3939129434 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0012430 con 0x7fccb8070b30 2023-03-30T08:11:59.675 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.671+0000 7fccbd537700 1 -- 172.21.15.87:0/3939129434 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccb8070b30 msgr2=0x7fccb80c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:59.675 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.671+0000 7fccbd537700 1 --2- 172.21.15.87:0/3939129434 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccb8070b30 0x7fccb80c9ac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009d90 tx=0x7fccb000b330 comp rx=0 tx=0).stop 2023-03-30T08:11:59.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.671+0000 7fccbd537700 1 -- 172.21.15.87:0/3939129434 shutdown_connections 2023-03-30T08:11:59.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.671+0000 7fccbd537700 1 --2- 172.21.15.87:0/3939129434 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccb8070b30 0x7fccb80c9ac0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.671+0000 7fccbd537700 1 --2- 172.21.15.87:0/3939129434 >> v2:172.21.15.115:3300/0 conn(0x7fccb80adb80 0x7fccb806cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.671+0000 7fccbd537700 1 -- 172.21.15.87:0/3939129434 >> 172.21.15.87:0/3939129434 conn(0x7fccb80ce960 msgr2=0x7fccb80ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:59.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.671+0000 7fccbd537700 1 -- 172.21.15.87:0/3939129434 shutdown_connections 2023-03-30T08:11:59.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.671+0000 7fccbd537700 1 -- 172.21.15.87:0/3939129434 wait complete. 2023-03-30T08:11:59.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.671+0000 7fccbd537700 1 Processor -- start 2023-03-30T08:11:59.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.671+0000 7fccbd537700 1 -- start start 2023-03-30T08:11:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccbd537700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccb8070b30 0x7fccb80c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccbd537700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb80adb80 0x7fccb8159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccbd537700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccb80cd8e0 0x7fccb81f1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccbd537700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb8154930 con 0x7fccb80adb80 2023-03-30T08:11:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccbd537700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb815c000 con 0x7fccb8070b30 2023-03-30T08:11:59.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccbd537700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb815c2e0 con 0x7fccb80cd8e0 2023-03-30T08:11:59.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccb67fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb80adb80 0x7fccb8159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:59.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccb67fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb80adb80 0x7fccb8159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37444/0 (socket says 172.21.15.87:37444) 2023-03-30T08:11:59.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccb67fc700 1 -- 172.21.15.87:0/1838829308 learned_addr learned my addr 172.21.15.87:0/1838829308 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:11:59.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccb6ffd700 1 --2- 172.21.15.87:0/1838829308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccb8070b30 0x7fccb80c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:59.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccb77fe700 1 --2- 172.21.15.87:0/1838829308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccb80cd8e0 0x7fccb81f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:59.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccb67fc700 1 -- 172.21.15.87:0/1838829308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccb80cd8e0 msgr2=0x7fccb81f1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:59.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccb67fc700 1 --2- 172.21.15.87:0/1838829308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccb80cd8e0 0x7fccb81f1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccb67fc700 1 -- 172.21.15.87:0/1838829308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccb8070b30 msgr2=0x7fccb80c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:59.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccb67fc700 1 --2- 172.21.15.87:0/1838829308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccb8070b30 0x7fccb80c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccb67fc700 1 -- 172.21.15.87:0/1838829308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb0009a70 con 0x7fccb80adb80 2023-03-30T08:11:59.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccb67fc700 1 --2- 172.21.15.87:0/1838829308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb80adb80 0x7fccb8159750 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fccac00c500 tx=0x7fccac00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:59.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fcc9f7fe700 1 -- 172.21.15.87:0/1838829308 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccac005d90 con 0x7fccb80adb80 2023-03-30T08:11:59.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fcc9f7fe700 1 -- 172.21.15.87:0/1838829308 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccac0070d0 con 0x7fccb80adb80 2023-03-30T08:11:59.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fcc9f7fe700 1 -- 172.21.15.87:0/1838829308 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccac007440 con 0x7fccb80adb80 2023-03-30T08:11:59.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccbd537700 1 -- 172.21.15.87:0/1838829308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb806d0e0 con 0x7fccb80adb80 2023-03-30T08:11:59.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.675+0000 7fccbd537700 1 -- 172.21.15.87:0/1838829308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb806c3a0 con 0x7fccb80adb80 2023-03-30T08:11:59.684 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.679+0000 7fccbd537700 1 -- 172.21.15.87:0/1838829308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb80cde30 con 0x7fccb80adb80 2023-03-30T08:11:59.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.679+0000 7fcc9f7fe700 1 -- 172.21.15.87:0/1838829308 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fccac0075a0 con 0x7fccb80adb80 2023-03-30T08:11:59.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.679+0000 7fcc9f7fe700 1 --2- 172.21.15.87:0/1838829308 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcca40653f0 0x7fcca40678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:11:59.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.679+0000 7fcc9f7fe700 1 -- 172.21.15.87:0/1838829308 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fccac081cf0 con 0x7fccb80adb80 2023-03-30T08:11:59.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.683+0000 7fccb6ffd700 1 --2- 172.21.15.87:0/1838829308 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcca40653f0 0x7fcca40678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:11:59.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.683+0000 7fccb6ffd700 1 --2- 172.21.15.87:0/1838829308 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcca40653f0 0x7fcca40678a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009b50 tx=0x7fcca8009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:11:59.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.687+0000 7fcc9f7fe700 1 -- 172.21.15.87:0/1838829308 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fccac04a5e0 con 0x7fccb80adb80 2023-03-30T08:11:59.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.855+0000 7fccbd537700 1 -- 172.21.15.87:0/1838829308 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fccb806dc50 con 0x7fccb80adb80 2023-03-30T08:11:59.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.855+0000 7fcc9f7fe700 1 -- 172.21.15.87:0/1838829308 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fccac0170a0 con 0x7fccb80adb80 2023-03-30T08:11:59.861 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T08:11:59.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.859+0000 7fccbd537700 1 -- 172.21.15.87:0/1838829308 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcca40653f0 msgr2=0x7fcca40678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:59.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.859+0000 7fccbd537700 1 --2- 172.21.15.87:0/1838829308 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcca40653f0 0x7fcca40678a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009b50 tx=0x7fcca8009240 comp rx=0 tx=0).stop 2023-03-30T08:11:59.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.859+0000 7fccbd537700 1 -- 172.21.15.87:0/1838829308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb80adb80 msgr2=0x7fccb8159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:11:59.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.859+0000 7fccbd537700 1 --2- 172.21.15.87:0/1838829308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb80adb80 0x7fccb8159750 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fccac00c500 tx=0x7fccac00c810 comp rx=0 tx=0).stop 2023-03-30T08:11:59.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.859+0000 7fccbd537700 1 -- 172.21.15.87:0/1838829308 shutdown_connections 2023-03-30T08:11:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.859+0000 7fccbd537700 1 --2- 172.21.15.87:0/1838829308 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcca40653f0 0x7fcca40678a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.859+0000 7fccbd537700 1 --2- 172.21.15.87:0/1838829308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccb80cd8e0 0x7fccb81f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.859+0000 7fccbd537700 1 --2- 172.21.15.87:0/1838829308 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fccb80adb80 0x7fccb8159750 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.859+0000 7fccbd537700 1 --2- 172.21.15.87:0/1838829308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccb8070b30 0x7fccb80c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:11:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.859+0000 7fccbd537700 1 -- 172.21.15.87:0/1838829308 >> 172.21.15.87:0/1838829308 conn(0x7fccb80ce960 msgr2=0x7fccb8060870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:11:59.865 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.859+0000 7fccbd537700 1 -- 172.21.15.87:0/1838829308 shutdown_connections 2023-03-30T08:11:59.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:11:59.859+0000 7fccbd537700 1 -- 172.21.15.87:0/1838829308 wait complete. 2023-03-30T08:11:59.885 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T08:12:00.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.047+0000 7f3ffb59e700 1 Processor -- start 2023-03-30T08:12:00.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.047+0000 7f3ffb59e700 1 -- start start 2023-03-30T08:12:00.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffb59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3ffc0b84c0 0x7f3ffc0cd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffb59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ffc0d0220 0x7f3ffc0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffb59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3ffc0b45e0 0x7f3ffc0b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffb59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ffc0b4fc0 con 0x7f3ffc0b84c0 2023-03-30T08:12:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffb59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ffc0cd1b0 con 0x7f3ffc0b45e0 2023-03-30T08:12:00.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffb59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc160f70 con 0x7f3ffc0d0220 2023-03-30T08:12:00.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffa59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3ffc0b84c0 0x7f3ffc0cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffa59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3ffc0b84c0 0x7f3ffc0cd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33554/0 (socket says 172.21.15.87:33554) 2023-03-30T08:12:00.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffa59c700 1 -- 172.21.15.87:0/3691985589 learned_addr learned my addr 172.21.15.87:0/3691985589 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:00.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffad9d700 1 --2- 172.21.15.87:0/3691985589 >> v2:172.21.15.115:3300/0 conn(0x7f3ffc0b45e0 0x7f3ffc0b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ff9d9b700 1 --2- 172.21.15.87:0/3691985589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ffc0d0220 0x7f3ffc0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffa59c700 1 -- 172.21.15.87:0/3691985589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ffc0d0220 msgr2=0x7f3ffc0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:00.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffa59c700 1 --2- 172.21.15.87:0/3691985589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ffc0d0220 0x7f3ffc0cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffa59c700 1 -- 172.21.15.87:0/3691985589 >> v2:172.21.15.115:3300/0 conn(0x7f3ffc0b45e0 msgr2=0x7f3ffc0b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:00.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffa59c700 1 --2- 172.21.15.87:0/3691985589 >> v2:172.21.15.115:3300/0 conn(0x7f3ffc0b45e0 0x7f3ffc0b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffa59c700 1 -- 172.21.15.87:0/3691985589 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc0d2250 con 0x7f3ffc0b84c0 2023-03-30T08:12:00.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ffa59c700 1 --2- 172.21.15.87:0/3691985589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ffc0b84c0 0x7f3ffc0cd640 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0b1b10 tx=0x7f3fec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9665dd7599ee019 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:00.060 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.051+0000 7f3ff959a700 1 -- 172.21.15.87:0/3691985589 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec011830 con 0x7f3ffc0b84c0 2023-03-30T08:12:00.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.055+0000 7f3ff959a700 1 -- 172.21.15.87:0/3691985589 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec011990 con 0x7f3ffc0b84c0 2023-03-30T08:12:00.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.055+0000 7f3ff959a700 1 -- 172.21.15.87:0/3691985589 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec011d20 con 0x7f3ffc0b84c0 2023-03-30T08:12:00.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.055+0000 7f3ffb59e700 1 -- 172.21.15.87:0/3691985589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ffc0b84c0 msgr2=0x7f3ffc0cd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:00.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.055+0000 7f3ffb59e700 1 --2- 172.21.15.87:0/3691985589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ffc0b84c0 0x7f3ffc0cd640 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0b1b10 tx=0x7f3fec009bf0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.055+0000 7f3ffb59e700 1 -- 172.21.15.87:0/3691985589 shutdown_connections 2023-03-30T08:12:00.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.055+0000 7f3ffb59e700 1 --2- 172.21.15.87:0/3691985589 >> v2:172.21.15.115:3300/0 conn(0x7f3ffc0b45e0 0x7f3ffc0b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.055+0000 7f3ffb59e700 1 --2- 172.21.15.87:0/3691985589 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ffc0d0220 0x7f3ffc0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.055+0000 7f3ffb59e700 1 --2- 172.21.15.87:0/3691985589 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ffc0b84c0 0x7f3ffc0cd640 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.055+0000 7f3ffb59e700 1 -- 172.21.15.87:0/3691985589 >> 172.21.15.87:0/3691985589 conn(0x7f3ffc06a910 msgr2=0x7f3ffc0cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:00.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.055+0000 7f3ffb59e700 1 -- 172.21.15.87:0/3691985589 shutdown_connections 2023-03-30T08:12:00.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.055+0000 7f3ffb59e700 1 -- 172.21.15.87:0/3691985589 wait complete. 2023-03-30T08:12:00.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffb59e700 1 Processor -- start 2023-03-30T08:12:00.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffb59e700 1 -- start start 2023-03-30T08:12:00.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffb59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ffc0b45e0 0x7f3ffc14d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffb59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ffc0b84c0 0x7f3ffc0c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffb59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ffc0d0220 0x7f3ffc0cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffb59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc0b70a0 con 0x7f3ffc0d0220 2023-03-30T08:12:00.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffb59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc0b6dc0 con 0x7f3ffc0b84c0 2023-03-30T08:12:00.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffb59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc0ca660 con 0x7f3ffc0b45e0 2023-03-30T08:12:00.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffad9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ffc0d0220 0x7f3ffc0cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffad9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ffc0d0220 0x7f3ffc0cc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33570/0 (socket says 172.21.15.87:33570) 2023-03-30T08:12:00.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffad9d700 1 -- 172.21.15.87:0/3110631483 learned_addr learned my addr 172.21.15.87:0/3110631483 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:00.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffa59c700 1 --2- 172.21.15.87:0/3110631483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ffc0b45e0 0x7f3ffc14d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ff9d9b700 1 --2- 172.21.15.87:0/3110631483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ffc0b84c0 0x7f3ffc0c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffad9d700 1 -- 172.21.15.87:0/3110631483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ffc0b45e0 msgr2=0x7f3ffc14d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:00.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffad9d700 1 --2- 172.21.15.87:0/3110631483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ffc0b45e0 0x7f3ffc14d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffad9d700 1 -- 172.21.15.87:0/3110631483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ffc0b84c0 msgr2=0x7f3ffc0c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:00.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffad9d700 1 --2- 172.21.15.87:0/3110631483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ffc0b84c0 0x7f3ffc0c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffad9d700 1 -- 172.21.15.87:0/3110631483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec009570 con 0x7f3ffc0d0220 2023-03-30T08:12:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffad9d700 1 --2- 172.21.15.87:0/3110631483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ffc0d0220 0x7f3ffc0cc390 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400eed0 tx=0x7f3ff400b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3feaffd700 1 -- 172.21.15.87:0/3110631483 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4010040 con 0x7f3ffc0d0220 2023-03-30T08:12:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3feaffd700 1 -- 172.21.15.87:0/3110631483 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff400bb70 con 0x7f3ffc0d0220 2023-03-30T08:12:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3feaffd700 1 -- 172.21.15.87:0/3110631483 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4014400 con 0x7f3ffc0d0220 2023-03-30T08:12:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffb59e700 1 -- 172.21.15.87:0/3110631483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ffc0d2810 con 0x7f3ffc0d0220 2023-03-30T08:12:00.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.059+0000 7f3ffb59e700 1 -- 172.21.15.87:0/3110631483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ffc0d2530 con 0x7f3ffc0d0220 2023-03-30T08:12:00.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.063+0000 7f3ffb59e700 1 -- 172.21.15.87:0/3110631483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ffc160b40 con 0x7f3ffc0d0220 2023-03-30T08:12:00.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.063+0000 7f3feaffd700 1 -- 172.21.15.87:0/3110631483 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f3ff4014560 con 0x7f3ffc0d0220 2023-03-30T08:12:00.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.067+0000 7f3feaffd700 1 --2- 172.21.15.87:0/3110631483 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3fdc0653f0 0x7f3fdc0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.067+0000 7f3feaffd700 1 -- 172.21.15.87:0/3110631483 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3ff4082e80 con 0x7f3ffc0d0220 2023-03-30T08:12:00.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.067+0000 7f3ffa59c700 1 --2- 172.21.15.87:0/3110631483 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3fdc0653f0 0x7f3fdc0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.067+0000 7f3ffa59c700 1 --2- 172.21.15.87:0/3110631483 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3fdc0653f0 0x7f3fdc0678a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3fec014040 tx=0x7f3fec008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:00.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.071+0000 7f3feaffd700 1 -- 172.21.15.87:0/3110631483 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f3ff4050860 con 0x7f3ffc0d0220 2023-03-30T08:12:00.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.243+0000 7f3ffb59e700 1 -- 172.21.15.87:0/3110631483 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3ffc0733a0 con 0x7f3ffc0d0220 2023-03-30T08:12:00.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.243+0000 7f3feaffd700 1 -- 172.21.15.87:0/3110631483 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3ff4053e80 con 0x7f3ffc0d0220 2023-03-30T08:12:00.250 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T08:12:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.247+0000 7f3ffb59e700 1 -- 172.21.15.87:0/3110631483 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3fdc0653f0 msgr2=0x7f3fdc0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.247+0000 7f3ffb59e700 1 --2- 172.21.15.87:0/3110631483 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3fdc0653f0 0x7f3fdc0678a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3fec014040 tx=0x7f3fec008030 comp rx=0 tx=0).stop 2023-03-30T08:12:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.247+0000 7f3ffb59e700 1 -- 172.21.15.87:0/3110631483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ffc0d0220 msgr2=0x7f3ffc0cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:00.254 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.247+0000 7f3ffb59e700 1 --2- 172.21.15.87:0/3110631483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ffc0d0220 0x7f3ffc0cc390 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400eed0 tx=0x7f3ff400b0b0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.247+0000 7f3ffb59e700 1 -- 172.21.15.87:0/3110631483 shutdown_connections 2023-03-30T08:12:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.247+0000 7f3ffb59e700 1 --2- 172.21.15.87:0/3110631483 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3fdc0653f0 0x7f3fdc0678a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.247+0000 7f3ffb59e700 1 --2- 172.21.15.87:0/3110631483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ffc0d0220 0x7f3ffc0cc390 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.247+0000 7f3ffb59e700 1 --2- 172.21.15.87:0/3110631483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ffc0b84c0 0x7f3ffc0c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.247+0000 7f3ffb59e700 1 --2- 172.21.15.87:0/3110631483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ffc0b45e0 0x7f3ffc14d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.247+0000 7f3ffb59e700 1 -- 172.21.15.87:0/3110631483 >> 172.21.15.87:0/3110631483 conn(0x7f3ffc06a910 msgr2=0x7f3ffc0b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.247+0000 7f3ffb59e700 1 -- 172.21.15.87:0/3110631483 shutdown_connections 2023-03-30T08:12:00.255 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.247+0000 7f3ffb59e700 1 -- 172.21.15.87:0/3110631483 wait complete. 2023-03-30T08:12:00.274 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-30T08:12:00.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.435+0000 7f8db33f9700 1 Processor -- start 2023-03-30T08:12:00.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.435+0000 7f8db33f9700 1 -- start start 2023-03-30T08:12:00.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.439+0000 7f8db33f9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8dac15cba0 0x7f8dac069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.439+0000 7f8db33f9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8dac0ca4b0 0x7f8dac0ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.439+0000 7f8db33f9700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dac0afca0 con 0x7f8dac159050 2023-03-30T08:12:00.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.439+0000 7f8db33f9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dac0afb10 con 0x7f8dac15cba0 2023-03-30T08:12:00.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.439+0000 7f8db33f9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac0cae70 con 0x7f8dac0ca4b0 2023-03-30T08:12:00.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.439+0000 7f8db23f7700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8dac159050 0x7f8dac0cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44344/0 (socket says 172.21.15.87:44344) 2023-03-30T08:12:00.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.439+0000 7f8db23f7700 1 -- 172.21.15.87:0/3276194129 learned_addr learned my addr 172.21.15.87:0/3276194129 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:00.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.439+0000 7f8db2bf8700 1 --2- 172.21.15.87:0/3276194129 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8dac0ca4b0 0x7f8dac0ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.439+0000 7f8db1bf6700 1 --2- 172.21.15.87:0/3276194129 >> v2:172.21.15.115:3300/0 conn(0x7f8dac15cba0 0x7f8dac069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.439+0000 7f8db13f5700 1 -- 172.21.15.87:0/3276194129 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499276876 0 0) 0x7f8dac0afca0 con 0x7f8dac159050 2023-03-30T08:12:00.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.439+0000 7f8db13f5700 1 -- 172.21.15.87:0/3276194129 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d980035d0 con 0x7f8dac159050 2023-03-30T08:12:00.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.439+0000 7f8db2bf8700 1 -- 172.21.15.87:0/3276194129 >> v2:172.21.15.115:3300/0 conn(0x7f8dac15cba0 msgr2=0x7f8dac069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:00.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.439+0000 7f8db2bf8700 1 --2- 172.21.15.87:0/3276194129 >> v2:172.21.15.115:3300/0 conn(0x7f8dac15cba0 0x7f8dac069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.439+0000 7f8db2bf8700 1 -- 172.21.15.87:0/3276194129 >> v1:172.21.15.87:6789/0 conn(0x7f8dac159050 legacy=0x7f8dac0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:00.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.439+0000 7f8db2bf8700 1 -- 172.21.15.87:0/3276194129 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac15d110 con 0x7f8dac0ca4b0 2023-03-30T08:12:00.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.443+0000 7f8db2bf8700 1 --2- 172.21.15.87:0/3276194129 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8dac0ca4b0 0x7f8dac0ca930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009d90 tx=0x7f8da400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e7e04f9ecfb17d9 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:00.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.443+0000 7f8db13f5700 1 -- 172.21.15.87:0/3276194129 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da400e070 con 0x7f8dac0ca4b0 2023-03-30T08:12:00.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.443+0000 7f8db13f5700 1 -- 172.21.15.87:0/3276194129 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da400bb20 con 0x7f8dac0ca4b0 2023-03-30T08:12:00.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.443+0000 7f8db13f5700 1 -- 172.21.15.87:0/3276194129 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4012430 con 0x7f8dac0ca4b0 2023-03-30T08:12:00.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.443+0000 7f8db33f9700 1 -- 172.21.15.87:0/3276194129 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8dac0ca4b0 msgr2=0x7f8dac0ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:00.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.443+0000 7f8db33f9700 1 --2- 172.21.15.87:0/3276194129 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8dac0ca4b0 0x7f8dac0ca930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009d90 tx=0x7f8da400b330 comp rx=0 tx=0).stop 2023-03-30T08:12:00.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.443+0000 7f8db33f9700 1 -- 172.21.15.87:0/3276194129 shutdown_connections 2023-03-30T08:12:00.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.443+0000 7f8db33f9700 1 --2- 172.21.15.87:0/3276194129 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8dac0ca4b0 0x7f8dac0ca930 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.443+0000 7f8db33f9700 1 --2- 172.21.15.87:0/3276194129 >> v2:172.21.15.115:3300/0 conn(0x7f8dac15cba0 0x7f8dac069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.443+0000 7f8db33f9700 1 -- 172.21.15.87:0/3276194129 >> 172.21.15.87:0/3276194129 conn(0x7f8dac0cf410 msgr2=0x7f8dac0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:00.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.443+0000 7f8db33f9700 1 -- 172.21.15.87:0/3276194129 shutdown_connections 2023-03-30T08:12:00.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.443+0000 7f8db33f9700 1 -- 172.21.15.87:0/3276194129 wait complete. 2023-03-30T08:12:00.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.447+0000 7f8db33f9700 1 Processor -- start 2023-03-30T08:12:00.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.447+0000 7f8db33f9700 1 -- start start 2023-03-30T08:12:00.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.447+0000 7f8db33f9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dac0ca4b0 0x7f8dac149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.447+0000 7f8db33f9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8dac159050 0x7f8dac14e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.447+0000 7f8db33f9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dac15cba0 0x7f8dac0b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.447+0000 7f8db33f9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac14d460 con 0x7f8dac15cba0 2023-03-30T08:12:00.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.447+0000 7f8db33f9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac14d740 con 0x7f8dac0ca4b0 2023-03-30T08:12:00.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.447+0000 7f8db33f9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac14da20 con 0x7f8dac159050 2023-03-30T08:12:00.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.447+0000 7f8db2bf8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dac15cba0 0x7f8dac0b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.447+0000 7f8db2bf8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dac15cba0 0x7f8dac0b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33576/0 (socket says 172.21.15.87:33576) 2023-03-30T08:12:00.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.447+0000 7f8db2bf8700 1 -- 172.21.15.87:0/1895990381 learned_addr learned my addr 172.21.15.87:0/1895990381 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:00.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.447+0000 7f8db23f7700 1 --2- 172.21.15.87:0/1895990381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dac0ca4b0 0x7f8dac149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.447+0000 7f8db1bf6700 1 --2- 172.21.15.87:0/1895990381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8dac159050 0x7f8dac14e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.451+0000 7f8db2bf8700 1 -- 172.21.15.87:0/1895990381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8dac159050 msgr2=0x7f8dac14e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:00.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.451+0000 7f8db2bf8700 1 --2- 172.21.15.87:0/1895990381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8dac159050 0x7f8dac14e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.451+0000 7f8db2bf8700 1 -- 172.21.15.87:0/1895990381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dac0ca4b0 msgr2=0x7f8dac149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:00.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.451+0000 7f8db2bf8700 1 --2- 172.21.15.87:0/1895990381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dac0ca4b0 0x7f8dac149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.451+0000 7f8db2bf8700 1 -- 172.21.15.87:0/1895990381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da4009a70 con 0x7f8dac15cba0 2023-03-30T08:12:00.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.451+0000 7f8db23f7700 1 --2- 172.21.15.87:0/1895990381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dac0ca4b0 0x7f8dac149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:00.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.451+0000 7f8db2bf8700 1 --2- 172.21.15.87:0/1895990381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dac15cba0 0x7f8dac0b3680 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8da4014040 tx=0x7f8da4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:00.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.451+0000 7f8da2ffd700 1 -- 172.21.15.87:0/1895990381 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4012430 con 0x7f8dac15cba0 2023-03-30T08:12:00.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.451+0000 7f8da2ffd700 1 -- 172.21.15.87:0/1895990381 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da4020070 con 0x7f8dac15cba0 2023-03-30T08:12:00.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.451+0000 7f8db33f9700 1 -- 172.21.15.87:0/1895990381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dac15d6d0 con 0x7f8dac15cba0 2023-03-30T08:12:00.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.451+0000 7f8da2ffd700 1 -- 172.21.15.87:0/1895990381 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4004280 con 0x7f8dac15cba0 2023-03-30T08:12:00.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.451+0000 7f8db33f9700 1 -- 172.21.15.87:0/1895990381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dac15d3f0 con 0x7f8dac15cba0 2023-03-30T08:12:00.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.451+0000 7f8db33f9700 1 -- 172.21.15.87:0/1895990381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dac15d9b0 con 0x7f8dac15cba0 2023-03-30T08:12:00.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.455+0000 7f8da2ffd700 1 -- 172.21.15.87:0/1895990381 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f8da40043e0 con 0x7f8dac15cba0 2023-03-30T08:12:00.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.455+0000 7f8da2ffd700 1 --2- 172.21.15.87:0/1895990381 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8d90065420 0x7f8d900678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.455+0000 7f8da2ffd700 1 -- 172.21.15.87:0/1895990381 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8da4022070 con 0x7f8dac15cba0 2023-03-30T08:12:00.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.455+0000 7f8db23f7700 1 --2- 172.21.15.87:0/1895990381 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8d90065420 0x7f8d900678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.455+0000 7f8db23f7700 1 --2- 172.21.15.87:0/1895990381 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8d90065420 0x7f8d900678d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8da80011e0 tx=0x7f8da8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:00.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.463+0000 7f8da2ffd700 1 -- 172.21.15.87:0/1895990381 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f8da40526a0 con 0x7f8dac15cba0 2023-03-30T08:12:00.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.631+0000 7f8db33f9700 1 -- 172.21.15.87:0/1895990381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8dac0733a0 con 0x7f8dac15cba0 2023-03-30T08:12:00.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.631+0000 7f8da2ffd700 1 -- 172.21.15.87:0/1895990381 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8da4055cc0 con 0x7f8dac15cba0 2023-03-30T08:12:00.638 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:12:00.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.635+0000 7f8db33f9700 1 -- 172.21.15.87:0/1895990381 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8d90065420 msgr2=0x7f8d900678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:00.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.635+0000 7f8db33f9700 1 --2- 172.21.15.87:0/1895990381 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8d90065420 0x7f8d900678d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8da80011e0 tx=0x7f8da8009040 comp rx=0 tx=0).stop 2023-03-30T08:12:00.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.635+0000 7f8db33f9700 1 -- 172.21.15.87:0/1895990381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dac15cba0 msgr2=0x7f8dac0b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:00.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.635+0000 7f8db33f9700 1 --2- 172.21.15.87:0/1895990381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dac15cba0 0x7f8dac0b3680 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8da4014040 tx=0x7f8da4004af0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.635+0000 7f8db33f9700 1 -- 172.21.15.87:0/1895990381 shutdown_connections 2023-03-30T08:12:00.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.635+0000 7f8db33f9700 1 --2- 172.21.15.87:0/1895990381 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8d90065420 0x7f8d900678d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.635+0000 7f8db33f9700 1 --2- 172.21.15.87:0/1895990381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dac15cba0 0x7f8dac0b3680 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.635+0000 7f8db33f9700 1 --2- 172.21.15.87:0/1895990381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8dac159050 0x7f8dac14e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.635+0000 7f8db33f9700 1 --2- 172.21.15.87:0/1895990381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dac0ca4b0 0x7f8dac149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.635+0000 7f8db33f9700 1 -- 172.21.15.87:0/1895990381 >> 172.21.15.87:0/1895990381 conn(0x7f8dac0cf410 msgr2=0x7f8dac14bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:00.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.635+0000 7f8db33f9700 1 -- 172.21.15.87:0/1895990381 shutdown_connections 2023-03-30T08:12:00.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.635+0000 7f8db33f9700 1 -- 172.21.15.87:0/1895990381 wait complete. 2023-03-30T08:12:00.659 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-30T08:12:00.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.823+0000 7fab8c93d700 1 Processor -- start 2023-03-30T08:12:00.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.823+0000 7fab8c93d700 1 -- start start 2023-03-30T08:12:00.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.823+0000 7fab8c93d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab88163dc0 0x7fab880c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.823+0000 7fab8c93d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fab880aea30 0x7fab8806a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab8c93d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab88069f00 con 0x7fab88164190 2023-03-30T08:12:00.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab8c93d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8806d810 con 0x7fab880aea30 2023-03-30T08:12:00.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab8c93d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab880cc1d0 con 0x7fab88163dc0 2023-03-30T08:12:00.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab86d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab88163dc0 0x7fab880c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab86d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab88163dc0 0x7fab880c95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:55514/0 (socket says 172.21.15.87:55514) 2023-03-30T08:12:00.832 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab86d9d700 1 -- 172.21.15.87:0/2964218651 learned_addr learned my addr 172.21.15.87:0/2964218651 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:00.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab8759e700 1 --2- 172.21.15.87:0/2964218651 >> v2:172.21.15.115:3300/0 conn(0x7fab880aea30 0x7fab8806a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab85d9b700 1 -- 172.21.15.87:0/2964218651 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589397736 0 0) 0x7fab88069f00 con 0x7fab88164190 2023-03-30T08:12:00.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab86d9d700 1 -- 172.21.15.87:0/2964218651 >> v2:172.21.15.115:3300/0 conn(0x7fab880aea30 msgr2=0x7fab8806a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:00.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab86d9d700 1 --2- 172.21.15.87:0/2964218651 >> v2:172.21.15.115:3300/0 conn(0x7fab880aea30 0x7fab8806a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab86d9d700 1 -- 172.21.15.87:0/2964218651 >> v1:172.21.15.115:6789/0 conn(0x7fab88164190 legacy=0x7fab880c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:00.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab86d9d700 1 -- 172.21.15.87:0/2964218651 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8806cf70 con 0x7fab88163dc0 2023-03-30T08:12:00.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab86d9d700 1 --2- 172.21.15.87:0/2964218651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab88163dc0 0x7fab880c95c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fab78009910 tx=0x7fab78009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b08fe6b0aca7c2d1 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:00.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab85d9b700 1 -- 172.21.15.87:0/2964218651 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78011830 con 0x7fab88163dc0 2023-03-30T08:12:00.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab85d9b700 1 -- 172.21.15.87:0/2964218651 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab78011990 con 0x7fab88163dc0 2023-03-30T08:12:00.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.827+0000 7fab85d9b700 1 -- 172.21.15.87:0/2964218651 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78011d40 con 0x7fab88163dc0 2023-03-30T08:12:00.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.831+0000 7fab8c93d700 1 -- 172.21.15.87:0/2964218651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab88163dc0 msgr2=0x7fab880c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:00.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.831+0000 7fab8c93d700 1 --2- 172.21.15.87:0/2964218651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab88163dc0 0x7fab880c95c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fab78009910 tx=0x7fab78009c20 comp rx=0 tx=0).stop 2023-03-30T08:12:00.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.831+0000 7fab8c93d700 1 -- 172.21.15.87:0/2964218651 shutdown_connections 2023-03-30T08:12:00.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.831+0000 7fab8c93d700 1 --2- 172.21.15.87:0/2964218651 >> v2:172.21.15.115:3300/0 conn(0x7fab880aea30 0x7fab8806a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.831+0000 7fab8c93d700 1 --2- 172.21.15.87:0/2964218651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab88163dc0 0x7fab880c95c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.831+0000 7fab8c93d700 1 -- 172.21.15.87:0/2964218651 >> 172.21.15.87:0/2964218651 conn(0x7fab880cf410 msgr2=0x7fab880cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:00.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.831+0000 7fab8c93d700 1 -- 172.21.15.87:0/2964218651 shutdown_connections 2023-03-30T08:12:00.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.831+0000 7fab8c93d700 1 -- 172.21.15.87:0/2964218651 wait complete. 2023-03-30T08:12:00.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.831+0000 7fab8c93d700 1 Processor -- start 2023-03-30T08:12:00.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.831+0000 7fab8c93d700 1 -- start start 2023-03-30T08:12:00.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8c93d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab880aea30 0x7fab88158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8c93d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab88163dc0 0x7fab880c36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8c93d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab88164190 0x7fab8815d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8c93d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab881f6200 con 0x7fab88163dc0 2023-03-30T08:12:00.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8c93d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab881f64e0 con 0x7fab88164190 2023-03-30T08:12:00.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8c93d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab881f67c0 con 0x7fab880aea30 2023-03-30T08:12:00.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab88163dc0 0x7fab880c36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8659c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab88163dc0 0x7fab880c36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33584/0 (socket says 172.21.15.87:33584) 2023-03-30T08:12:00.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8759e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab88164190 0x7fab8815d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8659c700 1 -- 172.21.15.87:0/1622846085 learned_addr learned my addr 172.21.15.87:0/1622846085 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:00.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab86d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab880aea30 0x7fab88158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8659c700 1 -- 172.21.15.87:0/1622846085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab880aea30 msgr2=0x7fab88158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:00.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8659c700 1 --2- 172.21.15.87:0/1622846085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab880aea30 0x7fab88158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8659c700 1 -- 172.21.15.87:0/1622846085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab88164190 msgr2=0x7fab8815d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:00.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8659c700 1 --2- 172.21.15.87:0/1622846085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab88164190 0x7fab8815d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:00.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8659c700 1 -- 172.21.15.87:0/1622846085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab78009570 con 0x7fab88163dc0 2023-03-30T08:12:00.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8659c700 1 --2- 172.21.15.87:0/1622846085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab88163dc0 0x7fab880c36a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fab7c007fd0 tx=0x7fab7c00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:00.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab6f7fe700 1 -- 172.21.15.87:0/1622846085 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0054e0 con 0x7fab88163dc0 2023-03-30T08:12:00.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab6f7fe700 1 -- 172.21.15.87:0/1622846085 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c00ce30 con 0x7fab88163dc0 2023-03-30T08:12:00.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab8c93d700 1 -- 172.21.15.87:0/1622846085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8806d530 con 0x7fab88163dc0 2023-03-30T08:12:00.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.835+0000 7fab6f7fe700 1 -- 172.21.15.87:0/1622846085 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0038e0 con 0x7fab88163dc0 2023-03-30T08:12:00.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.839+0000 7fab8c93d700 1 -- 172.21.15.87:0/1622846085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8806d250 con 0x7fab88163dc0 2023-03-30T08:12:00.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.839+0000 7fab8c93d700 1 -- 172.21.15.87:0/1622846085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8806cc40 con 0x7fab88163dc0 2023-03-30T08:12:00.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.843+0000 7fab6f7fe700 1 -- 172.21.15.87:0/1622846085 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fab7c003a40 con 0x7fab88163dc0 2023-03-30T08:12:00.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.843+0000 7fab6f7fe700 1 --2- 172.21.15.87:0/1622846085 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fab740653f0 0x7fab740678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:00.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.843+0000 7fab6f7fe700 1 -- 172.21.15.87:0/1622846085 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fab7c081ef0 con 0x7fab88163dc0 2023-03-30T08:12:00.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.843+0000 7fab86d9d700 1 --2- 172.21.15.87:0/1622846085 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fab740653f0 0x7fab740678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:00.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.843+0000 7fab86d9d700 1 --2- 172.21.15.87:0/1622846085 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fab740653f0 0x7fab740678a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab78000c00 tx=0x7fab78008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:00.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:00.851+0000 7fab6f7fe700 1 -- 172.21.15.87:0/1622846085 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fab7c04f830 con 0x7fab88163dc0 2023-03-30T08:12:01.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.019+0000 7fab8c93d700 1 -- 172.21.15.87:0/1622846085 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab881f6340 con 0x7fab88163dc0 2023-03-30T08:12:01.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.019+0000 7fab6f7fe700 1 -- 172.21.15.87:0/1622846085 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab881f6340 con 0x7fab88163dc0 2023-03-30T08:12:01.027 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-03-30T08:12:01.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.023+0000 7fab8c93d700 1 -- 172.21.15.87:0/1622846085 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fab740653f0 msgr2=0x7fab740678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:01.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.023+0000 7fab8c93d700 1 --2- 172.21.15.87:0/1622846085 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fab740653f0 0x7fab740678a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab78000c00 tx=0x7fab78008030 comp rx=0 tx=0).stop 2023-03-30T08:12:01.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.023+0000 7fab8c93d700 1 -- 172.21.15.87:0/1622846085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab88163dc0 msgr2=0x7fab880c36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:01.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.023+0000 7fab8c93d700 1 --2- 172.21.15.87:0/1622846085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab88163dc0 0x7fab880c36a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fab7c007fd0 tx=0x7fab7c00c730 comp rx=0 tx=0).stop 2023-03-30T08:12:01.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.023+0000 7fab8c93d700 1 -- 172.21.15.87:0/1622846085 shutdown_connections 2023-03-30T08:12:01.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.023+0000 7fab8c93d700 1 --2- 172.21.15.87:0/1622846085 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fab740653f0 0x7fab740678a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.023+0000 7fab8c93d700 1 --2- 172.21.15.87:0/1622846085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab88164190 0x7fab8815d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.023+0000 7fab8c93d700 1 --2- 172.21.15.87:0/1622846085 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fab88163dc0 0x7fab880c36a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.023+0000 7fab8c93d700 1 --2- 172.21.15.87:0/1622846085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab880aea30 0x7fab88158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.023+0000 7fab8c93d700 1 -- 172.21.15.87:0/1622846085 >> 172.21.15.87:0/1622846085 conn(0x7fab880cf410 msgr2=0x7fab880cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:01.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.023+0000 7fab8c93d700 1 -- 172.21.15.87:0/1622846085 shutdown_connections 2023-03-30T08:12:01.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.023+0000 7fab8c93d700 1 -- 172.21.15.87:0/1622846085 wait complete. 2023-03-30T08:12:01.049 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-30T08:12:01.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.215+0000 7f1d832bc700 1 Processor -- start 2023-03-30T08:12:01.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.215+0000 7f1d832bc700 1 -- start start 2023-03-30T08:12:01.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.215+0000 7f1d832bc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1d7c0b8380 0x7f1d7c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:01.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d832bc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d7c06a3e0 0x7f1d7c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:01.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d832bc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c160ef0 con 0x7f1d7c0d27e0 2023-03-30T08:12:01.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d832bc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c0cd6a0 con 0x7f1d7c0b8380 2023-03-30T08:12:01.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d832bc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0cd3a0 con 0x7f1d7c06a3e0 2023-03-30T08:12:01.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d822ba700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1d7c0b8380 0x7f1d7c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:01.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d822ba700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1d7c0b8380 0x7f1d7c0d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33598/0 (socket says 172.21.15.87:33598) 2023-03-30T08:12:01.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d822ba700 1 -- 172.21.15.87:0/169403292 learned_addr learned my addr 172.21.15.87:0/169403292 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:01.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d82abb700 1 --2- 172.21.15.87:0/169403292 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d7c06a3e0 0x7f1d7c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:01.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d822ba700 1 -- 172.21.15.87:0/169403292 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d7c06a3e0 msgr2=0x7f1d7c0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:01.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d822ba700 1 --2- 172.21.15.87:0/169403292 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d7c06a3e0 0x7f1d7c0d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d822ba700 1 -- 172.21.15.87:0/169403292 >> v1:172.21.15.115:6789/0 conn(0x7f1d7c0d27e0 legacy=0x7f1d7c069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:01.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d822ba700 1 -- 172.21.15.87:0/169403292 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0cef00 con 0x7f1d7c0b8380 2023-03-30T08:12:01.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d822ba700 1 --2- 172.21.15.87:0/169403292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d7c0b8380 0x7f1d7c0d2200 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009e50 tx=0x7f1d7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6eda5ffdca672c5 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:01.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d812b8700 1 -- 172.21.15.87:0/169403292 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7800e070 con 0x7f1d7c0b8380 2023-03-30T08:12:01.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d812b8700 1 -- 172.21.15.87:0/169403292 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7800b9c0 con 0x7f1d7c0b8380 2023-03-30T08:12:01.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d812b8700 1 -- 172.21.15.87:0/169403292 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7800bd70 con 0x7f1d7c0b8380 2023-03-30T08:12:01.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d832bc700 1 -- 172.21.15.87:0/169403292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d7c0b8380 msgr2=0x7f1d7c0d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:01.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d832bc700 1 --2- 172.21.15.87:0/169403292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d7c0b8380 0x7f1d7c0d2200 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009e50 tx=0x7f1d7800b330 comp rx=0 tx=0).stop 2023-03-30T08:12:01.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d832bc700 1 -- 172.21.15.87:0/169403292 shutdown_connections 2023-03-30T08:12:01.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d832bc700 1 --2- 172.21.15.87:0/169403292 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d7c06a3e0 0x7f1d7c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d832bc700 1 --2- 172.21.15.87:0/169403292 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d7c0b8380 0x7f1d7c0d2200 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.219+0000 7f1d832bc700 1 -- 172.21.15.87:0/169403292 >> 172.21.15.87:0/169403292 conn(0x7f1d7c0b53f0 msgr2=0x7f1d7c0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:01.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.223+0000 7f1d832bc700 1 -- 172.21.15.87:0/169403292 shutdown_connections 2023-03-30T08:12:01.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.223+0000 7f1d832bc700 1 -- 172.21.15.87:0/169403292 wait complete. 2023-03-30T08:12:01.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.223+0000 7f1d832bc700 1 Processor -- start 2023-03-30T08:12:01.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.223+0000 7f1d832bc700 1 -- start start 2023-03-30T08:12:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.223+0000 7f1d832bc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d7c06a3e0 0x7f1d7c1f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.223+0000 7f1d832bc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d7c0b8380 0x7f1d7c0c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.223+0000 7f1d832bc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d7c14ab50 0x7f1d7c14aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.223+0000 7f1d832bc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c14b530 con 0x7f1d7c14ab50 2023-03-30T08:12:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.223+0000 7f1d832bc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c149950 con 0x7f1d7c06a3e0 2023-03-30T08:12:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.223+0000 7f1d832bc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c148af0 con 0x7f1d7c0b8380 2023-03-30T08:12:01.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.223+0000 7f1d82abb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d7c14ab50 0x7f1d7c14aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:01.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.223+0000 7f1d82abb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d7c14ab50 0x7f1d7c14aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33602/0 (socket says 172.21.15.87:33602) 2023-03-30T08:12:01.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.223+0000 7f1d82abb700 1 -- 172.21.15.87:0/2694088427 learned_addr learned my addr 172.21.15.87:0/2694088427 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:01.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.223+0000 7f1d822ba700 1 --2- 172.21.15.87:0/2694088427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d7c06a3e0 0x7f1d7c1f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:01.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.223+0000 7f1d81ab9700 1 --2- 172.21.15.87:0/2694088427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d7c0b8380 0x7f1d7c0c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:01.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.227+0000 7f1d82abb700 1 -- 172.21.15.87:0/2694088427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d7c0b8380 msgr2=0x7f1d7c0c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:01.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.227+0000 7f1d82abb700 1 --2- 172.21.15.87:0/2694088427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d7c0b8380 0x7f1d7c0c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.227+0000 7f1d82abb700 1 -- 172.21.15.87:0/2694088427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d7c06a3e0 msgr2=0x7f1d7c1f1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:01.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.227+0000 7f1d82abb700 1 --2- 172.21.15.87:0/2694088427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d7c06a3e0 0x7f1d7c1f1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.227+0000 7f1d82abb700 1 -- 172.21.15.87:0/2694088427 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78009b30 con 0x7f1d7c14ab50 2023-03-30T08:12:01.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.227+0000 7f1d82abb700 1 --2- 172.21.15.87:0/2694088427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d7c14ab50 0x7f1d7c14aff0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400e840 tx=0x7f1d7400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:01.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.227+0000 7f1d72ffd700 1 -- 172.21.15.87:0/2694088427 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74013610 con 0x7f1d7c14ab50 2023-03-30T08:12:01.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.227+0000 7f1d72ffd700 1 -- 172.21.15.87:0/2694088427 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d74013770 con 0x7f1d7c14ab50 2023-03-30T08:12:01.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.227+0000 7f1d832bc700 1 -- 172.21.15.87:0/2694088427 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c0cf480 con 0x7f1d7c14ab50 2023-03-30T08:12:01.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.227+0000 7f1d72ffd700 1 -- 172.21.15.87:0/2694088427 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74013b20 con 0x7f1d7c14ab50 2023-03-30T08:12:01.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.227+0000 7f1d832bc700 1 -- 172.21.15.87:0/2694088427 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c0cf1a0 con 0x7f1d7c14ab50 2023-03-30T08:12:01.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.227+0000 7f1d832bc700 1 -- 172.21.15.87:0/2694088427 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c0b8750 con 0x7f1d7c14ab50 2023-03-30T08:12:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.231+0000 7f1d72ffd700 1 -- 172.21.15.87:0/2694088427 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f1d74013c80 con 0x7f1d7c14ab50 2023-03-30T08:12:01.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.231+0000 7f1d72ffd700 1 --2- 172.21.15.87:0/2694088427 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1d60065420 0x7f1d600678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:01.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.231+0000 7f1d72ffd700 1 -- 172.21.15.87:0/2694088427 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1d74082930 con 0x7f1d7c14ab50 2023-03-30T08:12:01.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.231+0000 7f1d822ba700 1 --2- 172.21.15.87:0/2694088427 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1d60065420 0x7f1d600678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:01.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.231+0000 7f1d822ba700 1 --2- 172.21.15.87:0/2694088427 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1d60065420 0x7f1d600678d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800b370 tx=0x7f1d78009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:01.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.239+0000 7f1d72ffd700 1 -- 172.21.15.87:0/2694088427 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f1d740501e0 con 0x7f1d7c14ab50 2023-03-30T08:12:01.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.407+0000 7f1d832bc700 1 -- 172.21.15.87:0/2694088427 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1d7c072cf0 con 0x7f1d7c14ab50 2023-03-30T08:12:01.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.407+0000 7f1d72ffd700 1 -- 172.21.15.87:0/2694088427 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1d74053800 con 0x7f1d7c14ab50 2023-03-30T08:12:01.414 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T08:12:01.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.411+0000 7f1d832bc700 1 -- 172.21.15.87:0/2694088427 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1d60065420 msgr2=0x7f1d600678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:01.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.411+0000 7f1d832bc700 1 --2- 172.21.15.87:0/2694088427 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1d60065420 0x7f1d600678d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800b370 tx=0x7f1d78009000 comp rx=0 tx=0).stop 2023-03-30T08:12:01.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.411+0000 7f1d832bc700 1 -- 172.21.15.87:0/2694088427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d7c14ab50 msgr2=0x7f1d7c14aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:01.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.411+0000 7f1d832bc700 1 --2- 172.21.15.87:0/2694088427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d7c14ab50 0x7f1d7c14aff0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400e840 tx=0x7f1d7400ec00 comp rx=0 tx=0).stop 2023-03-30T08:12:01.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.411+0000 7f1d832bc700 1 -- 172.21.15.87:0/2694088427 shutdown_connections 2023-03-30T08:12:01.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.411+0000 7f1d832bc700 1 --2- 172.21.15.87:0/2694088427 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1d60065420 0x7f1d600678d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.411+0000 7f1d832bc700 1 --2- 172.21.15.87:0/2694088427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1d7c14ab50 0x7f1d7c14aff0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.411+0000 7f1d832bc700 1 --2- 172.21.15.87:0/2694088427 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d7c0b8380 0x7f1d7c0c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.411+0000 7f1d832bc700 1 --2- 172.21.15.87:0/2694088427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d7c06a3e0 0x7f1d7c1f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.411+0000 7f1d832bc700 1 -- 172.21.15.87:0/2694088427 >> 172.21.15.87:0/2694088427 conn(0x7f1d7c0b53f0 msgr2=0x7f1d7c0d2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:01.418 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.411+0000 7f1d832bc700 1 -- 172.21.15.87:0/2694088427 shutdown_connections 2023-03-30T08:12:01.418 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.411+0000 7f1d832bc700 1 -- 172.21.15.87:0/2694088427 wait complete. 2023-03-30T08:12:01.435 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T08:12:01.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.587+0000 7f9861b75700 1 Processor -- start 2023-03-30T08:12:01.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.587+0000 7f9861b75700 1 -- start start 2023-03-30T08:12:01.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f9861b75700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f985c0b41c0 0x7f985c0cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:01.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f9861b75700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f985c0c8fb0 0x7f985c070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:01.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f9861b75700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f985c070960 0x7f985c069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:01.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f9861b75700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c15ed50 con 0x7f985c0b41c0 2023-03-30T08:12:01.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f9861b75700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c070dc0 con 0x7f985c070960 2023-03-30T08:12:01.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f9861b75700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c15e8c0 con 0x7f985c0c8fb0 2023-03-30T08:12:01.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f985b7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f985c0b41c0 0x7f985c0cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:01.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f985affd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f985c0c8fb0 0x7f985c070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:01.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f985bfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f985c070960 0x7f985c069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:01.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f985affd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f985c0c8fb0 0x7f985c070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:55566/0 (socket says 172.21.15.87:55566) 2023-03-30T08:12:01.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f985b7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f985c0b41c0 0x7f985c0cab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33610/0 (socket says 172.21.15.87:33610) 2023-03-30T08:12:01.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f985bfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f985c070960 0x7f985c069cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:46824/0 (socket says 172.21.15.87:46824) 2023-03-30T08:12:01.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f985affd700 1 -- 172.21.15.87:0/1429029876 learned_addr learned my addr 172.21.15.87:0/1429029876 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:01.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f985bfff700 1 -- 172.21.15.87:0/1429029876 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f985c0c8fb0 msgr2=0x7f985c070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:01.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f985bfff700 1 --2- 172.21.15.87:0/1429029876 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f985c0c8fb0 0x7f985c070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f985bfff700 1 -- 172.21.15.87:0/1429029876 >> v2:172.21.15.87:3300/0 conn(0x7f985c0b41c0 msgr2=0x7f985c0cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:01.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f985bfff700 1 --2- 172.21.15.87:0/1429029876 >> v2:172.21.15.87:3300/0 conn(0x7f985c0b41c0 0x7f985c0cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f985bfff700 1 -- 172.21.15.87:0/1429029876 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c0c96b0 con 0x7f985c070960 2023-03-30T08:12:01.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.591+0000 7f985b7fe700 1 --2- 172.21.15.87:0/1429029876 >> v2:172.21.15.87:3300/0 conn(0x7f985c0b41c0 0x7f985c0cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:12:01.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.595+0000 7f985bfff700 1 --2- 172.21.15.87:0/1429029876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f985c070960 0x7f985c069cd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f985c0b1530 tx=0x7f985400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=280bab580c0e3bd0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:01.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.595+0000 7f985a7fc700 1 -- 172.21.15.87:0/1429029876 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985400e070 con 0x7f985c070960 2023-03-30T08:12:01.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.595+0000 7f985a7fc700 1 -- 172.21.15.87:0/1429029876 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985400bb20 con 0x7f985c070960 2023-03-30T08:12:01.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.595+0000 7f985a7fc700 1 -- 172.21.15.87:0/1429029876 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854012430 con 0x7f985c070960 2023-03-30T08:12:01.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.595+0000 7f9861b75700 1 -- 172.21.15.87:0/1429029876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f985c070960 msgr2=0x7f985c069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:01.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.595+0000 7f9861b75700 1 --2- 172.21.15.87:0/1429029876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f985c070960 0x7f985c069cd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f985c0b1530 tx=0x7f985400b330 comp rx=0 tx=0).stop 2023-03-30T08:12:01.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.595+0000 7f9861b75700 1 -- 172.21.15.87:0/1429029876 shutdown_connections 2023-03-30T08:12:01.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.595+0000 7f9861b75700 1 --2- 172.21.15.87:0/1429029876 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f985c070960 0x7f985c069cd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.595+0000 7f9861b75700 1 --2- 172.21.15.87:0/1429029876 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f985c0c8fb0 0x7f985c070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.595+0000 7f9861b75700 1 --2- 172.21.15.87:0/1429029876 >> v2:172.21.15.87:3300/0 conn(0x7f985c0b41c0 0x7f985c0cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.595+0000 7f9861b75700 1 -- 172.21.15.87:0/1429029876 >> 172.21.15.87:0/1429029876 conn(0x7f985c0ce960 msgr2=0x7f985c0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:01.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.595+0000 7f9861b75700 1 -- 172.21.15.87:0/1429029876 shutdown_connections 2023-03-30T08:12:01.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.595+0000 7f9861b75700 1 -- 172.21.15.87:0/1429029876 wait complete. 2023-03-30T08:12:01.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.599+0000 7f9861b75700 1 Processor -- start 2023-03-30T08:12:01.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.599+0000 7f9861b75700 1 -- start start 2023-03-30T08:12:01.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.599+0000 7f9861b75700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f985c070960 0x7f985c1f0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.599+0000 7f9861b75700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f985c0b41c0 0x7f985c0b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.599+0000 7f9861b75700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c0c8fb0 0x7f985c0b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.599+0000 7f9861b75700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0b34f0 con 0x7f985c0c8fb0 2023-03-30T08:12:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.599+0000 7f9861b75700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0b28e0 con 0x7f985c070960 2023-03-30T08:12:01.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.599+0000 7f9861b75700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0b2bc0 con 0x7f985c0b41c0 2023-03-30T08:12:01.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f985bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c0c8fb0 0x7f985c0b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:01.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f985bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c0c8fb0 0x7f985c0b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33616/0 (socket says 172.21.15.87:33616) 2023-03-30T08:12:01.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f985bfff700 1 -- 172.21.15.87:0/3614660598 learned_addr learned my addr 172.21.15.87:0/3614660598 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:01.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f985b7fe700 1 --2- 172.21.15.87:0/3614660598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f985c070960 0x7f985c1f0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:01.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f985affd700 1 --2- 172.21.15.87:0/3614660598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f985c0b41c0 0x7f985c0b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:01.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f985bfff700 1 -- 172.21.15.87:0/3614660598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f985c0b41c0 msgr2=0x7f985c0b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:01.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f985bfff700 1 --2- 172.21.15.87:0/3614660598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f985c0b41c0 0x7f985c0b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f985bfff700 1 -- 172.21.15.87:0/3614660598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f985c070960 msgr2=0x7f985c1f0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:01.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f985bfff700 1 --2- 172.21.15.87:0/3614660598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f985c070960 0x7f985c1f0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f985bfff700 1 -- 172.21.15.87:0/3614660598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c00d950 con 0x7f985c0c8fb0 2023-03-30T08:12:01.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f985bfff700 1 --2- 172.21.15.87:0/3614660598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c0c8fb0 0x7f985c0b00d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9854014040 tx=0x7f9854004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:01.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f9843fff700 1 -- 172.21.15.87:0/3614660598 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854004780 con 0x7f985c0c8fb0 2023-03-30T08:12:01.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f9843fff700 1 -- 172.21.15.87:0/3614660598 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9854020070 con 0x7f985c0c8fb0 2023-03-30T08:12:01.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f9861b75700 1 -- 172.21.15.87:0/3614660598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9854009a70 con 0x7f985c0c8fb0 2023-03-30T08:12:01.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f9843fff700 1 -- 172.21.15.87:0/3614660598 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98540276c0 con 0x7f985c0c8fb0 2023-03-30T08:12:01.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.603+0000 7f9861b75700 1 -- 172.21.15.87:0/3614660598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c0ce720 con 0x7f985c0c8fb0 2023-03-30T08:12:01.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.607+0000 7f9861b75700 1 -- 172.21.15.87:0/3614660598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c0c9400 con 0x7f985c0c8fb0 2023-03-30T08:12:01.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.607+0000 7f9843fff700 1 -- 172.21.15.87:0/3614660598 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f9854012430 con 0x7f985c0c8fb0 2023-03-30T08:12:01.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.607+0000 7f9843fff700 1 --2- 172.21.15.87:0/3614660598 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f98480653f0 0x7f98480678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:01.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.607+0000 7f9843fff700 1 -- 172.21.15.87:0/3614660598 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9854022070 con 0x7f985c0c8fb0 2023-03-30T08:12:01.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.607+0000 7f985b7fe700 1 --2- 172.21.15.87:0/3614660598 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f98480653f0 0x7f98480678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:01.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.607+0000 7f985b7fe700 1 --2- 172.21.15.87:0/3614660598 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f98480653f0 0x7f98480678a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f984c015460 tx=0x7f984c00f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:01.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.615+0000 7f9843fff700 1 -- 172.21.15.87:0/3614660598 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f9854052310 con 0x7f985c0c8fb0 2023-03-30T08:12:01.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.819+0000 7f9861b75700 1 -- 172.21.15.87:0/3614660598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f985c15df90 con 0x7f985c0c8fb0 2023-03-30T08:12:01.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.823+0000 7f9843fff700 1 -- 172.21.15.87:0/3614660598 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f9854055930 con 0x7f985c0c8fb0 2023-03-30T08:12:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:01.828 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2818344230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2818344230},{"type":"v1","addr":"172.21.15.115:6833","nonce":2818344230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3891185444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3891185444},{"type":"v1","addr":"172.21.15.87:6836","nonce":3891185444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3443119914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3443119914},{"type":"v1","addr":"172.21.15.87:6837","nonce":3443119914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-30T08:10:58.351331+0000","modified":"2023-03-30T08:11:17.023824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3640886103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3640886103},{"type":"v1","addr":"172.21.15.115:6835","nonce":3640886103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-30T08:12:01.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.823+0000 7f9861b75700 1 -- 172.21.15.87:0/3614660598 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f98480653f0 msgr2=0x7f98480678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:01.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.823+0000 7f9861b75700 1 --2- 172.21.15.87:0/3614660598 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f98480653f0 0x7f98480678a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f984c015460 tx=0x7f984c00f040 comp rx=0 tx=0).stop 2023-03-30T08:12:01.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.823+0000 7f9861b75700 1 -- 172.21.15.87:0/3614660598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c0c8fb0 msgr2=0x7f985c0b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:01.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.823+0000 7f9861b75700 1 --2- 172.21.15.87:0/3614660598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c0c8fb0 0x7f985c0b00d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9854014040 tx=0x7f9854004af0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.823+0000 7f9861b75700 1 -- 172.21.15.87:0/3614660598 shutdown_connections 2023-03-30T08:12:01.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.823+0000 7f9861b75700 1 --2- 172.21.15.87:0/3614660598 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f98480653f0 0x7f98480678a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.823+0000 7f9861b75700 1 --2- 172.21.15.87:0/3614660598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f985c0c8fb0 0x7f985c0b00d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.823+0000 7f9861b75700 1 --2- 172.21.15.87:0/3614660598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f985c0b41c0 0x7f985c0b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.823+0000 7f9861b75700 1 --2- 172.21.15.87:0/3614660598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f985c070960 0x7f985c1f0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:01.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.823+0000 7f9861b75700 1 -- 172.21.15.87:0/3614660598 >> 172.21.15.87:0/3614660598 conn(0x7f985c0ce960 msgr2=0x7f985c158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:01.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.823+0000 7f9861b75700 1 -- 172.21.15.87:0/3614660598 shutdown_connections 2023-03-30T08:12:01.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:01.823+0000 7f9861b75700 1 -- 172.21.15.87:0/3614660598 wait complete. 2023-03-30T08:12:01.836 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2023-03-30T08:12:01.850 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:12:02.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.003+0000 7f410f59e700 1 Processor -- start 2023-03-30T08:12:02.010 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.003+0000 7f410f59e700 1 -- start start 2023-03-30T08:12:02.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f410f59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f41100ca080 0x7f41100ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f410f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4110158b00 0x7f411006a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f410f59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41100aff50 con 0x7f411006ac20 2023-03-30T08:12:02.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f410f59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41100cc020 con 0x7f41100ca080 2023-03-30T08:12:02.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f410f59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41100ca990 con 0x7f4110158b00 2023-03-30T08:12:02.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f410e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f41100ca080 0x7f41100ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f4105d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4110158b00 0x7f411006a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f410e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f41100ca080 0x7f41100ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:46836/0 (socket says 172.21.15.87:46836) 2023-03-30T08:12:02.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f410e59c700 1 -- 172.21.15.87:0/1332603204 learned_addr learned my addr 172.21.15.87:0/1332603204 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:02.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f410ed9d700 1 --1- 172.21.15.87:0/1332603204 >> v1:172.21.15.87:6789/0 conn(0x7f411006ac20 0x7f41100cb910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44354/0 (socket says 172.21.15.87:44354) 2023-03-30T08:12:02.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f410e59c700 1 -- 172.21.15.87:0/1332603204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4110158b00 msgr2=0x7f411006a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:02.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f410e59c700 1 --2- 172.21.15.87:0/1332603204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4110158b00 0x7f411006a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f410e59c700 1 -- 172.21.15.87:0/1332603204 >> v1:172.21.15.87:6789/0 conn(0x7f411006ac20 legacy=0x7f41100cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f410dd9b700 1 -- 172.21.15.87:0/1332603204 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820755635 0 0) 0x7f41100aff50 con 0x7f411006ac20 2023-03-30T08:12:02.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f410e59c700 1 -- 172.21.15.87:0/1332603204 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41100af620 con 0x7f41100ca080 2023-03-30T08:12:02.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.007+0000 7f410e59c700 1 --2- 172.21.15.87:0/1332603204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41100ca080 0x7f41100ca450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4100009910 tx=0x7f4100009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e2eabe17b736a7a server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:02.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.011+0000 7f410dd9b700 1 -- 172.21.15.87:0/1332603204 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100011830 con 0x7f41100ca080 2023-03-30T08:12:02.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.011+0000 7f410dd9b700 1 -- 172.21.15.87:0/1332603204 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4100011990 con 0x7f41100ca080 2023-03-30T08:12:02.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.011+0000 7f410dd9b700 1 -- 172.21.15.87:0/1332603204 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100011d40 con 0x7f41100ca080 2023-03-30T08:12:02.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.011+0000 7f410f59e700 1 -- 172.21.15.87:0/1332603204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41100ca080 msgr2=0x7f41100ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.011+0000 7f410f59e700 1 --2- 172.21.15.87:0/1332603204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41100ca080 0x7f41100ca450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4100009910 tx=0x7f4100009c20 comp rx=0 tx=0).stop 2023-03-30T08:12:02.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.011+0000 7f410f59e700 1 -- 172.21.15.87:0/1332603204 shutdown_connections 2023-03-30T08:12:02.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.011+0000 7f410f59e700 1 --2- 172.21.15.87:0/1332603204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4110158b00 0x7f411006a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.011+0000 7f410f59e700 1 --2- 172.21.15.87:0/1332603204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41100ca080 0x7f41100ca450 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.011+0000 7f410f59e700 1 -- 172.21.15.87:0/1332603204 >> 172.21.15.87:0/1332603204 conn(0x7f41100cf410 msgr2=0x7f41100cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:02.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.011+0000 7f410f59e700 1 -- 172.21.15.87:0/1332603204 shutdown_connections 2023-03-30T08:12:02.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.011+0000 7f410f59e700 1 -- 172.21.15.87:0/1332603204 wait complete. 2023-03-30T08:12:02.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.015+0000 7f410f59e700 1 Processor -- start 2023-03-30T08:12:02.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.015+0000 7f410f59e700 1 -- start start 2023-03-30T08:12:02.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.015+0000 7f410f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f411006ac20 0x7f41100c1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.015+0000 7f410f59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41100ca080 0x7f4110157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.015+0000 7f410f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f411014d0e0 0x7f4110156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.015+0000 7f410f59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41100c1ab0 con 0x7f41100ca080 2023-03-30T08:12:02.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.015+0000 7f410f59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411014c040 con 0x7f411014d0e0 2023-03-30T08:12:02.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.015+0000 7f410f59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411014c320 con 0x7f411006ac20 2023-03-30T08:12:02.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.015+0000 7f4105d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41100ca080 0x7f4110157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.015+0000 7f4105d9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41100ca080 0x7f4110157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33622/0 (socket says 172.21.15.87:33622) 2023-03-30T08:12:02.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.015+0000 7f4105d9b700 1 -- 172.21.15.87:0/1108328536 learned_addr learned my addr 172.21.15.87:0/1108328536 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:02.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.015+0000 7f410ed9d700 1 --2- 172.21.15.87:0/1108328536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f411014d0e0 0x7f4110156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.015+0000 7f410e59c700 1 --2- 172.21.15.87:0/1108328536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f411006ac20 0x7f41100c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.019+0000 7f4105d9b700 1 -- 172.21.15.87:0/1108328536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f411006ac20 msgr2=0x7f41100c1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.019+0000 7f4105d9b700 1 --2- 172.21.15.87:0/1108328536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f411006ac20 0x7f41100c1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.019+0000 7f4105d9b700 1 -- 172.21.15.87:0/1108328536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f411014d0e0 msgr2=0x7f4110156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.019+0000 7f4105d9b700 1 --2- 172.21.15.87:0/1108328536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f411014d0e0 0x7f4110156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.019+0000 7f4105d9b700 1 -- 172.21.15.87:0/1108328536 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4100009570 con 0x7f41100ca080 2023-03-30T08:12:02.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.019+0000 7f4105d9b700 1 --2- 172.21.15.87:0/1108328536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41100ca080 0x7f4110157b30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f40f800e9d0 tx=0x7f40f800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:02.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.019+0000 7f41077fe700 1 -- 172.21.15.87:0/1108328536 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f8009720 con 0x7f41100ca080 2023-03-30T08:12:02.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.019+0000 7f41077fe700 1 -- 172.21.15.87:0/1108328536 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f800ee70 con 0x7f41100ca080 2023-03-30T08:12:02.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.019+0000 7f41077fe700 1 -- 172.21.15.87:0/1108328536 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f800ca50 con 0x7f41100ca080 2023-03-30T08:12:02.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.019+0000 7f410f59e700 1 -- 172.21.15.87:0/1108328536 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41100afbe0 con 0x7f41100ca080 2023-03-30T08:12:02.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.019+0000 7f410f59e700 1 -- 172.21.15.87:0/1108328536 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41100af900 con 0x7f41100ca080 2023-03-30T08:12:02.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.019+0000 7f410f59e700 1 -- 172.21.15.87:0/1108328536 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41100af240 con 0x7f41100ca080 2023-03-30T08:12:02.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.023+0000 7f41077fe700 1 -- 172.21.15.87:0/1108328536 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f40f800cbb0 con 0x7f41100ca080 2023-03-30T08:12:02.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.023+0000 7f41077fe700 1 --2- 172.21.15.87:0/1108328536 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f40f00653f0 0x7f40f00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.023+0000 7f41077fe700 1 -- 172.21.15.87:0/1108328536 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f40f8082be0 con 0x7f41100ca080 2023-03-30T08:12:02.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.023+0000 7f410e59c700 1 --2- 172.21.15.87:0/1108328536 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f40f00653f0 0x7f40f00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.027+0000 7f410e59c700 1 --2- 172.21.15.87:0/1108328536 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f40f00653f0 0x7f40f00678a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4100000c00 tx=0x7f4100008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:02.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.031+0000 7f41077fe700 1 -- 172.21.15.87:0/1108328536 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f40f8053f50 con 0x7f41100ca080 2023-03-30T08:12:02.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.199+0000 7f410f59e700 1 -- 172.21.15.87:0/1108328536 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41100733a0 con 0x7f41100ca080 2023-03-30T08:12:02.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.203+0000 7f41077fe700 1 -- 172.21.15.87:0/1108328536 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+19747 (secure 0 0 0) 0x7f40f800ce60 con 0x7f41100ca080 2023-03-30T08:12:02.210 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:02.210 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:39.157903+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:12:02.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.207+0000 7f410f59e700 1 -- 172.21.15.87:0/1108328536 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f40f00653f0 msgr2=0x7f40f00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.212 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.207+0000 7f410f59e700 1 --2- 172.21.15.87:0/1108328536 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f40f00653f0 0x7f40f00678a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4100000c00 tx=0x7f4100008030 comp rx=0 tx=0).stop 2023-03-30T08:12:02.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.207+0000 7f410f59e700 1 -- 172.21.15.87:0/1108328536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41100ca080 msgr2=0x7f4110157b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.207+0000 7f410f59e700 1 --2- 172.21.15.87:0/1108328536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41100ca080 0x7f4110157b30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f40f800e9d0 tx=0x7f40f800ece0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.207+0000 7f410f59e700 1 -- 172.21.15.87:0/1108328536 shutdown_connections 2023-03-30T08:12:02.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.207+0000 7f410f59e700 1 --2- 172.21.15.87:0/1108328536 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f40f00653f0 0x7f40f00678a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.207+0000 7f410f59e700 1 --2- 172.21.15.87:0/1108328536 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f411014d0e0 0x7f4110156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.207+0000 7f410f59e700 1 --2- 172.21.15.87:0/1108328536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41100ca080 0x7f4110157b30 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.207+0000 7f410f59e700 1 --2- 172.21.15.87:0/1108328536 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f411006ac20 0x7f41100c1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.207+0000 7f410f59e700 1 -- 172.21.15.87:0/1108328536 >> 172.21.15.87:0/1108328536 conn(0x7f41100cf410 msgr2=0x7f4110151280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:02.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.207+0000 7f410f59e700 1 -- 172.21.15.87:0/1108328536 shutdown_connections 2023-03-30T08:12:02.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.207+0000 7f410f59e700 1 -- 172.21.15.87:0/1108328536 wait complete. 2023-03-30T08:12:02.233 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-03-30T08:12:02.233 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T08:12:02.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.383+0000 7f7d4dc12700 1 Processor -- start 2023-03-30T08:12:02.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.383+0000 7f7d4dc12700 1 -- start start 2023-03-30T08:12:02.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.383+0000 7f7d4dc12700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7d480b0c10 0x7f7d480aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.383+0000 7f7d4dc12700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d480af180 0x7f7d4806c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.383+0000 7f7d4dc12700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4806b670 con 0x7f7d480b3f30 2023-03-30T08:12:02.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.383+0000 7f7d4dc12700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d480b1090 con 0x7f7d480b0c10 2023-03-30T08:12:02.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.383+0000 7f7d4dc12700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d480af600 con 0x7f7d480af180 2023-03-30T08:12:02.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.387+0000 7f7d4cc10700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7d480b3f30 0x7f7d4806a6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44368/0 (socket says 172.21.15.87:44368) 2023-03-30T08:12:02.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.387+0000 7f7d4cc10700 1 -- 172.21.15.87:0/1959969036 learned_addr learned my addr 172.21.15.87:0/1959969036 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:02.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.387+0000 7f7d4d411700 1 --2- 172.21.15.87:0/1959969036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d480af180 0x7f7d4806c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.387+0000 7f7d47fff700 1 --2- 172.21.15.87:0/1959969036 >> v2:172.21.15.115:3300/0 conn(0x7f7d480b0c10 0x7f7d480aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.387+0000 7f7d477fe700 1 -- 172.21.15.87:0/1959969036 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898633630 0 0) 0x7f7d4806b670 con 0x7f7d480b3f30 2023-03-30T08:12:02.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.387+0000 7f7d477fe700 1 -- 172.21.15.87:0/1959969036 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d380035d0 con 0x7f7d480b3f30 2023-03-30T08:12:02.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.387+0000 7f7d4d411700 1 -- 172.21.15.87:0/1959969036 >> v2:172.21.15.115:3300/0 conn(0x7f7d480b0c10 msgr2=0x7f7d480aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:02.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.387+0000 7f7d4d411700 1 --2- 172.21.15.87:0/1959969036 >> v2:172.21.15.115:3300/0 conn(0x7f7d480b0c10 0x7f7d480aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.387+0000 7f7d4d411700 1 -- 172.21.15.87:0/1959969036 >> v1:172.21.15.87:6789/0 conn(0x7f7d480b3f30 legacy=0x7f7d4806a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.387+0000 7f7d4d411700 1 -- 172.21.15.87:0/1959969036 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4806b0b0 con 0x7f7d480af180 2023-03-30T08:12:02.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.387+0000 7f7d4d411700 1 --2- 172.21.15.87:0/1959969036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d480af180 0x7f7d4806c310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009d90 tx=0x7f7d4000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54979ee20a22f0b2 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:02.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.387+0000 7f7d477fe700 1 -- 172.21.15.87:0/1959969036 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4000e070 con 0x7f7d480af180 2023-03-30T08:12:02.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.387+0000 7f7d477fe700 1 -- 172.21.15.87:0/1959969036 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4000bb20 con 0x7f7d480af180 2023-03-30T08:12:02.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.387+0000 7f7d477fe700 1 -- 172.21.15.87:0/1959969036 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40012430 con 0x7f7d480af180 2023-03-30T08:12:02.395 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.391+0000 7f7d4dc12700 1 -- 172.21.15.87:0/1959969036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d480af180 msgr2=0x7f7d4806c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.391+0000 7f7d4dc12700 1 --2- 172.21.15.87:0/1959969036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d480af180 0x7f7d4806c310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009d90 tx=0x7f7d4000b330 comp rx=0 tx=0).stop 2023-03-30T08:12:02.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.391+0000 7f7d4dc12700 1 -- 172.21.15.87:0/1959969036 shutdown_connections 2023-03-30T08:12:02.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.391+0000 7f7d4dc12700 1 --2- 172.21.15.87:0/1959969036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d480af180 0x7f7d4806c310 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.391+0000 7f7d4dc12700 1 --2- 172.21.15.87:0/1959969036 >> v2:172.21.15.115:3300/0 conn(0x7f7d480b0c10 0x7f7d480aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.391+0000 7f7d4dc12700 1 -- 172.21.15.87:0/1959969036 >> 172.21.15.87:0/1959969036 conn(0x7f7d480cf410 msgr2=0x7f7d480cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:02.396 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.391+0000 7f7d4dc12700 1 -- 172.21.15.87:0/1959969036 shutdown_connections 2023-03-30T08:12:02.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.391+0000 7f7d4dc12700 1 -- 172.21.15.87:0/1959969036 wait complete. 2023-03-30T08:12:02.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.391+0000 7f7d4dc12700 1 Processor -- start 2023-03-30T08:12:02.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.391+0000 7f7d4dc12700 1 -- start start 2023-03-30T08:12:02.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.391+0000 7f7d4dc12700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d480af180 0x7f7d4815c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.391+0000 7f7d4dc12700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d480b0c10 0x7f7d480c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.391+0000 7f7d4dc12700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d480b3f30 0x7f7d480c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.391+0000 7f7d4dc12700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4815a920 con 0x7f7d480b0c10 2023-03-30T08:12:02.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d4dc12700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4815a620 con 0x7f7d480b3f30 2023-03-30T08:12:02.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d4dc12700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4815cc60 con 0x7f7d480af180 2023-03-30T08:12:02.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d47fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d480b0c10 0x7f7d480c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d47fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d480b0c10 0x7f7d480c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33638/0 (socket says 172.21.15.87:33638) 2023-03-30T08:12:02.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d47fff700 1 -- 172.21.15.87:0/1299203663 learned_addr learned my addr 172.21.15.87:0/1299203663 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:02.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d4cc10700 1 --2- 172.21.15.87:0/1299203663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d480af180 0x7f7d4815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d4d411700 1 --2- 172.21.15.87:0/1299203663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d480b3f30 0x7f7d480c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.401 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d47fff700 1 -- 172.21.15.87:0/1299203663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d480af180 msgr2=0x7f7d4815c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d47fff700 1 --2- 172.21.15.87:0/1299203663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d480af180 0x7f7d4815c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d47fff700 1 -- 172.21.15.87:0/1299203663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d480b3f30 msgr2=0x7f7d480c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d47fff700 1 --2- 172.21.15.87:0/1299203663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d480b3f30 0x7f7d480c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d47fff700 1 -- 172.21.15.87:0/1299203663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d40009a70 con 0x7f7d480b0c10 2023-03-30T08:12:02.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d47fff700 1 --2- 172.21.15.87:0/1299203663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d480b0c10 0x7f7d480c68a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400e9d0 tx=0x7f7d3400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:02.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d457fa700 1 -- 172.21.15.87:0/1299203663 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34009720 con 0x7f7d480b0c10 2023-03-30T08:12:02.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d457fa700 1 -- 172.21.15.87:0/1299203663 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3400ee70 con 0x7f7d480b0c10 2023-03-30T08:12:02.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d457fa700 1 -- 172.21.15.87:0/1299203663 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3400ca50 con 0x7f7d480b0c10 2023-03-30T08:12:02.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d4dc12700 1 -- 172.21.15.87:0/1299203663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d480aded0 con 0x7f7d480b0c10 2023-03-30T08:12:02.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d4dc12700 1 -- 172.21.15.87:0/1299203663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4806b390 con 0x7f7d480b0c10 2023-03-30T08:12:02.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.395+0000 7f7d4dc12700 1 -- 172.21.15.87:0/1299203663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d480ae1b0 con 0x7f7d480b0c10 2023-03-30T08:12:02.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.399+0000 7f7d457fa700 1 -- 172.21.15.87:0/1299203663 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f7d3400cbb0 con 0x7f7d480b0c10 2023-03-30T08:12:02.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.399+0000 7f7d457fa700 1 --2- 172.21.15.87:0/1299203663 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7d2c0653f0 0x7f7d2c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.399+0000 7f7d457fa700 1 -- 172.21.15.87:0/1299203663 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7d34082b60 con 0x7f7d480b0c10 2023-03-30T08:12:02.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.399+0000 7f7d4cc10700 1 --2- 172.21.15.87:0/1299203663 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7d2c0653f0 0x7f7d2c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.399+0000 7f7d4cc10700 1 --2- 172.21.15.87:0/1299203663 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7d2c0653f0 0x7f7d2c0678a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c007fd0 tx=0x7f7d3c007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:02.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.403+0000 7f7d457fa700 1 -- 172.21.15.87:0/1299203663 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f7d34053ee0 con 0x7f7d480b0c10 2023-03-30T08:12:02.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.607+0000 7f7d4dc12700 1 -- 172.21.15.87:0/1299203663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d480733a0 con 0x7f7d480b0c10 2023-03-30T08:12:02.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.607+0000 7f7d457fa700 1 -- 172.21.15.87:0/1299203663 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f7d3400ce60 con 0x7f7d480b0c10 2023-03-30T08:12:02.614 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:02.614 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2818344230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2818344230},{"type":"v1","addr":"172.21.15.115:6833","nonce":2818344230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3891185444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3891185444},{"type":"v1","addr":"172.21.15.87:6836","nonce":3891185444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3443119914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3443119914},{"type":"v1","addr":"172.21.15.87:6837","nonce":3443119914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-30T08:10:58.351331+0000","modified":"2023-03-30T08:11:17.023824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3640886103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3640886103},{"type":"v1","addr":"172.21.15.115:6835","nonce":3640886103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-30T08:12:02.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.611+0000 7f7d4dc12700 1 -- 172.21.15.87:0/1299203663 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7d2c0653f0 msgr2=0x7f7d2c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.611+0000 7f7d4dc12700 1 --2- 172.21.15.87:0/1299203663 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7d2c0653f0 0x7f7d2c0678a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c007fd0 tx=0x7f7d3c007de0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.611+0000 7f7d4dc12700 1 -- 172.21.15.87:0/1299203663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d480b0c10 msgr2=0x7f7d480c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.611+0000 7f7d4dc12700 1 --2- 172.21.15.87:0/1299203663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d480b0c10 0x7f7d480c68a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400e9d0 tx=0x7f7d3400ece0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.615+0000 7f7d4dc12700 1 -- 172.21.15.87:0/1299203663 shutdown_connections 2023-03-30T08:12:02.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.615+0000 7f7d4dc12700 1 --2- 172.21.15.87:0/1299203663 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7d2c0653f0 0x7f7d2c0678a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.615+0000 7f7d4dc12700 1 --2- 172.21.15.87:0/1299203663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d480b3f30 0x7f7d480c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.615+0000 7f7d4dc12700 1 --2- 172.21.15.87:0/1299203663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7d480b0c10 0x7f7d480c68a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.615+0000 7f7d4dc12700 1 --2- 172.21.15.87:0/1299203663 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7d480af180 0x7f7d4815c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.615+0000 7f7d4dc12700 1 -- 172.21.15.87:0/1299203663 >> 172.21.15.87:0/1299203663 conn(0x7f7d480cf410 msgr2=0x7f7d480ac510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.615+0000 7f7d4dc12700 1 -- 172.21.15.87:0/1299203663 shutdown_connections 2023-03-30T08:12:02.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.615+0000 7f7d4dc12700 1 -- 172.21.15.87:0/1299203663 wait complete. 2023-03-30T08:12:02.621 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2023-03-30T08:12:02.639 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T08:12:02.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.795+0000 7f88990e7700 1 Processor -- start 2023-03-30T08:12:02.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.795+0000 7f88990e7700 1 -- start start 2023-03-30T08:12:02.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.795+0000 7f88990e7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8894159440 0x7f889406b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.795+0000 7f88990e7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f889406bc90 0x7f88940b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f88990e7700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889406c740 con 0x7f8894159070 2023-03-30T08:12:02.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f88990e7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f889406c180 con 0x7f8894159440 2023-03-30T08:12:02.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f88990e7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889406c460 con 0x7f889406bc90 2023-03-30T08:12:02.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f888b7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8894159440 0x7f889406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f888b7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8894159440 0x7f889406b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33640/0 (socket says 172.21.15.87:33640) 2023-03-30T08:12:02.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f888b7fe700 1 -- 172.21.15.87:0/3549836049 learned_addr learned my addr 172.21.15.87:0/3549836049 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:02.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f88988e6700 1 --2- 172.21.15.87:0/3549836049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f889406bc90 0x7f88940b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f8893fff700 1 --1- 172.21.15.87:0/3549836049 >> v1:172.21.15.87:6789/0 conn(0x7f8894159070 0x7f88940cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44376/0 (socket says 172.21.15.87:44376) 2023-03-30T08:12:02.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f888b7fe700 1 -- 172.21.15.87:0/3549836049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f889406bc90 msgr2=0x7f88940b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:02.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f888b7fe700 1 --2- 172.21.15.87:0/3549836049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f889406bc90 0x7f88940b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f888b7fe700 1 -- 172.21.15.87:0/3549836049 >> v1:172.21.15.87:6789/0 conn(0x7f8894159070 legacy=0x7f88940cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f888b7fe700 1 -- 172.21.15.87:0/3549836049 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88940cab00 con 0x7f8894159440 2023-03-30T08:12:02.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f888b7fe700 1 --2- 172.21.15.87:0/3549836049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8894159440 0x7f889406b750 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f887c009910 tx=0x7f887c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de99d9fb130d096 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:02.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f88937fe700 1 -- 172.21.15.87:0/3549836049 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c011830 con 0x7f8894159440 2023-03-30T08:12:02.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f88937fe700 1 -- 172.21.15.87:0/3549836049 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887c011990 con 0x7f8894159440 2023-03-30T08:12:02.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f88937fe700 1 -- 172.21.15.87:0/3549836049 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c011d40 con 0x7f8894159440 2023-03-30T08:12:02.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f88990e7700 1 -- 172.21.15.87:0/3549836049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8894159440 msgr2=0x7f889406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f88990e7700 1 --2- 172.21.15.87:0/3549836049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8894159440 0x7f889406b750 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f887c009910 tx=0x7f887c009c20 comp rx=0 tx=0).stop 2023-03-30T08:12:02.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f88990e7700 1 -- 172.21.15.87:0/3549836049 shutdown_connections 2023-03-30T08:12:02.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f88990e7700 1 --2- 172.21.15.87:0/3549836049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f889406bc90 0x7f88940b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f88990e7700 1 --2- 172.21.15.87:0/3549836049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8894159440 0x7f889406b750 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.799+0000 7f88990e7700 1 -- 172.21.15.87:0/3549836049 >> 172.21.15.87:0/3549836049 conn(0x7f88940d05b0 msgr2=0x7f88940cc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:02.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.803+0000 7f88990e7700 1 -- 172.21.15.87:0/3549836049 shutdown_connections 2023-03-30T08:12:02.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.803+0000 7f88990e7700 1 -- 172.21.15.87:0/3549836049 wait complete. 2023-03-30T08:12:02.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.803+0000 7f88990e7700 1 Processor -- start 2023-03-30T08:12:02.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.803+0000 7f88990e7700 1 -- start start 2023-03-30T08:12:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f88990e7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f889406bc90 0x7f8894156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f88990e7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8894159070 0x7f8894166b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f88990e7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8894159440 0x7f88941551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f88990e7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88940b41b0 con 0x7f889406bc90 2023-03-30T08:12:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f88990e7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8894167080 con 0x7f8894159070 2023-03-30T08:12:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f88990e7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88941571c0 con 0x7f8894159440 2023-03-30T08:12:02.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f8893fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f889406bc90 0x7f8894156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f8893fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f889406bc90 0x7f8894156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33642/0 (socket says 172.21.15.87:33642) 2023-03-30T08:12:02.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f8893fff700 1 -- 172.21.15.87:0/2743137194 learned_addr learned my addr 172.21.15.87:0/2743137194 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:02.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f88988e6700 1 --2- 172.21.15.87:0/2743137194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8894159440 0x7f88941551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f888b7fe700 1 --2- 172.21.15.87:0/2743137194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8894159070 0x7f8894166b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f88988e6700 1 -- 172.21.15.87:0/2743137194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8894159070 msgr2=0x7f8894166b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f88988e6700 1 --2- 172.21.15.87:0/2743137194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8894159070 0x7f8894166b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f88988e6700 1 -- 172.21.15.87:0/2743137194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f889406bc90 msgr2=0x7f8894156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:02.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f88988e6700 1 --2- 172.21.15.87:0/2743137194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f889406bc90 0x7f8894156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:02.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f88988e6700 1 -- 172.21.15.87:0/2743137194 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c009570 con 0x7f8894159440 2023-03-30T08:12:02.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f8893fff700 1 --2- 172.21.15.87:0/2743137194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f889406bc90 0x7f8894156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:12:02.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.807+0000 7f88988e6700 1 --2- 172.21.15.87:0/2743137194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8894159440 0x7f88941551b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f888c00ef90 tx=0x7f888c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:02.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.811+0000 7f88917fa700 1 -- 172.21.15.87:0/2743137194 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c00cc90 con 0x7f8894159440 2023-03-30T08:12:02.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.811+0000 7f88917fa700 1 -- 172.21.15.87:0/2743137194 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c00f040 con 0x7f8894159440 2023-03-30T08:12:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.811+0000 7f88917fa700 1 -- 172.21.15.87:0/2743137194 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c0146c0 con 0x7f8894159440 2023-03-30T08:12:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.811+0000 7f88990e7700 1 -- 172.21.15.87:0/2743137194 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8894071490 con 0x7f8894159440 2023-03-30T08:12:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.811+0000 7f88990e7700 1 -- 172.21.15.87:0/2743137194 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88940cade0 con 0x7f8894159440 2023-03-30T08:12:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.811+0000 7f88990e7700 1 -- 172.21.15.87:0/2743137194 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8894071620 con 0x7f8894159440 2023-03-30T08:12:02.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.815+0000 7f88917fa700 1 -- 172.21.15.87:0/2743137194 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f888c014820 con 0x7f8894159440 2023-03-30T08:12:02.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.815+0000 7f88917fa700 1 --2- 172.21.15.87:0/2743137194 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f88740653f0 0x7f88740678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:02.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.815+0000 7f88917fa700 1 -- 172.21.15.87:0/2743137194 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f888c083640 con 0x7f8894159440 2023-03-30T08:12:02.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.815+0000 7f8893fff700 1 --2- 172.21.15.87:0/2743137194 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f88740653f0 0x7f88740678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:02.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.815+0000 7f8893fff700 1 --2- 172.21.15.87:0/2743137194 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f88740653f0 0x7f88740678a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8884000f60 tx=0x7f8884001190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:02.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:02.823+0000 7f88917fa700 1 -- 172.21.15.87:0/2743137194 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f888c050fc0 con 0x7f8894159440 2023-03-30T08:12:03.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.031+0000 7f88990e7700 1 -- 172.21.15.87:0/2743137194 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88940733a0 con 0x7f8894159440 2023-03-30T08:12:03.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.031+0000 7f88917fa700 1 -- 172.21.15.87:0/2743137194 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f888c009e60 con 0x7f8894159440 2023-03-30T08:12:03.038 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:03.038 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2818344230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2818344230},{"type":"v1","addr":"172.21.15.115:6833","nonce":2818344230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/3891185444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":3891185444},{"type":"v1","addr":"172.21.15.87:6836","nonce":3891185444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3443119914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3443119914},{"type":"v1","addr":"172.21.15.87:6837","nonce":3443119914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-30T08:10:58.351331+0000","modified":"2023-03-30T08:11:17.023824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3640886103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3640886103},{"type":"v1","addr":"172.21.15.115:6835","nonce":3640886103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-30T08:12:03.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.035+0000 7f88990e7700 1 -- 172.21.15.87:0/2743137194 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f88740653f0 msgr2=0x7f88740678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:03.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.035+0000 7f88990e7700 1 --2- 172.21.15.87:0/2743137194 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f88740653f0 0x7f88740678a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8884000f60 tx=0x7f8884001190 comp rx=0 tx=0).stop 2023-03-30T08:12:03.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.035+0000 7f88990e7700 1 -- 172.21.15.87:0/2743137194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8894159440 msgr2=0x7f88941551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.035+0000 7f88990e7700 1 --2- 172.21.15.87:0/2743137194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8894159440 0x7f88941551b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f888c00ef90 tx=0x7f888c00c3a0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.035+0000 7f88990e7700 1 -- 172.21.15.87:0/2743137194 shutdown_connections 2023-03-30T08:12:03.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.035+0000 7f88990e7700 1 --2- 172.21.15.87:0/2743137194 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f88740653f0 0x7f88740678a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.035+0000 7f88990e7700 1 --2- 172.21.15.87:0/2743137194 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8894159440 0x7f88941551b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.035+0000 7f88990e7700 1 --2- 172.21.15.87:0/2743137194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8894159070 0x7f8894166b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.035+0000 7f88990e7700 1 --2- 172.21.15.87:0/2743137194 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f889406bc90 0x7f8894156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.035+0000 7f88990e7700 1 -- 172.21.15.87:0/2743137194 >> 172.21.15.87:0/2743137194 conn(0x7f88940d05b0 msgr2=0x7f88940ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.035+0000 7f88990e7700 1 -- 172.21.15.87:0/2743137194 shutdown_connections 2023-03-30T08:12:03.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.035+0000 7f88990e7700 1 -- 172.21.15.87:0/2743137194 wait complete. 2023-03-30T08:12:03.043 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 9 2023-03-30T08:12:03.061 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:12:03.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.215+0000 7f3c4cdf9700 1 Processor -- start 2023-03-30T08:12:03.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.215+0000 7f3c4cdf9700 1 -- start start 2023-03-30T08:12:03.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c4cdf9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3c481600d0 0x7f3c4806a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c4cdf9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c4806aab0 0x7f3c480abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c4cdf9700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4806a0e0 con 0x7f3c480ad640 2023-03-30T08:12:03.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c4cdf9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c480c9db0 con 0x7f3c481600d0 2023-03-30T08:12:03.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c4cdf9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480ca090 con 0x7f3c4806aab0 2023-03-30T08:12:03.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c47fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3c480ad640 0x7f3c481604a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44384/0 (socket says 172.21.15.87:44384) 2023-03-30T08:12:03.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c47fff700 1 -- 172.21.15.87:0/3143813459 learned_addr learned my addr 172.21.15.87:0/3143813459 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:03.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c477fe700 1 --2- 172.21.15.87:0/3143813459 >> v2:172.21.15.115:3300/0 conn(0x7f3c481600d0 0x7f3c4806a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c3effd700 1 --2- 172.21.15.87:0/3143813459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c4806aab0 0x7f3c480abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 -- 172.21.15.87:0/3143813459 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245694433 0 0) 0x7f3c4806a0e0 con 0x7f3c480ad640 2023-03-30T08:12:03.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 -- 172.21.15.87:0/3143813459 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c340035d0 con 0x7f3c480ad640 2023-03-30T08:12:03.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 -- 172.21.15.87:0/3143813459 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 762740312 0 0) 0x7f3c340035d0 con 0x7f3c480ad640 2023-03-30T08:12:03.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 -- 172.21.15.87:0/3143813459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c4806aab0 msgr2=0x7f3c480abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:03.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 --2- 172.21.15.87:0/3143813459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c4806aab0 0x7f3c480abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 -- 172.21.15.87:0/3143813459 >> v2:172.21.15.115:3300/0 conn(0x7f3c481600d0 msgr2=0x7f3c4806a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:03.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 --2- 172.21.15.87:0/3143813459 >> v2:172.21.15.115:3300/0 conn(0x7f3c481600d0 0x7f3c4806a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 -- 172.21.15.87:0/3143813459 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48069d70 con 0x7f3c480ad640 2023-03-30T08:12:03.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 -- 172.21.15.87:0/3143813459 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f3c400019f0 con 0x7f3c480ad640 2023-03-30T08:12:03.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 -- 172.21.15.87:0/3143813459 >> v1:172.21.15.87:6789/0 conn(0x7f3c480ad640 legacy=0x7f3c481604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:03.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 --2- 172.21.15.87:0/3143813459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c4806aab0 0x7f3c34003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 --2- 172.21.15.87:0/3143813459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c34003fa0 0x7f3c34004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 --2- 172.21.15.87:0/3143813459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c34004db0 0x7f3c34005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 -- 172.21.15.87:0/3143813459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480c9db0 con 0x7f3c34004db0 2023-03-30T08:12:03.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 -- 172.21.15.87:0/3143813459 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480ca090 con 0x7f3c34003fa0 2023-03-30T08:12:03.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c46ffd700 1 -- 172.21.15.87:0/3143813459 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3400ba30 con 0x7f3c4806aab0 2023-03-30T08:12:03.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c47fff700 1 --2- 172.21.15.87:0/3143813459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c34004db0 0x7f3c34005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c3effd700 1 --2- 172.21.15.87:0/3143813459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c34003fa0 0x7f3c34004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.219+0000 7f3c477fe700 1 --2- 172.21.15.87:0/3143813459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c4806aab0 0x7f3c34003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c47fff700 1 -- 172.21.15.87:0/3143813459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c4806aab0 msgr2=0x7f3c34003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:03.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c47fff700 1 --2- 172.21.15.87:0/3143813459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c4806aab0 0x7f3c34003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c47fff700 1 -- 172.21.15.87:0/3143813459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c34003fa0 msgr2=0x7f3c34004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:03.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c47fff700 1 --2- 172.21.15.87:0/3143813459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c34003fa0 0x7f3c34004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c47fff700 1 -- 172.21.15.87:0/3143813459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c340035d0 con 0x7f3c34004db0 2023-03-30T08:12:03.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c47fff700 1 --2- 172.21.15.87:0/3143813459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c34004db0 0x7f3c34005220 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000a860 tx=0x7f3c340058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3667a36ac2cf2a5 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:03.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c46ffd700 1 -- 172.21.15.87:0/3143813459 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c400072d0 con 0x7f3c34004db0 2023-03-30T08:12:03.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c46ffd700 1 -- 172.21.15.87:0/3143813459 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c40007450 con 0x7f3c34004db0 2023-03-30T08:12:03.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c46ffd700 1 -- 172.21.15.87:0/3143813459 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40007800 con 0x7f3c34004db0 2023-03-30T08:12:03.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c4cdf9700 1 -- 172.21.15.87:0/3143813459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c34004db0 msgr2=0x7f3c34005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:03.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c4cdf9700 1 --2- 172.21.15.87:0/3143813459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c34004db0 0x7f3c34005220 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000a860 tx=0x7f3c340058a0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c47fff700 1 -- 172.21.15.87:0/3143813459 reap_dead start 2023-03-30T08:12:03.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c4cdf9700 1 -- 172.21.15.87:0/3143813459 shutdown_connections 2023-03-30T08:12:03.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c4cdf9700 1 -- 172.21.15.87:0/3143813459 >> 172.21.15.87:0/3143813459 conn(0x7f3c480cf410 msgr2=0x7f3c480cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:03.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c4cdf9700 1 -- 172.21.15.87:0/3143813459 shutdown_connections 2023-03-30T08:12:03.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.223+0000 7f3c4cdf9700 1 -- 172.21.15.87:0/3143813459 wait complete. 2023-03-30T08:12:03.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.227+0000 7f3c4cdf9700 1 Processor -- start 2023-03-30T08:12:03.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.227+0000 7f3c4cdf9700 1 -- start start 2023-03-30T08:12:03.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.227+0000 7f3c4cdf9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c34004db0 0x7f3c480adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.227+0000 7f3c4cdf9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c480c6610 0x7f3c4815a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.227+0000 7f3c4cdf9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c480ae950 0x7f3c480b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.227+0000 7f3c4cdf9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4815aef0 con 0x7f3c480c6610 2023-03-30T08:12:03.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.227+0000 7f3c4cdf9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480c6a80 con 0x7f3c480ae950 2023-03-30T08:12:03.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.227+0000 7f3c4cdf9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480ae530 con 0x7f3c34004db0 2023-03-30T08:12:03.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c3effd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c480c6610 0x7f3c4815a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c3effd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c480c6610 0x7f3c4815a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33666/0 (socket says 172.21.15.87:33666) 2023-03-30T08:12:03.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c3effd700 1 -- 172.21.15.87:0/686206137 learned_addr learned my addr 172.21.15.87:0/686206137 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:03.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c477fe700 1 --2- 172.21.15.87:0/686206137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c34004db0 0x7f3c480adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c47fff700 1 --2- 172.21.15.87:0/686206137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c480ae950 0x7f3c480b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c3effd700 1 -- 172.21.15.87:0/686206137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c34004db0 msgr2=0x7f3c480adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:03.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c3effd700 1 --2- 172.21.15.87:0/686206137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c34004db0 0x7f3c480adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c3effd700 1 -- 172.21.15.87:0/686206137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c480ae950 msgr2=0x7f3c480b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:03.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c3effd700 1 --2- 172.21.15.87:0/686206137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c480ae950 0x7f3c480b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c3effd700 1 -- 172.21.15.87:0/686206137 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c480addc0 con 0x7f3c480c6610 2023-03-30T08:12:03.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c3effd700 1 --2- 172.21.15.87:0/686206137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c480c6610 0x7f3c4815a9b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3c300119b0 tx=0x7f3c30011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:03.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c44ff9700 1 -- 172.21.15.87:0/686206137 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3000f940 con 0x7f3c480c6610 2023-03-30T08:12:03.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c44ff9700 1 -- 172.21.15.87:0/686206137 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3000faa0 con 0x7f3c480c6610 2023-03-30T08:12:03.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c4cdf9700 1 -- 172.21.15.87:0/686206137 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c480ca370 con 0x7f3c480c6610 2023-03-30T08:12:03.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c44ff9700 1 -- 172.21.15.87:0/686206137 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3000fe30 con 0x7f3c480c6610 2023-03-30T08:12:03.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c4cdf9700 1 -- 172.21.15.87:0/686206137 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4815d8c0 con 0x7f3c480c6610 2023-03-30T08:12:03.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.231+0000 7f3c4cdf9700 1 -- 172.21.15.87:0/686206137 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c480733a0 con 0x7f3c480c6610 2023-03-30T08:12:03.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.235+0000 7f3c44ff9700 1 -- 172.21.15.87:0/686206137 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f3c30014440 con 0x7f3c480c6610 2023-03-30T08:12:03.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.235+0000 7f3c44ff9700 1 --2- 172.21.15.87:0/686206137 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3c28065420 0x7f3c280678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.235+0000 7f3c44ff9700 1 -- 172.21.15.87:0/686206137 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3c30083280 con 0x7f3c480c6610 2023-03-30T08:12:03.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.235+0000 7f3c477fe700 1 --2- 172.21.15.87:0/686206137 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3c28065420 0x7f3c280678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.235+0000 7f3c477fe700 1 --2- 172.21.15.87:0/686206137 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3c28065420 0x7f3c280678d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3c38009c30 tx=0x7f3c38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:03.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.243+0000 7f3c44ff9700 1 -- 172.21.15.87:0/686206137 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f3c300545f0 con 0x7f3c480c6610 2023-03-30T08:12:03.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.415+0000 7f3c4cdf9700 1 -- 172.21.15.87:0/686206137 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c4806af90 con 0x7f3c480c6610 2023-03-30T08:12:03.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.415+0000 7f3c44ff9700 1 -- 172.21.15.87:0/686206137 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+19747 (secure 0 0 0) 0x7f3c30054180 con 0x7f3c480c6610 2023-03-30T08:12:03.422 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:03.422 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":30,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:11:39.157903+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:10:56.407927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-30T08:10:57.359214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-30T08:11:00.430972+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:12:03.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.419+0000 7f3c4cdf9700 1 -- 172.21.15.87:0/686206137 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3c28065420 msgr2=0x7f3c280678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:03.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.419+0000 7f3c4cdf9700 1 --2- 172.21.15.87:0/686206137 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3c28065420 0x7f3c280678d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3c38009c30 tx=0x7f3c38008040 comp rx=0 tx=0).stop 2023-03-30T08:12:03.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.419+0000 7f3c4cdf9700 1 -- 172.21.15.87:0/686206137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c480c6610 msgr2=0x7f3c4815a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:03.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.419+0000 7f3c4cdf9700 1 --2- 172.21.15.87:0/686206137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c480c6610 0x7f3c4815a9b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3c300119b0 tx=0x7f3c30011d70 comp rx=0 tx=0).stop 2023-03-30T08:12:03.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.419+0000 7f3c4cdf9700 1 -- 172.21.15.87:0/686206137 shutdown_connections 2023-03-30T08:12:03.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.419+0000 7f3c4cdf9700 1 --2- 172.21.15.87:0/686206137 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3c28065420 0x7f3c280678d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.419+0000 7f3c4cdf9700 1 --2- 172.21.15.87:0/686206137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c480ae950 0x7f3c480b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.419+0000 7f3c4cdf9700 1 --2- 172.21.15.87:0/686206137 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c480c6610 0x7f3c4815a9b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.419+0000 7f3c4cdf9700 1 --2- 172.21.15.87:0/686206137 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c34004db0 0x7f3c480adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.419+0000 7f3c4cdf9700 1 -- 172.21.15.87:0/686206137 >> 172.21.15.87:0/686206137 conn(0x7f3c480cf410 msgr2=0x7f3c4815be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:03.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.419+0000 7f3c4cdf9700 1 -- 172.21.15.87:0/686206137 shutdown_connections 2023-03-30T08:12:03.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.419+0000 7f3c4cdf9700 1 -- 172.21.15.87:0/686206137 wait complete. 2023-03-30T08:12:03.446 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-03-30T08:12:03.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.603+0000 7f90fd93e700 1 Processor -- start 2023-03-30T08:12:03.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.603+0000 7f90fd93e700 1 -- start start 2023-03-30T08:12:03.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.603+0000 7f90fd93e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f80b8380 0x7f90f80d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.603+0000 7f90fd93e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f90f80d27e0 0x7f90f8069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.603+0000 7f90fd93e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f90f81609f0 0x7f90f806a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.603+0000 7f90fd93e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f8160ef0 con 0x7f90f81609f0 2023-03-30T08:12:03.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.603+0000 7f90fd93e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f80cd6a0 con 0x7f90f80d27e0 2023-03-30T08:12:03.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.603+0000 7f90fd93e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80cd3a0 con 0x7f90f80b8380 2023-03-30T08:12:03.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90fd13d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f90f81609f0 0x7f90f806a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90fc93c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f80b8380 0x7f90f80d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90fd13d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f90f81609f0 0x7f90f806a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33668/0 (socket says 172.21.15.87:33668) 2023-03-30T08:12:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90fc93c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f80b8380 0x7f90f80d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:55660/0 (socket says 172.21.15.87:55660) 2023-03-30T08:12:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90f7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f90f80d27e0 0x7f90f8069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90fd13d700 1 -- 172.21.15.87:0/1588831503 learned_addr learned my addr 172.21.15.87:0/1588831503 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90fd13d700 1 -- 172.21.15.87:0/1588831503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f80b8380 msgr2=0x7f90f80d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:03.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90fd13d700 1 --2- 172.21.15.87:0/1588831503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f80b8380 0x7f90f80d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90fd13d700 1 -- 172.21.15.87:0/1588831503 >> v2:172.21.15.115:3300/0 conn(0x7f90f80d27e0 msgr2=0x7f90f8069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90fd13d700 1 --2- 172.21.15.87:0/1588831503 >> v2:172.21.15.115:3300/0 conn(0x7f90f80d27e0 0x7f90f8069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90fd13d700 1 -- 172.21.15.87:0/1588831503 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f80cef00 con 0x7f90f81609f0 2023-03-30T08:12:03.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90fc93c700 1 --2- 172.21.15.87:0/1588831503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f80b8380 0x7f90f80d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:12:03.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90fd13d700 1 --2- 172.21.15.87:0/1588831503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90f81609f0 0x7f90f806a210 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f90f806add0 tx=0x7f90f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aefb1557108607f server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:03.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90f77fe700 1 -- 172.21.15.87:0/1588831503 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f000e070 con 0x7f90f81609f0 2023-03-30T08:12:03.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90f77fe700 1 -- 172.21.15.87:0/1588831503 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f000b910 con 0x7f90f81609f0 2023-03-30T08:12:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90f77fe700 1 -- 172.21.15.87:0/1588831503 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f000bcc0 con 0x7f90f81609f0 2023-03-30T08:12:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90fd93e700 1 -- 172.21.15.87:0/1588831503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90f81609f0 msgr2=0x7f90f806a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.607+0000 7f90fd93e700 1 --2- 172.21.15.87:0/1588831503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90f81609f0 0x7f90f806a210 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f90f806add0 tx=0x7f90f000b330 comp rx=0 tx=0).stop 2023-03-30T08:12:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.611+0000 7f90fd93e700 1 -- 172.21.15.87:0/1588831503 shutdown_connections 2023-03-30T08:12:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.611+0000 7f90fd93e700 1 --2- 172.21.15.87:0/1588831503 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90f81609f0 0x7f90f806a210 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.611+0000 7f90fd93e700 1 --2- 172.21.15.87:0/1588831503 >> v2:172.21.15.115:3300/0 conn(0x7f90f80d27e0 0x7f90f8069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.611+0000 7f90fd93e700 1 --2- 172.21.15.87:0/1588831503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f80b8380 0x7f90f80d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.611+0000 7f90fd93e700 1 -- 172.21.15.87:0/1588831503 >> 172.21.15.87:0/1588831503 conn(0x7f90f80b53f0 msgr2=0x7f90f80cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:03.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.611+0000 7f90fd93e700 1 -- 172.21.15.87:0/1588831503 shutdown_connections 2023-03-30T08:12:03.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.611+0000 7f90fd93e700 1 -- 172.21.15.87:0/1588831503 wait complete. 2023-03-30T08:12:03.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.611+0000 7f90fd93e700 1 Processor -- start 2023-03-30T08:12:03.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.611+0000 7f90fd93e700 1 -- start start 2023-03-30T08:12:03.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd93e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90f80b8380 0x7f90f815ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd93e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f81609f0 0x7f90f81f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd93e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90f815b5f0 0x7f90f80cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd93e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80ccd20 con 0x7f90f815b5f0 2023-03-30T08:12:03.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd93e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f81f1ae0 con 0x7f90f80b8380 2023-03-30T08:12:03.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd93e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f815b2c0 con 0x7f90f81609f0 2023-03-30T08:12:03.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd13d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90f815b5f0 0x7f90f80cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd13d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90f815b5f0 0x7f90f80cbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33682/0 (socket says 172.21.15.87:33682) 2023-03-30T08:12:03.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd13d700 1 -- 172.21.15.87:0/315650709 learned_addr learned my addr 172.21.15.87:0/315650709 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:03.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90f7fff700 1 --2- 172.21.15.87:0/315650709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f81609f0 0x7f90f81f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fc93c700 1 --2- 172.21.15.87:0/315650709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90f80b8380 0x7f90f815ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd13d700 1 -- 172.21.15.87:0/315650709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f81609f0 msgr2=0x7f90f81f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:03.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd13d700 1 --2- 172.21.15.87:0/315650709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f81609f0 0x7f90f81f5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd13d700 1 -- 172.21.15.87:0/315650709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90f80b8380 msgr2=0x7f90f815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:03.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd13d700 1 --2- 172.21.15.87:0/315650709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90f80b8380 0x7f90f815ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:03.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd13d700 1 -- 172.21.15.87:0/315650709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec0094b0 con 0x7f90f815b5f0 2023-03-30T08:12:03.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd13d700 1 --2- 172.21.15.87:0/315650709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90f815b5f0 0x7f90f80cbdf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f90f808bd10 tx=0x7f90f0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:03.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90f57fa700 1 -- 172.21.15.87:0/315650709 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f000ce80 con 0x7f90f815b5f0 2023-03-30T08:12:03.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90f57fa700 1 -- 172.21.15.87:0/315650709 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f0004250 con 0x7f90f815b5f0 2023-03-30T08:12:03.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90f57fa700 1 -- 172.21.15.87:0/315650709 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f0004600 con 0x7f90f815b5f0 2023-03-30T08:12:03.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd93e700 1 -- 172.21.15.87:0/315650709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f0009b30 con 0x7f90f815b5f0 2023-03-30T08:12:03.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.615+0000 7f90fd93e700 1 -- 172.21.15.87:0/315650709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f80cf480 con 0x7f90f815b5f0 2023-03-30T08:12:03.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.619+0000 7f90fd93e700 1 -- 172.21.15.87:0/315650709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f80cf1a0 con 0x7f90f815b5f0 2023-03-30T08:12:03.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.619+0000 7f90f57fa700 1 -- 172.21.15.87:0/315650709 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f90f0004760 con 0x7f90f815b5f0 2023-03-30T08:12:03.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.619+0000 7f90f57fa700 1 --2- 172.21.15.87:0/315650709 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f90dc0653f0 0x7f90dc0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:03.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.623+0000 7f90f57fa700 1 -- 172.21.15.87:0/315650709 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f90f0083c90 con 0x7f90f815b5f0 2023-03-30T08:12:03.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.623+0000 7f90fc93c700 1 --2- 172.21.15.87:0/315650709 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f90dc0653f0 0x7f90dc0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:03.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.623+0000 7f90fc93c700 1 --2- 172.21.15.87:0/315650709 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f90dc0653f0 0x7f90dc0678a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009c90 tx=0x7f90ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:03.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.631+0000 7f90f57fa700 1 -- 172.21.15.87:0/315650709 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f90f00515f0 con 0x7f90f815b5f0 2023-03-30T08:12:03.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:03.835+0000 7f90fd93e700 1 -- 172.21.15.87:0/315650709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f90f8072cf0 con 0x7f90f815b5f0 2023-03-30T08:12:04.350 INFO:tasks.ceph.mon.a.smithi087.stderr:2023-03-30T08:12:04.343+0000 7f988c1f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-03-30T08:12:04.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.359+0000 7f90f57fa700 1 -- 172.21.15.87:0/315650709 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f90f0029090 con 0x7f90f815b5f0 2023-03-30T08:12:04.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.363+0000 7f90fd93e700 1 -- 172.21.15.87:0/315650709 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f90dc0653f0 msgr2=0x7f90dc0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:04.369 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.363+0000 7f90fd93e700 1 --2- 172.21.15.87:0/315650709 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f90dc0653f0 0x7f90dc0678a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009c90 tx=0x7f90ec008040 comp rx=0 tx=0).stop 2023-03-30T08:12:04.369 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.363+0000 7f90fd93e700 1 -- 172.21.15.87:0/315650709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90f815b5f0 msgr2=0x7f90f80cbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:04.369 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.363+0000 7f90fd93e700 1 --2- 172.21.15.87:0/315650709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90f815b5f0 0x7f90f80cbdf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f90f808bd10 tx=0x7f90f0004af0 comp rx=0 tx=0).stop 2023-03-30T08:12:04.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.363+0000 7f90fd93e700 1 -- 172.21.15.87:0/315650709 shutdown_connections 2023-03-30T08:12:04.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.363+0000 7f90fd93e700 1 --2- 172.21.15.87:0/315650709 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f90dc0653f0 0x7f90dc0678a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:04.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.363+0000 7f90fd93e700 1 --2- 172.21.15.87:0/315650709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90f815b5f0 0x7f90f80cbdf0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:04.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.363+0000 7f90fd93e700 1 --2- 172.21.15.87:0/315650709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90f81609f0 0x7f90f81f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:04.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.363+0000 7f90fd93e700 1 --2- 172.21.15.87:0/315650709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90f80b8380 0x7f90f815ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:04.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.363+0000 7f90fd93e700 1 -- 172.21.15.87:0/315650709 >> 172.21.15.87:0/315650709 conn(0x7f90f80b53f0 msgr2=0x7f90f8069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:04.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.363+0000 7f90fd93e700 1 -- 172.21.15.87:0/315650709 shutdown_connections 2023-03-30T08:12:04.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.363+0000 7f90fd93e700 1 -- 172.21.15.87:0/315650709 wait complete. 2023-03-30T08:12:04.371 INFO:teuthology.orchestra.run.smithi087.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-03-30T08:12:04.379 INFO:tasks.ceph.mds.b.smithi115.stderr: -4810> 2023-03-30T08:11:04.034+0000 7f9a34a69700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-30T08:12:04.391 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-03-30T08:12:04.433 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-03-30T08:12:04.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.559+0000 7f18deba1700 1 Processor -- start 2023-03-30T08:12:04.567 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.559+0000 7f18deba1700 1 -- start start 2023-03-30T08:12:04.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18deba1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18d8163dc0 0x7f18d80c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:04.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18deba1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d8069f00 con 0x7f18d80aea30 2023-03-30T08:12:04.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18deba1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d806cf70 con 0x7f18d8164190 2023-03-30T08:12:04.568 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18deba1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d806d810 con 0x7f18d8163dc0 2023-03-30T08:12:04.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18de3a0700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f18d80aea30 0x7f18d806a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44390/0 (socket says 172.21.15.87:44390) 2023-03-30T08:12:04.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18de3a0700 1 -- 172.21.15.87:0/274853745 learned_addr learned my addr 172.21.15.87:0/274853745 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:04.569 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18ddb9f700 1 --2- 172.21.15.87:0/274853745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18d8163dc0 0x7f18d80c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:04.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18dcb9d700 1 -- 172.21.15.87:0/274853745 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603043157 0 0) 0x7f18d8069f00 con 0x7f18d80aea30 2023-03-30T08:12:04.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18dcb9d700 1 -- 172.21.15.87:0/274853745 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18c40035d0 con 0x7f18d80aea30 2023-03-30T08:12:04.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18dcb9d700 1 -- 172.21.15.87:0/274853745 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278154441 0 0) 0x7f18d806cf70 con 0x7f18d8164190 2023-03-30T08:12:04.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18ddb9f700 1 -- 172.21.15.87:0/274853745 >> v1:172.21.15.115:6789/0 conn(0x7f18d8164190 legacy=0x7f18d80c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:04.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18ddb9f700 1 -- 172.21.15.87:0/274853745 >> v1:172.21.15.87:6789/0 conn(0x7f18d80aea30 legacy=0x7f18d806a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:04.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18ddb9f700 1 -- 172.21.15.87:0/274853745 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d806d250 con 0x7f18d8163dc0 2023-03-30T08:12:04.571 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18ddb9f700 1 --2- 172.21.15.87:0/274853745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18d8163dc0 0x7f18d80c95c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009880 tx=0x7f18d4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15352c02d6e49946 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:04.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18dcb9d700 1 -- 172.21.15.87:0/274853745 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d4011830 con 0x7f18d8163dc0 2023-03-30T08:12:04.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18dcb9d700 1 -- 172.21.15.87:0/274853745 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d4011990 con 0x7f18d8163dc0 2023-03-30T08:12:04.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.563+0000 7f18dcb9d700 1 -- 172.21.15.87:0/274853745 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d4011d20 con 0x7f18d8163dc0 2023-03-30T08:12:04.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.567+0000 7f18deba1700 1 -- 172.21.15.87:0/274853745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18d8163dc0 msgr2=0x7f18d80c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:04.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.567+0000 7f18deba1700 1 --2- 172.21.15.87:0/274853745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18d8163dc0 0x7f18d80c95c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009880 tx=0x7f18d4009b90 comp rx=0 tx=0).stop 2023-03-30T08:12:04.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.567+0000 7f18deba1700 1 -- 172.21.15.87:0/274853745 shutdown_connections 2023-03-30T08:12:04.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.567+0000 7f18deba1700 1 --2- 172.21.15.87:0/274853745 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18d8163dc0 0x7f18d80c95c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:04.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.567+0000 7f18deba1700 1 -- 172.21.15.87:0/274853745 >> 172.21.15.87:0/274853745 conn(0x7f18d80cf410 msgr2=0x7f18d80cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:04.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.567+0000 7f18deba1700 1 -- 172.21.15.87:0/274853745 shutdown_connections 2023-03-30T08:12:04.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.567+0000 7f18deba1700 1 -- 172.21.15.87:0/274853745 wait complete. 2023-03-30T08:12:04.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.567+0000 7f18deba1700 1 Processor -- start 2023-03-30T08:12:04.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.567+0000 7f18deba1700 1 -- start start 2023-03-30T08:12:04.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18deba1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18d80aea30 0x7f18d80c0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:04.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18deba1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18d8163dc0 0x7f18d8158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:04.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18deba1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18d8164190 0x7f18d80b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:04.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18deba1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d815b890 con 0x7f18d8163dc0 2023-03-30T08:12:04.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18deba1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d8158ed0 con 0x7f18d80aea30 2023-03-30T08:12:04.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18deba1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d81591b0 con 0x7f18d8164190 2023-03-30T08:12:04.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18dd39e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18d8163dc0 0x7f18d8158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:04.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18dd39e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18d8163dc0 0x7f18d8158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33698/0 (socket says 172.21.15.87:33698) 2023-03-30T08:12:04.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18dd39e700 1 -- 172.21.15.87:0/3847498678 learned_addr learned my addr 172.21.15.87:0/3847498678 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:04.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18ddb9f700 1 --2- 172.21.15.87:0/3847498678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18d80aea30 0x7f18d80c0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:04.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18de3a0700 1 --2- 172.21.15.87:0/3847498678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18d8164190 0x7f18d80b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18dd39e700 1 -- 172.21.15.87:0/3847498678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18d8164190 msgr2=0x7f18d80b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18dd39e700 1 --2- 172.21.15.87:0/3847498678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18d8164190 0x7f18d80b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18dd39e700 1 -- 172.21.15.87:0/3847498678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18d80aea30 msgr2=0x7f18d80c0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18dd39e700 1 --2- 172.21.15.87:0/3847498678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18d80aea30 0x7f18d80c0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18dd39e700 1 -- 172.21.15.87:0/3847498678 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d40094b0 con 0x7f18d8163dc0 2023-03-30T08:12:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18ddb9f700 1 --2- 172.21.15.87:0/3847498678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18d80aea30 0x7f18d80c0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18dd39e700 1 --2- 172.21.15.87:0/3847498678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18d8163dc0 0x7f18d8158560 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f18c8007fd0 tx=0x7f18c800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18ce7fc700 1 -- 172.21.15.87:0/3847498678 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c80054e0 con 0x7f18d8163dc0 2023-03-30T08:12:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18ce7fc700 1 -- 172.21.15.87:0/3847498678 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c80036a0 con 0x7f18d8163dc0 2023-03-30T08:12:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18deba1700 1 -- 172.21.15.87:0/3847498678 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d806cc40 con 0x7f18d8163dc0 2023-03-30T08:12:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18ce7fc700 1 -- 172.21.15.87:0/3847498678 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8003a50 con 0x7f18d8163dc0 2023-03-30T08:12:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.571+0000 7f18deba1700 1 -- 172.21.15.87:0/3847498678 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d806d530 con 0x7f18d8163dc0 2023-03-30T08:12:04.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.575+0000 7f18deba1700 1 -- 172.21.15.87:0/3847498678 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d80ca210 con 0x7f18d8163dc0 2023-03-30T08:12:04.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.575+0000 7f18ce7fc700 1 -- 172.21.15.87:0/3847498678 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f18c8003bb0 con 0x7f18d8163dc0 2023-03-30T08:12:04.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.579+0000 7f18ce7fc700 1 --2- 172.21.15.87:0/3847498678 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f18bc0653f0 0x7f18bc0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.579+0000 7f18ce7fc700 1 -- 172.21.15.87:0/3847498678 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f18c8081fe0 con 0x7f18d8163dc0 2023-03-30T08:12:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.579+0000 7f18ddb9f700 1 --2- 172.21.15.87:0/3847498678 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f18bc0653f0 0x7f18bc0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:04.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.579+0000 7f18ddb9f700 1 --2- 172.21.15.87:0/3847498678 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f18bc0653f0 0x7f18bc0678a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f18d4000c00 tx=0x7f18d401c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:04.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.583+0000 7f18ce7fc700 1 -- 172.21.15.87:0/3847498678 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f18c804f910 con 0x7f18d8163dc0 2023-03-30T08:12:04.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:04.791+0000 7f18deba1700 1 -- 172.21.15.87:0/3847498678 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f18d80733a0 con 0x7f18d8163dc0 2023-03-30T08:12:05.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.363+0000 7f18ce7fc700 1 -- 172.21.15.87:0/3847498678 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f18c8003e60 con 0x7f18d8163dc0 2023-03-30T08:12:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.367+0000 7f18deba1700 1 -- 172.21.15.87:0/3847498678 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f18bc0653f0 msgr2=0x7f18bc0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.367+0000 7f18deba1700 1 --2- 172.21.15.87:0/3847498678 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f18bc0653f0 0x7f18bc0678a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f18d4000c00 tx=0x7f18d401c040 comp rx=0 tx=0).stop 2023-03-30T08:12:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.367+0000 7f18deba1700 1 -- 172.21.15.87:0/3847498678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18d8163dc0 msgr2=0x7f18d8158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.367+0000 7f18deba1700 1 --2- 172.21.15.87:0/3847498678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18d8163dc0 0x7f18d8158560 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f18c8007fd0 tx=0x7f18c800c7e0 comp rx=0 tx=0).stop 2023-03-30T08:12:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.367+0000 7f18deba1700 1 -- 172.21.15.87:0/3847498678 shutdown_connections 2023-03-30T08:12:05.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.367+0000 7f18deba1700 1 --2- 172.21.15.87:0/3847498678 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f18bc0653f0 0x7f18bc0678a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.367+0000 7f18deba1700 1 --2- 172.21.15.87:0/3847498678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18d8164190 0x7f18d80b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.367+0000 7f18deba1700 1 --2- 172.21.15.87:0/3847498678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18d8163dc0 0x7f18d8158560 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.367+0000 7f18deba1700 1 --2- 172.21.15.87:0/3847498678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18d80aea30 0x7f18d80c0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.367+0000 7f18deba1700 1 -- 172.21.15.87:0/3847498678 >> 172.21.15.87:0/3847498678 conn(0x7f18d80cf410 msgr2=0x7f18d80aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:05.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.367+0000 7f18deba1700 1 -- 172.21.15.87:0/3847498678 shutdown_connections 2023-03-30T08:12:05.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.367+0000 7f18deba1700 1 -- 172.21.15.87:0/3847498678 wait complete. 2023-03-30T08:12:05.395 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-03-30T08:12:05.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.567+0000 7fb3f0091700 1 Processor -- start 2023-03-30T08:12:05.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.567+0000 7fb3f0091700 1 -- start start 2023-03-30T08:12:05.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3f0091700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3e815a460 0x7fb3e80cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:05.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3f0091700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb3e80b31e0 0x7fb3e80cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:05.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3f0091700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80b2620 0x7fb3e80b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:05.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3f0091700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e80cfcc0 con 0x7fb3e80b31e0 2023-03-30T08:12:05.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3f0091700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e80b2fc0 con 0x7fb3e815a460 2023-03-30T08:12:05.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3f0091700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80ce770 con 0x7fb3e80b2620 2023-03-30T08:12:05.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3ede2d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3e815a460 0x7fb3e80cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:05.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3ed62c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb3e80b31e0 0x7fb3e80cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:05.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3ee62e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80b2620 0x7fb3e80b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:05.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3ede2d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb3e815a460 0x7fb3e80cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:46960/0 (socket says 172.21.15.87:46960) 2023-03-30T08:12:05.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3ede2d700 1 -- 172.21.15.87:0/32896393 learned_addr learned my addr 172.21.15.87:0/32896393 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:05.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3ee62e700 1 -- 172.21.15.87:0/32896393 >> v2:172.21.15.115:3300/0 conn(0x7fb3e815a460 msgr2=0x7fb3e80cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:05.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3ee62e700 1 --2- 172.21.15.87:0/32896393 >> v2:172.21.15.115:3300/0 conn(0x7fb3e815a460 0x7fb3e80cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:05.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3ee62e700 1 -- 172.21.15.87:0/32896393 >> v2:172.21.15.87:3300/0 conn(0x7fb3e80b31e0 msgr2=0x7fb3e80cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:05.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3ee62e700 1 --2- 172.21.15.87:0/32896393 >> v2:172.21.15.87:3300/0 conn(0x7fb3e80b31e0 0x7fb3e80cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:05.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3ee62e700 1 -- 172.21.15.87:0/32896393 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e815a830 con 0x7fb3e80b2620 2023-03-30T08:12:05.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3ede2d700 1 --2- 172.21.15.87:0/32896393 >> v2:172.21.15.115:3300/0 conn(0x7fb3e815a460 0x7fb3e80cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:12:05.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.571+0000 7fb3ee62e700 1 --2- 172.21.15.87:0/32896393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80b2620 0x7fb3e80b2a80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80720d0 tx=0x7fb3e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd7f7aa2229dbc1b server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:05.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.575+0000 7fb3ece2b700 1 -- 172.21.15.87:0/32896393 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000e070 con 0x7fb3e80b2620 2023-03-30T08:12:05.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.575+0000 7fb3ece2b700 1 -- 172.21.15.87:0/32896393 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e000bae0 con 0x7fb3e80b2620 2023-03-30T08:12:05.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.575+0000 7fb3ece2b700 1 -- 172.21.15.87:0/32896393 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000be90 con 0x7fb3e80b2620 2023-03-30T08:12:05.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.575+0000 7fb3f0091700 1 -- 172.21.15.87:0/32896393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80b2620 msgr2=0x7fb3e80b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:05.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.575+0000 7fb3f0091700 1 --2- 172.21.15.87:0/32896393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80b2620 0x7fb3e80b2a80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80720d0 tx=0x7fb3e000b330 comp rx=0 tx=0).stop 2023-03-30T08:12:05.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.575+0000 7fb3f0091700 1 -- 172.21.15.87:0/32896393 shutdown_connections 2023-03-30T08:12:05.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.575+0000 7fb3f0091700 1 --2- 172.21.15.87:0/32896393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80b2620 0x7fb3e80b2a80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:05.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.575+0000 7fb3f0091700 1 --2- 172.21.15.87:0/32896393 >> v2:172.21.15.87:3300/0 conn(0x7fb3e80b31e0 0x7fb3e80cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:05.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.575+0000 7fb3f0091700 1 --2- 172.21.15.87:0/32896393 >> v2:172.21.15.115:3300/0 conn(0x7fb3e815a460 0x7fb3e80cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:05.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.575+0000 7fb3f0091700 1 -- 172.21.15.87:0/32896393 >> 172.21.15.87:0/32896393 conn(0x7fb3e806e6f0 msgr2=0x7fb3e806eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:05.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.575+0000 7fb3f0091700 1 -- 172.21.15.87:0/32896393 shutdown_connections 2023-03-30T08:12:05.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.575+0000 7fb3f0091700 1 -- 172.21.15.87:0/32896393 wait complete. 2023-03-30T08:12:05.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3f0091700 1 Processor -- start 2023-03-30T08:12:05.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3f0091700 1 -- start start 2023-03-30T08:12:05.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3f0091700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3e80b2620 0x7fb3e815aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:05.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3f0091700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80b31e0 0x7fb3e8157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:05.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3f0091700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3e815a460 0x7fb3e80c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:05.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3f0091700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e815bdc0 con 0x7fb3e80b2620 2023-03-30T08:12:05.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3f0091700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80c53b0 con 0x7fb3e815a460 2023-03-30T08:12:05.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3f0091700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e815b140 con 0x7fb3e80b31e0 2023-03-30T08:12:05.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3ede2d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3e80b2620 0x7fb3e815aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:05.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3ede2d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3e80b2620 0x7fb3e815aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33718/0 (socket says 172.21.15.87:33718) 2023-03-30T08:12:05.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3ede2d700 1 -- 172.21.15.87:0/1622636155 learned_addr learned my addr 172.21.15.87:0/1622636155 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:05.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3ee62e700 1 --2- 172.21.15.87:0/1622636155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3e815a460 0x7fb3e80c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:05.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3ed62c700 1 --2- 172.21.15.87:0/1622636155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80b31e0 0x7fb3e8157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:05.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3ede2d700 1 -- 172.21.15.87:0/1622636155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80b31e0 msgr2=0x7fb3e8157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3ede2d700 1 --2- 172.21.15.87:0/1622636155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80b31e0 0x7fb3e8157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3ede2d700 1 -- 172.21.15.87:0/1622636155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3e815a460 msgr2=0x7fb3e80c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3ede2d700 1 --2- 172.21.15.87:0/1622636155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3e815a460 0x7fb3e80c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3ede2d700 1 -- 172.21.15.87:0/1622636155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e4009570 con 0x7fb3e80b2620 2023-03-30T08:12:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.579+0000 7fb3ede2d700 1 --2- 172.21.15.87:0/1622636155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3e80b2620 0x7fb3e815aa40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400ebe0 tx=0x7fb3e400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.583+0000 7fb3de7fc700 1 -- 172.21.15.87:0/1622636155 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400c850 con 0x7fb3e80b2620 2023-03-30T08:12:05.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.583+0000 7fb3de7fc700 1 -- 172.21.15.87:0/1622636155 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e400c9b0 con 0x7fb3e80b2620 2023-03-30T08:12:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.583+0000 7fb3f0091700 1 -- 172.21.15.87:0/1622636155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e0009a70 con 0x7fb3e80b2620 2023-03-30T08:12:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.583+0000 7fb3de7fc700 1 -- 172.21.15.87:0/1622636155 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400cd20 con 0x7fb3e80b2620 2023-03-30T08:12:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.583+0000 7fb3f0091700 1 -- 172.21.15.87:0/1622636155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e80ceca0 con 0x7fb3e80b2620 2023-03-30T08:12:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.583+0000 7fb3f0091700 1 -- 172.21.15.87:0/1622636155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e80ce9c0 con 0x7fb3e80b2620 2023-03-30T08:12:05.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.583+0000 7fb3de7fc700 1 -- 172.21.15.87:0/1622636155 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fb3e4013470 con 0x7fb3e80b2620 2023-03-30T08:12:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.587+0000 7fb3de7fc700 1 --2- 172.21.15.87:0/1622636155 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3cc065420 0x7fb3cc0678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:05.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.587+0000 7fb3de7fc700 1 -- 172.21.15.87:0/1622636155 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fb3e4082bc0 con 0x7fb3e80b2620 2023-03-30T08:12:05.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.587+0000 7fb3ed62c700 1 --2- 172.21.15.87:0/1622636155 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3cc065420 0x7fb3cc0678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:05.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.587+0000 7fb3ed62c700 1 --2- 172.21.15.87:0/1622636155 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3cc065420 0x7fb3cc0678d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb3e81f6370 tx=0x7fb3d8009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:05.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.591+0000 7fb3de7fc700 1 -- 172.21.15.87:0/1622636155 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fb3e4050460 con 0x7fb3e80b2620 2023-03-30T08:12:05.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:05.763+0000 7fb3f0091700 1 -- 172.21.15.87:0/1622636155 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb3e815c030 con 0x7fb3e80b2620 2023-03-30T08:12:06.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.371+0000 7fb3de7fc700 1 -- 172.21.15.87:0/1622636155 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb3e4053a80 con 0x7fb3e80b2620 2023-03-30T08:12:06.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.379+0000 7fb3f0091700 1 -- 172.21.15.87:0/1622636155 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3cc065420 msgr2=0x7fb3cc0678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:06.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.379+0000 7fb3f0091700 1 --2- 172.21.15.87:0/1622636155 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3cc065420 0x7fb3cc0678d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb3e81f6370 tx=0x7fb3d8009240 comp rx=0 tx=0).stop 2023-03-30T08:12:06.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.379+0000 7fb3f0091700 1 -- 172.21.15.87:0/1622636155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3e80b2620 msgr2=0x7fb3e815aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:06.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.379+0000 7fb3f0091700 1 --2- 172.21.15.87:0/1622636155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3e80b2620 0x7fb3e815aa40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400ebe0 tx=0x7fb3e400eef0 comp rx=0 tx=0).stop 2023-03-30T08:12:06.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.379+0000 7fb3f0091700 1 -- 172.21.15.87:0/1622636155 shutdown_connections 2023-03-30T08:12:06.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.379+0000 7fb3f0091700 1 --2- 172.21.15.87:0/1622636155 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3cc065420 0x7fb3cc0678d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:06.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.379+0000 7fb3f0091700 1 --2- 172.21.15.87:0/1622636155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb3e815a460 0x7fb3e80c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:06.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.379+0000 7fb3f0091700 1 --2- 172.21.15.87:0/1622636155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb3e80b31e0 0x7fb3e8157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:06.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.379+0000 7fb3f0091700 1 --2- 172.21.15.87:0/1622636155 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb3e80b2620 0x7fb3e815aa40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:06.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.379+0000 7fb3f0091700 1 -- 172.21.15.87:0/1622636155 >> 172.21.15.87:0/1622636155 conn(0x7fb3e806e6f0 msgr2=0x7fb3e8158050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:06.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.379+0000 7fb3f0091700 1 -- 172.21.15.87:0/1622636155 shutdown_connections 2023-03-30T08:12:06.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.379+0000 7fb3f0091700 1 -- 172.21.15.87:0/1622636155 wait complete. 2023-03-30T08:12:06.394 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' removed 2023-03-30T08:12:06.410 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-03-30T08:12:06.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.571+0000 7f07d609b700 1 Processor -- start 2023-03-30T08:12:06.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.571+0000 7f07d609b700 1 -- start start 2023-03-30T08:12:06.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07d609b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f07d0160630 0x7f07d015d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:06.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07d609b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07d0160a00 0x7f07d0070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:06.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07d609b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d0070da0 con 0x7f07d0070960 2023-03-30T08:12:06.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07d609b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d00cc8f0 con 0x7f07d0160630 2023-03-30T08:12:06.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07d609b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00ccbd0 con 0x7f07d0160a00 2023-03-30T08:12:06.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07cf7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f07d0160630 0x7f07d015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:06.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07cf7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f07d0160630 0x7f07d015d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33722/0 (socket says 172.21.15.87:33722) 2023-03-30T08:12:06.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07cf7fe700 1 -- 172.21.15.87:0/3427829086 learned_addr learned my addr 172.21.15.87:0/3427829086 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:06.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07c7fff700 1 --2- 172.21.15.87:0/3427829086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07d0160a00 0x7f07d0070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:06.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07cf7fe700 1 -- 172.21.15.87:0/3427829086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07d0160a00 msgr2=0x7f07d0070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:06.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07cf7fe700 1 --2- 172.21.15.87:0/3427829086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07d0160a00 0x7f07d0070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:06.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07cf7fe700 1 -- 172.21.15.87:0/3427829086 >> v1:172.21.15.87:6789/0 conn(0x7f07d0070960 legacy=0x7f07d006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:06.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07cf7fe700 1 -- 172.21.15.87:0/3427829086 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d015cd90 con 0x7f07d0160630 2023-03-30T08:12:06.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07cf7fe700 1 --2- 172.21.15.87:0/3427829086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0160630 0x7f07d015d590 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f07c0009910 tx=0x7f07c0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01a6877cb1b110d server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:06.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07ceffd700 1 -- 172.21.15.87:0/3427829086 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c0011830 con 0x7f07d0160630 2023-03-30T08:12:06.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07ceffd700 1 -- 172.21.15.87:0/3427829086 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c0011990 con 0x7f07d0160630 2023-03-30T08:12:06.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.575+0000 7f07ceffd700 1 -- 172.21.15.87:0/3427829086 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c0011d40 con 0x7f07d0160630 2023-03-30T08:12:06.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.579+0000 7f07d609b700 1 -- 172.21.15.87:0/3427829086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0160630 msgr2=0x7f07d015d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:06.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.579+0000 7f07d609b700 1 --2- 172.21.15.87:0/3427829086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0160630 0x7f07d015d590 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f07c0009910 tx=0x7f07c0009c20 comp rx=0 tx=0).stop 2023-03-30T08:12:06.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.579+0000 7f07d609b700 1 -- 172.21.15.87:0/3427829086 shutdown_connections 2023-03-30T08:12:06.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.579+0000 7f07d609b700 1 --2- 172.21.15.87:0/3427829086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07d0160a00 0x7f07d0070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:06.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.579+0000 7f07d609b700 1 --2- 172.21.15.87:0/3427829086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0160630 0x7f07d015d590 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.579+0000 7f07d609b700 1 -- 172.21.15.87:0/3427829086 >> 172.21.15.87:0/3427829086 conn(0x7f07d00ce960 msgr2=0x7f07d00ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.579+0000 7f07d609b700 1 -- 172.21.15.87:0/3427829086 shutdown_connections 2023-03-30T08:12:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.579+0000 7f07d609b700 1 -- 172.21.15.87:0/3427829086 wait complete. 2023-03-30T08:12:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.579+0000 7f07d609b700 1 Processor -- start 2023-03-30T08:12:06.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.579+0000 7f07d609b700 1 -- start start 2023-03-30T08:12:06.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07d609b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0070960 0x7f07d01f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:06.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07d609b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07d0160630 0x7f07d00b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:06.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07d609b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07d0160a00 0x7f07d015ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:06.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07d609b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d01506c0 con 0x7f07d0070960 2023-03-30T08:12:06.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07d609b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00c2650 con 0x7f07d0160630 2023-03-30T08:12:06.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07d609b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00b4380 con 0x7f07d0160a00 2023-03-30T08:12:06.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07cf7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0070960 0x7f07d01f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:06.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07cf7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0070960 0x7f07d01f1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33730/0 (socket says 172.21.15.87:33730) 2023-03-30T08:12:06.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07cf7fe700 1 -- 172.21.15.87:0/3056654850 learned_addr learned my addr 172.21.15.87:0/3056654850 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:06.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07cffff700 1 --2- 172.21.15.87:0/3056654850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07d0160a00 0x7f07d015ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:06.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07c7fff700 1 --2- 172.21.15.87:0/3056654850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07d0160630 0x7f07d00b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:06.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07cf7fe700 1 -- 172.21.15.87:0/3056654850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07d0160a00 msgr2=0x7f07d015ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:06.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07cf7fe700 1 --2- 172.21.15.87:0/3056654850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07d0160a00 0x7f07d015ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:06.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07cf7fe700 1 -- 172.21.15.87:0/3056654850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07d0160630 msgr2=0x7f07d00b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:06.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07cf7fe700 1 --2- 172.21.15.87:0/3056654850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07d0160630 0x7f07d00b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:06.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07cf7fe700 1 -- 172.21.15.87:0/3056654850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c0009570 con 0x7f07d0070960 2023-03-30T08:12:06.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07cf7fe700 1 --2- 172.21.15.87:0/3056654850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0070960 0x7f07d01f1920 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f07d006e880 tx=0x7f07c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:06.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07ccff9700 1 -- 172.21.15.87:0/3056654850 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c0004510 con 0x7f07d0070960 2023-03-30T08:12:06.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07ccff9700 1 -- 172.21.15.87:0/3056654850 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c00036c0 con 0x7f07d0070960 2023-03-30T08:12:06.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07d609b700 1 -- 172.21.15.87:0/3056654850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d015ca80 con 0x7f07d0070960 2023-03-30T08:12:06.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07ccff9700 1 -- 172.21.15.87:0/3056654850 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c0003a70 con 0x7f07d0070960 2023-03-30T08:12:06.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.583+0000 7f07d609b700 1 -- 172.21.15.87:0/3056654850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d015d070 con 0x7f07d0070960 2023-03-30T08:12:06.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.587+0000 7f07d609b700 1 -- 172.21.15.87:0/3056654850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d0160e30 con 0x7f07d0070960 2023-03-30T08:12:06.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.587+0000 7f07ccff9700 1 -- 172.21.15.87:0/3056654850 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f07c0003bd0 con 0x7f07d0070960 2023-03-30T08:12:06.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.587+0000 7f07ccff9700 1 --2- 172.21.15.87:0/3056654850 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f07b0065420 0x7f07b00678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:06.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.587+0000 7f07ccff9700 1 -- 172.21.15.87:0/3056654850 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f07c0021030 con 0x7f07d0070960 2023-03-30T08:12:06.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.587+0000 7f07c7fff700 1 --2- 172.21.15.87:0/3056654850 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f07b0065420 0x7f07b00678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:06.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.591+0000 7f07c7fff700 1 --2- 172.21.15.87:0/3056654850 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f07b0065420 0x7f07b00678d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f07d00ae120 tx=0x7f07b8009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:06.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.595+0000 7f07ccff9700 1 -- 172.21.15.87:0/3056654850 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f07c0051be0 con 0x7f07d0070960 2023-03-30T08:12:06.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:06.771+0000 7f07d609b700 1 -- 172.21.15.87:0/3056654850 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f07d0073ee0 con 0x7f07d0070960 2023-03-30T08:12:07.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.379+0000 7f07ccff9700 1 -- 172.21.15.87:0/3056654850 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7f07c0055200 con 0x7f07d0070960 2023-03-30T08:12:07.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.383+0000 7f07d609b700 1 -- 172.21.15.87:0/3056654850 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f07b0065420 msgr2=0x7f07b00678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:07.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.383+0000 7f07d609b700 1 --2- 172.21.15.87:0/3056654850 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f07b0065420 0x7f07b00678d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f07d00ae120 tx=0x7f07b8009240 comp rx=0 tx=0).stop 2023-03-30T08:12:07.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.383+0000 7f07d609b700 1 -- 172.21.15.87:0/3056654850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0070960 msgr2=0x7f07d01f1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:07.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.383+0000 7f07d609b700 1 --2- 172.21.15.87:0/3056654850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0070960 0x7f07d01f1920 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f07d006e880 tx=0x7f07c0004770 comp rx=0 tx=0).stop 2023-03-30T08:12:07.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.383+0000 7f07d609b700 1 -- 172.21.15.87:0/3056654850 shutdown_connections 2023-03-30T08:12:07.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.383+0000 7f07d609b700 1 --2- 172.21.15.87:0/3056654850 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f07b0065420 0x7f07b00678d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.383+0000 7f07d609b700 1 --2- 172.21.15.87:0/3056654850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07d0160a00 0x7f07d015ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.383+0000 7f07d609b700 1 --2- 172.21.15.87:0/3056654850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07d0160630 0x7f07d00b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.383+0000 7f07d609b700 1 --2- 172.21.15.87:0/3056654850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07d0070960 0x7f07d01f1920 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.383+0000 7f07d609b700 1 -- 172.21.15.87:0/3056654850 >> 172.21.15.87:0/3056654850 conn(0x7f07d00ce960 msgr2=0x7f07d00ab8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.383+0000 7f07d609b700 1 -- 172.21.15.87:0/3056654850 shutdown_connections 2023-03-30T08:12:07.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.383+0000 7f07d609b700 1 -- 172.21.15.87:0/3056654850 wait complete. 2023-03-30T08:12:07.393 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' removed 2023-03-30T08:12:07.411 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-03-30T08:12:07.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.583+0000 7f9f14f96700 1 Processor -- start 2023-03-30T08:12:07.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.583+0000 7f9f14f96700 1 -- start start 2023-03-30T08:12:07.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f14f96700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9f10070b30 0x7f9f100cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:07.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f14f96700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f100c8fb0 0x7f9f100cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:07.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f14f96700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1015e8c0 con 0x7f9f100b41c0 2023-03-30T08:12:07.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f14f96700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f1015ed50 con 0x7f9f10070b30 2023-03-30T08:12:07.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f14f96700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100c96b0 con 0x7f9f100c8fb0 2023-03-30T08:12:07.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f0e59c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9f100b41c0 0x7f9f10070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44414/0 (socket says 172.21.15.87:44414) 2023-03-30T08:12:07.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f0e59c700 1 -- 172.21.15.87:0/1872773532 learned_addr learned my addr 172.21.15.87:0/1872773532 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:07.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f0dd9b700 1 --2- 172.21.15.87:0/1872773532 >> v2:172.21.15.115:3300/0 conn(0x7f9f10070b30 0x7f9f100cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:07.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f0ed9d700 1 --2- 172.21.15.87:0/1872773532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f100c8fb0 0x7f9f100cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:07.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f0d59a700 1 -- 172.21.15.87:0/1872773532 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764844242 0 0) 0x7f9f1015e8c0 con 0x7f9f100b41c0 2023-03-30T08:12:07.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f0d59a700 1 -- 172.21.15.87:0/1872773532 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ef80035d0 con 0x7f9f100b41c0 2023-03-30T08:12:07.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f0dd9b700 1 -- 172.21.15.87:0/1872773532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f100c8fb0 msgr2=0x7f9f100cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:07.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f0dd9b700 1 --2- 172.21.15.87:0/1872773532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f100c8fb0 0x7f9f100cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:07.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f0dd9b700 1 -- 172.21.15.87:0/1872773532 >> v1:172.21.15.87:6789/0 conn(0x7f9f100b41c0 legacy=0x7f9f10070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:07.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f0dd9b700 1 -- 172.21.15.87:0/1872773532 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f100ce720 con 0x7f9f10070b30 2023-03-30T08:12:07.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f0dd9b700 1 --2- 172.21.15.87:0/1872773532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f10070b30 0x7f9f100cab10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009850 tx=0x7f9f04009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b77792c138c30c9 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:07.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f0d59a700 1 -- 172.21.15.87:0/1872773532 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f04011830 con 0x7f9f10070b30 2023-03-30T08:12:07.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f0d59a700 1 -- 172.21.15.87:0/1872773532 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f04011990 con 0x7f9f10070b30 2023-03-30T08:12:07.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.587+0000 7f9f0d59a700 1 -- 172.21.15.87:0/1872773532 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f04011d00 con 0x7f9f10070b30 2023-03-30T08:12:07.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.591+0000 7f9f14f96700 1 -- 172.21.15.87:0/1872773532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f10070b30 msgr2=0x7f9f100cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:07.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.591+0000 7f9f14f96700 1 --2- 172.21.15.87:0/1872773532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f10070b30 0x7f9f100cab10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009850 tx=0x7f9f04009b60 comp rx=0 tx=0).stop 2023-03-30T08:12:07.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.591+0000 7f9f14f96700 1 -- 172.21.15.87:0/1872773532 shutdown_connections 2023-03-30T08:12:07.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.591+0000 7f9f14f96700 1 --2- 172.21.15.87:0/1872773532 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f100c8fb0 0x7f9f100cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:07.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.591+0000 7f9f14f96700 1 --2- 172.21.15.87:0/1872773532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f10070b30 0x7f9f100cab10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:07.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.591+0000 7f9f14f96700 1 -- 172.21.15.87:0/1872773532 >> 172.21.15.87:0/1872773532 conn(0x7f9f100ce960 msgr2=0x7f9f100ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:07.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.591+0000 7f9f14f96700 1 -- 172.21.15.87:0/1872773532 shutdown_connections 2023-03-30T08:12:07.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.591+0000 7f9f14f96700 1 -- 172.21.15.87:0/1872773532 wait complete. 2023-03-30T08:12:07.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f14f96700 1 Processor -- start 2023-03-30T08:12:07.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f14f96700 1 -- start start 2023-03-30T08:12:07.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f14f96700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f10070b30 0x7f9f100c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:07.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f14f96700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f100b41c0 0x7f9f100acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:07.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f14f96700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f100c8fb0 0x7f9f10157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:07.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f14f96700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100c6010 con 0x7f9f10070b30 2023-03-30T08:12:07.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f14f96700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100c62f0 con 0x7f9f100c8fb0 2023-03-30T08:12:07.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f14f96700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100c65d0 con 0x7f9f100b41c0 2023-03-30T08:12:07.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f0e59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f10070b30 0x7f9f100c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:07.602 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f0e59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f10070b30 0x7f9f100c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33746/0 (socket says 172.21.15.87:33746) 2023-03-30T08:12:07.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f0e59c700 1 -- 172.21.15.87:0/1671546313 learned_addr learned my addr 172.21.15.87:0/1671546313 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:07.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f0ed9d700 1 --2- 172.21.15.87:0/1671546313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f100c8fb0 0x7f9f10157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:07.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f0dd9b700 1 --2- 172.21.15.87:0/1671546313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f100b41c0 0x7f9f100acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:07.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f0e59c700 1 -- 172.21.15.87:0/1671546313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f100b41c0 msgr2=0x7f9f100acba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:07.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f0e59c700 1 --2- 172.21.15.87:0/1671546313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f100b41c0 0x7f9f100acba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:07.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f0e59c700 1 -- 172.21.15.87:0/1671546313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f100c8fb0 msgr2=0x7f9f10157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:07.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f0e59c700 1 --2- 172.21.15.87:0/1671546313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f100c8fb0 0x7f9f10157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:07.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f0e59c700 1 -- 172.21.15.87:0/1671546313 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f040094b0 con 0x7f9f10070b30 2023-03-30T08:12:07.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.595+0000 7f9f0e59c700 1 --2- 172.21.15.87:0/1671546313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f10070b30 0x7f9f100c5a30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000c4f0 tx=0x7f9f0000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:07.604 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.599+0000 7f9efeffd700 1 -- 172.21.15.87:0/1671546313 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f00005d90 con 0x7f9f10070b30 2023-03-30T08:12:07.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.599+0000 7f9efeffd700 1 -- 172.21.15.87:0/1671546313 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f000070d0 con 0x7f9f10070b30 2023-03-30T08:12:07.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.599+0000 7f9efeffd700 1 -- 172.21.15.87:0/1671546313 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f00007440 con 0x7f9f10070b30 2023-03-30T08:12:07.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.599+0000 7f9f14f96700 1 -- 172.21.15.87:0/1671546313 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1015df90 con 0x7f9f10070b30 2023-03-30T08:12:07.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.599+0000 7f9f14f96700 1 -- 172.21.15.87:0/1671546313 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f100c93f0 con 0x7f9f10070b30 2023-03-30T08:12:07.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.599+0000 7f9f14f96700 1 -- 172.21.15.87:0/1671546313 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1015e250 con 0x7f9f10070b30 2023-03-30T08:12:07.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.599+0000 7f9efeffd700 1 -- 172.21.15.87:0/1671546313 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f9f000075a0 con 0x7f9f10070b30 2023-03-30T08:12:07.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.603+0000 7f9efeffd700 1 --2- 172.21.15.87:0/1671546313 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ef00653f0 0x7f9ef00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:07.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.603+0000 7f9efeffd700 1 -- 172.21.15.87:0/1671546313 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f9f00081cf0 con 0x7f9f10070b30 2023-03-30T08:12:07.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.603+0000 7f9f0dd9b700 1 --2- 172.21.15.87:0/1671546313 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ef00653f0 0x7f9ef00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:07.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.603+0000 7f9f0dd9b700 1 --2- 172.21.15.87:0/1671546313 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ef00653f0 0x7f9ef00678a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9f040090b0 tx=0x7f9f0401c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:07.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.607+0000 7f9efeffd700 1 -- 172.21.15.87:0/1671546313 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f9f0004a5e0 con 0x7f9f10070b30 2023-03-30T08:12:07.782 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:07.775+0000 7f9f14f96700 1 -- 172.21.15.87:0/1671546313 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9f10073ee0 con 0x7f9f10070b30 2023-03-30T08:12:08.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.399+0000 7f9efeffd700 1 -- 172.21.15.87:0/1671546313 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v34) v1 ==== 178+0+0 (secure 0 0 0) 0x7f9f000170d0 con 0x7f9f10070b30 2023-03-30T08:12:08.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.407+0000 7f9f14f96700 1 -- 172.21.15.87:0/1671546313 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ef00653f0 msgr2=0x7f9ef00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:08.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.407+0000 7f9f14f96700 1 --2- 172.21.15.87:0/1671546313 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ef00653f0 0x7f9ef00678a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9f040090b0 tx=0x7f9f0401c040 comp rx=0 tx=0).stop 2023-03-30T08:12:08.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.407+0000 7f9f14f96700 1 -- 172.21.15.87:0/1671546313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f10070b30 msgr2=0x7f9f100c5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:08.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.407+0000 7f9f14f96700 1 --2- 172.21.15.87:0/1671546313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f10070b30 0x7f9f100c5a30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000c4f0 tx=0x7f9f0000c8b0 comp rx=0 tx=0).stop 2023-03-30T08:12:08.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.407+0000 7f9f14f96700 1 -- 172.21.15.87:0/1671546313 shutdown_connections 2023-03-30T08:12:08.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.407+0000 7f9f14f96700 1 --2- 172.21.15.87:0/1671546313 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ef00653f0 0x7f9ef00678a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:08.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.407+0000 7f9f14f96700 1 --2- 172.21.15.87:0/1671546313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f100c8fb0 0x7f9f10157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:08.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.407+0000 7f9f14f96700 1 --2- 172.21.15.87:0/1671546313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f100b41c0 0x7f9f100acba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:08.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.407+0000 7f9f14f96700 1 --2- 172.21.15.87:0/1671546313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f10070b30 0x7f9f100c5a30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:08.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.407+0000 7f9f14f96700 1 -- 172.21.15.87:0/1671546313 >> 172.21.15.87:0/1671546313 conn(0x7f9f100ce960 msgr2=0x7f9f1006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:08.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.411+0000 7f9f14f96700 1 -- 172.21.15.87:0/1671546313 shutdown_connections 2023-03-30T08:12:08.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.411+0000 7f9f14f96700 1 -- 172.21.15.87:0/1671546313 wait complete. 2023-03-30T08:12:08.422 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data_ec' removed 2023-03-30T08:12:08.440 INFO:tasks.ceph.mds.a:Restarting daemon 2023-03-30T08:12:08.440 INFO:tasks.ceph.mds.a:Stopping old one... 2023-03-30T08:12:08.441 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-03-30T08:12:08.441 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T08:12:08.441 INFO:tasks.ceph.mds.c:Restarting daemon 2023-03-30T08:12:08.441 INFO:tasks.ceph.mds.c:Stopping old one... 2023-03-30T08:12:08.442 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-03-30T08:12:08.442 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T08:12:08.442 INFO:tasks.ceph.mds.b:Restarting daemon 2023-03-30T08:12:08.442 INFO:tasks.ceph.mds.b:Stopping old one... 2023-03-30T08:12:08.442 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-03-30T08:12:08.443 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T08:12:08.443 INFO:tasks.ceph.mds.d:Restarting daemon 2023-03-30T08:12:08.443 INFO:tasks.ceph.mds.d:Stopping old one... 2023-03-30T08:12:08.443 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-03-30T08:12:08.444 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T08:12:08.457 INFO:tasks.ceph.mds.a:Stopped 2023-03-30T08:12:08.457 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-03-30T08:12:08.459 INFO:tasks.ceph.mds.c:Stopped 2023-03-30T08:12:08.459 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-03-30T08:12:08.472 INFO:tasks.ceph.mds.b:Stopped 2023-03-30T08:12:08.472 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-03-30T08:12:08.473 INFO:tasks.ceph.mds.d:Stopped 2023-03-30T08:12:08.473 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-03-30T08:12:08.506 INFO:tasks.ceph.mds.a:Started 2023-03-30T08:12:08.507 DEBUG:teuthology.parallel:result is None 2023-03-30T08:12:08.510 INFO:tasks.ceph.mds.c:Started 2023-03-30T08:12:08.511 DEBUG:teuthology.parallel:result is None 2023-03-30T08:12:08.518 INFO:tasks.ceph.mds.b:Started 2023-03-30T08:12:08.518 DEBUG:teuthology.parallel:result is None 2023-03-30T08:12:08.522 INFO:tasks.ceph.mds.d:Started 2023-03-30T08:12:08.523 DEBUG:teuthology.parallel:result is None 2023-03-30T08:12:08.523 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-03-30T08:12:08.611 INFO:tasks.ceph.mds.a.smithi087.stdout:starting mds.a at 2023-03-30T08:12:08.611 INFO:tasks.ceph.mds.c.smithi087.stdout:starting mds.c at 2023-03-30T08:12:08.634 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-03-30T08:12:08.635 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-03-30T08:12:08.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.679+0000 7f29593ef700 1 Processor -- start 2023-03-30T08:12:08.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.679+0000 7f29593ef700 1 -- start start 2023-03-30T08:12:08.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.679+0000 7f29593ef700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f29540b0c10 0x7f29540aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:08.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.679+0000 7f29593ef700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295406b670 con 0x7f29540b3f30 2023-03-30T08:12:08.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.679+0000 7f29593ef700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295406b0b0 con 0x7f29540af180 2023-03-30T08:12:08.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.679+0000 7f29593ef700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29540b1090 con 0x7f29540b0c10 2023-03-30T08:12:08.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.679+0000 7f294bfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f29540b0c10 0x7f29540aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:08.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.679+0000 7f2953fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f29540b3f30 0x7f295406a6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:44448/0 (socket says 172.21.15.87:44448) 2023-03-30T08:12:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.679+0000 7f2953fff700 1 -- 172.21.15.87:0/397985562 learned_addr learned my addr 172.21.15.87:0/397985562 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.683+0000 7f294bfff700 1 -- 172.21.15.87:0/397985562 >> v1:172.21.15.115:6789/0 conn(0x7f29540af180 legacy=0x7f295406c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.683+0000 7f294bfff700 1 -- 172.21.15.87:0/397985562 >> v1:172.21.15.87:6789/0 conn(0x7f29540b3f30 legacy=0x7f295406a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.683+0000 7f294bfff700 1 -- 172.21.15.87:0/397985562 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295406b390 con 0x7f29540b0c10 2023-03-30T08:12:08.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.683+0000 7f29537fe700 1 -- 172.21.15.87:0/397985562 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812545626 0 0) 0x7f295406b0b0 con 0x7f29540af180 2023-03-30T08:12:08.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.683+0000 7f294bfff700 1 --2- 172.21.15.87:0/397985562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29540b0c10 0x7f29540aec40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f293c009850 tx=0x7f293c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9d84dd8c888d23 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:08.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.683+0000 7f29537fe700 1 -- 172.21.15.87:0/397985562 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c011830 con 0x7f29540b0c10 2023-03-30T08:12:08.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.683+0000 7f29537fe700 1 -- 172.21.15.87:0/397985562 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c011990 con 0x7f29540b0c10 2023-03-30T08:12:08.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.683+0000 7f29537fe700 1 -- 172.21.15.87:0/397985562 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c011d20 con 0x7f29540b0c10 2023-03-30T08:12:08.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.683+0000 7f29593ef700 1 -- 172.21.15.87:0/397985562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29540b0c10 msgr2=0x7f29540aec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:08.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.683+0000 7f29593ef700 1 --2- 172.21.15.87:0/397985562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29540b0c10 0x7f29540aec40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f293c009850 tx=0x7f293c009b60 comp rx=0 tx=0).stop 2023-03-30T08:12:08.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.683+0000 7f29593ef700 1 -- 172.21.15.87:0/397985562 shutdown_connections 2023-03-30T08:12:08.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.683+0000 7f29593ef700 1 --2- 172.21.15.87:0/397985562 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29540b0c10 0x7f29540aec40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:08.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.683+0000 7f29593ef700 1 -- 172.21.15.87:0/397985562 >> 172.21.15.87:0/397985562 conn(0x7f29540cf410 msgr2=0x7f29540cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:08.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.683+0000 7f29593ef700 1 -- 172.21.15.87:0/397985562 shutdown_connections 2023-03-30T08:12:08.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.683+0000 7f29593ef700 1 -- 172.21.15.87:0/397985562 wait complete. 2023-03-30T08:12:08.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f29593ef700 1 Processor -- start 2023-03-30T08:12:08.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f29593ef700 1 -- start start 2023-03-30T08:12:08.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f29593ef700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29540af180 0x7f29540c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:08.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f29593ef700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29540b0c10 0x7f2954158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:08.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f29593ef700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29540b3f30 0x7f29541f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:08.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f29593ef700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29540ca0c0 con 0x7f29540b3f30 2023-03-30T08:12:08.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f29593ef700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29540c67a0 con 0x7f29540b0c10 2023-03-30T08:12:08.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f29593ef700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29540c7a70 con 0x7f29540af180 2023-03-30T08:12:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f294bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29540b0c10 0x7f2954158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f294bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29540b0c10 0x7f2954158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:47032/0 (socket says 172.21.15.87:47032) 2023-03-30T08:12:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f294bfff700 1 -- 172.21.15.87:0/1400198190 learned_addr learned my addr 172.21.15.87:0/1400198190 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:08.695 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f2953fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29540af180 0x7f29540c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:08.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f2958bee700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29540b3f30 0x7f29541f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:08.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f294bfff700 1 -- 172.21.15.87:0/1400198190 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29540af180 msgr2=0x7f29540c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:08.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f294bfff700 1 --2- 172.21.15.87:0/1400198190 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29540af180 0x7f29540c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:08.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f294bfff700 1 -- 172.21.15.87:0/1400198190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29540b3f30 msgr2=0x7f29541f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:08.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f294bfff700 1 --2- 172.21.15.87:0/1400198190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29540b3f30 0x7f29541f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:08.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f294bfff700 1 -- 172.21.15.87:0/1400198190 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c0094b0 con 0x7f29540b0c10 2023-03-30T08:12:08.696 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f2958bee700 1 --2- 172.21.15.87:0/1400198190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29540b3f30 0x7f29541f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:08.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f294bfff700 1 --2- 172.21.15.87:0/1400198190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29540b0c10 0x7f2954158600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f293c014040 tx=0x7f293c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:08.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f29517fa700 1 -- 172.21.15.87:0/1400198190 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c00bb60 con 0x7f29540b0c10 2023-03-30T08:12:08.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.687+0000 7f29517fa700 1 -- 172.21.15.87:0/1400198190 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c01e070 con 0x7f29540b0c10 2023-03-30T08:12:08.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.691+0000 7f29517fa700 1 -- 172.21.15.87:0/1400198190 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c01a420 con 0x7f29540b0c10 2023-03-30T08:12:08.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.691+0000 7f29593ef700 1 -- 172.21.15.87:0/1400198190 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29540ae1b0 con 0x7f29540b0c10 2023-03-30T08:12:08.697 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.691+0000 7f29593ef700 1 -- 172.21.15.87:0/1400198190 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29540aded0 con 0x7f29540b0c10 2023-03-30T08:12:08.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.691+0000 7f29593ef700 1 -- 172.21.15.87:0/1400198190 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29540b4300 con 0x7f29540b0c10 2023-03-30T08:12:08.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.691+0000 7f29517fa700 1 -- 172.21.15.87:0/1400198190 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f293c01a580 con 0x7f29540b0c10 2023-03-30T08:12:08.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.695+0000 7f29517fa700 1 --2- 172.21.15.87:0/1400198190 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f29340653f0 0x7f29340678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:08.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.695+0000 7f29517fa700 1 -- 172.21.15.87:0/1400198190 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f293c083ab0 con 0x7f29540b0c10 2023-03-30T08:12:08.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.695+0000 7f2953fff700 1 --2- 172.21.15.87:0/1400198190 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f29340653f0 0x7f29340678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:08.700 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.695+0000 7f2953fff700 1 --2- 172.21.15.87:0/1400198190 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f29340653f0 0x7f29340678a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2944005930 tx=0x7f2944009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:08.705 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.699+0000 7f29517fa700 1 -- 172.21.15.87:0/1400198190 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f293c0518a0 con 0x7f29540b0c10 2023-03-30T08:12:08.893 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:08.887+0000 7f29593ef700 1 -- 172.21.15.87:0/1400198190 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f295415d6b0 con 0x7f29540b0c10 2023-03-30T08:12:09.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.679+0000 7f29517fa700 1 -- 172.21.15.87:0/1400198190 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) v1 ==== 97+0+0 (secure 0 0 0) 0x7f293c054ec0 con 0x7f29540b0c10 2023-03-30T08:12:09.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.683+0000 7f29593ef700 1 -- 172.21.15.87:0/1400198190 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f29340653f0 msgr2=0x7f29340678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:09.691 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.683+0000 7f29593ef700 1 --2- 172.21.15.87:0/1400198190 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f29340653f0 0x7f29340678a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2944005930 tx=0x7f2944009040 comp rx=0 tx=0).stop 2023-03-30T08:12:09.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.683+0000 7f29593ef700 1 -- 172.21.15.87:0/1400198190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29540b0c10 msgr2=0x7f2954158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:09.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.683+0000 7f29593ef700 1 --2- 172.21.15.87:0/1400198190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29540b0c10 0x7f2954158600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f293c014040 tx=0x7f293c004770 comp rx=0 tx=0).stop 2023-03-30T08:12:09.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.683+0000 7f29593ef700 1 -- 172.21.15.87:0/1400198190 shutdown_connections 2023-03-30T08:12:09.692 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.683+0000 7f29593ef700 1 --2- 172.21.15.87:0/1400198190 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f29340653f0 0x7f29340678a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:09.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.683+0000 7f29593ef700 1 --2- 172.21.15.87:0/1400198190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29540b3f30 0x7f29541f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:09.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.683+0000 7f29593ef700 1 --2- 172.21.15.87:0/1400198190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29540b0c10 0x7f2954158600 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:09.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.683+0000 7f29593ef700 1 --2- 172.21.15.87:0/1400198190 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29540af180 0x7f29540c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:09.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.683+0000 7f29593ef700 1 -- 172.21.15.87:0/1400198190 >> 172.21.15.87:0/1400198190 conn(0x7f29540cf410 msgr2=0x7f29540b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:09.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.687+0000 7f29593ef700 1 -- 172.21.15.87:0/1400198190 shutdown_connections 2023-03-30T08:12:09.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.687+0000 7f29593ef700 1 -- 172.21.15.87:0/1400198190 wait complete. 2023-03-30T08:12:09.695 INFO:teuthology.orchestra.run.smithi087.stderr: removed all blocklist entries 2023-03-30T08:12:09.712 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-03-30T08:12:09.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.867+0000 7fea8ac28700 1 Processor -- start 2023-03-30T08:12:09.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.867+0000 7fea8ac28700 1 -- start start 2023-03-30T08:12:09.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea8ac28700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fea84163dc0 0x7fea840c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:09.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea8ac28700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fea840aea30 0x7fea8406a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:09.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea8ac28700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea84069f00 con 0x7fea84164190 2023-03-30T08:12:09.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea8ac28700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8406d810 con 0x7fea840aea30 2023-03-30T08:12:09.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea8ac28700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea840cc1d0 con 0x7fea84163dc0 2023-03-30T08:12:09.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea8a427700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fea840aea30 0x7fea8406a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:09.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea8a427700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fea840aea30 0x7fea8406a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59430/0 (socket says 172.21.15.87:59430) 2023-03-30T08:12:09.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea8a427700 1 -- 172.21.15.87:0/1756161508 learned_addr learned my addr 172.21.15.87:0/1756161508 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:09.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea89c26700 1 --2- 172.21.15.87:0/1756161508 >> v2:172.21.15.115:3300/0 conn(0x7fea84163dc0 0x7fea840c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:09.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea8a427700 1 -- 172.21.15.87:0/1756161508 >> v2:172.21.15.115:3300/0 conn(0x7fea84163dc0 msgr2=0x7fea840c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:09.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea8a427700 1 --2- 172.21.15.87:0/1756161508 >> v2:172.21.15.115:3300/0 conn(0x7fea84163dc0 0x7fea840c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:09.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea8a427700 1 -- 172.21.15.87:0/1756161508 >> v1:172.21.15.115:6789/0 conn(0x7fea84164190 legacy=0x7fea840c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:09.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea8a427700 1 -- 172.21.15.87:0/1756161508 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8406cf70 con 0x7fea840aea30 2023-03-30T08:12:09.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea8a427700 1 --2- 172.21.15.87:0/1756161508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea840aea30 0x7fea8406a390 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fea840cba30 tx=0x7fea7c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62c72ac478ae7f4 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:09.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea88c24700 1 -- 172.21.15.87:0/1756161508 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c011830 con 0x7fea840aea30 2023-03-30T08:12:09.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea88c24700 1 -- 172.21.15.87:0/1756161508 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7c011990 con 0x7fea840aea30 2023-03-30T08:12:09.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.871+0000 7fea88c24700 1 -- 172.21.15.87:0/1756161508 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c011d20 con 0x7fea840aea30 2023-03-30T08:12:09.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.875+0000 7fea8ac28700 1 -- 172.21.15.87:0/1756161508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea840aea30 msgr2=0x7fea8406a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:09.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.875+0000 7fea8ac28700 1 --2- 172.21.15.87:0/1756161508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea840aea30 0x7fea8406a390 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fea840cba30 tx=0x7fea7c009bf0 comp rx=0 tx=0).stop 2023-03-30T08:12:09.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.875+0000 7fea8ac28700 1 -- 172.21.15.87:0/1756161508 shutdown_connections 2023-03-30T08:12:09.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.875+0000 7fea8ac28700 1 --2- 172.21.15.87:0/1756161508 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea840aea30 0x7fea8406a390 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:09.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.875+0000 7fea8ac28700 1 --2- 172.21.15.87:0/1756161508 >> v2:172.21.15.115:3300/0 conn(0x7fea84163dc0 0x7fea840c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:09.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.875+0000 7fea8ac28700 1 -- 172.21.15.87:0/1756161508 >> 172.21.15.87:0/1756161508 conn(0x7fea840cf410 msgr2=0x7fea840cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:09.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.875+0000 7fea8ac28700 1 -- 172.21.15.87:0/1756161508 shutdown_connections 2023-03-30T08:12:09.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.875+0000 7fea8ac28700 1 -- 172.21.15.87:0/1756161508 wait complete. 2023-03-30T08:12:09.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.875+0000 7fea8ac28700 1 Processor -- start 2023-03-30T08:12:09.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.875+0000 7fea8ac28700 1 -- start start 2023-03-30T08:12:09.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea8ac28700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea840aea30 0x7fea840c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:09.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea8ac28700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea84163dc0 0x7fea840cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:09.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea8ac28700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea84164190 0x7fea840ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:09.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea8ac28700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea840c47d0 con 0x7fea840aea30 2023-03-30T08:12:09.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea8ac28700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea840c51a0 con 0x7fea84163dc0 2023-03-30T08:12:09.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea8ac28700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea840b3e00 con 0x7fea84164190 2023-03-30T08:12:09.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea89c26700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea840aea30 0x7fea840c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:09.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea89c26700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea840aea30 0x7fea840c4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59440/0 (socket says 172.21.15.87:59440) 2023-03-30T08:12:09.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea89c26700 1 -- 172.21.15.87:0/3795026412 learned_addr learned my addr 172.21.15.87:0/3795026412 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:09.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea89425700 1 --2- 172.21.15.87:0/3795026412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea84163dc0 0x7fea840cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:09.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea8a427700 1 --2- 172.21.15.87:0/3795026412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea84164190 0x7fea840ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:09.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea89c26700 1 -- 172.21.15.87:0/3795026412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea84164190 msgr2=0x7fea840ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:09.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea89c26700 1 --2- 172.21.15.87:0/3795026412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea84164190 0x7fea840ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:09.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea89c26700 1 -- 172.21.15.87:0/3795026412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea84163dc0 msgr2=0x7fea840cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:09.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea89c26700 1 --2- 172.21.15.87:0/3795026412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea84163dc0 0x7fea840cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:09.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea89c26700 1 -- 172.21.15.87:0/3795026412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c009570 con 0x7fea840aea30 2023-03-30T08:12:09.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea89425700 1 --2- 172.21.15.87:0/3795026412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea84163dc0 0x7fea840cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:09.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea89c26700 1 --2- 172.21.15.87:0/3795026412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea840aea30 0x7fea840c4c60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fea8000efc0 tx=0x7fea8000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:09.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea7a7fc700 1 -- 172.21.15.87:0/3795026412 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8000cdc0 con 0x7fea840aea30 2023-03-30T08:12:09.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea7a7fc700 1 -- 172.21.15.87:0/3795026412 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8000f040 con 0x7fea840aea30 2023-03-30T08:12:09.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea7a7fc700 1 -- 172.21.15.87:0/3795026412 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea800146a0 con 0x7fea840aea30 2023-03-30T08:12:09.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea8ac28700 1 -- 172.21.15.87:0/3795026412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8406d530 con 0x7fea840aea30 2023-03-30T08:12:09.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.879+0000 7fea8ac28700 1 -- 172.21.15.87:0/3795026412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8406d250 con 0x7fea840aea30 2023-03-30T08:12:09.888 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.883+0000 7fea8ac28700 1 -- 172.21.15.87:0/3795026412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8406cc40 con 0x7fea840aea30 2023-03-30T08:12:09.888 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.883+0000 7fea7a7fc700 1 -- 172.21.15.87:0/3795026412 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fea80014800 con 0x7fea840aea30 2023-03-30T08:12:09.890 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.883+0000 7fea7a7fc700 1 --2- 172.21.15.87:0/3795026412 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fea68065420 0x7fea680678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:09.890 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.883+0000 7fea7a7fc700 1 -- 172.21.15.87:0/3795026412 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fea80082fd0 con 0x7fea840aea30 2023-03-30T08:12:09.890 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.883+0000 7fea89425700 1 --2- 172.21.15.87:0/3795026412 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fea68065420 0x7fea680678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:09.891 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.887+0000 7fea89425700 1 --2- 172.21.15.87:0/3795026412 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fea68065420 0x7fea680678d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fea841f9470 tx=0x7fea74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:09.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:09.891+0000 7fea7a7fc700 1 -- 172.21.15.87:0/3795026412 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fea80050dc0 con 0x7fea840aea30 2023-03-30T08:12:10.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.119+0000 7fea8ac28700 1 -- 172.21.15.87:0/3795026412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fea840733a0 con 0x7fea840aea30 2023-03-30T08:12:10.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.119+0000 7fea7a7fc700 1 -- 172.21.15.87:0/3795026412 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fea800543e0 con 0x7fea840aea30 2023-03-30T08:12:10.126 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:10.126 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-03-30T08:12:10.127 INFO:teuthology.orchestra.run.smithi087.stdout: "auth_dump": [ 2023-03-30T08:12:10.127 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.127 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mds.a", 2023-03-30T08:12:10.127 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDJQyVk0WR9CxAAj/HIs03b3UXC15TDyV0CaA==", 2023-03-30T08:12:10.127 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.127 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2023-03-30T08:12:10.127 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow *", 2023-03-30T08:12:10.127 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow *", 2023-03-30T08:12:10.128 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2023-03-30T08:12:10.128 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.128 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.128 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mds.b", 2023-03-30T08:12:10.128 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDJQyVkR7dkHBAAumpXy9u42c6ZvzCalEM3sg==", 2023-03-30T08:12:10.128 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.129 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2023-03-30T08:12:10.129 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow *", 2023-03-30T08:12:10.129 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow *", 2023-03-30T08:12:10.129 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2023-03-30T08:12:10.129 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.129 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.129 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.129 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mds.c", 2023-03-30T08:12:10.130 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDJQyVkh+ZaFRAApqwS1KDVviRnfcCyWNbXfw==", 2023-03-30T08:12:10.130 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.130 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2023-03-30T08:12:10.130 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow *", 2023-03-30T08:12:10.130 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow *", 2023-03-30T08:12:10.130 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2023-03-30T08:12:10.130 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.131 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.131 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mds.d", 2023-03-30T08:12:10.131 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDJQyVku/n0JRAAR0LtRbpx7xhVdVUy0Ec/Rw==", 2023-03-30T08:12:10.131 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.131 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2023-03-30T08:12:10.131 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow *", 2023-03-30T08:12:10.131 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow *", 2023-03-30T08:12:10.131 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2023-03-30T08:12:10.132 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.132 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.132 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.0", 2023-03-30T08:12:10.132 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDNQyVk3t/KDRAAh/doqkDA3saU0oO544Mk5g==", 2023-03-30T08:12:10.132 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.132 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2023-03-30T08:12:10.132 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2023-03-30T08:12:10.133 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2023-03-30T08:12:10.133 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.133 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.133 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.1", 2023-03-30T08:12:10.133 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDQQyVkgFHVKhAAoI+x0IEyJRJpYzmumBSS3w==", 2023-03-30T08:12:10.133 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.134 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2023-03-30T08:12:10.134 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2023-03-30T08:12:10.134 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2023-03-30T08:12:10.134 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.134 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.134 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.2", 2023-03-30T08:12:10.134 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDTQyVk/FcBOBAArHHqtrurl0tNY2NGAXYJkQ==", 2023-03-30T08:12:10.135 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.135 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2023-03-30T08:12:10.135 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2023-03-30T08:12:10.135 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2023-03-30T08:12:10.135 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.135 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.135 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.135 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.3", 2023-03-30T08:12:10.136 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDXQyVkZjZVBxAAy0yM9R+WaLryuRU5lQkJDQ==", 2023-03-30T08:12:10.136 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.136 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2023-03-30T08:12:10.136 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2023-03-30T08:12:10.136 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2023-03-30T08:12:10.136 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.136 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.136 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.137 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.4", 2023-03-30T08:12:10.137 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDdQyVkLNSyHBAARL8uqcpJ5VbML5RcJ+AyeQ==", 2023-03-30T08:12:10.137 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.137 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2023-03-30T08:12:10.137 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2023-03-30T08:12:10.137 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2023-03-30T08:12:10.137 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.138 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.138 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.5", 2023-03-30T08:12:10.138 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDgQyVk4uUhORAA3HcnlsCRhwvSczD5OK4OHA==", 2023-03-30T08:12:10.138 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.138 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2023-03-30T08:12:10.138 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2023-03-30T08:12:10.138 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2023-03-30T08:12:10.139 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.139 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.139 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.6", 2023-03-30T08:12:10.139 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDkQyVkTNebCRAAQYG63wHseBzO1wkAnKNu7w==", 2023-03-30T08:12:10.139 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.139 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2023-03-30T08:12:10.139 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2023-03-30T08:12:10.140 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2023-03-30T08:12:10.140 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.140 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.140 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "osd.7", 2023-03-30T08:12:10.140 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDnQyVkPfeGFRAAcTAO00ne03UYnUkareUf+w==", 2023-03-30T08:12:10.140 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.140 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow profile osd", 2023-03-30T08:12:10.141 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile osd", 2023-03-30T08:12:10.141 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2023-03-30T08:12:10.141 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.141 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.141 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.0", 2023-03-30T08:12:10.141 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDJQyVkPcl4LBAA1G96+FCw7jee5PlqiYhJvA==", 2023-03-30T08:12:10.141 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.142 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2023-03-30T08:12:10.142 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow r", 2023-03-30T08:12:10.142 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow rw", 2023-03-30T08:12:10.142 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow rwx" 2023-03-30T08:12:10.142 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.142 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.143 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.1", 2023-03-30T08:12:10.143 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDJQyVkBMQKNxAAWgehKxymjV6O8weU+9S5Eg==", 2023-03-30T08:12:10.143 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.143 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2023-03-30T08:12:10.143 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow r", 2023-03-30T08:12:10.143 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow rw", 2023-03-30T08:12:10.143 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow rwx" 2023-03-30T08:12:10.143 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.144 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.144 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.2", 2023-03-30T08:12:10.144 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDJQyVkpL2MMRAA8UBOCuP918a/KC992r1juw==", 2023-03-30T08:12:10.144 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.144 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2023-03-30T08:12:10.144 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow r", 2023-03-30T08:12:10.144 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow rw", 2023-03-30T08:12:10.145 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow rwx" 2023-03-30T08:12:10.145 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.145 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.145 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.3", 2023-03-30T08:12:10.145 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDKQyVke/jMABAAEjw6oKtbehX4O1cQtW3Aew==", 2023-03-30T08:12:10.145 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.145 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow", 2023-03-30T08:12:10.146 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow r", 2023-03-30T08:12:10.146 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow rw", 2023-03-30T08:12:10.146 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow rwx" 2023-03-30T08:12:10.146 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.147 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.admin", 2023-03-30T08:12:10.147 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ==", 2023-03-30T08:12:10.147 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.147 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow *", 2023-03-30T08:12:10.148 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr": "allow *", 2023-03-30T08:12:10.148 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow *", 2023-03-30T08:12:10.148 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2023-03-30T08:12:10.148 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.148 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.148 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.bootstrap-mds", 2023-03-30T08:12:10.149 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQD4QyVkfllRCxAAaBnMoQoMBEIMdMBTrpLaNw==", 2023-03-30T08:12:10.149 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.149 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile bootstrap-mds" 2023-03-30T08:12:10.149 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.150 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.150 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.bootstrap-mgr", 2023-03-30T08:12:10.150 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQD4QyVkPWhRCxAAluxSHaGPXQI4YdD8CcfH/w==", 2023-03-30T08:12:10.151 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.151 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile bootstrap-mgr" 2023-03-30T08:12:10.151 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.152 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.152 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.bootstrap-osd", 2023-03-30T08:12:10.152 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQD4QyVk7XlRCxAA6NkZYINxoz3n/Yec2XE2Fw==", 2023-03-30T08:12:10.152 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.152 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile bootstrap-osd" 2023-03-30T08:12:10.152 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.153 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.153 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.bootstrap-rbd", 2023-03-30T08:12:10.153 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQD4QyVkpYZRCxAAqNGNgRc51LkfGtnSlTS6Vg==", 2023-03-30T08:12:10.153 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.154 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile bootstrap-rbd" 2023-03-30T08:12:10.154 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.154 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-03-30T08:12:10.154 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQD4QyVkG5NRCxAAQ7a3a6klSDbo63yRyjg7Vg==", 2023-03-30T08:12:10.154 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.155 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-03-30T08:12:10.155 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.155 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.155 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "client.bootstrap-rgw", 2023-03-30T08:12:10.155 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQD4QyVkkZ9RCxAAcC2hcwVlc4UNl4v2ATOahA==", 2023-03-30T08:12:10.155 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.155 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile bootstrap-rgw" 2023-03-30T08:12:10.156 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.156 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.156 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mgr.x", 2023-03-30T08:12:10.156 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDJQyVkddVHBBAAutK10mLMZo/MHWelsabqLQ==", 2023-03-30T08:12:10.156 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.156 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow *", 2023-03-30T08:12:10.156 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile mgr", 2023-03-30T08:12:10.157 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2023-03-30T08:12:10.157 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:10.157 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:10.157 INFO:teuthology.orchestra.run.smithi087.stdout: "entity": "mgr.y", 2023-03-30T08:12:10.157 INFO:teuthology.orchestra.run.smithi087.stdout: "key": "AQDIQyVkxu/5ORAAZ9z8upF22mTFxeHf8EuesQ==", 2023-03-30T08:12:10.157 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": { 2023-03-30T08:12:10.158 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": "allow *", 2023-03-30T08:12:10.158 INFO:teuthology.orchestra.run.smithi087.stdout: "mon": "allow profile mgr", 2023-03-30T08:12:10.158 INFO:teuthology.orchestra.run.smithi087.stdout: "osd": "allow *" 2023-03-30T08:12:10.158 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.158 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:10.158 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2023-03-30T08:12:10.158 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-03-30T08:12:10.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.123+0000 7fea8ac28700 1 -- 172.21.15.87:0/3795026412 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fea68065420 msgr2=0x7fea680678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:10.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.123+0000 7fea8ac28700 1 --2- 172.21.15.87:0/3795026412 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fea68065420 0x7fea680678d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fea841f9470 tx=0x7fea74009040 comp rx=0 tx=0).stop 2023-03-30T08:12:10.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.123+0000 7fea8ac28700 1 -- 172.21.15.87:0/3795026412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea840aea30 msgr2=0x7fea840c4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:10.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.123+0000 7fea8ac28700 1 --2- 172.21.15.87:0/3795026412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea840aea30 0x7fea840c4c60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fea8000efc0 tx=0x7fea8000c3a0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.123+0000 7fea8ac28700 1 -- 172.21.15.87:0/3795026412 shutdown_connections 2023-03-30T08:12:10.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.123+0000 7fea8ac28700 1 --2- 172.21.15.87:0/3795026412 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fea68065420 0x7fea680678d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.123+0000 7fea8ac28700 1 --2- 172.21.15.87:0/3795026412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fea84164190 0x7fea840ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.123+0000 7fea8ac28700 1 --2- 172.21.15.87:0/3795026412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fea84163dc0 0x7fea840cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.123+0000 7fea8ac28700 1 --2- 172.21.15.87:0/3795026412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fea840aea30 0x7fea840c4c60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.123+0000 7fea8ac28700 1 -- 172.21.15.87:0/3795026412 >> 172.21.15.87:0/3795026412 conn(0x7fea840cf410 msgr2=0x7fea840c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:10.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.123+0000 7fea8ac28700 1 -- 172.21.15.87:0/3795026412 shutdown_connections 2023-03-30T08:12:10.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.123+0000 7fea8ac28700 1 -- 172.21.15.87:0/3795026412 wait complete. 2023-03-30T08:12:10.161 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-03-30T08:12:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.319+0000 7fec8bcfa700 1 Processor -- start 2023-03-30T08:12:10.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.323+0000 7fec8bcfa700 1 -- start start 2023-03-30T08:12:10.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.323+0000 7fec8bcfa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec840b41c0 0x7fec840cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:10.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.323+0000 7fec8bcfa700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fec84070b30 0x7fec840cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:10.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.323+0000 7fec8bcfa700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8415e8c0 con 0x7fec840c8fb0 2023-03-30T08:12:10.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.323+0000 7fec8bcfa700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8415ed50 con 0x7fec84070b30 2023-03-30T08:12:10.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.323+0000 7fec8bcfa700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec840c96b0 con 0x7fec840b41c0 2023-03-30T08:12:10.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.323+0000 7fec89295700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fec840c8fb0 0x7fec84070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41734/0 (socket says 172.21.15.87:41734) 2023-03-30T08:12:10.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.323+0000 7fec89295700 1 -- 172.21.15.87:0/2074703204 learned_addr learned my addr 172.21.15.87:0/2074703204 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:10.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.323+0000 7fec8a297700 1 --2- 172.21.15.87:0/2074703204 >> v2:172.21.15.87:3300/0 conn(0x7fec84070b30 0x7fec840cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:10.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.323+0000 7fec89a96700 1 --2- 172.21.15.87:0/2074703204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec840b41c0 0x7fec840cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:10.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.323+0000 7fec88a94700 1 -- 172.21.15.87:0/2074703204 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303843873 0 0) 0x7fec8415e8c0 con 0x7fec840c8fb0 2023-03-30T08:12:10.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec88a94700 1 -- 172.21.15.87:0/2074703204 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec700035d0 con 0x7fec840c8fb0 2023-03-30T08:12:10.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec8a297700 1 -- 172.21.15.87:0/2074703204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec840b41c0 msgr2=0x7fec840cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:10.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec8a297700 1 --2- 172.21.15.87:0/2074703204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec840b41c0 0x7fec840cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec8a297700 1 -- 172.21.15.87:0/2074703204 >> v1:172.21.15.87:6789/0 conn(0x7fec840c8fb0 legacy=0x7fec84070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:10.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec8a297700 1 -- 172.21.15.87:0/2074703204 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec840c9400 con 0x7fec84070b30 2023-03-30T08:12:10.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec8a297700 1 --2- 172.21.15.87:0/2074703204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec84070b30 0x7fec840cc530 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009d90 tx=0x7fec7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c988474afde35be4 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:10.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec88a94700 1 -- 172.21.15.87:0/2074703204 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c00e070 con 0x7fec84070b30 2023-03-30T08:12:10.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec88a94700 1 -- 172.21.15.87:0/2074703204 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c00bae0 con 0x7fec84070b30 2023-03-30T08:12:10.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec88a94700 1 -- 172.21.15.87:0/2074703204 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c00be90 con 0x7fec84070b30 2023-03-30T08:12:10.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec8bcfa700 1 -- 172.21.15.87:0/2074703204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec84070b30 msgr2=0x7fec840cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:10.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec8bcfa700 1 --2- 172.21.15.87:0/2074703204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec84070b30 0x7fec840cc530 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009d90 tx=0x7fec7c00b330 comp rx=0 tx=0).stop 2023-03-30T08:12:10.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec8bcfa700 1 -- 172.21.15.87:0/2074703204 shutdown_connections 2023-03-30T08:12:10.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec8bcfa700 1 --2- 172.21.15.87:0/2074703204 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec84070b30 0x7fec840cc530 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec8bcfa700 1 --2- 172.21.15.87:0/2074703204 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec840b41c0 0x7fec840cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec8bcfa700 1 -- 172.21.15.87:0/2074703204 >> 172.21.15.87:0/2074703204 conn(0x7fec840ce960 msgr2=0x7fec840ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:10.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec8bcfa700 1 -- 172.21.15.87:0/2074703204 shutdown_connections 2023-03-30T08:12:10.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.327+0000 7fec8bcfa700 1 -- 172.21.15.87:0/2074703204 wait complete. 2023-03-30T08:12:10.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec8bcfa700 1 Processor -- start 2023-03-30T08:12:10.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec8bcfa700 1 -- start start 2023-03-30T08:12:10.336 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec8bcfa700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec84070b30 0x7fec841f4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:10.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec8bcfa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec840b41c0 0x7fec84156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:10.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec8bcfa700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec840c8fb0 0x7fec84145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:10.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec8bcfa700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec84143ae0 con 0x7fec84070b30 2023-03-30T08:12:10.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec8bcfa700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec84143dc0 con 0x7fec840b41c0 2023-03-30T08:12:10.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec8bcfa700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec841574b0 con 0x7fec840c8fb0 2023-03-30T08:12:10.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec89a96700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec84070b30 0x7fec841f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:10.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec89a96700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec84070b30 0x7fec841f4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59460/0 (socket says 172.21.15.87:59460) 2023-03-30T08:12:10.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec89a96700 1 -- 172.21.15.87:0/1349157667 learned_addr learned my addr 172.21.15.87:0/1349157667 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:10.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec89295700 1 --2- 172.21.15.87:0/1349157667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec840b41c0 0x7fec84156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:10.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec8a297700 1 --2- 172.21.15.87:0/1349157667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec840c8fb0 0x7fec84145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:10.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec89a96700 1 -- 172.21.15.87:0/1349157667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec840c8fb0 msgr2=0x7fec84145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:10.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec89a96700 1 --2- 172.21.15.87:0/1349157667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec840c8fb0 0x7fec84145b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec89a96700 1 -- 172.21.15.87:0/1349157667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec840b41c0 msgr2=0x7fec84156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:10.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec89a96700 1 --2- 172.21.15.87:0/1349157667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec840b41c0 0x7fec84156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec89a96700 1 -- 172.21.15.87:0/1349157667 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c009a70 con 0x7fec84070b30 2023-03-30T08:12:10.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec89295700 1 --2- 172.21.15.87:0/1349157667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec840b41c0 0x7fec84156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:10.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec89a96700 1 --2- 172.21.15.87:0/1349157667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec84070b30 0x7fec841f4950 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fec8000e790 tx=0x7fec8000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:10.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec7a7fc700 1 -- 172.21.15.87:0/1349157667 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80013610 con 0x7fec84070b30 2023-03-30T08:12:10.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec7a7fc700 1 -- 172.21.15.87:0/1349157667 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec80013770 con 0x7fec84070b30 2023-03-30T08:12:10.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec8bcfa700 1 -- 172.21.15.87:0/1349157667 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8415df90 con 0x7fec84070b30 2023-03-30T08:12:10.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec7a7fc700 1 -- 172.21.15.87:0/1349157667 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80013ae0 con 0x7fec84070b30 2023-03-30T08:12:10.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.331+0000 7fec8bcfa700 1 -- 172.21.15.87:0/1349157667 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec840ce720 con 0x7fec84070b30 2023-03-30T08:12:10.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.335+0000 7fec8bcfa700 1 -- 172.21.15.87:0/1349157667 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8415e270 con 0x7fec84070b30 2023-03-30T08:12:10.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.335+0000 7fec7a7fc700 1 -- 172.21.15.87:0/1349157667 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fec80013c40 con 0x7fec84070b30 2023-03-30T08:12:10.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.339+0000 7fec7a7fc700 1 --2- 172.21.15.87:0/1349157667 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fec680653f0 0x7fec680678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:10.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.339+0000 7fec7a7fc700 1 -- 172.21.15.87:0/1349157667 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fec80082470 con 0x7fec84070b30 2023-03-30T08:12:10.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.339+0000 7fec89295700 1 --2- 172.21.15.87:0/1349157667 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fec680653f0 0x7fec680678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:10.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.339+0000 7fec89295700 1 --2- 172.21.15.87:0/1349157667 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fec680653f0 0x7fec680678a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec8415dc00 tx=0x7fec74007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:10.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.343+0000 7fec7a7fc700 1 -- 172.21.15.87:0/1349157667 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fec80053c90 con 0x7fec84070b30 2023-03-30T08:12:10.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.575+0000 7fec8bcfa700 1 -- 172.21.15.87:0/1349157667 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fec8406dd90 con 0x7fec84070b30 2023-03-30T08:12:10.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.583+0000 7fec7a7fc700 1 -- 172.21.15.87:0/1349157667 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fec80053880 con 0x7fec84070b30 2023-03-30T08:12:10.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.587+0000 7fec8bcfa700 1 -- 172.21.15.87:0/1349157667 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fec680653f0 msgr2=0x7fec680678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:10.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.587+0000 7fec8bcfa700 1 --2- 172.21.15.87:0/1349157667 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fec680653f0 0x7fec680678a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec8415dc00 tx=0x7fec74007d50 comp rx=0 tx=0).stop 2023-03-30T08:12:10.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.587+0000 7fec8bcfa700 1 -- 172.21.15.87:0/1349157667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec84070b30 msgr2=0x7fec841f4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:10.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.587+0000 7fec8bcfa700 1 --2- 172.21.15.87:0/1349157667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec84070b30 0x7fec841f4950 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fec8000e790 tx=0x7fec8000eb50 comp rx=0 tx=0).stop 2023-03-30T08:12:10.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.587+0000 7fec8bcfa700 1 -- 172.21.15.87:0/1349157667 shutdown_connections 2023-03-30T08:12:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.587+0000 7fec8bcfa700 1 --2- 172.21.15.87:0/1349157667 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fec680653f0 0x7fec680678a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.587+0000 7fec8bcfa700 1 --2- 172.21.15.87:0/1349157667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fec840c8fb0 0x7fec84145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.587+0000 7fec8bcfa700 1 --2- 172.21.15.87:0/1349157667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec840b41c0 0x7fec84156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.587+0000 7fec8bcfa700 1 --2- 172.21.15.87:0/1349157667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fec84070b30 0x7fec841f4950 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.587+0000 7fec8bcfa700 1 -- 172.21.15.87:0/1349157667 >> 172.21.15.87:0/1349157667 conn(0x7fec840ce960 msgr2=0x7fec840acb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:10.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.587+0000 7fec8bcfa700 1 -- 172.21.15.87:0/1349157667 shutdown_connections 2023-03-30T08:12:10.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.587+0000 7fec8bcfa700 1 -- 172.21.15.87:0/1349157667 wait complete. 2023-03-30T08:12:10.612 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-03-30T08:12:10.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.771+0000 7f8a42ddc700 1 Processor -- start 2023-03-30T08:12:10.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.771+0000 7f8a42ddc700 1 -- start start 2023-03-30T08:12:10.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a42ddc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a3c0ad640 0x7f8a3c0abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:10.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a42ddc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8a3c0ac520 0x7f8a3c1604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:10.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a42ddc700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3c06a0e0 con 0x7f8a3c1600d0 2023-03-30T08:12:10.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a42ddc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3c0c9db0 con 0x7f8a3c0ad640 2023-03-30T08:12:10.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a42ddc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3c0ca090 con 0x7f8a3c0ac520 2023-03-30T08:12:10.782 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a415d9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8a3c0ad640 0x7f8a3c0abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:10.782 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a41dda700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8a3c1600d0 0x7f8a3c06a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41750/0 (socket says 172.21.15.87:41750) 2023-03-30T08:12:10.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a41dda700 1 -- 172.21.15.87:0/2742125735 learned_addr learned my addr 172.21.15.87:0/2742125735 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:10.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a425db700 1 --2- 172.21.15.87:0/2742125735 >> v2:172.21.15.115:3300/0 conn(0x7f8a3c0ac520 0x7f8a3c1604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:10.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a415d9700 1 -- 172.21.15.87:0/2742125735 >> v2:172.21.15.115:3300/0 conn(0x7f8a3c0ac520 msgr2=0x7f8a3c1604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:10.783 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a415d9700 1 --2- 172.21.15.87:0/2742125735 >> v2:172.21.15.115:3300/0 conn(0x7f8a3c0ac520 0x7f8a3c1604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.784 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a415d9700 1 -- 172.21.15.87:0/2742125735 >> v1:172.21.15.87:6789/0 conn(0x7f8a3c1600d0 legacy=0x7f8a3c06a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:10.784 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a415d9700 1 -- 172.21.15.87:0/2742125735 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c069d70 con 0x7f8a3c0ad640 2023-03-30T08:12:10.784 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a40dd8700 1 -- 172.21.15.87:0/2742125735 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802526449 0 0) 0x7f8a3c06a0e0 con 0x7f8a3c1600d0 2023-03-30T08:12:10.784 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a415d9700 1 --2- 172.21.15.87:0/2742125735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c0ad640 0x7f8a3c0abfe0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c06c0d0 tx=0x7f8a2c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8162675cc52e2d server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:10.784 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a40dd8700 1 -- 172.21.15.87:0/2742125735 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c011830 con 0x7f8a3c0ad640 2023-03-30T08:12:10.785 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a40dd8700 1 -- 172.21.15.87:0/2742125735 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c011990 con 0x7f8a3c0ad640 2023-03-30T08:12:10.786 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.775+0000 7f8a40dd8700 1 -- 172.21.15.87:0/2742125735 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c011d40 con 0x7f8a3c0ad640 2023-03-30T08:12:10.787 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.779+0000 7f8a42ddc700 1 -- 172.21.15.87:0/2742125735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c0ad640 msgr2=0x7f8a3c0abfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:10.787 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.779+0000 7f8a42ddc700 1 --2- 172.21.15.87:0/2742125735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c0ad640 0x7f8a3c0abfe0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c06c0d0 tx=0x7f8a2c009b30 comp rx=0 tx=0).stop 2023-03-30T08:12:10.787 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.779+0000 7f8a42ddc700 1 -- 172.21.15.87:0/2742125735 shutdown_connections 2023-03-30T08:12:10.787 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.779+0000 7f8a42ddc700 1 --2- 172.21.15.87:0/2742125735 >> v2:172.21.15.115:3300/0 conn(0x7f8a3c0ac520 0x7f8a3c1604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.788 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.779+0000 7f8a42ddc700 1 --2- 172.21.15.87:0/2742125735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c0ad640 0x7f8a3c0abfe0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.788 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.779+0000 7f8a42ddc700 1 -- 172.21.15.87:0/2742125735 >> 172.21.15.87:0/2742125735 conn(0x7f8a3c0cf410 msgr2=0x7f8a3c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:10.788 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.779+0000 7f8a42ddc700 1 -- 172.21.15.87:0/2742125735 shutdown_connections 2023-03-30T08:12:10.788 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.779+0000 7f8a42ddc700 1 -- 172.21.15.87:0/2742125735 wait complete. 2023-03-30T08:12:10.789 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.779+0000 7f8a42ddc700 1 Processor -- start 2023-03-30T08:12:10.789 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.779+0000 7f8a42ddc700 1 -- start start 2023-03-30T08:12:10.790 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a42ddc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c0ac520 0x7f8a3c0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:10.790 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a42ddc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a3c0ad640 0x7f8a3c1f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:10.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a42ddc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3c1600d0 0x7f8a3c1f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:10.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a42ddc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0c6f80 con 0x7f8a3c0ac520 2023-03-30T08:12:10.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a42ddc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0c8450 con 0x7f8a3c0ad640 2023-03-30T08:12:10.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a42ddc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c1f2d90 con 0x7f8a3c1600d0 2023-03-30T08:12:10.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a41dda700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c0ac520 0x7f8a3c0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:10.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a41dda700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c0ac520 0x7f8a3c0cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59488/0 (socket says 172.21.15.87:59488) 2023-03-30T08:12:10.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a41dda700 1 -- 172.21.15.87:0/4209788150 learned_addr learned my addr 172.21.15.87:0/4209788150 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:10.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a415d9700 1 --2- 172.21.15.87:0/4209788150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a3c0ad640 0x7f8a3c1f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:10.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a425db700 1 --2- 172.21.15.87:0/4209788150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3c1600d0 0x7f8a3c1f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:10.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a41dda700 1 -- 172.21.15.87:0/4209788150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3c1600d0 msgr2=0x7f8a3c1f2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:10.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a41dda700 1 --2- 172.21.15.87:0/4209788150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3c1600d0 0x7f8a3c1f2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a41dda700 1 -- 172.21.15.87:0/4209788150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a3c0ad640 msgr2=0x7f8a3c1f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:10.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a41dda700 1 --2- 172.21.15.87:0/4209788150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a3c0ad640 0x7f8a3c1f2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:10.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a41dda700 1 -- 172.21.15.87:0/4209788150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c0094b0 con 0x7f8a3c0ac520 2023-03-30T08:12:10.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a41dda700 1 --2- 172.21.15.87:0/4209788150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c0ac520 0x7f8a3c0cd6b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800c4e0 tx=0x7f8a3800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:10.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a327fc700 1 -- 172.21.15.87:0/4209788150 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38004ca0 con 0x7f8a3c0ac520 2023-03-30T08:12:10.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a327fc700 1 -- 172.21.15.87:0/4209788150 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a38004e20 con 0x7f8a3c0ac520 2023-03-30T08:12:10.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a42ddc700 1 -- 172.21.15.87:0/4209788150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c0ac980 con 0x7f8a3c0ac520 2023-03-30T08:12:10.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a327fc700 1 -- 172.21.15.87:0/4209788150 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38007310 con 0x7f8a3c0ac520 2023-03-30T08:12:10.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.783+0000 7f8a42ddc700 1 -- 172.21.15.87:0/4209788150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c0ca370 con 0x7f8a3c0ac520 2023-03-30T08:12:10.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.787+0000 7f8a42ddc700 1 -- 172.21.15.87:0/4209788150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3c06ac80 con 0x7f8a3c0ac520 2023-03-30T08:12:10.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.787+0000 7f8a327fc700 1 -- 172.21.15.87:0/4209788150 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f8a38007470 con 0x7f8a3c0ac520 2023-03-30T08:12:10.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.787+0000 7f8a327fc700 1 --2- 172.21.15.87:0/4209788150 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8a200653f0 0x7f8a200678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:10.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.787+0000 7f8a327fc700 1 -- 172.21.15.87:0/4209788150 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8a380823f0 con 0x7f8a3c0ac520 2023-03-30T08:12:10.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.787+0000 7f8a415d9700 1 --2- 172.21.15.87:0/4209788150 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8a200653f0 0x7f8a200678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:10.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.791+0000 7f8a415d9700 1 --2- 172.21.15.87:0/4209788150 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8a200653f0 0x7f8a200678a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c009b70 tx=0x7f8a2c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:10.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:10.791+0000 7f8a327fc700 1 -- 172.21.15.87:0/4209788150 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f8a380501f0 con 0x7f8a3c0ac520 2023-03-30T08:12:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.023+0000 7f8a42ddc700 1 -- 172.21.15.87:0/4209788150 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f8a3c0733a0 con 0x7f8a3c0ac520 2023-03-30T08:12:11.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.031+0000 7f8a327fc700 1 -- 172.21.15.87:0/4209788150 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8a38007720 con 0x7f8a3c0ac520 2023-03-30T08:12:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.035+0000 7f8a42ddc700 1 -- 172.21.15.87:0/4209788150 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8a200653f0 msgr2=0x7f8a200678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.035+0000 7f8a42ddc700 1 --2- 172.21.15.87:0/4209788150 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8a200653f0 0x7f8a200678a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c009b70 tx=0x7f8a2c008030 comp rx=0 tx=0).stop 2023-03-30T08:12:11.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.035+0000 7f8a42ddc700 1 -- 172.21.15.87:0/4209788150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c0ac520 msgr2=0x7f8a3c0cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.035+0000 7f8a42ddc700 1 --2- 172.21.15.87:0/4209788150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c0ac520 0x7f8a3c0cd6b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800c4e0 tx=0x7f8a3800c8a0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.035+0000 7f8a42ddc700 1 -- 172.21.15.87:0/4209788150 shutdown_connections 2023-03-30T08:12:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.035+0000 7f8a42ddc700 1 --2- 172.21.15.87:0/4209788150 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8a200653f0 0x7f8a200678a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.035+0000 7f8a42ddc700 1 --2- 172.21.15.87:0/4209788150 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a3c1600d0 0x7f8a3c1f2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.035+0000 7f8a42ddc700 1 --2- 172.21.15.87:0/4209788150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a3c0ad640 0x7f8a3c1f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.035+0000 7f8a42ddc700 1 --2- 172.21.15.87:0/4209788150 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8a3c0ac520 0x7f8a3c0cd6b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.035+0000 7f8a42ddc700 1 -- 172.21.15.87:0/4209788150 >> 172.21.15.87:0/4209788150 conn(0x7f8a3c0cf410 msgr2=0x7f8a3c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.035+0000 7f8a42ddc700 1 -- 172.21.15.87:0/4209788150 shutdown_connections 2023-03-30T08:12:11.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.035+0000 7f8a42ddc700 1 -- 172.21.15.87:0/4209788150 wait complete. 2023-03-30T08:12:11.060 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-03-30T08:12:11.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.219+0000 7f5bf0c16700 1 Processor -- start 2023-03-30T08:12:11.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.219+0000 7f5bf0c16700 1 -- start start 2023-03-30T08:12:11.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.219+0000 7f5bf0c16700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5bec0713b0 0x7f5bec1600e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:11.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.219+0000 7f5bf0c16700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5bec06b440 0x7f5bec160620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:11.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.219+0000 7f5bf0c16700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec06eae0 con 0x7f5bec15a220 2023-03-30T08:12:11.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.219+0000 7f5bf0c16700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec06dfd0 con 0x7f5bec06b440 2023-03-30T08:12:11.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.219+0000 7f5bf0c16700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec06e1b0 con 0x7f5bec0713b0 2023-03-30T08:12:11.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bead9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5bec06b440 0x7f5bec160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:11.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bead9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5bec06b440 0x7f5bec160620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59502/0 (socket says 172.21.15.87:59502) 2023-03-30T08:12:11.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bead9d700 1 -- 172.21.15.87:0/618034678 learned_addr learned my addr 172.21.15.87:0/618034678 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:11.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5be9d9b700 1 --2- 172.21.15.87:0/618034678 >> v2:172.21.15.115:3300/0 conn(0x7f5bec0713b0 0x7f5bec1600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:11.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bead9d700 1 -- 172.21.15.87:0/618034678 >> v2:172.21.15.115:3300/0 conn(0x7f5bec0713b0 msgr2=0x7f5bec1600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:11.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bead9d700 1 --2- 172.21.15.87:0/618034678 >> v2:172.21.15.115:3300/0 conn(0x7f5bec0713b0 0x7f5bec1600e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bead9d700 1 -- 172.21.15.87:0/618034678 >> v1:172.21.15.115:6789/0 conn(0x7f5bec15a220 legacy=0x7f5bec070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:11.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bead9d700 1 -- 172.21.15.87:0/618034678 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec06e490 con 0x7f5bec06b440 2023-03-30T08:12:11.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bead9d700 1 --2- 172.21.15.87:0/618034678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bec06b440 0x7f5bec160620 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5bec06f370 tx=0x7f5be400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecfcc529d9f9831 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:11.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5be959a700 1 -- 172.21.15.87:0/618034678 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be400e070 con 0x7f5bec06b440 2023-03-30T08:12:11.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5be959a700 1 -- 172.21.15.87:0/618034678 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be400b9c0 con 0x7f5bec06b440 2023-03-30T08:12:11.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5be959a700 1 -- 172.21.15.87:0/618034678 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be400bd70 con 0x7f5bec06b440 2023-03-30T08:12:11.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bf0c16700 1 -- 172.21.15.87:0/618034678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bec06b440 msgr2=0x7f5bec160620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:11.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bf0c16700 1 --2- 172.21.15.87:0/618034678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bec06b440 0x7f5bec160620 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5bec06f370 tx=0x7f5be400b330 comp rx=0 tx=0).stop 2023-03-30T08:12:11.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bf0c16700 1 -- 172.21.15.87:0/618034678 shutdown_connections 2023-03-30T08:12:11.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bf0c16700 1 --2- 172.21.15.87:0/618034678 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bec06b440 0x7f5bec160620 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bf0c16700 1 --2- 172.21.15.87:0/618034678 >> v2:172.21.15.115:3300/0 conn(0x7f5bec0713b0 0x7f5bec1600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bf0c16700 1 -- 172.21.15.87:0/618034678 >> 172.21.15.87:0/618034678 conn(0x7f5bec0cf120 msgr2=0x7f5bec0cf4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:11.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bf0c16700 1 -- 172.21.15.87:0/618034678 shutdown_connections 2023-03-30T08:12:11.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.223+0000 7f5bf0c16700 1 -- 172.21.15.87:0/618034678 wait complete. 2023-03-30T08:12:11.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.227+0000 7f5bf0c16700 1 Processor -- start 2023-03-30T08:12:11.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.227+0000 7f5bf0c16700 1 -- start start 2023-03-30T08:12:11.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bf0c16700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bec06b440 0x7f5bec0ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:11.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bf0c16700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bec0713b0 0x7f5bec0ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:11.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bf0c16700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bec15a220 0x7f5bec14b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:11.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bf0c16700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0ae940 con 0x7f5bec15a220 2023-03-30T08:12:11.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bf0c16700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0b2420 con 0x7f5bec06b440 2023-03-30T08:12:11.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bf0c16700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0b2700 con 0x7f5bec0713b0 2023-03-30T08:12:11.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bead9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bec15a220 0x7f5bec14b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:11.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bead9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bec15a220 0x7f5bec14b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59514/0 (socket says 172.21.15.87:59514) 2023-03-30T08:12:11.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bead9d700 1 -- 172.21.15.87:0/208317668 learned_addr learned my addr 172.21.15.87:0/208317668 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:11.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5be9d9b700 1 --2- 172.21.15.87:0/208317668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bec0713b0 0x7f5bec0ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:11.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bea59c700 1 --2- 172.21.15.87:0/208317668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bec06b440 0x7f5bec0ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:11.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bead9d700 1 -- 172.21.15.87:0/208317668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bec0713b0 msgr2=0x7f5bec0ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:11.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bead9d700 1 --2- 172.21.15.87:0/208317668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bec0713b0 0x7f5bec0ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bead9d700 1 -- 172.21.15.87:0/208317668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bec06b440 msgr2=0x7f5bec0ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:11.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bead9d700 1 --2- 172.21.15.87:0/208317668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bec06b440 0x7f5bec0ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bead9d700 1 -- 172.21.15.87:0/208317668 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be4009b30 con 0x7f5bec15a220 2023-03-30T08:12:11.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bead9d700 1 --2- 172.21.15.87:0/208317668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bec15a220 0x7f5bec14b050 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0cfcf0 tx=0x7f5be4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:11.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bdaffd700 1 -- 172.21.15.87:0/208317668 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be40099b0 con 0x7f5bec15a220 2023-03-30T08:12:11.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bdaffd700 1 -- 172.21.15.87:0/208317668 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be40092e0 con 0x7f5bec15a220 2023-03-30T08:12:11.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bdaffd700 1 -- 172.21.15.87:0/208317668 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be401c640 con 0x7f5bec15a220 2023-03-30T08:12:11.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bf0c16700 1 -- 172.21.15.87:0/208317668 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec0cee40 con 0x7f5bec15a220 2023-03-30T08:12:11.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.231+0000 7f5bf0c16700 1 -- 172.21.15.87:0/208317668 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec06e770 con 0x7f5bec15a220 2023-03-30T08:12:11.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.235+0000 7f5bdaffd700 1 -- 172.21.15.87:0/208317668 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f5be401c7a0 con 0x7f5bec15a220 2023-03-30T08:12:11.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.235+0000 7f5bf0c16700 1 -- 172.21.15.87:0/208317668 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec15caf0 con 0x7f5bec15a220 2023-03-30T08:12:11.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.235+0000 7f5bdaffd700 1 --2- 172.21.15.87:0/208317668 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5bcc0653f0 0x7f5bcc0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:11.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.239+0000 7f5bdaffd700 1 -- 172.21.15.87:0/208317668 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5be4083d30 con 0x7f5bec15a220 2023-03-30T08:12:11.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.239+0000 7f5bea59c700 1 --2- 172.21.15.87:0/208317668 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5bcc0653f0 0x7f5bcc0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:11.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.239+0000 7f5bea59c700 1 --2- 172.21.15.87:0/208317668 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5bcc0653f0 0x7f5bcc0678a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc000f60 tx=0x7f5bdc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:11.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.243+0000 7f5bdaffd700 1 -- 172.21.15.87:0/208317668 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f5be4051b20 con 0x7f5bec15a220 2023-03-30T08:12:11.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.471+0000 7f5bf0c16700 1 -- 172.21.15.87:0/208317668 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f5bec073ee0 con 0x7f5bec15a220 2023-03-30T08:12:11.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.483+0000 7f5bdaffd700 1 -- 172.21.15.87:0/208317668 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5be4055140 con 0x7f5bec15a220 2023-03-30T08:12:11.491 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.483+0000 7f5bf0c16700 1 -- 172.21.15.87:0/208317668 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5bcc0653f0 msgr2=0x7f5bcc0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:11.491 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.483+0000 7f5bf0c16700 1 --2- 172.21.15.87:0/208317668 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5bcc0653f0 0x7f5bcc0678a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc000f60 tx=0x7f5bdc009040 comp rx=0 tx=0).stop 2023-03-30T08:12:11.491 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.487+0000 7f5bf0c16700 1 -- 172.21.15.87:0/208317668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bec15a220 msgr2=0x7f5bec14b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:11.491 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.487+0000 7f5bf0c16700 1 --2- 172.21.15.87:0/208317668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bec15a220 0x7f5bec14b050 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0cfcf0 tx=0x7f5be4004af0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.491 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.487+0000 7f5bf0c16700 1 -- 172.21.15.87:0/208317668 shutdown_connections 2023-03-30T08:12:11.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.487+0000 7f5bf0c16700 1 --2- 172.21.15.87:0/208317668 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5bcc0653f0 0x7f5bcc0678a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.487+0000 7f5bf0c16700 1 --2- 172.21.15.87:0/208317668 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5bec15a220 0x7f5bec14b050 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.487+0000 7f5bf0c16700 1 --2- 172.21.15.87:0/208317668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5bec0713b0 0x7f5bec0ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.487+0000 7f5bf0c16700 1 --2- 172.21.15.87:0/208317668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5bec06b440 0x7f5bec0ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.487+0000 7f5bf0c16700 1 -- 172.21.15.87:0/208317668 >> 172.21.15.87:0/208317668 conn(0x7f5bec0cf120 msgr2=0x7f5bec0aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:11.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.487+0000 7f5bf0c16700 1 -- 172.21.15.87:0/208317668 shutdown_connections 2023-03-30T08:12:11.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.487+0000 7f5bf0c16700 1 -- 172.21.15.87:0/208317668 wait complete. 2023-03-30T08:12:11.512 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-03-30T08:12:11.674 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.667+0000 7fad98b3e700 1 Processor -- start 2023-03-30T08:12:11.674 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.667+0000 7fad98b3e700 1 -- start start 2023-03-30T08:12:11.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad98b3e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad94070b30 0x7fad940cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:11.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad98b3e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fad940c8fb0 0x7fad940cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:11.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad98b3e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9415e8c0 con 0x7fad940b41c0 2023-03-30T08:12:11.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad98b3e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9415ed50 con 0x7fad940c8fb0 2023-03-30T08:12:11.676 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad98b3e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad940c96b0 con 0x7fad94070b30 2023-03-30T08:12:11.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad9259c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fad940b41c0 0x7fad94070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41758/0 (socket says 172.21.15.87:41758) 2023-03-30T08:12:11.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad9259c700 1 -- 172.21.15.87:0/850819295 learned_addr learned my addr 172.21.15.87:0/850819295 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:11.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad92d9d700 1 --2- 172.21.15.87:0/850819295 >> v2:172.21.15.115:3300/0 conn(0x7fad940c8fb0 0x7fad940cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:11.677 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad91d9b700 1 --2- 172.21.15.87:0/850819295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad94070b30 0x7fad940cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:11.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad9159a700 1 -- 172.21.15.87:0/850819295 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292379297 0 0) 0x7fad9415e8c0 con 0x7fad940b41c0 2023-03-30T08:12:11.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad9159a700 1 -- 172.21.15.87:0/850819295 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad7c0035d0 con 0x7fad940b41c0 2023-03-30T08:12:11.678 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad91d9b700 1 -- 172.21.15.87:0/850819295 >> v2:172.21.15.115:3300/0 conn(0x7fad940c8fb0 msgr2=0x7fad940cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:11.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad91d9b700 1 --2- 172.21.15.87:0/850819295 >> v2:172.21.15.115:3300/0 conn(0x7fad940c8fb0 0x7fad940cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad91d9b700 1 -- 172.21.15.87:0/850819295 >> v1:172.21.15.87:6789/0 conn(0x7fad940b41c0 legacy=0x7fad94070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:11.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad91d9b700 1 -- 172.21.15.87:0/850819295 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad940ce720 con 0x7fad94070b30 2023-03-30T08:12:11.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad91d9b700 1 --2- 172.21.15.87:0/850819295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad94070b30 0x7fad940cab10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad88009850 tx=0x7fad88009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efbaa43fce04028a server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:11.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.671+0000 7fad9159a700 1 -- 172.21.15.87:0/850819295 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88011830 con 0x7fad94070b30 2023-03-30T08:12:11.680 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.675+0000 7fad9159a700 1 -- 172.21.15.87:0/850819295 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad88011990 con 0x7fad94070b30 2023-03-30T08:12:11.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.675+0000 7fad9159a700 1 -- 172.21.15.87:0/850819295 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88011d40 con 0x7fad94070b30 2023-03-30T08:12:11.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.675+0000 7fad98b3e700 1 -- 172.21.15.87:0/850819295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad94070b30 msgr2=0x7fad940cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:11.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.675+0000 7fad98b3e700 1 --2- 172.21.15.87:0/850819295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad94070b30 0x7fad940cab10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad88009850 tx=0x7fad88009b60 comp rx=0 tx=0).stop 2023-03-30T08:12:11.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.675+0000 7fad98b3e700 1 -- 172.21.15.87:0/850819295 shutdown_connections 2023-03-30T08:12:11.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.675+0000 7fad98b3e700 1 --2- 172.21.15.87:0/850819295 >> v2:172.21.15.115:3300/0 conn(0x7fad940c8fb0 0x7fad940cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.675+0000 7fad98b3e700 1 --2- 172.21.15.87:0/850819295 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad94070b30 0x7fad940cab10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.675+0000 7fad98b3e700 1 -- 172.21.15.87:0/850819295 >> 172.21.15.87:0/850819295 conn(0x7fad940ce960 msgr2=0x7fad940ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:11.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.675+0000 7fad98b3e700 1 -- 172.21.15.87:0/850819295 shutdown_connections 2023-03-30T08:12:11.682 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.675+0000 7fad98b3e700 1 -- 172.21.15.87:0/850819295 wait complete. 2023-03-30T08:12:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad98b3e700 1 Processor -- start 2023-03-30T08:12:11.683 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad98b3e700 1 -- start start 2023-03-30T08:12:11.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad98b3e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad94070b30 0x7fad94158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:11.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad98b3e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad940b41c0 0x7fad940c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:11.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad98b3e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad940c8fb0 0x7fad940c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:11.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad98b3e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad940c6a80 con 0x7fad94070b30 2023-03-30T08:12:11.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad98b3e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad940c6d60 con 0x7fad940b41c0 2023-03-30T08:12:11.685 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad98b3e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad940c7040 con 0x7fad940c8fb0 2023-03-30T08:12:11.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad9259c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad94070b30 0x7fad94158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:11.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad9259c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad94070b30 0x7fad94158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59520/0 (socket says 172.21.15.87:59520) 2023-03-30T08:12:11.686 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad9259c700 1 -- 172.21.15.87:0/1611040975 learned_addr learned my addr 172.21.15.87:0/1611040975 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:11.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad91d9b700 1 --2- 172.21.15.87:0/1611040975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad940b41c0 0x7fad940c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:11.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad92d9d700 1 --2- 172.21.15.87:0/1611040975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad940c8fb0 0x7fad940c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:11.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad9259c700 1 -- 172.21.15.87:0/1611040975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad940c8fb0 msgr2=0x7fad940c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:11.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad9259c700 1 --2- 172.21.15.87:0/1611040975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad940c8fb0 0x7fad940c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad9259c700 1 -- 172.21.15.87:0/1611040975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad940b41c0 msgr2=0x7fad940c2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:11.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad9259c700 1 --2- 172.21.15.87:0/1611040975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad940b41c0 0x7fad940c2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad9259c700 1 -- 172.21.15.87:0/1611040975 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad880094b0 con 0x7fad94070b30 2023-03-30T08:12:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad92d9d700 1 --2- 172.21.15.87:0/1611040975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad940c8fb0 0x7fad940c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:12:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad9259c700 1 --2- 172.21.15.87:0/1611040975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad94070b30 0x7fad94158140 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fad8400cbc0 tx=0x7fad8400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.679+0000 7fad82ffd700 1 -- 172.21.15.87:0/1611040975 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8400a9e0 con 0x7fad94070b30 2023-03-30T08:12:11.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.683+0000 7fad82ffd700 1 -- 172.21.15.87:0/1611040975 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8400ab40 con 0x7fad94070b30 2023-03-30T08:12:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.683+0000 7fad82ffd700 1 -- 172.21.15.87:0/1611040975 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84012400 con 0x7fad94070b30 2023-03-30T08:12:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.683+0000 7fad98b3e700 1 -- 172.21.15.87:0/1611040975 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9415df90 con 0x7fad94070b30 2023-03-30T08:12:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.683+0000 7fad98b3e700 1 -- 172.21.15.87:0/1611040975 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad940c93f0 con 0x7fad94070b30 2023-03-30T08:12:11.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.683+0000 7fad98b3e700 1 -- 172.21.15.87:0/1611040975 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9415e250 con 0x7fad94070b30 2023-03-30T08:12:11.690 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.683+0000 7fad82ffd700 1 -- 172.21.15.87:0/1611040975 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fad8401b3b0 con 0x7fad94070b30 2023-03-30T08:12:11.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.687+0000 7fad82ffd700 1 --2- 172.21.15.87:0/1611040975 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fad740653f0 0x7fad740678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:11.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.687+0000 7fad82ffd700 1 -- 172.21.15.87:0/1611040975 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fad84082250 con 0x7fad94070b30 2023-03-30T08:12:11.693 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.687+0000 7fad91d9b700 1 --2- 172.21.15.87:0/1611040975 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fad740653f0 0x7fad740678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:11.694 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.687+0000 7fad91d9b700 1 --2- 172.21.15.87:0/1611040975 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fad740653f0 0x7fad740678a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad94070f20 tx=0x7fad88008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:11.698 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.691+0000 7fad82ffd700 1 -- 172.21.15.87:0/1611040975 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fad8404ffe0 con 0x7fad94070b30 2023-03-30T08:12:11.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.923+0000 7fad98b3e700 1 -- 172.21.15.87:0/1611040975 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fad94073ee0 con 0x7fad94070b30 2023-03-30T08:12:11.936 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.931+0000 7fad82ffd700 1 -- 172.21.15.87:0/1611040975 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fad84053600 con 0x7fad94070b30 2023-03-30T08:12:11.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.935+0000 7fad98b3e700 1 -- 172.21.15.87:0/1611040975 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fad740653f0 msgr2=0x7fad740678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:11.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.935+0000 7fad98b3e700 1 --2- 172.21.15.87:0/1611040975 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fad740653f0 0x7fad740678a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad94070f20 tx=0x7fad88008030 comp rx=0 tx=0).stop 2023-03-30T08:12:11.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.935+0000 7fad98b3e700 1 -- 172.21.15.87:0/1611040975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad94070b30 msgr2=0x7fad94158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:11.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.935+0000 7fad98b3e700 1 --2- 172.21.15.87:0/1611040975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad94070b30 0x7fad94158140 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fad8400cbc0 tx=0x7fad8400cca0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.935+0000 7fad98b3e700 1 -- 172.21.15.87:0/1611040975 shutdown_connections 2023-03-30T08:12:11.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.935+0000 7fad98b3e700 1 --2- 172.21.15.87:0/1611040975 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fad740653f0 0x7fad740678a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.935+0000 7fad98b3e700 1 --2- 172.21.15.87:0/1611040975 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fad940c8fb0 0x7fad940c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.935+0000 7fad98b3e700 1 --2- 172.21.15.87:0/1611040975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad940b41c0 0x7fad940c2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.935+0000 7fad98b3e700 1 --2- 172.21.15.87:0/1611040975 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad94070b30 0x7fad94158140 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:11.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.935+0000 7fad98b3e700 1 -- 172.21.15.87:0/1611040975 >> 172.21.15.87:0/1611040975 conn(0x7fad940ce960 msgr2=0x7fad940cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:11.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.935+0000 7fad98b3e700 1 -- 172.21.15.87:0/1611040975 shutdown_connections 2023-03-30T08:12:11.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:11.935+0000 7fad98b3e700 1 -- 172.21.15.87:0/1611040975 wait complete. 2023-03-30T08:12:11.962 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-03-30T08:12:12.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.119+0000 7f0446d79700 1 Processor -- start 2023-03-30T08:12:12.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.119+0000 7f0446d79700 1 -- start start 2023-03-30T08:12:12.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f0446d79700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f044015d3c0 0x7f044015d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f0446d79700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04400cd410 0x7f04400cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f0446d79700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04401601c0 con 0x7f04400cf7d0 2023-03-30T08:12:12.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f0446d79700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0440160410 con 0x7f044015d3c0 2023-03-30T08:12:12.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f0446d79700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04401606f0 con 0x7f04400cd410 2023-03-30T08:12:12.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f0445316700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f04400cf7d0 0x7f04400b4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41762/0 (socket says 172.21.15.87:41762) 2023-03-30T08:12:12.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f0445316700 1 -- 172.21.15.87:0/4039612817 learned_addr learned my addr 172.21.15.87:0/4039612817 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:12.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043ffff700 1 --2- 172.21.15.87:0/4039612817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04400cd410 0x7f04400cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f0444b15700 1 --2- 172.21.15.87:0/4039612817 >> v2:172.21.15.115:3300/0 conn(0x7f044015d3c0 0x7f044015d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 -- 172.21.15.87:0/4039612817 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806140501 0 0) 0x7f04401601c0 con 0x7f04400cf7d0 2023-03-30T08:12:12.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 -- 172.21.15.87:0/4039612817 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04300035d0 con 0x7f04400cf7d0 2023-03-30T08:12:12.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 -- 172.21.15.87:0/4039612817 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2087736656 0 0) 0x7f04300035d0 con 0x7f04400cf7d0 2023-03-30T08:12:12.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 -- 172.21.15.87:0/4039612817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04400cd410 msgr2=0x7f04400cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:12.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 --2- 172.21.15.87:0/4039612817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04400cd410 0x7f04400cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 -- 172.21.15.87:0/4039612817 >> v2:172.21.15.115:3300/0 conn(0x7f044015d3c0 msgr2=0x7f044015d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:12.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 --2- 172.21.15.87:0/4039612817 >> v2:172.21.15.115:3300/0 conn(0x7f044015d3c0 0x7f044015d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 -- 172.21.15.87:0/4039612817 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04401609d0 con 0x7f04400cf7d0 2023-03-30T08:12:12.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 -- 172.21.15.87:0/4039612817 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f04380019f0 con 0x7f04400cf7d0 2023-03-30T08:12:12.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 -- 172.21.15.87:0/4039612817 >> v1:172.21.15.87:6789/0 conn(0x7f04400cf7d0 legacy=0x7f04400b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:12.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 --2- 172.21.15.87:0/4039612817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04400cd410 0x7f0430003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 --2- 172.21.15.87:0/4039612817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0430003fa0 0x7f0430004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.133 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 --2- 172.21.15.87:0/4039612817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0430004db0 0x7f0430005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 -- 172.21.15.87:0/4039612817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0440160410 con 0x7f0430003fa0 2023-03-30T08:12:12.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 -- 172.21.15.87:0/4039612817 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04401606f0 con 0x7f0430004db0 2023-03-30T08:12:12.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043f7fe700 1 -- 172.21.15.87:0/4039612817 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043000ba30 con 0x7f04400cd410 2023-03-30T08:12:12.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f043ffff700 1 --2- 172.21.15.87:0/4039612817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0430003fa0 0x7f0430004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f0445316700 1 --2- 172.21.15.87:0/4039612817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0430004db0 0x7f0430005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.123+0000 7f0444b15700 1 --2- 172.21.15.87:0/4039612817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04400cd410 0x7f0430003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f043ffff700 1 -- 172.21.15.87:0/4039612817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04400cd410 msgr2=0x7f0430003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:12.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f043ffff700 1 --2- 172.21.15.87:0/4039612817 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04400cd410 0x7f0430003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f043ffff700 1 -- 172.21.15.87:0/4039612817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0430004db0 msgr2=0x7f0430005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:12.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f043ffff700 1 --2- 172.21.15.87:0/4039612817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0430004db0 0x7f0430005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f043ffff700 1 -- 172.21.15.87:0/4039612817 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04300035d0 con 0x7f0430003fa0 2023-03-30T08:12:12.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f043ffff700 1 --2- 172.21.15.87:0/4039612817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0430003fa0 0x7f0430004870 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f042c009b70 tx=0x7f04300058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6907422212f237ce server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:12.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f043f7fe700 1 -- 172.21.15.87:0/4039612817 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c00e6c0 con 0x7f0430003fa0 2023-03-30T08:12:12.135 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f043f7fe700 1 -- 172.21.15.87:0/4039612817 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c00e820 con 0x7f0430003fa0 2023-03-30T08:12:12.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f043f7fe700 1 -- 172.21.15.87:0/4039612817 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c00eb90 con 0x7f0430003fa0 2023-03-30T08:12:12.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f0446d79700 1 -- 172.21.15.87:0/4039612817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0430003fa0 msgr2=0x7f0430004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:12.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f0446d79700 1 --2- 172.21.15.87:0/4039612817 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0430003fa0 0x7f0430004870 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f042c009b70 tx=0x7f04300058a0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f0445316700 1 -- 172.21.15.87:0/4039612817 reap_dead start 2023-03-30T08:12:12.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f0446d79700 1 -- 172.21.15.87:0/4039612817 shutdown_connections 2023-03-30T08:12:12.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f0446d79700 1 -- 172.21.15.87:0/4039612817 >> 172.21.15.87:0/4039612817 conn(0x7f044006b2e0 msgr2=0x7f044006b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:12.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f0446d79700 1 -- 172.21.15.87:0/4039612817 shutdown_connections 2023-03-30T08:12:12.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.127+0000 7f0446d79700 1 -- 172.21.15.87:0/4039612817 wait complete. 2023-03-30T08:12:12.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.131+0000 7f0446d79700 1 Processor -- start 2023-03-30T08:12:12.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.131+0000 7f0446d79700 1 -- start start 2023-03-30T08:12:12.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.131+0000 7f0446d79700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0430003fa0 0x7f0440155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.131+0000 7f0446d79700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0440154be0 0x7f04401f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.131+0000 7f0446d79700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0440152f30 0x7f0440155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.131+0000 7f0446d79700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0440155dd0 con 0x7f0430003fa0 2023-03-30T08:12:12.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.131+0000 7f0446d79700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0440155030 con 0x7f0440152f30 2023-03-30T08:12:12.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.131+0000 7f0446d79700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0440153e20 con 0x7f0440154be0 2023-03-30T08:12:12.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f0444b15700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0430003fa0 0x7f0440155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f0444b15700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0430003fa0 0x7f0440155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59550/0 (socket says 172.21.15.87:59550) 2023-03-30T08:12:12.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f0444b15700 1 -- 172.21.15.87:0/140030826 learned_addr learned my addr 172.21.15.87:0/140030826 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:12.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f0445316700 1 --2- 172.21.15.87:0/140030826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0440152f30 0x7f0440155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f043ffff700 1 --2- 172.21.15.87:0/140030826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0440154be0 0x7f04401f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f0444b15700 1 -- 172.21.15.87:0/140030826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0440154be0 msgr2=0x7f04401f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:12.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f0444b15700 1 --2- 172.21.15.87:0/140030826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0440154be0 0x7f04401f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f0444b15700 1 -- 172.21.15.87:0/140030826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0440152f30 msgr2=0x7f0440155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:12.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f0444b15700 1 --2- 172.21.15.87:0/140030826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0440152f30 0x7f0440155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f0444b15700 1 -- 172.21.15.87:0/140030826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04400d19a0 con 0x7f0430003fa0 2023-03-30T08:12:12.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f043ffff700 1 --2- 172.21.15.87:0/140030826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0440154be0 0x7f04401f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:12.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f0444b15700 1 --2- 172.21.15.87:0/140030826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0430003fa0 0x7f0440155740 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0434011ad0 tx=0x7f0434011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:12.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f043d7fa700 1 -- 172.21.15.87:0/140030826 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043400fa60 con 0x7f0430003fa0 2023-03-30T08:12:12.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f043d7fa700 1 -- 172.21.15.87:0/140030826 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043400fbc0 con 0x7f0430003fa0 2023-03-30T08:12:12.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f0446d79700 1 -- 172.21.15.87:0/140030826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0440160cb0 con 0x7f0430003fa0 2023-03-30T08:12:12.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f043d7fa700 1 -- 172.21.15.87:0/140030826 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434014440 con 0x7f0430003fa0 2023-03-30T08:12:12.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f0446d79700 1 -- 172.21.15.87:0/140030826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04400d1b30 con 0x7f0430003fa0 2023-03-30T08:12:12.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.135+0000 7f0446d79700 1 -- 172.21.15.87:0/140030826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0440073ee0 con 0x7f0430003fa0 2023-03-30T08:12:12.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.139+0000 7f043d7fa700 1 -- 172.21.15.87:0/140030826 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f04340145a0 con 0x7f0430003fa0 2023-03-30T08:12:12.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.139+0000 7f043d7fa700 1 --2- 172.21.15.87:0/140030826 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0424065420 0x7f04240678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.139+0000 7f043d7fa700 1 -- 172.21.15.87:0/140030826 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0434082e60 con 0x7f0430003fa0 2023-03-30T08:12:12.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.139+0000 7f043ffff700 1 --2- 172.21.15.87:0/140030826 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0424065420 0x7f04240678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.139+0000 7f043ffff700 1 --2- 172.21.15.87:0/140030826 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0424065420 0x7f04240678d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f042c0090b0 tx=0x7f042c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:12.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.147+0000 7f043d7fa700 1 -- 172.21.15.87:0/140030826 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f0434050c60 con 0x7f0430003fa0 2023-03-30T08:12:12.381 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.375+0000 7f0446d79700 1 -- 172.21.15.87:0/140030826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f044006a9a0 con 0x7f0430003fa0 2023-03-30T08:12:12.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.383+0000 7f043d7fa700 1 -- 172.21.15.87:0/140030826 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f04340220a0 con 0x7f0430003fa0 2023-03-30T08:12:12.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.387+0000 7f0446d79700 1 -- 172.21.15.87:0/140030826 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0424065420 msgr2=0x7f04240678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:12.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.387+0000 7f0446d79700 1 --2- 172.21.15.87:0/140030826 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0424065420 0x7f04240678d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f042c0090b0 tx=0x7f042c008030 comp rx=0 tx=0).stop 2023-03-30T08:12:12.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.387+0000 7f0446d79700 1 -- 172.21.15.87:0/140030826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0430003fa0 msgr2=0x7f0440155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:12.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.387+0000 7f0446d79700 1 --2- 172.21.15.87:0/140030826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0430003fa0 0x7f0440155740 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0434011ad0 tx=0x7f0434011e90 comp rx=0 tx=0).stop 2023-03-30T08:12:12.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.387+0000 7f0446d79700 1 -- 172.21.15.87:0/140030826 shutdown_connections 2023-03-30T08:12:12.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.387+0000 7f0446d79700 1 --2- 172.21.15.87:0/140030826 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0424065420 0x7f04240678d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.387+0000 7f0446d79700 1 --2- 172.21.15.87:0/140030826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0440152f30 0x7f0440155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.387+0000 7f0446d79700 1 --2- 172.21.15.87:0/140030826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0440154be0 0x7f04401f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.387+0000 7f0446d79700 1 --2- 172.21.15.87:0/140030826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0430003fa0 0x7f0440155740 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.387+0000 7f0446d79700 1 -- 172.21.15.87:0/140030826 >> 172.21.15.87:0/140030826 conn(0x7f044006b2e0 msgr2=0x7f04400b8480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:12.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.387+0000 7f0446d79700 1 -- 172.21.15.87:0/140030826 shutdown_connections 2023-03-30T08:12:12.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.387+0000 7f0446d79700 1 -- 172.21.15.87:0/140030826 wait complete. 2023-03-30T08:12:12.412 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-03-30T08:12:12.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.567+0000 7fc0522ab700 1 Processor -- start 2023-03-30T08:12:12.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc0522ab700 1 -- start start 2023-03-30T08:12:12.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc0522ab700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc04c163dc0 0x7fc04c0c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc0522ab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc04c164190 0x7fc04c0c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc0522ab700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc04c0aea30 0x7fc04c0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc0522ab700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04c06d810 con 0x7fc04c0aea30 2023-03-30T08:12:12.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc0522ab700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04c0cc1d0 con 0x7fc04c163dc0 2023-03-30T08:12:12.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc0522ab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c069f00 con 0x7fc04c164190 2023-03-30T08:12:12.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc051aaa700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc04c0aea30 0x7fc04c0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc0512a9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc04c163dc0 0x7fc04c0c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc050aa8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc04c164190 0x7fc04c0c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc050aa8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc04c164190 0x7fc04c0c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:46946/0 (socket says 172.21.15.87:46946) 2023-03-30T08:12:12.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc050aa8700 1 -- 172.21.15.87:0/2717949723 learned_addr learned my addr 172.21.15.87:0/2717949723 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:12.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc050aa8700 1 -- 172.21.15.87:0/2717949723 >> v2:172.21.15.115:3300/0 conn(0x7fc04c163dc0 msgr2=0x7fc04c0c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:12.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc050aa8700 1 --2- 172.21.15.87:0/2717949723 >> v2:172.21.15.115:3300/0 conn(0x7fc04c163dc0 0x7fc04c0c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc050aa8700 1 -- 172.21.15.87:0/2717949723 >> v2:172.21.15.87:3300/0 conn(0x7fc04c0aea30 msgr2=0x7fc04c0ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:12.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc050aa8700 1 --2- 172.21.15.87:0/2717949723 >> v2:172.21.15.87:3300/0 conn(0x7fc04c0aea30 0x7fc04c0ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.571+0000 7fc050aa8700 1 -- 172.21.15.87:0/2717949723 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c06cf70 con 0x7fc04c164190 2023-03-30T08:12:12.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.575+0000 7fc050aa8700 1 --2- 172.21.15.87:0/2717949723 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc04c164190 0x7fc04c0c9b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0cba30 tx=0x7fc03c009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd89ba39c41f58f8 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:12.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.575+0000 7fc043fff700 1 -- 172.21.15.87:0/2717949723 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c011830 con 0x7fc04c164190 2023-03-30T08:12:12.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.575+0000 7fc043fff700 1 -- 172.21.15.87:0/2717949723 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c011990 con 0x7fc04c164190 2023-03-30T08:12:12.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.575+0000 7fc043fff700 1 -- 172.21.15.87:0/2717949723 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c011d20 con 0x7fc04c164190 2023-03-30T08:12:12.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.575+0000 7fc0522ab700 1 -- 172.21.15.87:0/2717949723 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc04c164190 msgr2=0x7fc04c0c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:12.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.575+0000 7fc0522ab700 1 --2- 172.21.15.87:0/2717949723 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc04c164190 0x7fc04c0c9b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0cba30 tx=0x7fc03c009bf0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.581 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.575+0000 7fc0522ab700 1 -- 172.21.15.87:0/2717949723 shutdown_connections 2023-03-30T08:12:12.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.575+0000 7fc0522ab700 1 --2- 172.21.15.87:0/2717949723 >> v2:172.21.15.87:3300/0 conn(0x7fc04c0aea30 0x7fc04c0ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.575+0000 7fc0522ab700 1 --2- 172.21.15.87:0/2717949723 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc04c164190 0x7fc04c0c9b00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.575+0000 7fc0522ab700 1 --2- 172.21.15.87:0/2717949723 >> v2:172.21.15.115:3300/0 conn(0x7fc04c163dc0 0x7fc04c0c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.575+0000 7fc0522ab700 1 -- 172.21.15.87:0/2717949723 >> 172.21.15.87:0/2717949723 conn(0x7fc04c0cf410 msgr2=0x7fc04c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:12.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.575+0000 7fc0522ab700 1 -- 172.21.15.87:0/2717949723 shutdown_connections 2023-03-30T08:12:12.582 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.575+0000 7fc0522ab700 1 -- 172.21.15.87:0/2717949723 wait complete. 2023-03-30T08:12:12.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0522ab700 1 Processor -- start 2023-03-30T08:12:12.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0522ab700 1 -- start start 2023-03-30T08:12:12.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0522ab700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c0aea30 0x7fc04c14c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0522ab700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc04c163dc0 0x7fc04c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0522ab700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc04c164190 0x7fc04c06a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0522ab700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c14d3d0 con 0x7fc04c0aea30 2023-03-30T08:12:12.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0522ab700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c158d40 con 0x7fc04c164190 2023-03-30T08:12:12.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0522ab700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c158a60 con 0x7fc04c163dc0 2023-03-30T08:12:12.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0512a9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c0aea30 0x7fc04c14c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0512a9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c0aea30 0x7fc04c14c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59568/0 (socket says 172.21.15.87:59568) 2023-03-30T08:12:12.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0512a9700 1 -- 172.21.15.87:0/1387501365 learned_addr learned my addr 172.21.15.87:0/1387501365 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:12.587 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc050aa8700 1 --2- 172.21.15.87:0/1387501365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc04c163dc0 0x7fc04c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc051aaa700 1 --2- 172.21.15.87:0/1387501365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc04c164190 0x7fc04c06a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0512a9700 1 -- 172.21.15.87:0/1387501365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc04c163dc0 msgr2=0x7fc04c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:12.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0512a9700 1 --2- 172.21.15.87:0/1387501365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc04c163dc0 0x7fc04c15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0512a9700 1 -- 172.21.15.87:0/1387501365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc04c164190 msgr2=0x7fc04c06a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:12.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0512a9700 1 --2- 172.21.15.87:0/1387501365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc04c164190 0x7fc04c06a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc0512a9700 1 -- 172.21.15.87:0/1387501365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c009570 con 0x7fc04c0aea30 2023-03-30T08:12:12.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.579+0000 7fc051aaa700 1 --2- 172.21.15.87:0/1387501365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc04c164190 0x7fc04c06a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:12:12.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.583+0000 7fc0512a9700 1 --2- 172.21.15.87:0/1387501365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c0aea30 0x7fc04c14c930 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc04800e9d0 tx=0x7fc04800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:12.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.583+0000 7fc041ffb700 1 -- 172.21.15.87:0/1387501365 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048009720 con 0x7fc04c0aea30 2023-03-30T08:12:12.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.583+0000 7fc041ffb700 1 -- 172.21.15.87:0/1387501365 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04800c850 con 0x7fc04c0aea30 2023-03-30T08:12:12.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.583+0000 7fc041ffb700 1 -- 172.21.15.87:0/1387501365 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04800cbc0 con 0x7fc04c0aea30 2023-03-30T08:12:12.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.583+0000 7fc0522ab700 1 -- 172.21.15.87:0/1387501365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04c06d530 con 0x7fc04c0aea30 2023-03-30T08:12:12.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.583+0000 7fc0522ab700 1 -- 172.21.15.87:0/1387501365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04c06d250 con 0x7fc04c0aea30 2023-03-30T08:12:12.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.583+0000 7fc0522ab700 1 -- 172.21.15.87:0/1387501365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04c06cc40 con 0x7fc04c0aea30 2023-03-30T08:12:12.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.583+0000 7fc041ffb700 1 -- 172.21.15.87:0/1387501365 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc04800cd20 con 0x7fc04c0aea30 2023-03-30T08:12:12.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.587+0000 7fc041ffb700 1 --2- 172.21.15.87:0/1387501365 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0300653f0 0x7fc0300678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:12.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.587+0000 7fc041ffb700 1 -- 172.21.15.87:0/1387501365 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc0480827e0 con 0x7fc04c0aea30 2023-03-30T08:12:12.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.587+0000 7fc050aa8700 1 --2- 172.21.15.87:0/1387501365 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0300653f0 0x7fc0300678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:12.593 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.587+0000 7fc050aa8700 1 --2- 172.21.15.87:0/1387501365 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0300653f0 0x7fc0300678a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc04c164560 tx=0x7fc03c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:12.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.591+0000 7fc041ffb700 1 -- 172.21.15.87:0/1387501365 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fc048054090 con 0x7fc04c0aea30 2023-03-30T08:12:12.747 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:12:12.752 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:12:12.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.819+0000 7fc0522ab700 1 -- 172.21.15.87:0/1387501365 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fc04c0733a0 con 0x7fc04c0aea30 2023-03-30T08:12:12.831 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.827+0000 7fc041ffb700 1 -- 172.21.15.87:0/1387501365 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc048053c20 con 0x7fc04c0aea30 2023-03-30T08:12:12.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.831+0000 7fc0522ab700 1 -- 172.21.15.87:0/1387501365 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0300653f0 msgr2=0x7fc0300678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:12.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.831+0000 7fc0522ab700 1 --2- 172.21.15.87:0/1387501365 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0300653f0 0x7fc0300678a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc04c164560 tx=0x7fc03c008030 comp rx=0 tx=0).stop 2023-03-30T08:12:12.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.831+0000 7fc0522ab700 1 -- 172.21.15.87:0/1387501365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c0aea30 msgr2=0x7fc04c14c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:12.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.831+0000 7fc0522ab700 1 --2- 172.21.15.87:0/1387501365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c0aea30 0x7fc04c14c930 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc04800e9d0 tx=0x7fc04800ed90 comp rx=0 tx=0).stop 2023-03-30T08:12:12.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.831+0000 7fc0522ab700 1 -- 172.21.15.87:0/1387501365 shutdown_connections 2023-03-30T08:12:12.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.831+0000 7fc0522ab700 1 --2- 172.21.15.87:0/1387501365 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0300653f0 0x7fc0300678a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.831+0000 7fc0522ab700 1 --2- 172.21.15.87:0/1387501365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc04c164190 0x7fc04c06a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.831+0000 7fc0522ab700 1 --2- 172.21.15.87:0/1387501365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc04c163dc0 0x7fc04c15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.831+0000 7fc0522ab700 1 --2- 172.21.15.87:0/1387501365 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc04c0aea30 0x7fc04c14c930 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:12.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.831+0000 7fc0522ab700 1 -- 172.21.15.87:0/1387501365 >> 172.21.15.87:0/1387501365 conn(0x7fc04c0cf410 msgr2=0x7fc04c0cd270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:12.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.831+0000 7fc0522ab700 1 -- 172.21.15.87:0/1387501365 shutdown_connections 2023-03-30T08:12:12.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:12.831+0000 7fc0522ab700 1 -- 172.21.15.87:0/1387501365 wait complete. 2023-03-30T08:12:12.857 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:12:13.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.051+0000 7f1b2963e700 1 Processor -- start 2023-03-30T08:12:13.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.051+0000 7f1b2963e700 1 -- start start 2023-03-30T08:12:13.060 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.055+0000 7f1b2963e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b241600d0 0x7f1b2406a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.055+0000 7f1b2963e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1b2406aab0 0x7f1b240abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.055+0000 7f1b2963e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2406a0e0 con 0x7f1b240ad640 2023-03-30T08:12:13.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.055+0000 7f1b2963e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b240c9db0 con 0x7f1b2406aab0 2023-03-30T08:12:13.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.055+0000 7f1b2963e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240ca090 con 0x7f1b241600d0 2023-03-30T08:12:13.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.055+0000 7f1b1a7fc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1b2406aab0 0x7f1b240abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.055+0000 7f1b22ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b241600d0 0x7f1b2406a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.055+0000 7f1b22ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b241600d0 0x7f1b2406a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:46960/0 (socket says 172.21.15.87:46960) 2023-03-30T08:12:13.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.055+0000 7f1b22ffd700 1 -- 172.21.15.87:0/3944668257 learned_addr learned my addr 172.21.15.87:0/3944668257 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:13.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.055+0000 7f1b22ffd700 1 -- 172.21.15.87:0/3944668257 >> v2:172.21.15.87:3300/0 conn(0x7f1b2406aab0 msgr2=0x7f1b240abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:13.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.055+0000 7f1b22ffd700 1 --2- 172.21.15.87:0/3944668257 >> v2:172.21.15.87:3300/0 conn(0x7f1b2406aab0 0x7f1b240abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.055+0000 7f1b22ffd700 1 -- 172.21.15.87:0/3944668257 >> v1:172.21.15.115:6789/0 conn(0x7f1b240ad640 legacy=0x7f1b241604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:13.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.055+0000 7f1b22ffd700 1 -- 172.21.15.87:0/3944668257 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24069d70 con 0x7f1b241600d0 2023-03-30T08:12:13.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.059+0000 7f1b22ffd700 1 --2- 172.21.15.87:0/3944668257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b241600d0 0x7f1b2406a570 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009910 tx=0x7f1b14009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=704c6f8193293b5e server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:13.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.059+0000 7f1b227fc700 1 -- 172.21.15.87:0/3944668257 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14011830 con 0x7f1b241600d0 2023-03-30T08:12:13.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.059+0000 7f1b227fc700 1 -- 172.21.15.87:0/3944668257 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b14011990 con 0x7f1b241600d0 2023-03-30T08:12:13.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.059+0000 7f1b227fc700 1 -- 172.21.15.87:0/3944668257 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14011d40 con 0x7f1b241600d0 2023-03-30T08:12:13.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.059+0000 7f1b2963e700 1 -- 172.21.15.87:0/3944668257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b241600d0 msgr2=0x7f1b2406a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:13.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.059+0000 7f1b2963e700 1 --2- 172.21.15.87:0/3944668257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b241600d0 0x7f1b2406a570 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009910 tx=0x7f1b14009c20 comp rx=0 tx=0).stop 2023-03-30T08:12:13.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.059+0000 7f1b2963e700 1 -- 172.21.15.87:0/3944668257 shutdown_connections 2023-03-30T08:12:13.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.059+0000 7f1b2963e700 1 --2- 172.21.15.87:0/3944668257 >> v2:172.21.15.87:3300/0 conn(0x7f1b2406aab0 0x7f1b240abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.059+0000 7f1b2963e700 1 --2- 172.21.15.87:0/3944668257 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b241600d0 0x7f1b2406a570 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.059+0000 7f1b2963e700 1 -- 172.21.15.87:0/3944668257 >> 172.21.15.87:0/3944668257 conn(0x7f1b240cf410 msgr2=0x7f1b240cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:13.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.059+0000 7f1b2963e700 1 -- 172.21.15.87:0/3944668257 shutdown_connections 2023-03-30T08:12:13.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.059+0000 7f1b2963e700 1 -- 172.21.15.87:0/3944668257 wait complete. 2023-03-30T08:12:13.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.063+0000 7f1b2963e700 1 Processor -- start 2023-03-30T08:12:13.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.063+0000 7f1b2963e700 1 -- start start 2023-03-30T08:12:13.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.063+0000 7f1b2963e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b2406aab0 0x7f1b241494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.063+0000 7f1b2963e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b240ad640 0x7f1b240b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.063+0000 7f1b2963e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b241600d0 0x7f1b240b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.063+0000 7f1b2963e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b241f3160 con 0x7f1b240ad640 2023-03-30T08:12:13.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.063+0000 7f1b2963e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2414c040 con 0x7f1b2406aab0 2023-03-30T08:12:13.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.063+0000 7f1b2963e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2414c320 con 0x7f1b241600d0 2023-03-30T08:12:13.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.063+0000 7f1b1a7fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b240ad640 0x7f1b240b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.063+0000 7f1b1a7fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b240ad640 0x7f1b240b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59578/0 (socket says 172.21.15.87:59578) 2023-03-30T08:12:13.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.063+0000 7f1b1a7fc700 1 -- 172.21.15.87:0/2998230566 learned_addr learned my addr 172.21.15.87:0/2998230566 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:13.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.063+0000 7f1b22ffd700 1 --2- 172.21.15.87:0/2998230566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b2406aab0 0x7f1b241494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.063+0000 7f1b237fe700 1 --2- 172.21.15.87:0/2998230566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b241600d0 0x7f1b240b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.067+0000 7f1b1a7fc700 1 -- 172.21.15.87:0/2998230566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b241600d0 msgr2=0x7f1b240b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:13.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.067+0000 7f1b1a7fc700 1 --2- 172.21.15.87:0/2998230566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b241600d0 0x7f1b240b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.067+0000 7f1b1a7fc700 1 -- 172.21.15.87:0/2998230566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b2406aab0 msgr2=0x7f1b241494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:13.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.067+0000 7f1b1a7fc700 1 --2- 172.21.15.87:0/2998230566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b2406aab0 0x7f1b241494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.067+0000 7f1b1a7fc700 1 -- 172.21.15.87:0/2998230566 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b14009570 con 0x7f1b240ad640 2023-03-30T08:12:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.067+0000 7f1b1a7fc700 1 --2- 172.21.15.87:0/2998230566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b240ad640 0x7f1b240b05c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00e9d0 tx=0x7f1b0c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.067+0000 7f1b1bfff700 1 -- 172.21.15.87:0/2998230566 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c009720 con 0x7f1b240ad640 2023-03-30T08:12:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.067+0000 7f1b1bfff700 1 -- 172.21.15.87:0/2998230566 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c00ee70 con 0x7f1b240ad640 2023-03-30T08:12:13.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.067+0000 7f1b1bfff700 1 -- 172.21.15.87:0/2998230566 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c00ca50 con 0x7f1b240ad640 2023-03-30T08:12:13.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.067+0000 7f1b2963e700 1 -- 172.21.15.87:0/2998230566 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b240addc0 con 0x7f1b240ad640 2023-03-30T08:12:13.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.067+0000 7f1b2963e700 1 -- 172.21.15.87:0/2998230566 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b240ca370 con 0x7f1b240ad640 2023-03-30T08:12:13.074 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.067+0000 7f1b2963e700 1 -- 172.21.15.87:0/2998230566 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2415d8c0 con 0x7f1b240ad640 2023-03-30T08:12:13.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.071+0000 7f1b1bfff700 1 -- 172.21.15.87:0/2998230566 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f1b0c00cbb0 con 0x7f1b240ad640 2023-03-30T08:12:13.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.071+0000 7f1b1bfff700 1 --2- 172.21.15.87:0/2998230566 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1b040653f0 0x7f1b040678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.071+0000 7f1b1bfff700 1 -- 172.21.15.87:0/2998230566 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1b0c0826b0 con 0x7f1b240ad640 2023-03-30T08:12:13.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.071+0000 7f1b22ffd700 1 --2- 172.21.15.87:0/2998230566 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1b040653f0 0x7f1b040678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.071+0000 7f1b22ffd700 1 --2- 172.21.15.87:0/2998230566 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1b040653f0 0x7f1b040678a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1b14000c00 tx=0x7f1b14008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:13.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.075+0000 7f1b1bfff700 1 -- 172.21.15.87:0/2998230566 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f1b0c053f80 con 0x7f1b240ad640 2023-03-30T08:12:13.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.251+0000 7f1b2963e700 1 -- 172.21.15.87:0/2998230566 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b240733a0 con 0x7f1b240ad640 2023-03-30T08:12:13.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.251+0000 7f1b1bfff700 1 -- 172.21.15.87:0/2998230566 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+14376 (secure 0 0 0) 0x7f1b0c00ce60 con 0x7f1b240ad640 2023-03-30T08:12:13.259 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:13.260 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":39,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:12:09.675489+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:12:13.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.255+0000 7f1b2963e700 1 -- 172.21.15.87:0/2998230566 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1b040653f0 msgr2=0x7f1b040678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:13.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.255+0000 7f1b2963e700 1 --2- 172.21.15.87:0/2998230566 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1b040653f0 0x7f1b040678a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1b14000c00 tx=0x7f1b14008030 comp rx=0 tx=0).stop 2023-03-30T08:12:13.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.255+0000 7f1b2963e700 1 -- 172.21.15.87:0/2998230566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b240ad640 msgr2=0x7f1b240b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:13.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.255+0000 7f1b2963e700 1 --2- 172.21.15.87:0/2998230566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b240ad640 0x7f1b240b05c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00e9d0 tx=0x7f1b0c00ece0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.255+0000 7f1b2963e700 1 -- 172.21.15.87:0/2998230566 shutdown_connections 2023-03-30T08:12:13.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.255+0000 7f1b2963e700 1 --2- 172.21.15.87:0/2998230566 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1b040653f0 0x7f1b040678a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.255+0000 7f1b2963e700 1 --2- 172.21.15.87:0/2998230566 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1b241600d0 0x7f1b240b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.255+0000 7f1b2963e700 1 --2- 172.21.15.87:0/2998230566 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1b240ad640 0x7f1b240b05c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.255+0000 7f1b2963e700 1 --2- 172.21.15.87:0/2998230566 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b2406aab0 0x7f1b241494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.255+0000 7f1b2963e700 1 -- 172.21.15.87:0/2998230566 >> 172.21.15.87:0/2998230566 conn(0x7f1b240cf410 msgr2=0x7f1b2415be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:13.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.255+0000 7f1b2963e700 1 -- 172.21.15.87:0/2998230566 shutdown_connections 2023-03-30T08:12:13.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.255+0000 7f1b2963e700 1 -- 172.21.15.87:0/2998230566 wait complete. 2023-03-30T08:12:13.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-30T08:12:13.281 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T08:12:13.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.439+0000 7f4ea9726700 1 Processor -- start 2023-03-30T08:12:13.447 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.439+0000 7f4ea9726700 1 -- start start 2023-03-30T08:12:13.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.443+0000 7f4ea9726700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4ea4163dc0 0x7f4ea40c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.443+0000 7f4ea9726700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4ea40aea30 0x7f4ea406a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.443+0000 7f4ea9726700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea4069f00 con 0x7f4ea4164190 2023-03-30T08:12:13.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.443+0000 7f4ea9726700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea406d810 con 0x7f4ea4163dc0 2023-03-30T08:12:13.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.443+0000 7f4ea9726700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea40cc1d0 con 0x7f4ea40aea30 2023-03-30T08:12:13.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.443+0000 7f4ea2ffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4ea4163dc0 0x7f4ea40c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea27fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f4ea4164190 0x7f4ea40c9b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:35776/0 (socket says 172.21.15.87:35776) 2023-03-30T08:12:13.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea27fc700 1 -- 172.21.15.87:0/1287179719 learned_addr learned my addr 172.21.15.87:0/1287179719 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:13.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea37fe700 1 --2- 172.21.15.87:0/1287179719 >> v2:172.21.15.115:3300/0 conn(0x7f4ea40aea30 0x7f4ea406a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea1ffb700 1 -- 172.21.15.87:0/1287179719 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000607489 0 0) 0x7f4ea4069f00 con 0x7f4ea4164190 2023-03-30T08:12:13.452 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea2ffd700 1 -- 172.21.15.87:0/1287179719 >> v2:172.21.15.115:3300/0 conn(0x7f4ea40aea30 msgr2=0x7f4ea406a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:13.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea2ffd700 1 --2- 172.21.15.87:0/1287179719 >> v2:172.21.15.115:3300/0 conn(0x7f4ea40aea30 0x7f4ea406a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea2ffd700 1 -- 172.21.15.87:0/1287179719 >> v1:172.21.15.115:6789/0 conn(0x7f4ea4164190 legacy=0x7f4ea40c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:13.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea2ffd700 1 -- 172.21.15.87:0/1287179719 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea406cf70 con 0x7f4ea4163dc0 2023-03-30T08:12:13.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea37fe700 1 --2- 172.21.15.87:0/1287179719 >> v2:172.21.15.115:3300/0 conn(0x7f4ea40aea30 0x7f4ea406a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:13.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea2ffd700 1 --2- 172.21.15.87:0/1287179719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea4163dc0 0x7f4ea40c95c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40cb9a0 tx=0x7f4e94009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0a7aa417cc1d11 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:13.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea1ffb700 1 -- 172.21.15.87:0/1287179719 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e94011830 con 0x7f4ea4163dc0 2023-03-30T08:12:13.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea1ffb700 1 -- 172.21.15.87:0/1287179719 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e94011990 con 0x7f4ea4163dc0 2023-03-30T08:12:13.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea1ffb700 1 -- 172.21.15.87:0/1287179719 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e94011d40 con 0x7f4ea4163dc0 2023-03-30T08:12:13.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea9726700 1 -- 172.21.15.87:0/1287179719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea4163dc0 msgr2=0x7f4ea40c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:13.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea9726700 1 --2- 172.21.15.87:0/1287179719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea4163dc0 0x7f4ea40c95c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40cb9a0 tx=0x7f4e94009b30 comp rx=0 tx=0).stop 2023-03-30T08:12:13.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea9726700 1 -- 172.21.15.87:0/1287179719 shutdown_connections 2023-03-30T08:12:13.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea9726700 1 --2- 172.21.15.87:0/1287179719 >> v2:172.21.15.115:3300/0 conn(0x7f4ea40aea30 0x7f4ea406a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea9726700 1 --2- 172.21.15.87:0/1287179719 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea4163dc0 0x7f4ea40c95c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea9726700 1 -- 172.21.15.87:0/1287179719 >> 172.21.15.87:0/1287179719 conn(0x7f4ea40cf410 msgr2=0x7f4ea40cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:13.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea9726700 1 -- 172.21.15.87:0/1287179719 shutdown_connections 2023-03-30T08:12:13.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.447+0000 7f4ea9726700 1 -- 172.21.15.87:0/1287179719 wait complete. 2023-03-30T08:12:13.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.451+0000 7f4ea9726700 1 Processor -- start 2023-03-30T08:12:13.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea9726700 1 -- start start 2023-03-30T08:12:13.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea9726700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ea40aea30 0x7f4ea414edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea9726700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea4163dc0 0x7f4ea414cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea9726700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ea4164190 0x7f4ea414b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea9726700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea415f890 con 0x7f4ea4163dc0 2023-03-30T08:12:13.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea9726700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea414d280 con 0x7f4ea4164190 2023-03-30T08:12:13.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea9726700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea41499d0 con 0x7f4ea40aea30 2023-03-30T08:12:13.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea27fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea4163dc0 0x7f4ea414cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea27fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea4163dc0 0x7f4ea414cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59602/0 (socket says 172.21.15.87:59602) 2023-03-30T08:12:13.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea27fc700 1 -- 172.21.15.87:0/4194236792 learned_addr learned my addr 172.21.15.87:0/4194236792 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:13.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea2ffd700 1 --2- 172.21.15.87:0/4194236792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ea40aea30 0x7f4ea414edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea37fe700 1 --2- 172.21.15.87:0/4194236792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ea4164190 0x7f4ea414b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea27fc700 1 -- 172.21.15.87:0/4194236792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ea40aea30 msgr2=0x7f4ea414edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:13.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea27fc700 1 --2- 172.21.15.87:0/4194236792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ea40aea30 0x7f4ea414edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea27fc700 1 -- 172.21.15.87:0/4194236792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ea4164190 msgr2=0x7f4ea414b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:13.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea27fc700 1 --2- 172.21.15.87:0/4194236792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ea4164190 0x7f4ea414b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea27fc700 1 -- 172.21.15.87:0/4194236792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940094b0 con 0x7f4ea4163dc0 2023-03-30T08:12:13.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.455+0000 7f4ea27fc700 1 --2- 172.21.15.87:0/4194236792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea4163dc0 0x7f4ea414cd40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800c520 tx=0x7f4e9800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:13.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.459+0000 7f4e8b7fe700 1 -- 172.21.15.87:0/4194236792 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98004ca0 con 0x7f4ea4163dc0 2023-03-30T08:12:13.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.459+0000 7f4e8b7fe700 1 -- 172.21.15.87:0/4194236792 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e98004e00 con 0x7f4ea4163dc0 2023-03-30T08:12:13.465 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.459+0000 7f4ea9726700 1 -- 172.21.15.87:0/4194236792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea406d530 con 0x7f4ea4163dc0 2023-03-30T08:12:13.465 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.459+0000 7f4e8b7fe700 1 -- 172.21.15.87:0/4194236792 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98007310 con 0x7f4ea4163dc0 2023-03-30T08:12:13.465 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.459+0000 7f4ea9726700 1 -- 172.21.15.87:0/4194236792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea406d250 con 0x7f4ea4163dc0 2023-03-30T08:12:13.465 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.459+0000 7f4ea9726700 1 -- 172.21.15.87:0/4194236792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea406cc40 con 0x7f4ea4163dc0 2023-03-30T08:12:13.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.463+0000 7f4e8b7fe700 1 -- 172.21.15.87:0/4194236792 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f4e98007470 con 0x7f4ea4163dc0 2023-03-30T08:12:13.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.463+0000 7f4e8b7fe700 1 --2- 172.21.15.87:0/4194236792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4e900653f0 0x7f4e900678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.463+0000 7f4e8b7fe700 1 -- 172.21.15.87:0/4194236792 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4e980822f0 con 0x7f4ea4163dc0 2023-03-30T08:12:13.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.463+0000 7f4ea2ffd700 1 --2- 172.21.15.87:0/4194236792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4e900653f0 0x7f4e900678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.467+0000 7f4ea2ffd700 1 --2- 172.21.15.87:0/4194236792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4e900653f0 0x7f4e900678a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009b70 tx=0x7f4e94008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:13.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.471+0000 7f4e8b7fe700 1 -- 172.21.15.87:0/4194236792 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f4e980500e0 con 0x7f4ea4163dc0 2023-03-30T08:12:13.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.647+0000 7f4ea9726700 1 -- 172.21.15.87:0/4194236792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ea40733a0 con 0x7f4ea4163dc0 2023-03-30T08:12:13.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.647+0000 7f4e8b7fe700 1 -- 172.21.15.87:0/4194236792 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e98007720 con 0x7f4ea4163dc0 2023-03-30T08:12:13.652 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T08:12:13.654 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.647+0000 7f4ea9726700 1 -- 172.21.15.87:0/4194236792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4e900653f0 msgr2=0x7f4e900678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:13.654 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.647+0000 7f4ea9726700 1 --2- 172.21.15.87:0/4194236792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4e900653f0 0x7f4e900678a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009b70 tx=0x7f4e94008030 comp rx=0 tx=0).stop 2023-03-30T08:12:13.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.647+0000 7f4ea9726700 1 -- 172.21.15.87:0/4194236792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea4163dc0 msgr2=0x7f4ea414cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:13.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.647+0000 7f4ea9726700 1 --2- 172.21.15.87:0/4194236792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea4163dc0 0x7f4ea414cd40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800c520 tx=0x7f4e9800c830 comp rx=0 tx=0).stop 2023-03-30T08:12:13.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.647+0000 7f4ea9726700 1 -- 172.21.15.87:0/4194236792 shutdown_connections 2023-03-30T08:12:13.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.647+0000 7f4ea9726700 1 --2- 172.21.15.87:0/4194236792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4e900653f0 0x7f4e900678a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.647+0000 7f4ea9726700 1 --2- 172.21.15.87:0/4194236792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ea4164190 0x7f4ea414b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.647+0000 7f4ea9726700 1 --2- 172.21.15.87:0/4194236792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ea4163dc0 0x7f4ea414cd40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.647+0000 7f4ea9726700 1 --2- 172.21.15.87:0/4194236792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ea40aea30 0x7f4ea414edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.647+0000 7f4ea9726700 1 -- 172.21.15.87:0/4194236792 >> 172.21.15.87:0/4194236792 conn(0x7f4ea40cf410 msgr2=0x7f4ea40cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:13.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.651+0000 7f4ea9726700 1 -- 172.21.15.87:0/4194236792 shutdown_connections 2023-03-30T08:12:13.656 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.651+0000 7f4ea9726700 1 -- 172.21.15.87:0/4194236792 wait complete. 2023-03-30T08:12:13.672 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T08:12:13.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 Processor -- start 2023-03-30T08:12:13.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 -- start start 2023-03-30T08:12:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4a080b41c0 0x7f4a080cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4a080c8fb0 0x7f4a08070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a08070960 0x7f4a08069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a0815ed50 con 0x7f4a080c8fb0 2023-03-30T08:12:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a0815e8c0 con 0x7f4a080b41c0 2023-03-30T08:12:13.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a08070da0 con 0x7f4a08070960 2023-03-30T08:12:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a07fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4a080c8fb0 0x7f4a08070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a07fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4a080c8fb0 0x7f4a08070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59614/0 (socket says 172.21.15.87:59614) 2023-03-30T08:12:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a07fff700 1 -- 172.21.15.87:0/1947041462 learned_addr learned my addr 172.21.15.87:0/1947041462 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0d342700 1 --2- 172.21.15.87:0/1947041462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a08070960 0x7f4a08069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0cb41700 1 --2- 172.21.15.87:0/1947041462 >> v2:172.21.15.115:3300/0 conn(0x7f4a080b41c0 0x7f4a080cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0cb41700 1 -- 172.21.15.87:0/1947041462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a08070960 msgr2=0x7f4a08069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:13.840 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0cb41700 1 --2- 172.21.15.87:0/1947041462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a08070960 0x7f4a08069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0cb41700 1 -- 172.21.15.87:0/1947041462 >> v2:172.21.15.87:3300/0 conn(0x7f4a080c8fb0 msgr2=0x7f4a08070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:13.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0cb41700 1 --2- 172.21.15.87:0/1947041462 >> v2:172.21.15.87:3300/0 conn(0x7f4a080c8fb0 0x7f4a08070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0cb41700 1 -- 172.21.15.87:0/1947041462 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a080c96b0 con 0x7f4a080b41c0 2023-03-30T08:12:13.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a07fff700 1 --2- 172.21.15.87:0/1947041462 >> v2:172.21.15.87:3300/0 conn(0x7f4a080c8fb0 0x7f4a08070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:12:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0cb41700 1 --2- 172.21.15.87:0/1947041462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a080b41c0 0x7f4a080cab10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4a0806fed0 tx=0x7f49fc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1e466ff8cbdec24 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a077fe700 1 -- 172.21.15.87:0/1947041462 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc011830 con 0x7f4a080b41c0 2023-03-30T08:12:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a077fe700 1 -- 172.21.15.87:0/1947041462 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc011990 con 0x7f4a080b41c0 2023-03-30T08:12:13.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a077fe700 1 -- 172.21.15.87:0/1947041462 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc011d20 con 0x7f4a080b41c0 2023-03-30T08:12:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 -- 172.21.15.87:0/1947041462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a080b41c0 msgr2=0x7f4a080cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 --2- 172.21.15.87:0/1947041462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a080b41c0 0x7f4a080cab10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4a0806fed0 tx=0x7f49fc009b30 comp rx=0 tx=0).stop 2023-03-30T08:12:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 -- 172.21.15.87:0/1947041462 shutdown_connections 2023-03-30T08:12:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 --2- 172.21.15.87:0/1947041462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a08070960 0x7f4a08069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 --2- 172.21.15.87:0/1947041462 >> v2:172.21.15.87:3300/0 conn(0x7f4a080c8fb0 0x7f4a08070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 --2- 172.21.15.87:0/1947041462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a080b41c0 0x7f4a080cab10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 -- 172.21.15.87:0/1947041462 >> 172.21.15.87:0/1947041462 conn(0x7f4a080ce960 msgr2=0x7f4a080ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:13.843 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 -- 172.21.15.87:0/1947041462 shutdown_connections 2023-03-30T08:12:13.844 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.835+0000 7f4a0eda5700 1 -- 172.21.15.87:0/1947041462 wait complete. 2023-03-30T08:12:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.839+0000 7f4a0eda5700 1 Processor -- start 2023-03-30T08:12:13.845 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.839+0000 7f4a0eda5700 1 -- start start 2023-03-30T08:12:13.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.839+0000 7f4a0eda5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a08070960 0x7f4a080b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.839+0000 7f4a0eda5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a080b41c0 0x7f4a0814cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.846 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.839+0000 7f4a0eda5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a080c8fb0 0x7f4a08149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.839+0000 7f4a0eda5700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0815b8e0 con 0x7f4a08070960 2023-03-30T08:12:13.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.839+0000 7f4a0eda5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0814d290 con 0x7f4a080c8fb0 2023-03-30T08:12:13.847 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.839+0000 7f4a0eda5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a080b0990 con 0x7f4a080b41c0 2023-03-30T08:12:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a0cb41700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a08070960 0x7f4a080b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a0cb41700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a08070960 0x7f4a080b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59628/0 (socket says 172.21.15.87:59628) 2023-03-30T08:12:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a0cb41700 1 -- 172.21.15.87:0/1815015591 learned_addr learned my addr 172.21.15.87:0/1815015591 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a07fff700 1 --2- 172.21.15.87:0/1815015591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a080b41c0 0x7f4a0814cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.848 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a0d342700 1 --2- 172.21.15.87:0/1815015591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a080c8fb0 0x7f4a08149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a0cb41700 1 -- 172.21.15.87:0/1815015591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a080b41c0 msgr2=0x7f4a0814cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a0cb41700 1 --2- 172.21.15.87:0/1815015591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a080b41c0 0x7f4a0814cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a0cb41700 1 -- 172.21.15.87:0/1815015591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a080c8fb0 msgr2=0x7f4a08149960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a0cb41700 1 --2- 172.21.15.87:0/1815015591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a080c8fb0 0x7f4a08149960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a0cb41700 1 -- 172.21.15.87:0/1815015591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f4009570 con 0x7f4a08070960 2023-03-30T08:12:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a0d342700 1 --2- 172.21.15.87:0/1815015591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a080c8fb0 0x7f4a08149960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:12:13.849 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a0cb41700 1 --2- 172.21.15.87:0/1815015591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a08070960 0x7f4a080b02d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009b70 tx=0x7f49fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:13.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a057fa700 1 -- 172.21.15.87:0/1815015591 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc004380 con 0x7f4a08070960 2023-03-30T08:12:13.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a057fa700 1 -- 172.21.15.87:0/1815015591 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc01f070 con 0x7f4a08070960 2023-03-30T08:12:13.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a0eda5700 1 -- 172.21.15.87:0/1815015591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49fc0094b0 con 0x7f4a08070960 2023-03-30T08:12:13.850 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a057fa700 1 -- 172.21.15.87:0/1815015591 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc0036c0 con 0x7f4a08070960 2023-03-30T08:12:13.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a0eda5700 1 -- 172.21.15.87:0/1815015591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a080ce720 con 0x7f4a08070960 2023-03-30T08:12:13.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.843+0000 7f4a0eda5700 1 -- 172.21.15.87:0/1815015591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a080c9430 con 0x7f4a08070960 2023-03-30T08:12:13.851 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.847+0000 7f4a057fa700 1 -- 172.21.15.87:0/1815015591 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f49fc021030 con 0x7f4a08070960 2023-03-30T08:12:13.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.847+0000 7f4a057fa700 1 --2- 172.21.15.87:0/1815015591 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f49ec0653f0 0x7f49ec0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:13.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.847+0000 7f4a057fa700 1 -- 172.21.15.87:0/1815015591 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f49fc083860 con 0x7f4a08070960 2023-03-30T08:12:13.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.847+0000 7f4a07fff700 1 --2- 172.21.15.87:0/1815015591 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f49ec0653f0 0x7f49ec0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:13.854 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.847+0000 7f4a07fff700 1 --2- 172.21.15.87:0/1815015591 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f49ec0653f0 0x7f49ec0678a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4a081f53c0 tx=0x7f49f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:13.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:13.851+0000 7f4a057fa700 1 -- 172.21.15.87:0/1815015591 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f49fc0516e0 con 0x7f4a08070960 2023-03-30T08:12:14.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.027+0000 7f4a0eda5700 1 -- 172.21.15.87:0/1815015591 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4a0815df90 con 0x7f4a08070960 2023-03-30T08:12:14.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.027+0000 7f4a057fa700 1 -- 172.21.15.87:0/1815015591 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f49fc0150a0 con 0x7f4a08070960 2023-03-30T08:12:14.032 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T08:12:14.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.027+0000 7f4a0eda5700 1 -- 172.21.15.87:0/1815015591 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f49ec0653f0 msgr2=0x7f49ec0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:14.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.027+0000 7f4a0eda5700 1 --2- 172.21.15.87:0/1815015591 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f49ec0653f0 0x7f49ec0678a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4a081f53c0 tx=0x7f49f4008040 comp rx=0 tx=0).stop 2023-03-30T08:12:14.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.027+0000 7f4a0eda5700 1 -- 172.21.15.87:0/1815015591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a08070960 msgr2=0x7f4a080b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:14.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.027+0000 7f4a0eda5700 1 --2- 172.21.15.87:0/1815015591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a08070960 0x7f4a080b02d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009b70 tx=0x7f49fc004770 comp rx=0 tx=0).stop 2023-03-30T08:12:14.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.027+0000 7f4a0eda5700 1 -- 172.21.15.87:0/1815015591 shutdown_connections 2023-03-30T08:12:14.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.027+0000 7f4a0eda5700 1 --2- 172.21.15.87:0/1815015591 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f49ec0653f0 0x7f49ec0678a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.027+0000 7f4a0eda5700 1 --2- 172.21.15.87:0/1815015591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a080c8fb0 0x7f4a08149960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.027+0000 7f4a0eda5700 1 --2- 172.21.15.87:0/1815015591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4a080b41c0 0x7f4a0814cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.027+0000 7f4a0eda5700 1 --2- 172.21.15.87:0/1815015591 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a08070960 0x7f4a080b02d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.027+0000 7f4a0eda5700 1 -- 172.21.15.87:0/1815015591 >> 172.21.15.87:0/1815015591 conn(0x7f4a080ce960 msgr2=0x7f4a080ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:14.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.031+0000 7f4a0eda5700 1 -- 172.21.15.87:0/1815015591 shutdown_connections 2023-03-30T08:12:14.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.031+0000 7f4a0eda5700 1 -- 172.21.15.87:0/1815015591 wait complete. 2023-03-30T08:12:14.055 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-30T08:12:14.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.215+0000 7fc470251700 1 Processor -- start 2023-03-30T08:12:14.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.215+0000 7fc470251700 1 -- start start 2023-03-30T08:12:14.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc470251700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc4680b41c0 0x7fc4680cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:14.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc470251700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4680c8fb0 0x7fc468070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:14.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc470251700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc468070dc0 con 0x7fc468070960 2023-03-30T08:12:14.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc470251700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc46815ed50 con 0x7fc4680b41c0 2023-03-30T08:12:14.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc470251700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46815e8c0 con 0x7fc4680c8fb0 2023-03-30T08:12:14.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc46e7ee700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc468070960 0x7fc468069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41774/0 (socket says 172.21.15.87:41774) 2023-03-30T08:12:14.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc46e7ee700 1 -- 172.21.15.87:0/3357322447 learned_addr learned my addr 172.21.15.87:0/3357322447 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:14.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc46dfed700 1 --2- 172.21.15.87:0/3357322447 >> v2:172.21.15.115:3300/0 conn(0x7fc4680b41c0 0x7fc4680cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:14.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc46d7ec700 1 --2- 172.21.15.87:0/3357322447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4680c8fb0 0x7fc468070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:14.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc46cfeb700 1 -- 172.21.15.87:0/3357322447 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003083274 0 0) 0x7fc468070dc0 con 0x7fc468070960 2023-03-30T08:12:14.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc46cfeb700 1 -- 172.21.15.87:0/3357322447 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4540035d0 con 0x7fc468070960 2023-03-30T08:12:14.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc46dfed700 1 -- 172.21.15.87:0/3357322447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4680c8fb0 msgr2=0x7fc468070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:14.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc46dfed700 1 --2- 172.21.15.87:0/3357322447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4680c8fb0 0x7fc468070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc46dfed700 1 -- 172.21.15.87:0/3357322447 >> v1:172.21.15.87:6789/0 conn(0x7fc468070960 legacy=0x7fc468069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:14.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc46dfed700 1 -- 172.21.15.87:0/3357322447 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4680c96b0 con 0x7fc4680b41c0 2023-03-30T08:12:14.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.219+0000 7fc46dfed700 1 --2- 172.21.15.87:0/3357322447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4680b41c0 0x7fc4680cab10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc464009850 tx=0x7fc464009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c56537ef5ae4d30d server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:14.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.223+0000 7fc46cfeb700 1 -- 172.21.15.87:0/3357322447 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464011830 con 0x7fc4680b41c0 2023-03-30T08:12:14.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.223+0000 7fc46cfeb700 1 -- 172.21.15.87:0/3357322447 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc464011990 con 0x7fc4680b41c0 2023-03-30T08:12:14.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.223+0000 7fc46cfeb700 1 -- 172.21.15.87:0/3357322447 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464011d40 con 0x7fc4680b41c0 2023-03-30T08:12:14.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.223+0000 7fc470251700 1 -- 172.21.15.87:0/3357322447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4680b41c0 msgr2=0x7fc4680cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:14.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.223+0000 7fc470251700 1 --2- 172.21.15.87:0/3357322447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4680b41c0 0x7fc4680cab10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc464009850 tx=0x7fc464009b60 comp rx=0 tx=0).stop 2023-03-30T08:12:14.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.223+0000 7fc470251700 1 -- 172.21.15.87:0/3357322447 shutdown_connections 2023-03-30T08:12:14.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.223+0000 7fc470251700 1 --2- 172.21.15.87:0/3357322447 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc4680c8fb0 0x7fc468070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.223+0000 7fc470251700 1 --2- 172.21.15.87:0/3357322447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4680b41c0 0x7fc4680cab10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.223+0000 7fc470251700 1 -- 172.21.15.87:0/3357322447 >> 172.21.15.87:0/3357322447 conn(0x7fc4680ce960 msgr2=0x7fc4680ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:14.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.223+0000 7fc470251700 1 -- 172.21.15.87:0/3357322447 shutdown_connections 2023-03-30T08:12:14.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.223+0000 7fc470251700 1 -- 172.21.15.87:0/3357322447 wait complete. 2023-03-30T08:12:14.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.227+0000 7fc470251700 1 Processor -- start 2023-03-30T08:12:14.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.227+0000 7fc470251700 1 -- start start 2023-03-30T08:12:14.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc470251700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc468070960 0x7fc4681582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:14.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc470251700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4680b41c0 0x7fc4680cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:14.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc470251700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4680c8fb0 0x7fc4680cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:14.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc470251700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc468158c20 con 0x7fc4680b41c0 2023-03-30T08:12:14.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc470251700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46806cad0 con 0x7fc4680c8fb0 2023-03-30T08:12:14.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc470251700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46806cce0 con 0x7fc468070960 2023-03-30T08:12:14.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc46d7ec700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4680b41c0 0x7fc4680cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:14.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc46d7ec700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4680b41c0 0x7fc4680cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59630/0 (socket says 172.21.15.87:59630) 2023-03-30T08:12:14.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc46d7ec700 1 -- 172.21.15.87:0/2171613645 learned_addr learned my addr 172.21.15.87:0/2171613645 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:14.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc46dfed700 1 --2- 172.21.15.87:0/2171613645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc468070960 0x7fc4681582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:14.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc46e7ee700 1 --2- 172.21.15.87:0/2171613645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4680c8fb0 0x7fc4680cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:14.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc46dfed700 1 -- 172.21.15.87:0/2171613645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4680c8fb0 msgr2=0x7fc4680cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:14.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc46dfed700 1 --2- 172.21.15.87:0/2171613645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4680c8fb0 0x7fc4680cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc46dfed700 1 -- 172.21.15.87:0/2171613645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4680b41c0 msgr2=0x7fc4680cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:14.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc46dfed700 1 --2- 172.21.15.87:0/2171613645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4680b41c0 0x7fc4680cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc46dfed700 1 -- 172.21.15.87:0/2171613645 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4640094b0 con 0x7fc468070960 2023-03-30T08:12:14.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc46d7ec700 1 --2- 172.21.15.87:0/2171613645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4680b41c0 0x7fc4680cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:12:14.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc46dfed700 1 --2- 172.21.15.87:0/2171613645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc468070960 0x7fc4681582b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc4680b1530 tx=0x7fc464004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:14.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc45e7fc700 1 -- 172.21.15.87:0/2171613645 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464004450 con 0x7fc468070960 2023-03-30T08:12:14.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc470251700 1 -- 172.21.15.87:0/2171613645 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4680ce720 con 0x7fc468070960 2023-03-30T08:12:14.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc45e7fc700 1 -- 172.21.15.87:0/2171613645 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46401f070 con 0x7fc468070960 2023-03-30T08:12:14.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc45e7fc700 1 -- 172.21.15.87:0/2171613645 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464003900 con 0x7fc468070960 2023-03-30T08:12:14.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.231+0000 7fc470251700 1 -- 172.21.15.87:0/2171613645 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4680c9400 con 0x7fc468070960 2023-03-30T08:12:14.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.235+0000 7fc470251700 1 -- 172.21.15.87:0/2171613645 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46815df90 con 0x7fc468070960 2023-03-30T08:12:14.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.235+0000 7fc45e7fc700 1 -- 172.21.15.87:0/2171613645 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc464003a60 con 0x7fc468070960 2023-03-30T08:12:14.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.239+0000 7fc45e7fc700 1 --2- 172.21.15.87:0/2171613645 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc44c0653f0 0x7fc44c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:14.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.239+0000 7fc45e7fc700 1 -- 172.21.15.87:0/2171613645 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc464021070 con 0x7fc468070960 2023-03-30T08:12:14.243 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.239+0000 7fc46d7ec700 1 --2- 172.21.15.87:0/2171613645 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc44c0653f0 0x7fc44c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:14.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.239+0000 7fc46d7ec700 1 --2- 172.21.15.87:0/2171613645 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc44c0653f0 0x7fc44c0678a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc46806def0 tx=0x7fc458009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:14.248 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.243+0000 7fc45e7fc700 1 -- 172.21.15.87:0/2171613645 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fc464052210 con 0x7fc468070960 2023-03-30T08:12:14.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.415+0000 7fc470251700 1 -- 172.21.15.87:0/2171613645 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc46806ce20 con 0x7fc468070960 2023-03-30T08:12:14.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.419+0000 7fc45e7fc700 1 -- 172.21.15.87:0/2171613645 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v39) v1 ==== 84+0+126 (secure 0 0 0) 0x7fc46806ce20 con 0x7fc468070960 2023-03-30T08:12:14.423 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:14.423 INFO:teuthology.orchestra.run.smithi087.stdout:[ 2023-03-30T08:12:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "poolnum": 1, 2023-03-30T08:12:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "poolname": ".mgr" 2023-03-30T08:12:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2023-03-30T08:12:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2023-03-30T08:12:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "poolnum": 2, 2023-03-30T08:12:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: "poolname": "rbd" 2023-03-30T08:12:14.424 INFO:teuthology.orchestra.run.smithi087.stdout: } 2023-03-30T08:12:14.425 INFO:teuthology.orchestra.run.smithi087.stdout:] 2023-03-30T08:12:14.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.423+0000 7fc470251700 1 -- 172.21.15.87:0/2171613645 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc44c0653f0 msgr2=0x7fc44c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:14.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.423+0000 7fc470251700 1 --2- 172.21.15.87:0/2171613645 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc44c0653f0 0x7fc44c0678a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc46806def0 tx=0x7fc458009240 comp rx=0 tx=0).stop 2023-03-30T08:12:14.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.423+0000 7fc470251700 1 -- 172.21.15.87:0/2171613645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc468070960 msgr2=0x7fc4681582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:14.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.423+0000 7fc470251700 1 --2- 172.21.15.87:0/2171613645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc468070960 0x7fc4681582b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc4680b1530 tx=0x7fc464004770 comp rx=0 tx=0).stop 2023-03-30T08:12:14.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.423+0000 7fc470251700 1 -- 172.21.15.87:0/2171613645 shutdown_connections 2023-03-30T08:12:14.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.423+0000 7fc470251700 1 --2- 172.21.15.87:0/2171613645 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc44c0653f0 0x7fc44c0678a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.423+0000 7fc470251700 1 --2- 172.21.15.87:0/2171613645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4680c8fb0 0x7fc4680cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.423+0000 7fc470251700 1 --2- 172.21.15.87:0/2171613645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4680b41c0 0x7fc4680cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.423+0000 7fc470251700 1 --2- 172.21.15.87:0/2171613645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc468070960 0x7fc4681582b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.423+0000 7fc470251700 1 -- 172.21.15.87:0/2171613645 >> 172.21.15.87:0/2171613645 conn(0x7fc4680ce960 msgr2=0x7fc4680ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:14.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.423+0000 7fc470251700 1 -- 172.21.15.87:0/2171613645 shutdown_connections 2023-03-30T08:12:14.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.423+0000 7fc470251700 1 -- 172.21.15.87:0/2171613645 wait complete. 2023-03-30T08:12:14.447 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-30T08:12:14.447 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-30T08:12:14.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.611+0000 7f829d785700 1 Processor -- start 2023-03-30T08:12:14.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.611+0000 7f829d785700 1 -- start start 2023-03-30T08:12:14.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.611+0000 7f829d785700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f829806a3e0 0x7f8298160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:14.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.611+0000 7f829d785700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82980d09f0 con 0x7f82980ceeb0 2023-03-30T08:12:14.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.611+0000 7f829d785700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82980cd240 con 0x7f82980b8570 2023-03-30T08:12:14.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.611+0000 7f829d785700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82980cf330 con 0x7f829806a3e0 2023-03-30T08:12:14.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f82967fc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f829806a3e0 0x7f8298160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:14.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f82977fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f82980ceeb0 0x7f82980d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41782/0 (socket says 172.21.15.87:41782) 2023-03-30T08:12:14.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f82977fe700 1 -- 172.21.15.87:0/2715723306 learned_addr learned my addr 172.21.15.87:0/2715723306 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:14.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f82967fc700 1 -- 172.21.15.87:0/2715723306 >> v1:172.21.15.115:6789/0 conn(0x7f82980b8570 legacy=0x7f8298069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:14.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f82967fc700 1 -- 172.21.15.87:0/2715723306 >> v1:172.21.15.87:6789/0 conn(0x7f82980ceeb0 legacy=0x7f82980d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:14.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f8295ffb700 1 -- 172.21.15.87:0/2715723306 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129012722 0 0) 0x7f82980d09f0 con 0x7f82980ceeb0 2023-03-30T08:12:14.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f82967fc700 1 -- 172.21.15.87:0/2715723306 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82980cda50 con 0x7f829806a3e0 2023-03-30T08:12:14.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f82967fc700 1 --2- 172.21.15.87:0/2715723306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829806a3e0 0x7f8298160930 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f828c009840 tx=0x7f828c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae5aae6ccd8ff9c server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:14.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f8295ffb700 1 -- 172.21.15.87:0/2715723306 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c011830 con 0x7f829806a3e0 2023-03-30T08:12:14.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f8295ffb700 1 -- 172.21.15.87:0/2715723306 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c011990 con 0x7f829806a3e0 2023-03-30T08:12:14.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f8295ffb700 1 -- 172.21.15.87:0/2715723306 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c011d20 con 0x7f829806a3e0 2023-03-30T08:12:14.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f829d785700 1 -- 172.21.15.87:0/2715723306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829806a3e0 msgr2=0x7f8298160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:14.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f829d785700 1 --2- 172.21.15.87:0/2715723306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829806a3e0 0x7f8298160930 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f828c009840 tx=0x7f828c009b50 comp rx=0 tx=0).stop 2023-03-30T08:12:14.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f829d785700 1 -- 172.21.15.87:0/2715723306 shutdown_connections 2023-03-30T08:12:14.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f829d785700 1 --2- 172.21.15.87:0/2715723306 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f829806a3e0 0x7f8298160930 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f829d785700 1 -- 172.21.15.87:0/2715723306 >> 172.21.15.87:0/2715723306 conn(0x7f82980b5320 msgr2=0x7f82980cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:14.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f829d785700 1 -- 172.21.15.87:0/2715723306 shutdown_connections 2023-03-30T08:12:14.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.615+0000 7f829d785700 1 -- 172.21.15.87:0/2715723306 wait complete. 2023-03-30T08:12:14.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.619+0000 7f829d785700 1 Processor -- start 2023-03-30T08:12:14.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.619+0000 7f829d785700 1 -- start start 2023-03-30T08:12:14.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.619+0000 7f829d785700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f829806a3e0 0x7f829815fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:14.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.619+0000 7f829d785700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82980b8570 0x7f8298150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:14.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.619+0000 7f829d785700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82980ceeb0 0x7f82980cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:14.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.619+0000 7f829d785700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829815a750 con 0x7f82980ceeb0 2023-03-30T08:12:14.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.619+0000 7f829d785700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82980cc280 con 0x7f82980b8570 2023-03-30T08:12:14.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.619+0000 7f829d785700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82980c9d60 con 0x7f829806a3e0 2023-03-30T08:12:14.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.619+0000 7f82977fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82980ceeb0 0x7f82980cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:14.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.619+0000 7f82977fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82980ceeb0 0x7f82980cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59650/0 (socket says 172.21.15.87:59650) 2023-03-30T08:12:14.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.619+0000 7f82977fe700 1 -- 172.21.15.87:0/764235426 learned_addr learned my addr 172.21.15.87:0/764235426 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:14.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.619+0000 7f82967fc700 1 --2- 172.21.15.87:0/764235426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82980b8570 0x7f8298150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:14.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.619+0000 7f8296ffd700 1 --2- 172.21.15.87:0/764235426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f829806a3e0 0x7f829815fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:14.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.623+0000 7f82977fe700 1 -- 172.21.15.87:0/764235426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f829806a3e0 msgr2=0x7f829815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:14.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.623+0000 7f82977fe700 1 --2- 172.21.15.87:0/764235426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f829806a3e0 0x7f829815fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.623+0000 7f82977fe700 1 -- 172.21.15.87:0/764235426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82980b8570 msgr2=0x7f8298150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:14.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.623+0000 7f82977fe700 1 --2- 172.21.15.87:0/764235426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82980b8570 0x7f8298150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:14.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.623+0000 7f82977fe700 1 -- 172.21.15.87:0/764235426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c009450 con 0x7f82980ceeb0 2023-03-30T08:12:14.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.623+0000 7f8296ffd700 1 --2- 172.21.15.87:0/764235426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f829806a3e0 0x7f829815fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:14.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.623+0000 7f82977fe700 1 --2- 172.21.15.87:0/764235426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82980ceeb0 0x7f82980cbd40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f829000cba0 tx=0x7f829000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:14.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.623+0000 7f827f7fe700 1 -- 172.21.15.87:0/764235426 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829000aad0 con 0x7f82980ceeb0 2023-03-30T08:12:14.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.623+0000 7f827f7fe700 1 -- 172.21.15.87:0/764235426 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829000ac50 con 0x7f82980ceeb0 2023-03-30T08:12:14.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.623+0000 7f829d785700 1 -- 172.21.15.87:0/764235426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82980cd490 con 0x7f82980ceeb0 2023-03-30T08:12:14.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.623+0000 7f827f7fe700 1 -- 172.21.15.87:0/764235426 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82900070d0 con 0x7f82980ceeb0 2023-03-30T08:12:14.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.623+0000 7f829d785700 1 -- 172.21.15.87:0/764235426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82980d28c0 con 0x7f82980ceeb0 2023-03-30T08:12:14.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.623+0000 7f829d785700 1 -- 172.21.15.87:0/764235426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82980cd770 con 0x7f82980ceeb0 2023-03-30T08:12:14.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.627+0000 7f827f7fe700 1 -- 172.21.15.87:0/764235426 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f8290007230 con 0x7f82980ceeb0 2023-03-30T08:12:14.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.627+0000 7f827f7fe700 1 --2- 172.21.15.87:0/764235426 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f82840653f0 0x7f82840678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:14.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.627+0000 7f827f7fe700 1 -- 172.21.15.87:0/764235426 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f82900823b0 con 0x7f82980ceeb0 2023-03-30T08:12:14.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.627+0000 7f8296ffd700 1 --2- 172.21.15.87:0/764235426 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f82840653f0 0x7f82840678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:14.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.627+0000 7f8296ffd700 1 --2- 172.21.15.87:0/764235426 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f82840653f0 0x7f82840678a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8288000f60 tx=0x7f8288009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:14.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.639+0000 7f827f7fe700 1 -- 172.21.15.87:0/764235426 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f82900501e0 con 0x7f82980ceeb0 2023-03-30T08:12:14.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:14.803+0000 7f829d785700 1 -- 172.21.15.87:0/764235426 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f82980733a0 con 0x7f82980ceeb0 2023-03-30T08:12:15.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.515+0000 7f827f7fe700 1 -- 172.21.15.87:0/764235426 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v40) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8290057e60 con 0x7f82980ceeb0 2023-03-30T08:12:15.525 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.523+0000 7f829d785700 1 -- 172.21.15.87:0/764235426 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f82840653f0 msgr2=0x7f82840678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:15.525 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.523+0000 7f829d785700 1 --2- 172.21.15.87:0/764235426 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f82840653f0 0x7f82840678a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8288000f60 tx=0x7f8288009040 comp rx=0 tx=0).stop 2023-03-30T08:12:15.525 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.523+0000 7f829d785700 1 -- 172.21.15.87:0/764235426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82980ceeb0 msgr2=0x7f82980cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:15.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.523+0000 7f829d785700 1 --2- 172.21.15.87:0/764235426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82980ceeb0 0x7f82980cbd40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f829000cba0 tx=0x7f829000ceb0 comp rx=0 tx=0).stop 2023-03-30T08:12:15.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.523+0000 7f829d785700 1 -- 172.21.15.87:0/764235426 shutdown_connections 2023-03-30T08:12:15.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.523+0000 7f829d785700 1 --2- 172.21.15.87:0/764235426 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f82840653f0 0x7f82840678a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:15.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.523+0000 7f829d785700 1 --2- 172.21.15.87:0/764235426 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82980ceeb0 0x7f82980cbd40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:15.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.523+0000 7f829d785700 1 --2- 172.21.15.87:0/764235426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82980b8570 0x7f8298150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:15.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.523+0000 7f829d785700 1 --2- 172.21.15.87:0/764235426 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f829806a3e0 0x7f829815fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:15.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.523+0000 7f829d785700 1 -- 172.21.15.87:0/764235426 >> 172.21.15.87:0/764235426 conn(0x7f82980b5320 msgr2=0x7f8298160760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:15.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.527+0000 7f829d785700 1 -- 172.21.15.87:0/764235426 shutdown_connections 2023-03-30T08:12:15.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.527+0000 7f829d785700 1 -- 172.21.15.87:0/764235426 wait complete. 2023-03-30T08:12:15.530 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' created 2023-03-30T08:12:15.549 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-03-30T08:12:15.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.723+0000 7f05a880a700 1 Processor -- start 2023-03-30T08:12:15.726 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.723+0000 7f05a880a700 1 -- start start 2023-03-30T08:12:15.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.727+0000 7f05a880a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f05a415c3d0 0x7f05a40ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:15.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.727+0000 7f05a880a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05a40ceca0 0x7f05a40b2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:15.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.727+0000 7f05a880a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a4160d70 con 0x7f05a40b2b90 2023-03-30T08:12:15.729 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.727+0000 7f05a880a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a406ce80 con 0x7f05a415c3d0 2023-03-30T08:12:15.730 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.727+0000 7f05a880a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40b2fd0 con 0x7f05a40ceca0 2023-03-30T08:12:15.730 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.727+0000 7f05a2d9d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f05a40b2b90 0x7f05a40d0b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41798/0 (socket says 172.21.15.87:41798) 2023-03-30T08:12:15.730 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.727+0000 7f05a2d9d700 1 -- 172.21.15.87:0/4200478644 learned_addr learned my addr 172.21.15.87:0/4200478644 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:15.731 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.727+0000 7f05a259c700 1 --2- 172.21.15.87:0/4200478644 >> v2:172.21.15.87:3300/0 conn(0x7f05a415c3d0 0x7f05a40ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:15.731 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.727+0000 7f05a1d9b700 1 --2- 172.21.15.87:0/4200478644 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05a40ceca0 0x7f05a40b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:15.731 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.727+0000 7f05a159a700 1 -- 172.21.15.87:0/4200478644 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361406529 0 0) 0x7f05a4160d70 con 0x7f05a40b2b90 2023-03-30T08:12:15.731 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.727+0000 7f05a159a700 1 -- 172.21.15.87:0/4200478644 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f058c0035d0 con 0x7f05a40b2b90 2023-03-30T08:12:15.732 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a159a700 1 -- 172.21.15.87:0/4200478644 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 750706536 0 0) 0x7f058c0035d0 con 0x7f05a40b2b90 2023-03-30T08:12:15.732 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a259c700 1 -- 172.21.15.87:0/4200478644 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05a40ceca0 msgr2=0x7f05a40b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:15.732 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a259c700 1 --2- 172.21.15.87:0/4200478644 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05a40ceca0 0x7f05a40b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:15.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a259c700 1 -- 172.21.15.87:0/4200478644 >> v1:172.21.15.87:6789/0 conn(0x7f05a40b2b90 legacy=0x7f05a40d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:15.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a259c700 1 -- 172.21.15.87:0/4200478644 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a4160160 con 0x7f05a415c3d0 2023-03-30T08:12:15.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a1d9b700 1 --2- 172.21.15.87:0/4200478644 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05a40ceca0 0x7f05a40b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:12:15.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a259c700 1 --2- 172.21.15.87:0/4200478644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05a415c3d0 0x7f05a40ce760 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0594009850 tx=0x7f0594009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d435f8f4fa725 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:15.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a159a700 1 -- 172.21.15.87:0/4200478644 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0019f0 con 0x7f05a415c3d0 2023-03-30T08:12:15.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a159a700 1 -- 172.21.15.87:0/4200478644 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0594004030 con 0x7f05a415c3d0 2023-03-30T08:12:15.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a159a700 1 -- 172.21.15.87:0/4200478644 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05940043e0 con 0x7f05a415c3d0 2023-03-30T08:12:15.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a880a700 1 -- 172.21.15.87:0/4200478644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05a415c3d0 msgr2=0x7f05a40ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:15.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a880a700 1 --2- 172.21.15.87:0/4200478644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05a415c3d0 0x7f05a40ce760 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0594009850 tx=0x7f0594009b60 comp rx=0 tx=0).stop 2023-03-30T08:12:15.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a880a700 1 -- 172.21.15.87:0/4200478644 shutdown_connections 2023-03-30T08:12:15.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a880a700 1 --2- 172.21.15.87:0/4200478644 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05a40ceca0 0x7f05a40b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:15.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a880a700 1 --2- 172.21.15.87:0/4200478644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05a415c3d0 0x7f05a40ce760 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:15.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a880a700 1 -- 172.21.15.87:0/4200478644 >> 172.21.15.87:0/4200478644 conn(0x7f05a406e790 msgr2=0x7f05a406eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:15.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a880a700 1 -- 172.21.15.87:0/4200478644 shutdown_connections 2023-03-30T08:12:15.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.731+0000 7f05a880a700 1 -- 172.21.15.87:0/4200478644 wait complete. 2023-03-30T08:12:15.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a880a700 1 Processor -- start 2023-03-30T08:12:15.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a880a700 1 -- start start 2023-03-30T08:12:15.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a880a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05a40b2b90 0x7f05a415d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:15.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a880a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05a40ceca0 0x7f05a415f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:15.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a880a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05a415c3d0 0x7f05a4144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:15.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a880a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a415f670 con 0x7f05a415c3d0 2023-03-30T08:12:15.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a880a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a415d820 con 0x7f05a40ceca0 2023-03-30T08:12:15.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a880a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a415db00 con 0x7f05a40b2b90 2023-03-30T08:12:15.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a2d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05a415c3d0 0x7f05a4144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:15.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a2d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05a415c3d0 0x7f05a4144f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59676/0 (socket says 172.21.15.87:59676) 2023-03-30T08:12:15.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a2d9d700 1 -- 172.21.15.87:0/2670017918 learned_addr learned my addr 172.21.15.87:0/2670017918 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:15.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a1d9b700 1 --2- 172.21.15.87:0/2670017918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05a40ceca0 0x7f05a415f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:15.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a259c700 1 --2- 172.21.15.87:0/2670017918 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05a40b2b90 0x7f05a415d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:15.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a2d9d700 1 -- 172.21.15.87:0/2670017918 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05a40b2b90 msgr2=0x7f05a415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:15.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a2d9d700 1 --2- 172.21.15.87:0/2670017918 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05a40b2b90 0x7f05a415d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:15.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a2d9d700 1 -- 172.21.15.87:0/2670017918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05a40ceca0 msgr2=0x7f05a415f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:15.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.735+0000 7f05a2d9d700 1 --2- 172.21.15.87:0/2670017918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05a40ceca0 0x7f05a415f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:15.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.739+0000 7f05a2d9d700 1 -- 172.21.15.87:0/2670017918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05980094b0 con 0x7f05a415c3d0 2023-03-30T08:12:15.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.739+0000 7f05a2d9d700 1 --2- 172.21.15.87:0/2670017918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05a415c3d0 0x7f05a4144f00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f059c00cc00 tx=0x7f059c00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:15.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.739+0000 7f0592ffd700 1 -- 172.21.15.87:0/2670017918 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c00aa80 con 0x7f05a415c3d0 2023-03-30T08:12:15.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.739+0000 7f0592ffd700 1 -- 172.21.15.87:0/2670017918 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059c00ac00 con 0x7f05a415c3d0 2023-03-30T08:12:15.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.739+0000 7f0592ffd700 1 -- 172.21.15.87:0/2670017918 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0070d0 con 0x7f05a415c3d0 2023-03-30T08:12:15.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.739+0000 7f05a880a700 1 -- 172.21.15.87:0/2670017918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05940094b0 con 0x7f05a415c3d0 2023-03-30T08:12:15.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.739+0000 7f05a880a700 1 -- 172.21.15.87:0/2670017918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a4160720 con 0x7f05a415c3d0 2023-03-30T08:12:15.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.739+0000 7f05a880a700 1 -- 172.21.15.87:0/2670017918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a4160440 con 0x7f05a415c3d0 2023-03-30T08:12:15.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.743+0000 7f0592ffd700 1 -- 172.21.15.87:0/2670017918 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f059c007230 con 0x7f05a415c3d0 2023-03-30T08:12:15.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.743+0000 7f0592ffd700 1 --2- 172.21.15.87:0/2670017918 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f05840653f0 0x7f05840678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:15.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.743+0000 7f0592ffd700 1 -- 172.21.15.87:0/2670017918 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f059c0821a0 con 0x7f05a415c3d0 2023-03-30T08:12:15.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.743+0000 7f05a259c700 1 --2- 172.21.15.87:0/2670017918 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f05840653f0 0x7f05840678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:15.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.743+0000 7f05a259c700 1 --2- 172.21.15.87:0/2670017918 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f05840653f0 0x7f05840678a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f05940090b0 tx=0x7f0594008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:15.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.751+0000 7f0592ffd700 1 -- 172.21.15.87:0/2670017918 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f059c04feb0 con 0x7f05a415c3d0 2023-03-30T08:12:15.931 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:15.931+0000 7f05a880a700 1 -- 172.21.15.87:0/2670017918 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f05a41609d0 con 0x7f05a415c3d0 2023-03-30T08:12:16.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.527+0000 7f0592ffd700 1 -- 172.21.15.87:0/2670017918 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v41) v1 ==== 170+0+0 (secure 0 0 0) 0x7f059c0534d0 con 0x7f05a415c3d0 2023-03-30T08:12:16.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.531+0000 7f05a880a700 1 -- 172.21.15.87:0/2670017918 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f05840653f0 msgr2=0x7f05840678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:16.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.531+0000 7f05a880a700 1 --2- 172.21.15.87:0/2670017918 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f05840653f0 0x7f05840678a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f05940090b0 tx=0x7f0594008030 comp rx=0 tx=0).stop 2023-03-30T08:12:16.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.531+0000 7f05a880a700 1 -- 172.21.15.87:0/2670017918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05a415c3d0 msgr2=0x7f05a4144f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:16.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.531+0000 7f05a880a700 1 --2- 172.21.15.87:0/2670017918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05a415c3d0 0x7f05a4144f00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f059c00cc00 tx=0x7f059c00cf10 comp rx=0 tx=0).stop 2023-03-30T08:12:16.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.531+0000 7f05a880a700 1 -- 172.21.15.87:0/2670017918 shutdown_connections 2023-03-30T08:12:16.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.531+0000 7f05a880a700 1 --2- 172.21.15.87:0/2670017918 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f05840653f0 0x7f05840678a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:16.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.531+0000 7f05a880a700 1 --2- 172.21.15.87:0/2670017918 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f05a415c3d0 0x7f05a4144f00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:16.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.531+0000 7f05a880a700 1 --2- 172.21.15.87:0/2670017918 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05a40ceca0 0x7f05a415f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:16.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.531+0000 7f05a880a700 1 --2- 172.21.15.87:0/2670017918 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f05a40b2b90 0x7f05a415d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:16.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.531+0000 7f05a880a700 1 -- 172.21.15.87:0/2670017918 >> 172.21.15.87:0/2670017918 conn(0x7f05a406e790 msgr2=0x7f05a40b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:16.537 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.535+0000 7f05a880a700 1 -- 172.21.15.87:0/2670017918 shutdown_connections 2023-03-30T08:12:16.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.539+0000 7f05a880a700 1 -- 172.21.15.87:0/2670017918 wait complete. 2023-03-30T08:12:16.550 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' created 2023-03-30T08:12:16.569 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-30T08:12:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.731+0000 7fc2f9ad7700 1 Processor -- start 2023-03-30T08:12:16.732 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.731+0000 7fc2f9ad7700 1 -- start start 2023-03-30T08:12:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f9ad7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc2f40cabc0 0x7fc2f4069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:16.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f9ad7700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f40afca0 con 0x7fc2f4159050 2023-03-30T08:12:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f9ad7700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f415d110 con 0x7fc2f415cba0 2023-03-30T08:12:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f9ad7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f40afb10 con 0x7fc2f40cabc0 2023-03-30T08:12:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f8ad5700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc2f4159050 0x7fc2f40cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41802/0 (socket says 172.21.15.87:41802) 2023-03-30T08:12:16.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f8ad5700 1 -- 172.21.15.87:0/4192580586 learned_addr learned my addr 172.21.15.87:0/4192580586 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:16.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f92d6700 1 --2- 172.21.15.87:0/4192580586 >> v2:172.21.15.87:3300/0 conn(0x7fc2f40cabc0 0x7fc2f4069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:16.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f92d6700 1 -- 172.21.15.87:0/4192580586 >> v1:172.21.15.115:6789/0 conn(0x7fc2f415cba0 legacy=0x7fc2f40ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:16.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f92d6700 1 -- 172.21.15.87:0/4192580586 >> v1:172.21.15.87:6789/0 conn(0x7fc2f4159050 legacy=0x7fc2f40cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:16.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f92d6700 1 -- 172.21.15.87:0/4192580586 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f415d3f0 con 0x7fc2f40cabc0 2023-03-30T08:12:16.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f92d6700 1 --2- 172.21.15.87:0/4192580586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2f40cabc0 0x7fc2f4069cd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009d90 tx=0x7fc2ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6678c74b6d1411d server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:16.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f37fe700 1 -- 172.21.15.87:0/4192580586 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec00bdd0 con 0x7fc2f40cabc0 2023-03-30T08:12:16.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f37fe700 1 -- 172.21.15.87:0/4192580586 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec011460 con 0x7fc2f40cabc0 2023-03-30T08:12:16.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f37fe700 1 -- 172.21.15.87:0/4192580586 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec011810 con 0x7fc2f40cabc0 2023-03-30T08:12:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f9ad7700 1 -- 172.21.15.87:0/4192580586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2f40cabc0 msgr2=0x7fc2f4069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f9ad7700 1 --2- 172.21.15.87:0/4192580586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2f40cabc0 0x7fc2f4069cd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009d90 tx=0x7fc2ec00b330 comp rx=0 tx=0).stop 2023-03-30T08:12:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f9ad7700 1 -- 172.21.15.87:0/4192580586 shutdown_connections 2023-03-30T08:12:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f9ad7700 1 --2- 172.21.15.87:0/4192580586 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2f40cabc0 0x7fc2f4069cd0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:16.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f9ad7700 1 -- 172.21.15.87:0/4192580586 >> 172.21.15.87:0/4192580586 conn(0x7fc2f40cf410 msgr2=0x7fc2f40cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:16.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f9ad7700 1 -- 172.21.15.87:0/4192580586 shutdown_connections 2023-03-30T08:12:16.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.735+0000 7fc2f9ad7700 1 -- 172.21.15.87:0/4192580586 wait complete. 2023-03-30T08:12:16.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.739+0000 7fc2f9ad7700 1 Processor -- start 2023-03-30T08:12:16.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.739+0000 7fc2f9ad7700 1 -- start start 2023-03-30T08:12:16.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.739+0000 7fc2f9ad7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f40cabc0 0x7fc2f40c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:16.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.739+0000 7fc2f9ad7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2f4159050 0x7fc2f40c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:16.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.739+0000 7fc2f9ad7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2f415cba0 0x7fc2f4159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:16.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.739+0000 7fc2f9ad7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f40c4410 con 0x7fc2f4159050 2023-03-30T08:12:16.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.739+0000 7fc2f9ad7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f40c3b50 con 0x7fc2f40cabc0 2023-03-30T08:12:16.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.739+0000 7fc2f9ad7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f40c3dc0 con 0x7fc2f415cba0 2023-03-30T08:12:16.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f3fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2f4159050 0x7fc2f40c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:16.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f3fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2f4159050 0x7fc2f40c48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59690/0 (socket says 172.21.15.87:59690) 2023-03-30T08:12:16.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f3fff700 1 -- 172.21.15.87:0/1053877441 learned_addr learned my addr 172.21.15.87:0/1053877441 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:16.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f8ad5700 1 --2- 172.21.15.87:0/1053877441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f40cabc0 0x7fc2f40c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:16.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f92d6700 1 --2- 172.21.15.87:0/1053877441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2f415cba0 0x7fc2f4159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:16.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f3fff700 1 -- 172.21.15.87:0/1053877441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2f415cba0 msgr2=0x7fc2f4159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:16.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f3fff700 1 --2- 172.21.15.87:0/1053877441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2f415cba0 0x7fc2f4159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:16.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f3fff700 1 -- 172.21.15.87:0/1053877441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f40cabc0 msgr2=0x7fc2f40c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:16.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f3fff700 1 --2- 172.21.15.87:0/1053877441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f40cabc0 0x7fc2f40c2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:16.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f3fff700 1 -- 172.21.15.87:0/1053877441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec009a70 con 0x7fc2f4159050 2023-03-30T08:12:16.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f3fff700 1 --2- 172.21.15.87:0/1053877441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2f4159050 0x7fc2f40c48a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc2e000c530 tx=0x7fc2e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:16.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f17fa700 1 -- 172.21.15.87:0/1053877441 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00052d0 con 0x7fc2f4159050 2023-03-30T08:12:16.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f17fa700 1 -- 172.21.15.87:0/1053877441 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e0005430 con 0x7fc2f4159050 2023-03-30T08:12:16.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f9ad7700 1 -- 172.21.15.87:0/1053877441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f415d9b0 con 0x7fc2f4159050 2023-03-30T08:12:16.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f17fa700 1 -- 172.21.15.87:0/1053877441 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00055a0 con 0x7fc2f4159050 2023-03-30T08:12:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f9ad7700 1 -- 172.21.15.87:0/1053877441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f415d6d0 con 0x7fc2f4159050 2023-03-30T08:12:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.743+0000 7fc2f9ad7700 1 -- 172.21.15.87:0/1053877441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f4159420 con 0x7fc2f4159050 2023-03-30T08:12:16.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.747+0000 7fc2f17fa700 1 -- 172.21.15.87:0/1053877441 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc2e00038e0 con 0x7fc2f4159050 2023-03-30T08:12:16.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.747+0000 7fc2f17fa700 1 --2- 172.21.15.87:0/1053877441 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc2d80653f0 0x7fc2d80678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:16.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.747+0000 7fc2f17fa700 1 -- 172.21.15.87:0/1053877441 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6282+0+0 (secure 0 0 0) 0x7fc2e0081d30 con 0x7fc2f4159050 2023-03-30T08:12:16.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.747+0000 7fc2f8ad5700 1 --2- 172.21.15.87:0/1053877441 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc2d80653f0 0x7fc2d80678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:16.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.747+0000 7fc2f8ad5700 1 --2- 172.21.15.87:0/1053877441 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc2d80653f0 0x7fc2d80678a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8005930 tx=0x7fc2e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:16.753 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.751+0000 7fc2f17fa700 1 -- 172.21.15.87:0/1053877441 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fc2e004f8d0 con 0x7fc2f4159050 2023-03-30T08:12:16.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.959+0000 7fc2f9ad7700 1 -- 172.21.15.87:0/1053877441 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc2f40c45c0 con 0x7fc2f4159050 2023-03-30T08:12:16.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.971+0000 7fc2f17fa700 1 -- 172.21.15.87:0/1053877441 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc2e0052ef0 con 0x7fc2f4159050 2023-03-30T08:12:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.979+0000 7fc2f9ad7700 1 -- 172.21.15.87:0/1053877441 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc2d80653f0 msgr2=0x7fc2d80678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.979+0000 7fc2f9ad7700 1 --2- 172.21.15.87:0/1053877441 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc2d80653f0 0x7fc2d80678a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8005930 tx=0x7fc2e8009040 comp rx=0 tx=0).stop 2023-03-30T08:12:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.979+0000 7fc2f9ad7700 1 -- 172.21.15.87:0/1053877441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2f4159050 msgr2=0x7fc2f40c48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:16.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.979+0000 7fc2f9ad7700 1 --2- 172.21.15.87:0/1053877441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2f4159050 0x7fc2f40c48a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc2e000c530 tx=0x7fc2e000c8f0 comp rx=0 tx=0).stop 2023-03-30T08:12:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.983+0000 7fc2f9ad7700 1 -- 172.21.15.87:0/1053877441 shutdown_connections 2023-03-30T08:12:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.983+0000 7fc2f9ad7700 1 --2- 172.21.15.87:0/1053877441 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc2d80653f0 0x7fc2d80678a0 secure :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8005930 tx=0x7fc2e8009040 comp rx=0 tx=0).stop 2023-03-30T08:12:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.983+0000 7fc2f9ad7700 1 --2- 172.21.15.87:0/1053877441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc2f415cba0 0x7fc2f4159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.983+0000 7fc2f9ad7700 1 --2- 172.21.15.87:0/1053877441 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc2f4159050 0x7fc2f40c48a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.983+0000 7fc2f9ad7700 1 --2- 172.21.15.87:0/1053877441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f40cabc0 0x7fc2f40c2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:16.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.983+0000 7fc2f9ad7700 1 -- 172.21.15.87:0/1053877441 >> 172.21.15.87:0/1053877441 conn(0x7fc2f40cf410 msgr2=0x7fc2f406cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.983+0000 7fc2f9ad7700 1 -- 172.21.15.87:0/1053877441 shutdown_connections 2023-03-30T08:12:16.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:16.983+0000 7fc2f9ad7700 1 -- 172.21.15.87:0/1053877441 wait complete. 2023-03-30T08:12:17.000 INFO:teuthology.orchestra.run.smithi087.stderr:new fs with metadata pool 6 and data pool 7 2023-03-30T08:12:17.021 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:12:17.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.175+0000 7fd11d184700 1 Processor -- start 2023-03-30T08:12:17.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd11d184700 1 -- start start 2023-03-30T08:12:17.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd11d184700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1180b8380 0x7fd1180d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd11d184700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd11806a3e0 0x7fd1180d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd11d184700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd118160ef0 con 0x7fd1180d27e0 2023-03-30T08:12:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd11d184700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1180cd6a0 con 0x7fd11806a3e0 2023-03-30T08:12:17.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd11d184700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1180cd3a0 con 0x7fd1180b8380 2023-03-30T08:12:17.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd10ffff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd1180d27e0 0x7fd118069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41808/0 (socket says 172.21.15.87:41808) 2023-03-30T08:12:17.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd10ffff700 1 -- 172.21.15.87:0/364346683 learned_addr learned my addr 172.21.15.87:0/364346683 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd117fff700 1 --2- 172.21.15.87:0/364346683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1180b8380 0x7fd1180d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd11c983700 1 --2- 172.21.15.87:0/364346683 >> v2:172.21.15.115:3300/0 conn(0x7fd11806a3e0 0x7fd1180d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd1177fe700 1 -- 172.21.15.87:0/364346683 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498733064 0 0) 0x7fd118160ef0 con 0x7fd1180d27e0 2023-03-30T08:12:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd1177fe700 1 -- 172.21.15.87:0/364346683 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1040035d0 con 0x7fd1180d27e0 2023-03-30T08:12:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd117fff700 1 -- 172.21.15.87:0/364346683 >> v2:172.21.15.115:3300/0 conn(0x7fd11806a3e0 msgr2=0x7fd1180d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd117fff700 1 --2- 172.21.15.87:0/364346683 >> v2:172.21.15.115:3300/0 conn(0x7fd11806a3e0 0x7fd1180d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd117fff700 1 -- 172.21.15.87:0/364346683 >> v1:172.21.15.87:6789/0 conn(0x7fd1180d27e0 legacy=0x7fd118069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.179+0000 7fd117fff700 1 -- 172.21.15.87:0/364346683 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1180cef00 con 0x7fd1180b8380 2023-03-30T08:12:17.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.183+0000 7fd117fff700 1 --2- 172.21.15.87:0/364346683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1180b8380 0x7fd1180d2200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd108009850 tx=0x7fd108009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63dce0f064f5840d server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:17.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.183+0000 7fd1177fe700 1 -- 172.21.15.87:0/364346683 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd108011830 con 0x7fd1180b8380 2023-03-30T08:12:17.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.183+0000 7fd1177fe700 1 -- 172.21.15.87:0/364346683 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd108011990 con 0x7fd1180b8380 2023-03-30T08:12:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.183+0000 7fd1177fe700 1 -- 172.21.15.87:0/364346683 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd108011d00 con 0x7fd1180b8380 2023-03-30T08:12:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.183+0000 7fd11d184700 1 -- 172.21.15.87:0/364346683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1180b8380 msgr2=0x7fd1180d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.183+0000 7fd11d184700 1 --2- 172.21.15.87:0/364346683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1180b8380 0x7fd1180d2200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd108009850 tx=0x7fd108009b60 comp rx=0 tx=0).stop 2023-03-30T08:12:17.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.183+0000 7fd11d184700 1 -- 172.21.15.87:0/364346683 shutdown_connections 2023-03-30T08:12:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.183+0000 7fd11d184700 1 --2- 172.21.15.87:0/364346683 >> v2:172.21.15.115:3300/0 conn(0x7fd11806a3e0 0x7fd1180d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.183+0000 7fd11d184700 1 --2- 172.21.15.87:0/364346683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1180b8380 0x7fd1180d2200 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.183+0000 7fd11d184700 1 -- 172.21.15.87:0/364346683 >> 172.21.15.87:0/364346683 conn(0x7fd1180b53f0 msgr2=0x7fd1180cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.183+0000 7fd11d184700 1 -- 172.21.15.87:0/364346683 shutdown_connections 2023-03-30T08:12:17.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.183+0000 7fd11d184700 1 -- 172.21.15.87:0/364346683 wait complete. 2023-03-30T08:12:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.187+0000 7fd11d184700 1 Processor -- start 2023-03-30T08:12:17.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.187+0000 7fd11d184700 1 -- start start 2023-03-30T08:12:17.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.187+0000 7fd11d184700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11806a3e0 0x7fd118156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.187+0000 7fd11d184700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1180b8380 0x7fd1181574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.187+0000 7fd11d184700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1180b31d0 0x7fd118159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.187+0000 7fd11d184700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1180c88f0 con 0x7fd1180b8380 2023-03-30T08:12:17.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.187+0000 7fd11d184700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1180b3660 con 0x7fd11806a3e0 2023-03-30T08:12:17.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.187+0000 7fd11d184700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1180c8b20 con 0x7fd1180b31d0 2023-03-30T08:12:17.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.187+0000 7fd10ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1180b8380 0x7fd1181574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.187+0000 7fd10ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1180b8380 0x7fd1181574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59704/0 (socket says 172.21.15.87:59704) 2023-03-30T08:12:17.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.187+0000 7fd10ffff700 1 -- 172.21.15.87:0/521523743 learned_addr learned my addr 172.21.15.87:0/521523743 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:17.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.187+0000 7fd117fff700 1 --2- 172.21.15.87:0/521523743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11806a3e0 0x7fd118156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.187+0000 7fd11c983700 1 --2- 172.21.15.87:0/521523743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1180b31d0 0x7fd118159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.191+0000 7fd10ffff700 1 -- 172.21.15.87:0/521523743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1180b31d0 msgr2=0x7fd118159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.191+0000 7fd10ffff700 1 --2- 172.21.15.87:0/521523743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1180b31d0 0x7fd118159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.191+0000 7fd10ffff700 1 -- 172.21.15.87:0/521523743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11806a3e0 msgr2=0x7fd118156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.191+0000 7fd10ffff700 1 --2- 172.21.15.87:0/521523743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11806a3e0 0x7fd118156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.191+0000 7fd10ffff700 1 -- 172.21.15.87:0/521523743 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1080094b0 con 0x7fd1180b8380 2023-03-30T08:12:17.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.191+0000 7fd117fff700 1 --2- 172.21.15.87:0/521523743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11806a3e0 0x7fd118156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:17.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.191+0000 7fd10ffff700 1 --2- 172.21.15.87:0/521523743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1180b8380 0x7fd1181574f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd1000010e0 tx=0x7fd10000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:17.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.191+0000 7fd1157fa700 1 -- 172.21.15.87:0/521523743 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100005d90 con 0x7fd1180b8380 2023-03-30T08:12:17.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.191+0000 7fd1157fa700 1 -- 172.21.15.87:0/521523743 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1000070d0 con 0x7fd1180b8380 2023-03-30T08:12:17.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.191+0000 7fd11d184700 1 -- 172.21.15.87:0/521523743 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1180cf480 con 0x7fd1180b8380 2023-03-30T08:12:17.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.191+0000 7fd1157fa700 1 -- 172.21.15.87:0/521523743 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100007460 con 0x7fd1180b8380 2023-03-30T08:12:17.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.191+0000 7fd11d184700 1 -- 172.21.15.87:0/521523743 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1180cf1a0 con 0x7fd1180b8380 2023-03-30T08:12:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.191+0000 7fd11d184700 1 -- 172.21.15.87:0/521523743 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1180b8750 con 0x7fd1180b8380 2023-03-30T08:12:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.195+0000 7fd1157fa700 1 -- 172.21.15.87:0/521523743 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd1000075c0 con 0x7fd1180b8380 2023-03-30T08:12:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.195+0000 7fd1157fa700 1 --2- 172.21.15.87:0/521523743 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd0f80653f0 0x7fd0f80678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.195+0000 7fd1157fa700 1 -- 172.21.15.87:0/521523743 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd100081e30 con 0x7fd1180b8380 2023-03-30T08:12:17.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.195+0000 7fd117fff700 1 --2- 172.21.15.87:0/521523743 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd0f80653f0 0x7fd0f80678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.198 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.195+0000 7fd117fff700 1 --2- 172.21.15.87:0/521523743 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd0f80653f0 0x7fd0f80678a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1080090b0 tx=0x7fd108008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:17.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.199+0000 7fd1157fa700 1 -- 172.21.15.87:0/521523743 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fd10004f8d0 con 0x7fd1180b8380 2023-03-30T08:12:17.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.371+0000 7fd11d184700 1 -- 172.21.15.87:0/521523743 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd118072cf0 con 0x7fd1180b8380 2023-03-30T08:12:17.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.375+0000 7fd1157fa700 1 -- 172.21.15.87:0/521523743 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18045 (secure 0 0 0) 0x7fd100017090 con 0x7fd1180b8380 2023-03-30T08:12:17.375 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:17.376 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":42,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:12:16.962254+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:12:14.871645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-03-30T08:12:15.991480+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:12:17.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.375+0000 7fd11d184700 1 -- 172.21.15.87:0/521523743 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd0f80653f0 msgr2=0x7fd0f80678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.375+0000 7fd11d184700 1 --2- 172.21.15.87:0/521523743 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd0f80653f0 0x7fd0f80678a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1080090b0 tx=0x7fd108008030 comp rx=0 tx=0).stop 2023-03-30T08:12:17.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.375+0000 7fd11d184700 1 -- 172.21.15.87:0/521523743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1180b8380 msgr2=0x7fd1181574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.375+0000 7fd11d184700 1 --2- 172.21.15.87:0/521523743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1180b8380 0x7fd1181574f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd1000010e0 tx=0x7fd10000c7b0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.375+0000 7fd11d184700 1 -- 172.21.15.87:0/521523743 shutdown_connections 2023-03-30T08:12:17.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.375+0000 7fd11d184700 1 --2- 172.21.15.87:0/521523743 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd0f80653f0 0x7fd0f80678a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.375+0000 7fd11d184700 1 --2- 172.21.15.87:0/521523743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd1180b31d0 0x7fd118159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.375+0000 7fd11d184700 1 --2- 172.21.15.87:0/521523743 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1180b8380 0x7fd1181574f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.375+0000 7fd11d184700 1 --2- 172.21.15.87:0/521523743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd11806a3e0 0x7fd118156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.375+0000 7fd11d184700 1 -- 172.21.15.87:0/521523743 >> 172.21.15.87:0/521523743 conn(0x7fd1180b53f0 msgr2=0x7fd1180b3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:17.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.375+0000 7fd11d184700 1 -- 172.21.15.87:0/521523743 shutdown_connections 2023-03-30T08:12:17.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.375+0000 7fd11d184700 1 -- 172.21.15.87:0/521523743 wait complete. 2023-03-30T08:12:17.396 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:12:17.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.539+0000 7f6393358700 1 Processor -- start 2023-03-30T08:12:17.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.539+0000 7f6393358700 1 -- start start 2023-03-30T08:12:17.542 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.539+0000 7f6393358700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638c0ad640 0x7f638c0abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.542 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.539+0000 7f6393358700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638c06a0e0 con 0x7f638c1600d0 2023-03-30T08:12:17.542 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.539+0000 7f6393358700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638c0c9db0 con 0x7f638c0ac520 2023-03-30T08:12:17.542 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.539+0000 7f6393358700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c0ca090 con 0x7f638c0ad640 2023-03-30T08:12:17.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.539+0000 7f6392356700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f638c1600d0 0x7f638c06a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41812/0 (socket says 172.21.15.87:41812) 2023-03-30T08:12:17.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.539+0000 7f6392356700 1 -- 172.21.15.87:0/3470803048 learned_addr learned my addr 172.21.15.87:0/3470803048 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:17.543 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.539+0000 7f6391b55700 1 --2- 172.21.15.87:0/3470803048 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638c0ad640 0x7f638c0abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.544 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.543+0000 7f6391b55700 1 -- 172.21.15.87:0/3470803048 >> v1:172.21.15.115:6789/0 conn(0x7f638c0ac520 legacy=0x7f638c1604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.544 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.543+0000 7f6391b55700 1 -- 172.21.15.87:0/3470803048 >> v1:172.21.15.87:6789/0 conn(0x7f638c1600d0 legacy=0x7f638c06a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.544 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.543+0000 7f6391b55700 1 -- 172.21.15.87:0/3470803048 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c069d70 con 0x7f638c0ad640 2023-03-30T08:12:17.544 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.543+0000 7f6391b55700 1 --2- 172.21.15.87:0/3470803048 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638c0ad640 0x7f638c0abfe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f637c009880 tx=0x7f637c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93d28db7f964825c server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.547+0000 7f6391354700 1 -- 172.21.15.87:0/3470803048 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c011830 con 0x7f638c0ad640 2023-03-30T08:12:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.547+0000 7f6391354700 1 -- 172.21.15.87:0/3470803048 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c011990 con 0x7f638c0ad640 2023-03-30T08:12:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.547+0000 7f6391354700 1 -- 172.21.15.87:0/3470803048 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c011d20 con 0x7f638c0ad640 2023-03-30T08:12:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.547+0000 7f6393358700 1 -- 172.21.15.87:0/3470803048 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638c0ad640 msgr2=0x7f638c0abfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.547 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.547+0000 7f6393358700 1 --2- 172.21.15.87:0/3470803048 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638c0ad640 0x7f638c0abfe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f637c009880 tx=0x7f637c009b90 comp rx=0 tx=0).stop 2023-03-30T08:12:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.547+0000 7f6393358700 1 -- 172.21.15.87:0/3470803048 shutdown_connections 2023-03-30T08:12:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.547+0000 7f6393358700 1 --2- 172.21.15.87:0/3470803048 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638c0ad640 0x7f638c0abfe0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.547+0000 7f6393358700 1 -- 172.21.15.87:0/3470803048 >> 172.21.15.87:0/3470803048 conn(0x7f638c0cf410 msgr2=0x7f638c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:17.548 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.547+0000 7f6393358700 1 -- 172.21.15.87:0/3470803048 shutdown_connections 2023-03-30T08:12:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.547+0000 7f6393358700 1 -- 172.21.15.87:0/3470803048 wait complete. 2023-03-30T08:12:17.549 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.547+0000 7f6393358700 1 Processor -- start 2023-03-30T08:12:17.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.547+0000 7f6393358700 1 -- start start 2023-03-30T08:12:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6393358700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f638c0ac520 0x7f638c158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6393358700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f638c0ad640 0x7f638c157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6393358700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638c1600d0 0x7f638c15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.551 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6393358700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c15a9e0 con 0x7f638c0ac520 2023-03-30T08:12:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6393358700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c15d310 con 0x7f638c0ad640 2023-03-30T08:12:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6393358700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c1594f0 con 0x7f638c1600d0 2023-03-30T08:12:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6392356700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f638c0ac520 0x7f638c158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6392356700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f638c0ac520 0x7f638c158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59720/0 (socket says 172.21.15.87:59720) 2023-03-30T08:12:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6392356700 1 -- 172.21.15.87:0/1903518462 learned_addr learned my addr 172.21.15.87:0/1903518462 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:17.552 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6391b55700 1 --2- 172.21.15.87:0/1903518462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f638c0ad640 0x7f638c157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.553 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6392b57700 1 --2- 172.21.15.87:0/1903518462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638c1600d0 0x7f638c15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6392356700 1 -- 172.21.15.87:0/1903518462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638c1600d0 msgr2=0x7f638c15ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6392356700 1 --2- 172.21.15.87:0/1903518462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638c1600d0 0x7f638c15ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6392356700 1 -- 172.21.15.87:0/1903518462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f638c0ad640 msgr2=0x7f638c157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6392356700 1 --2- 172.21.15.87:0/1903518462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f638c0ad640 0x7f638c157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6392356700 1 -- 172.21.15.87:0/1903518462 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c0094b0 con 0x7f638c0ac520 2023-03-30T08:12:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6392b57700 1 --2- 172.21.15.87:0/1903518462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638c1600d0 0x7f638c15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:12:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6392356700 1 --2- 172.21.15.87:0/1903518462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f638c0ac520 0x7f638c158d50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6388001eb0 tx=0x7f638800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:17.554 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6382ffd700 1 -- 172.21.15.87:0/1903518462 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388005d90 con 0x7f638c0ac520 2023-03-30T08:12:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6382ffd700 1 -- 172.21.15.87:0/1903518462 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63880070d0 con 0x7f638c0ac520 2023-03-30T08:12:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6393358700 1 -- 172.21.15.87:0/1903518462 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638c0ac970 con 0x7f638c0ac520 2023-03-30T08:12:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6382ffd700 1 -- 172.21.15.87:0/1903518462 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388007440 con 0x7f638c0ac520 2023-03-30T08:12:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6393358700 1 -- 172.21.15.87:0/1903518462 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638c0ca370 con 0x7f638c0ac520 2023-03-30T08:12:17.555 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.551+0000 7f6393358700 1 -- 172.21.15.87:0/1903518462 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638c06ac80 con 0x7f638c0ac520 2023-03-30T08:12:17.556 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.555+0000 7f6382ffd700 1 -- 172.21.15.87:0/1903518462 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f63880075a0 con 0x7f638c0ac520 2023-03-30T08:12:17.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.555+0000 7f6382ffd700 1 --2- 172.21.15.87:0/1903518462 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f63700653f0 0x7f63700678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.555+0000 7f6382ffd700 1 -- 172.21.15.87:0/1903518462 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6388081c50 con 0x7f638c0ac520 2023-03-30T08:12:17.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.555+0000 7f6391b55700 1 --2- 172.21.15.87:0/1903518462 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f63700653f0 0x7f63700678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.559+0000 7f6391b55700 1 --2- 172.21.15.87:0/1903518462 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f63700653f0 0x7f63700678a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f637c000c00 tx=0x7f637c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.563+0000 7f6382ffd700 1 -- 172.21.15.87:0/1903518462 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f638804a5e0 con 0x7f638c0ac520 2023-03-30T08:12:17.735 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.735+0000 7f6393358700 1 -- 172.21.15.87:0/1903518462 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f638c0733a0 con 0x7f638c0ac520 2023-03-30T08:12:17.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.735+0000 7f6382ffd700 1 -- 172.21.15.87:0/1903518462 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18045 (secure 0 0 0) 0x7f6388017090 con 0x7f638c0ac520 2023-03-30T08:12:17.739 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:17.739 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":42,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:12:16.962254+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:12:14.871645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-03-30T08:12:15.991480+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:12:17.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.739+0000 7f6393358700 1 -- 172.21.15.87:0/1903518462 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f63700653f0 msgr2=0x7f63700678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.739+0000 7f6393358700 1 --2- 172.21.15.87:0/1903518462 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f63700653f0 0x7f63700678a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f637c000c00 tx=0x7f637c008030 comp rx=0 tx=0).stop 2023-03-30T08:12:17.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.739+0000 7f6393358700 1 -- 172.21.15.87:0/1903518462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f638c0ac520 msgr2=0x7f638c158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.739+0000 7f6393358700 1 --2- 172.21.15.87:0/1903518462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f638c0ac520 0x7f638c158d50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6388001eb0 tx=0x7f638800c7b0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.739+0000 7f6393358700 1 -- 172.21.15.87:0/1903518462 shutdown_connections 2023-03-30T08:12:17.742 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.739+0000 7f6393358700 1 --2- 172.21.15.87:0/1903518462 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f63700653f0 0x7f63700678a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.739+0000 7f6393358700 1 --2- 172.21.15.87:0/1903518462 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638c1600d0 0x7f638c15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.739+0000 7f6393358700 1 --2- 172.21.15.87:0/1903518462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f638c0ad640 0x7f638c157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.739+0000 7f6393358700 1 --2- 172.21.15.87:0/1903518462 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f638c0ac520 0x7f638c158d50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.739+0000 7f6393358700 1 -- 172.21.15.87:0/1903518462 >> 172.21.15.87:0/1903518462 conn(0x7f638c0cf410 msgr2=0x7f638c0b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:17.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.739+0000 7f6393358700 1 -- 172.21.15.87:0/1903518462 shutdown_connections 2023-03-30T08:12:17.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.739+0000 7f6393358700 1 -- 172.21.15.87:0/1903518462 wait complete. 2023-03-30T08:12:17.763 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-30T08:12:17.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.931+0000 7f2ed8f84700 1 Processor -- start 2023-03-30T08:12:17.935 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.931+0000 7f2ed8f84700 1 -- start start 2023-03-30T08:12:17.937 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.935+0000 7f2ed8f84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ed40d27e0 0x7f2ed40d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.935+0000 7f2ed8f84700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2ed406a3e0 0x7f2ed40d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.935+0000 7f2ed8f84700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed4160ef0 con 0x7f2ed40b8380 2023-03-30T08:12:17.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.935+0000 7f2ed8f84700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed40cd6a0 con 0x7f2ed406a3e0 2023-03-30T08:12:17.938 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.935+0000 7f2ed8f84700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed40cd3a0 con 0x7f2ed40d27e0 2023-03-30T08:12:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.935+0000 7f2ed37fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2ed40b8380 0x7f2ed4069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41816/0 (socket says 172.21.15.87:41816) 2023-03-30T08:12:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.935+0000 7f2ed37fe700 1 -- 172.21.15.87:0/3414759474 learned_addr learned my addr 172.21.15.87:0/3414759474 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.935+0000 7f2ed3fff700 1 --2- 172.21.15.87:0/3414759474 >> v2:172.21.15.115:3300/0 conn(0x7f2ed406a3e0 0x7f2ed40d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.935+0000 7f2ed2ffd700 1 --2- 172.21.15.87:0/3414759474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ed40d27e0 0x7f2ed40d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.935+0000 7f2ed27fc700 1 -- 172.21.15.87:0/3414759474 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322350358 0 0) 0x7f2ed4160ef0 con 0x7f2ed40b8380 2023-03-30T08:12:17.939 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.935+0000 7f2ed27fc700 1 -- 172.21.15.87:0/3414759474 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ebc0035d0 con 0x7f2ed40b8380 2023-03-30T08:12:17.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed3fff700 1 -- 172.21.15.87:0/3414759474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ed40d27e0 msgr2=0x7f2ed40d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed3fff700 1 --2- 172.21.15.87:0/3414759474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ed40d27e0 0x7f2ed40d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed3fff700 1 -- 172.21.15.87:0/3414759474 >> v1:172.21.15.87:6789/0 conn(0x7f2ed40b8380 legacy=0x7f2ed4069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed3fff700 1 -- 172.21.15.87:0/3414759474 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed40cef00 con 0x7f2ed406a3e0 2023-03-30T08:12:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed2ffd700 1 --2- 172.21.15.87:0/3414759474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ed40d27e0 0x7f2ed40d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:12:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed3fff700 1 --2- 172.21.15.87:0/3414759474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed406a3e0 0x7f2ed40d0880 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009d90 tx=0x7f2ecc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34f4c5020f91b232 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed27fc700 1 -- 172.21.15.87:0/3414759474 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc00e070 con 0x7f2ed406a3e0 2023-03-30T08:12:17.941 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed27fc700 1 -- 172.21.15.87:0/3414759474 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc00bb20 con 0x7f2ed406a3e0 2023-03-30T08:12:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed27fc700 1 -- 172.21.15.87:0/3414759474 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc012430 con 0x7f2ed406a3e0 2023-03-30T08:12:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed8f84700 1 -- 172.21.15.87:0/3414759474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed406a3e0 msgr2=0x7f2ed40d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed8f84700 1 --2- 172.21.15.87:0/3414759474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed406a3e0 0x7f2ed40d0880 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009d90 tx=0x7f2ecc00b330 comp rx=0 tx=0).stop 2023-03-30T08:12:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed8f84700 1 -- 172.21.15.87:0/3414759474 shutdown_connections 2023-03-30T08:12:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed8f84700 1 --2- 172.21.15.87:0/3414759474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed406a3e0 0x7f2ed40d0880 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed8f84700 1 --2- 172.21.15.87:0/3414759474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ed40d27e0 0x7f2ed40d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed8f84700 1 -- 172.21.15.87:0/3414759474 >> 172.21.15.87:0/3414759474 conn(0x7f2ed40b53f0 msgr2=0x7f2ed40cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed8f84700 1 -- 172.21.15.87:0/3414759474 shutdown_connections 2023-03-30T08:12:17.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.939+0000 7f2ed8f84700 1 -- 172.21.15.87:0/3414759474 wait complete. 2023-03-30T08:12:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed8f84700 1 Processor -- start 2023-03-30T08:12:17.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed8f84700 1 -- start start 2023-03-30T08:12:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed8f84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ed406a3e0 0x7f2ed415f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed8f84700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ed40b8380 0x7f2ed40c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed8f84700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed40c76c0 0x7f2ed40d1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed8f84700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed4157a40 con 0x7f2ed40b8380 2023-03-30T08:12:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed8f84700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed40c7bd0 con 0x7f2ed40c76c0 2023-03-30T08:12:17.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed8f84700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed41f5060 con 0x7f2ed406a3e0 2023-03-30T08:12:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed2ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ed40b8380 0x7f2ed40c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed2ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ed40b8380 0x7f2ed40c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59726/0 (socket says 172.21.15.87:59726) 2023-03-30T08:12:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed37fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ed406a3e0 0x7f2ed415f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed2ffd700 1 -- 172.21.15.87:0/555454484 learned_addr learned my addr 172.21.15.87:0/555454484 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed3fff700 1 --2- 172.21.15.87:0/555454484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed40c76c0 0x7f2ed40d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed2ffd700 1 -- 172.21.15.87:0/555454484 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ed406a3e0 msgr2=0x7f2ed415f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed2ffd700 1 --2- 172.21.15.87:0/555454484 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ed406a3e0 0x7f2ed415f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed2ffd700 1 -- 172.21.15.87:0/555454484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed40c76c0 msgr2=0x7f2ed40d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:17.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed2ffd700 1 --2- 172.21.15.87:0/555454484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed40c76c0 0x7f2ed40d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.943+0000 7f2ed2ffd700 1 -- 172.21.15.87:0/555454484 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec80094b0 con 0x7f2ed40b8380 2023-03-30T08:12:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.947+0000 7f2ed2ffd700 1 --2- 172.21.15.87:0/555454484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ed40b8380 0x7f2ed40c7180 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800ebb0 tx=0x7f2ec800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:17.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.947+0000 7f2ebbfff700 1 -- 172.21.15.87:0/555454484 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec800c850 con 0x7f2ed40b8380 2023-03-30T08:12:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.947+0000 7f2ebbfff700 1 -- 172.21.15.87:0/555454484 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec800c9b0 con 0x7f2ed40b8380 2023-03-30T08:12:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.947+0000 7f2ed8f84700 1 -- 172.21.15.87:0/555454484 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc009a70 con 0x7f2ed40b8380 2023-03-30T08:12:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.947+0000 7f2ebbfff700 1 -- 172.21.15.87:0/555454484 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec800cd40 con 0x7f2ed40b8380 2023-03-30T08:12:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.947+0000 7f2ed8f84700 1 -- 172.21.15.87:0/555454484 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed40cf480 con 0x7f2ed40b8380 2023-03-30T08:12:17.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.947+0000 7f2ed8f84700 1 -- 172.21.15.87:0/555454484 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed40cf1a0 con 0x7f2ed40b8380 2023-03-30T08:12:17.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.951+0000 7f2ebbfff700 1 -- 172.21.15.87:0/555454484 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f2ec8013470 con 0x7f2ed40b8380 2023-03-30T08:12:17.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.951+0000 7f2ebbfff700 1 --2- 172.21.15.87:0/555454484 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2ec00653f0 0x7f2ec00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:17.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.951+0000 7f2ebbfff700 1 -- 172.21.15.87:0/555454484 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2ec8082a20 con 0x7f2ed40b8380 2023-03-30T08:12:17.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.951+0000 7f2ed37fe700 1 --2- 172.21.15.87:0/555454484 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2ec00653f0 0x7f2ec00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:17.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.951+0000 7f2ed37fe700 1 --2- 172.21.15.87:0/555454484 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2ec00653f0 0x7f2ec00678a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4007fd0 tx=0x7f2ec4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:17.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:17.955+0000 7f2ebbfff700 1 -- 172.21.15.87:0/555454484 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f2ec8050460 con 0x7f2ed40b8380 2023-03-30T08:12:18.170 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:18.167+0000 7f2ed8f84700 1 -- 172.21.15.87:0/555454484 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2ed4072cf0 con 0x7f2ed40b8380 2023-03-30T08:12:19.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.015+0000 7f2ebbfff700 1 -- 172.21.15.87:0/555454484 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2ec8053a80 con 0x7f2ed40b8380 2023-03-30T08:12:19.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.019+0000 7f2ed8f84700 1 -- 172.21.15.87:0/555454484 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2ec00653f0 msgr2=0x7f2ec00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:19.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.019+0000 7f2ed8f84700 1 --2- 172.21.15.87:0/555454484 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2ec00653f0 0x7f2ec00678a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4007fd0 tx=0x7f2ec4009040 comp rx=0 tx=0).stop 2023-03-30T08:12:19.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.019+0000 7f2ed8f84700 1 -- 172.21.15.87:0/555454484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ed40b8380 msgr2=0x7f2ed40c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:19.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.019+0000 7f2ed8f84700 1 --2- 172.21.15.87:0/555454484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ed40b8380 0x7f2ed40c7180 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800ebb0 tx=0x7f2ec800eec0 comp rx=0 tx=0).stop 2023-03-30T08:12:19.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.019+0000 7f2ed8f84700 1 -- 172.21.15.87:0/555454484 shutdown_connections 2023-03-30T08:12:19.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.019+0000 7f2ed8f84700 1 --2- 172.21.15.87:0/555454484 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f2ec00653f0 0x7f2ec00678a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:19.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.019+0000 7f2ed8f84700 1 --2- 172.21.15.87:0/555454484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ed40c76c0 0x7f2ed40d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:19.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.019+0000 7f2ed8f84700 1 --2- 172.21.15.87:0/555454484 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ed40b8380 0x7f2ed40c7180 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:19.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.019+0000 7f2ed8f84700 1 --2- 172.21.15.87:0/555454484 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2ed406a3e0 0x7f2ed415f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:19.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.019+0000 7f2ed8f84700 1 -- 172.21.15.87:0/555454484 >> 172.21.15.87:0/555454484 conn(0x7f2ed40b53f0 msgr2=0x7f2ed415c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:19.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.019+0000 7f2ed8f84700 1 -- 172.21.15.87:0/555454484 shutdown_connections 2023-03-30T08:12:19.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.019+0000 7f2ed8f84700 1 -- 172.21.15.87:0/555454484 wait complete. 2023-03-30T08:12:19.043 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-03-30T08:12:19.044 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-03-30T08:12:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.215+0000 7febad1c3700 1 Processor -- start 2023-03-30T08:12:19.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.215+0000 7febad1c3700 1 -- start start 2023-03-30T08:12:19.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.215+0000 7febad1c3700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7feba81600d0 0x7feba806a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:19.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.215+0000 7febad1c3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feba806aab0 0x7feba80abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:19.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.215+0000 7febad1c3700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba806a0e0 con 0x7feba80ad640 2023-03-30T08:12:19.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.215+0000 7febad1c3700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba80c9db0 con 0x7feba806aab0 2023-03-30T08:12:19.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.215+0000 7febad1c3700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba80ca090 con 0x7feba81600d0 2023-03-30T08:12:19.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.215+0000 7feb9f7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feba806aab0 0x7feba80abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:19.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.215+0000 7feb9f7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feba806aab0 0x7feba80abfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59732/0 (socket says 172.21.15.87:59732) 2023-03-30T08:12:19.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.215+0000 7feb9f7fe700 1 -- 172.21.15.87:0/1979263087 learned_addr learned my addr 172.21.15.87:0/1979263087 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:19.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.215+0000 7feba7fff700 1 --2- 172.21.15.87:0/1979263087 >> v2:172.21.15.115:3300/0 conn(0x7feba81600d0 0x7feba806a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:19.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.215+0000 7feb9f7fe700 1 -- 172.21.15.87:0/1979263087 >> v2:172.21.15.115:3300/0 conn(0x7feba81600d0 msgr2=0x7feba806a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:19.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.215+0000 7feb9f7fe700 1 --2- 172.21.15.87:0/1979263087 >> v2:172.21.15.115:3300/0 conn(0x7feba81600d0 0x7feba806a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:19.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.215+0000 7feb9f7fe700 1 -- 172.21.15.87:0/1979263087 >> v1:172.21.15.115:6789/0 conn(0x7feba80ad640 legacy=0x7feba81604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:19.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.215+0000 7feb9f7fe700 1 -- 172.21.15.87:0/1979263087 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba8069d70 con 0x7feba806aab0 2023-03-30T08:12:19.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.219+0000 7feb9f7fe700 1 --2- 172.21.15.87:0/1979263087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba806aab0 0x7feba80abfe0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7feba806fe20 tx=0x7feb90009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b7ac681a53c436 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:19.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.219+0000 7feba77fe700 1 -- 172.21.15.87:0/1979263087 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90011830 con 0x7feba806aab0 2023-03-30T08:12:19.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.219+0000 7feba77fe700 1 -- 172.21.15.87:0/1979263087 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb90011990 con 0x7feba806aab0 2023-03-30T08:12:19.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.219+0000 7feba77fe700 1 -- 172.21.15.87:0/1979263087 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90011d20 con 0x7feba806aab0 2023-03-30T08:12:19.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.219+0000 7febad1c3700 1 -- 172.21.15.87:0/1979263087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba806aab0 msgr2=0x7feba80abfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:19.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.219+0000 7febad1c3700 1 --2- 172.21.15.87:0/1979263087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba806aab0 0x7feba80abfe0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7feba806fe20 tx=0x7feb90009bf0 comp rx=0 tx=0).stop 2023-03-30T08:12:19.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.219+0000 7febad1c3700 1 -- 172.21.15.87:0/1979263087 shutdown_connections 2023-03-30T08:12:19.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.219+0000 7febad1c3700 1 --2- 172.21.15.87:0/1979263087 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba806aab0 0x7feba80abfe0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:19.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.219+0000 7febad1c3700 1 --2- 172.21.15.87:0/1979263087 >> v2:172.21.15.115:3300/0 conn(0x7feba81600d0 0x7feba806a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:19.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.219+0000 7febad1c3700 1 -- 172.21.15.87:0/1979263087 >> 172.21.15.87:0/1979263087 conn(0x7feba80cf410 msgr2=0x7feba80cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:19.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.219+0000 7febad1c3700 1 -- 172.21.15.87:0/1979263087 shutdown_connections 2023-03-30T08:12:19.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.219+0000 7febad1c3700 1 -- 172.21.15.87:0/1979263087 wait complete. 2023-03-30T08:12:19.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.223+0000 7febad1c3700 1 Processor -- start 2023-03-30T08:12:19.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.223+0000 7febad1c3700 1 -- start start 2023-03-30T08:12:19.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.223+0000 7febad1c3700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feba806aab0 0x7feba80c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:19.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.223+0000 7febad1c3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba80ad640 0x7feba8150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:19.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.223+0000 7febad1c3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba81600d0 0x7feba80c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:19.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.223+0000 7febad1c3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba80c7bc0 con 0x7feba80ad640 2023-03-30T08:12:19.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.223+0000 7febad1c3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba80c33c0 con 0x7feba81600d0 2023-03-30T08:12:19.226 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.223+0000 7febad1c3700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba8151160 con 0x7feba806aab0 2023-03-30T08:12:19.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.223+0000 7feb9f7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba80ad640 0x7feba8150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:19.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.223+0000 7feb9f7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba80ad640 0x7feba8150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:59736/0 (socket says 172.21.15.87:59736) 2023-03-30T08:12:19.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.223+0000 7feb9f7fe700 1 -- 172.21.15.87:0/2635587897 learned_addr learned my addr 172.21.15.87:0/2635587897 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:19.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.223+0000 7feba7fff700 1 --2- 172.21.15.87:0/2635587897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feba806aab0 0x7feba80c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:19.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.223+0000 7febac9c2700 1 --2- 172.21.15.87:0/2635587897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba81600d0 0x7feba80c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:19.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.227+0000 7feb9f7fe700 1 -- 172.21.15.87:0/2635587897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feba806aab0 msgr2=0x7feba80c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:19.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.227+0000 7feb9f7fe700 1 --2- 172.21.15.87:0/2635587897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feba806aab0 0x7feba80c2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:19.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.227+0000 7feb9f7fe700 1 -- 172.21.15.87:0/2635587897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba81600d0 msgr2=0x7feba80c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:19.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.227+0000 7feb9f7fe700 1 --2- 172.21.15.87:0/2635587897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba81600d0 0x7feba80c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:19.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.227+0000 7feb9f7fe700 1 -- 172.21.15.87:0/2635587897 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90009570 con 0x7feba80ad640 2023-03-30T08:12:19.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.227+0000 7febac9c2700 1 --2- 172.21.15.87:0/2635587897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba81600d0 0x7feba80c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:19.229 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.227+0000 7feb9f7fe700 1 --2- 172.21.15.87:0/2635587897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba80ad640 0x7feba8150c20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7feba806ff40 tx=0x7feb90004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:19.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.227+0000 7feba57fa700 1 -- 172.21.15.87:0/2635587897 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90004550 con 0x7feba80ad640 2023-03-30T08:12:19.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.227+0000 7feba57fa700 1 -- 172.21.15.87:0/2635587897 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9001f070 con 0x7feba80ad640 2023-03-30T08:12:19.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.227+0000 7feba57fa700 1 -- 172.21.15.87:0/2635587897 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90003900 con 0x7feba80ad640 2023-03-30T08:12:19.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.227+0000 7febad1c3700 1 -- 172.21.15.87:0/2635587897 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba80addc0 con 0x7feba80ad640 2023-03-30T08:12:19.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.227+0000 7febad1c3700 1 -- 172.21.15.87:0/2635587897 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba80ca370 con 0x7feba80ad640 2023-03-30T08:12:19.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.227+0000 7febad1c3700 1 -- 172.21.15.87:0/2635587897 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba815d8c0 con 0x7feba80ad640 2023-03-30T08:12:19.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.231+0000 7feba57fa700 1 -- 172.21.15.87:0/2635587897 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7feb90003a60 con 0x7feba80ad640 2023-03-30T08:12:19.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.231+0000 7feba57fa700 1 --2- 172.21.15.87:0/2635587897 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feb880653f0 0x7feb880678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:19.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.231+0000 7feba57fa700 1 -- 172.21.15.87:0/2635587897 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7feb90021070 con 0x7feba80ad640 2023-03-30T08:12:19.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.231+0000 7feba7fff700 1 --2- 172.21.15.87:0/2635587897 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feb880653f0 0x7feb880678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:19.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.231+0000 7feba7fff700 1 --2- 172.21.15.87:0/2635587897 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feb880653f0 0x7feb880678a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feba81f52f0 tx=0x7feb9800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:19.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.239+0000 7feba57fa700 1 -- 172.21.15.87:0/2635587897 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7feb90088070 con 0x7feba80ad640 2023-03-30T08:12:19.429 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T08:12:19.429+0000 7ff6acc61700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-30T08:12:19.445 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:19.443+0000 7febad1c3700 1 -- 172.21.15.87:0/2635587897 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7feba8073410 con 0x7feba80ad640 2023-03-30T08:12:20.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.023+0000 7feba57fa700 1 -- 172.21.15.87:0/2635587897 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7feba8073410 con 0x7feba80ad640 2023-03-30T08:12:20.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.027+0000 7febad1c3700 1 -- 172.21.15.87:0/2635587897 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feb880653f0 msgr2=0x7feb880678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:20.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.027+0000 7febad1c3700 1 --2- 172.21.15.87:0/2635587897 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feb880653f0 0x7feb880678a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feba81f52f0 tx=0x7feb9800b040 comp rx=0 tx=0).stop 2023-03-30T08:12:20.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.027+0000 7febad1c3700 1 -- 172.21.15.87:0/2635587897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba80ad640 msgr2=0x7feba8150c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:20.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.027+0000 7febad1c3700 1 --2- 172.21.15.87:0/2635587897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba80ad640 0x7feba8150c20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7feba806ff40 tx=0x7feb90004770 comp rx=0 tx=0).stop 2023-03-30T08:12:20.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.027+0000 7febad1c3700 1 -- 172.21.15.87:0/2635587897 shutdown_connections 2023-03-30T08:12:20.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.027+0000 7febad1c3700 1 --2- 172.21.15.87:0/2635587897 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7feb880653f0 0x7feb880678a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.027+0000 7febad1c3700 1 --2- 172.21.15.87:0/2635587897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba81600d0 0x7feba80c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.027+0000 7febad1c3700 1 --2- 172.21.15.87:0/2635587897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feba80ad640 0x7feba8150c20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.027+0000 7febad1c3700 1 --2- 172.21.15.87:0/2635587897 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7feba806aab0 0x7feba80c2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.027+0000 7febad1c3700 1 -- 172.21.15.87:0/2635587897 >> 172.21.15.87:0/2635587897 conn(0x7feba80cf410 msgr2=0x7feba815bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:20.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.027+0000 7febad1c3700 1 -- 172.21.15.87:0/2635587897 shutdown_connections 2023-03-30T08:12:20.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.027+0000 7febad1c3700 1 -- 172.21.15.87:0/2635587897 wait complete. 2023-03-30T08:12:20.053 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-03-30T08:12:20.053 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T08:12:20.227 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.227+0000 7f93ceffc700 1 Processor -- start 2023-03-30T08:12:20.228 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.227+0000 7f93ceffc700 1 -- start start 2023-03-30T08:12:20.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.227+0000 7f93ceffc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f93c806bd80 0x7f93c8070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:20.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.227+0000 7f93ceffc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f93c8070960 0x7f93c815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:20.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.227+0000 7f93ceffc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c8070d80 con 0x7f93c80c1dc0 2023-03-30T08:12:20.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.227+0000 7f93ceffc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c8164520 con 0x7f93c806bd80 2023-03-30T08:12:20.230 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.227+0000 7f93ceffc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c8164800 con 0x7f93c8070960 2023-03-30T08:12:20.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.227+0000 7f93c7fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f93c806bd80 0x7f93c8070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:20.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.227+0000 7f93c7fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f93c806bd80 0x7f93c8070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39586/0 (socket says 172.21.15.87:39586) 2023-03-30T08:12:20.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.227+0000 7f93c7fff700 1 -- 172.21.15.87:0/172474908 learned_addr learned my addr 172.21.15.87:0/172474908 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:20.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.227+0000 7f93cd599700 1 --2- 172.21.15.87:0/172474908 >> v2:172.21.15.115:3300/0 conn(0x7f93c8070960 0x7f93c815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:20.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93c7fff700 1 -- 172.21.15.87:0/172474908 >> v2:172.21.15.115:3300/0 conn(0x7f93c8070960 msgr2=0x7f93c815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:20.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93c7fff700 1 --2- 172.21.15.87:0/172474908 >> v2:172.21.15.115:3300/0 conn(0x7f93c8070960 0x7f93c815a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93c7fff700 1 -- 172.21.15.87:0/172474908 >> v1:172.21.15.115:6789/0 conn(0x7f93c80c1dc0 legacy=0x7f93c80cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:20.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93c7fff700 1 -- 172.21.15.87:0/172474908 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c8164ae0 con 0x7f93c806bd80 2023-03-30T08:12:20.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93c7fff700 1 --2- 172.21.15.87:0/172474908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c806bd80 0x7f93c8070420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f93c8071300 tx=0x7f93b4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14eae54a3f3e4eb server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:20.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93c77fe700 1 -- 172.21.15.87:0/172474908 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b400b8a0 con 0x7f93c806bd80 2023-03-30T08:12:20.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93c77fe700 1 -- 172.21.15.87:0/172474908 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b400ba00 con 0x7f93c806bd80 2023-03-30T08:12:20.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93c77fe700 1 -- 172.21.15.87:0/172474908 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b400bd90 con 0x7f93c806bd80 2023-03-30T08:12:20.234 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93ceffc700 1 -- 172.21.15.87:0/172474908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c806bd80 msgr2=0x7f93c8070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:20.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93ceffc700 1 --2- 172.21.15.87:0/172474908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c806bd80 0x7f93c8070420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f93c8071300 tx=0x7f93b4009bf0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93ceffc700 1 -- 172.21.15.87:0/172474908 shutdown_connections 2023-03-30T08:12:20.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93ceffc700 1 --2- 172.21.15.87:0/172474908 >> v2:172.21.15.115:3300/0 conn(0x7f93c8070960 0x7f93c815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93ceffc700 1 --2- 172.21.15.87:0/172474908 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c806bd80 0x7f93c8070420 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93ceffc700 1 -- 172.21.15.87:0/172474908 >> 172.21.15.87:0/172474908 conn(0x7f93c80ce960 msgr2=0x7f93c80ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:20.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93ceffc700 1 -- 172.21.15.87:0/172474908 shutdown_connections 2023-03-30T08:12:20.235 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.231+0000 7f93ceffc700 1 -- 172.21.15.87:0/172474908 wait complete. 2023-03-30T08:12:20.236 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ceffc700 1 Processor -- start 2023-03-30T08:12:20.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ceffc700 1 -- start start 2023-03-30T08:12:20.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ceffc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c806bd80 0x7f93c80c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:20.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ceffc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93c8070960 0x7f93c80afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:20.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ceffc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93c80c1dc0 0x7f93c80b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:20.237 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ceffc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80c2800 con 0x7f93c806bd80 2023-03-30T08:12:20.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ceffc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80b3d70 con 0x7f93c8070960 2023-03-30T08:12:20.238 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ceffc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80b34d0 con 0x7f93c80c1dc0 2023-03-30T08:12:20.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ccd98700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c806bd80 0x7f93c80c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:20.239 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ccd98700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c806bd80 0x7f93c80c4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39600/0 (socket says 172.21.15.87:39600) 2023-03-30T08:12:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ccd98700 1 -- 172.21.15.87:0/132015756 learned_addr learned my addr 172.21.15.87:0/132015756 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93c7fff700 1 --2- 172.21.15.87:0/132015756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93c8070960 0x7f93c80afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93cd599700 1 --2- 172.21.15.87:0/132015756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93c80c1dc0 0x7f93c80b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ccd98700 1 -- 172.21.15.87:0/132015756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93c80c1dc0 msgr2=0x7f93c80b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ccd98700 1 --2- 172.21.15.87:0/132015756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93c80c1dc0 0x7f93c80b0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.240 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ccd98700 1 -- 172.21.15.87:0/132015756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93c8070960 msgr2=0x7f93c80afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ccd98700 1 --2- 172.21.15.87:0/132015756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93c8070960 0x7f93c80afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ccd98700 1 -- 172.21.15.87:0/132015756 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b4009570 con 0x7f93c806bd80 2023-03-30T08:12:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ccd98700 1 --2- 172.21.15.87:0/132015756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c806bd80 0x7f93c80c4be0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00c500 tx=0x7f93bc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93c57fa700 1 -- 172.21.15.87:0/132015756 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc0052d0 con 0x7f93c806bd80 2023-03-30T08:12:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93c57fa700 1 -- 172.21.15.87:0/132015756 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93bc005430 con 0x7f93c806bd80 2023-03-30T08:12:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.235+0000 7f93ceffc700 1 -- 172.21.15.87:0/132015756 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c81650a0 con 0x7f93c806bd80 2023-03-30T08:12:20.241 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.239+0000 7f93c57fa700 1 -- 172.21.15.87:0/132015756 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc0055a0 con 0x7f93c806bd80 2023-03-30T08:12:20.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.239+0000 7f93ceffc700 1 -- 172.21.15.87:0/132015756 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c8164dc0 con 0x7f93c806bd80 2023-03-30T08:12:20.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.239+0000 7f93ceffc700 1 -- 172.21.15.87:0/132015756 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c80ce540 con 0x7f93c806bd80 2023-03-30T08:12:20.242 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.239+0000 7f93c57fa700 1 -- 172.21.15.87:0/132015756 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f93bc0036a0 con 0x7f93c806bd80 2023-03-30T08:12:20.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.243+0000 7f93c57fa700 1 --2- 172.21.15.87:0/132015756 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f93ac0653f0 0x7f93ac0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:20.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.243+0000 7f93c57fa700 1 -- 172.21.15.87:0/132015756 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f93bc081be0 con 0x7f93c806bd80 2023-03-30T08:12:20.244 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.243+0000 7f93c7fff700 1 --2- 172.21.15.87:0/132015756 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f93ac0653f0 0x7f93ac0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:20.245 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.243+0000 7f93c7fff700 1 --2- 172.21.15.87:0/132015756 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f93ac0653f0 0x7f93ac0678a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f93b4000c00 tx=0x7f93b4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:20.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.247+0000 7f93c57fa700 1 -- 172.21.15.87:0/132015756 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f93bc0495e0 con 0x7f93c806bd80 2023-03-30T08:12:20.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.447+0000 7f93ceffc700 1 -- 172.21.15.87:0/132015756 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93c80b3bb0 con 0x7f93c806bd80 2023-03-30T08:12:20.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.447+0000 7f93c57fa700 1 -- 172.21.15.87:0/132015756 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f93bc04f620 con 0x7f93c806bd80 2023-03-30T08:12:20.451 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:20.451 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4958,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/474261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":474261391},{"type":"v1","addr":"172.21.15.115:6833","nonce":474261391}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/2626542689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2626542689},{"type":"v1","addr":"172.21.15.87:6836","nonce":2626542689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3981806958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3981806958},{"type":"v1","addr":"172.21.15.87:6837","nonce":3981806958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-30T08:12:16.963002+0000","modified":"2023-03-30T08:12:20.012842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6835/450554084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":450554084},{"type":"v1","addr":"172.21.15.115:6835","nonce":450554084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-30T08:12:20.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.455+0000 7f93ceffc700 1 -- 172.21.15.87:0/132015756 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f93ac0653f0 msgr2=0x7f93ac0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:20.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.455+0000 7f93ceffc700 1 --2- 172.21.15.87:0/132015756 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f93ac0653f0 0x7f93ac0678a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f93b4000c00 tx=0x7f93b4008030 comp rx=0 tx=0).stop 2023-03-30T08:12:20.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.455+0000 7f93ceffc700 1 -- 172.21.15.87:0/132015756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c806bd80 msgr2=0x7f93c80c4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:20.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.455+0000 7f93ceffc700 1 --2- 172.21.15.87:0/132015756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c806bd80 0x7f93c80c4be0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00c500 tx=0x7f93bc00c810 comp rx=0 tx=0).stop 2023-03-30T08:12:20.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.455+0000 7f93ceffc700 1 -- 172.21.15.87:0/132015756 shutdown_connections 2023-03-30T08:12:20.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.455+0000 7f93ceffc700 1 --2- 172.21.15.87:0/132015756 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f93ac0653f0 0x7f93ac0678a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.455+0000 7f93ceffc700 1 --2- 172.21.15.87:0/132015756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93c80c1dc0 0x7f93c80b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.455+0000 7f93ceffc700 1 --2- 172.21.15.87:0/132015756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93c8070960 0x7f93c80afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.455+0000 7f93ceffc700 1 --2- 172.21.15.87:0/132015756 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f93c806bd80 0x7f93c80c4be0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.455+0000 7f93ceffc700 1 -- 172.21.15.87:0/132015756 >> 172.21.15.87:0/132015756 conn(0x7f93c80ce960 msgr2=0x7f93c80c8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:20.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.455+0000 7f93ceffc700 1 -- 172.21.15.87:0/132015756 shutdown_connections 2023-03-30T08:12:20.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.455+0000 7f93ceffc700 1 -- 172.21.15.87:0/132015756 wait complete. 2023-03-30T08:12:20.458 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 17 2023-03-30T08:12:20.475 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T08:12:20.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.631+0000 7faa85984700 1 Processor -- start 2023-03-30T08:12:20.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.631+0000 7faa85984700 1 -- start start 2023-03-30T08:12:20.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.631+0000 7faa85984700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faa800b3f30 0x7faa800b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:20.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.631+0000 7faa85984700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faa8006a6e0 0x7faa800aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:20.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.631+0000 7faa85984700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8006b670 con 0x7faa800af180 2023-03-30T08:12:20.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.631+0000 7faa85984700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa800af600 con 0x7faa800b3f30 2023-03-30T08:12:20.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.631+0000 7faa85984700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8006b0b0 con 0x7faa8006a6e0 2023-03-30T08:12:20.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.631+0000 7faa84982700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faa800b3f30 0x7faa800b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:20.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.631+0000 7faa84982700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7faa800b3f30 0x7faa800b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39610/0 (socket says 172.21.15.87:39610) 2023-03-30T08:12:20.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.631+0000 7faa84982700 1 -- 172.21.15.87:0/3481410952 learned_addr learned my addr 172.21.15.87:0/3481410952 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:20.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.631+0000 7faa77fff700 1 --2- 172.21.15.87:0/3481410952 >> v2:172.21.15.115:3300/0 conn(0x7faa8006a6e0 0x7faa800aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:20.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa84982700 1 -- 172.21.15.87:0/3481410952 >> v2:172.21.15.115:3300/0 conn(0x7faa8006a6e0 msgr2=0x7faa800aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:20.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa84982700 1 --2- 172.21.15.87:0/3481410952 >> v2:172.21.15.115:3300/0 conn(0x7faa8006a6e0 0x7faa800aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa84982700 1 -- 172.21.15.87:0/3481410952 >> v1:172.21.15.115:6789/0 conn(0x7faa800af180 legacy=0x7faa8015ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa84982700 1 -- 172.21.15.87:0/3481410952 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8006b390 con 0x7faa800b3f30 2023-03-30T08:12:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa77fff700 1 --2- 172.21.15.87:0/3481410952 >> v2:172.21.15.115:3300/0 conn(0x7faa8006a6e0 0x7faa800aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:12:20.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa84982700 1 --2- 172.21.15.87:0/3481410952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa800b3f30 0x7faa800b0c10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7faa800ce750 tx=0x7faa7c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e932d28aea71be85 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa777fe700 1 -- 172.21.15.87:0/3481410952 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c011830 con 0x7faa800b3f30 2023-03-30T08:12:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa777fe700 1 -- 172.21.15.87:0/3481410952 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7c011990 con 0x7faa800b3f30 2023-03-30T08:12:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa777fe700 1 -- 172.21.15.87:0/3481410952 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c011d20 con 0x7faa800b3f30 2023-03-30T08:12:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa85984700 1 -- 172.21.15.87:0/3481410952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa800b3f30 msgr2=0x7faa800b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:20.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa85984700 1 --2- 172.21.15.87:0/3481410952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa800b3f30 0x7faa800b0c10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7faa800ce750 tx=0x7faa7c009bf0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa85984700 1 -- 172.21.15.87:0/3481410952 shutdown_connections 2023-03-30T08:12:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa85984700 1 --2- 172.21.15.87:0/3481410952 >> v2:172.21.15.115:3300/0 conn(0x7faa8006a6e0 0x7faa800aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa85984700 1 --2- 172.21.15.87:0/3481410952 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa800b3f30 0x7faa800b0c10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa85984700 1 -- 172.21.15.87:0/3481410952 >> 172.21.15.87:0/3481410952 conn(0x7faa800cf410 msgr2=0x7faa800cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:20.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa85984700 1 -- 172.21.15.87:0/3481410952 shutdown_connections 2023-03-30T08:12:20.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.635+0000 7faa85984700 1 -- 172.21.15.87:0/3481410952 wait complete. 2023-03-30T08:12:20.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa85984700 1 Processor -- start 2023-03-30T08:12:20.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa85984700 1 -- start start 2023-03-30T08:12:20.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa85984700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa8006a6e0 0x7faa80154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:20.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa85984700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa800af180 0x7faa800c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:20.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa85984700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa800b3f30 0x7faa800c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:20.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa85984700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa80154c50 con 0x7faa8006a6e0 2023-03-30T08:12:20.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa85984700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa800c5e00 con 0x7faa800af180 2023-03-30T08:12:20.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa85984700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa800aced0 con 0x7faa800b3f30 2023-03-30T08:12:20.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa84982700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa8006a6e0 0x7faa80154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:20.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa84982700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa8006a6e0 0x7faa80154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39626/0 (socket says 172.21.15.87:39626) 2023-03-30T08:12:20.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa84982700 1 -- 172.21.15.87:0/122097491 learned_addr learned my addr 172.21.15.87:0/122097491 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:20.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa77fff700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa800af180 0x7faa800c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:20.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa85183700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa800b3f30 0x7faa800c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:20.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa84982700 1 -- 172.21.15.87:0/122097491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa800b3f30 msgr2=0x7faa800c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:20.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa84982700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa800b3f30 0x7faa800c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa84982700 1 -- 172.21.15.87:0/122097491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa800af180 msgr2=0x7faa800c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:20.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa84982700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa800af180 0x7faa800c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa84982700 1 -- 172.21.15.87:0/122097491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa700094b0 con 0x7faa8006a6e0 2023-03-30T08:12:20.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa77fff700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa800af180 0x7faa800c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:20.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.639+0000 7faa85183700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa800b3f30 0x7faa800c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:12:20.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.643+0000 7faa84982700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa8006a6e0 0x7faa80154710 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7faa7c014040 tx=0x7faa7c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:20.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.643+0000 7faa757fa700 1 -- 172.21.15.87:0/122097491 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c004550 con 0x7faa8006a6e0 2023-03-30T08:12:20.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.643+0000 7faa757fa700 1 -- 172.21.15.87:0/122097491 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7c01e070 con 0x7faa8006a6e0 2023-03-30T08:12:20.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.643+0000 7faa757fa700 1 -- 172.21.15.87:0/122097491 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c0038c0 con 0x7faa8006a6e0 2023-03-30T08:12:20.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.643+0000 7faa85984700 1 -- 172.21.15.87:0/122097491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7c009570 con 0x7faa8006a6e0 2023-03-30T08:12:20.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.643+0000 7faa85984700 1 -- 172.21.15.87:0/122097491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa800ae1b0 con 0x7faa8006a6e0 2023-03-30T08:12:20.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.643+0000 7faa85984700 1 -- 172.21.15.87:0/122097491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa800aded0 con 0x7faa8006a6e0 2023-03-30T08:12:20.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.647+0000 7faa757fa700 1 -- 172.21.15.87:0/122097491 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7faa7c003a20 con 0x7faa8006a6e0 2023-03-30T08:12:20.648 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.647+0000 7faa757fa700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7faa6c0653f0 0x7faa6c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:20.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.647+0000 7faa757fa700 1 -- 172.21.15.87:0/122097491 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faa7c083b30 con 0x7faa8006a6e0 2023-03-30T08:12:20.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.647+0000 7faa77fff700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7faa6c0653f0 0x7faa6c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:20.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.647+0000 7faa77fff700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7faa6c0653f0 0x7faa6c0678a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faa801f4fb0 tx=0x7faa70008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:20.655 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.651+0000 7faa757fa700 1 -- 172.21.15.87:0/122097491 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7faa7c051720 con 0x7faa8006a6e0 2023-03-30T08:12:20.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.823+0000 7faa85984700 1 -- 172.21.15.87:0/122097491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa800b4300 con 0x7faa8006a6e0 2023-03-30T08:12:20.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.827+0000 7faa757fa700 1 -- 172.21.15.87:0/122097491 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18032 (secure 0 0 0) 0x7faa7c020090 con 0x7faa8006a6e0 2023-03-30T08:12:20.830 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:20.830 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":43,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:12:17.967749+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:12:14.871645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-03-30T08:12:15.991480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T08:12:20.833 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.831+0000 7faa85984700 1 -- 172.21.15.87:0/122097491 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7faa6c0653f0 msgr2=0x7faa6c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:20.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.831+0000 7faa85984700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7faa6c0653f0 0x7faa6c0678a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faa801f4fb0 tx=0x7faa70008040 comp rx=0 tx=0).stop 2023-03-30T08:12:20.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.831+0000 7faa85984700 1 -- 172.21.15.87:0/122097491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa8006a6e0 msgr2=0x7faa80154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:20.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.831+0000 7faa85984700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa8006a6e0 0x7faa80154710 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7faa7c014040 tx=0x7faa7c004770 comp rx=0 tx=0).stop 2023-03-30T08:12:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.831+0000 7faa85984700 1 -- 172.21.15.87:0/122097491 shutdown_connections 2023-03-30T08:12:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.831+0000 7faa85984700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7faa6c0653f0 0x7faa6c0678a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.831+0000 7faa85984700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa800b3f30 0x7faa800c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.831+0000 7faa85984700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa800af180 0x7faa800c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.831+0000 7faa85984700 1 --2- 172.21.15.87:0/122097491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7faa8006a6e0 0x7faa80154710 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:20.835 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.831+0000 7faa85984700 1 -- 172.21.15.87:0/122097491 >> 172.21.15.87:0/122097491 conn(0x7faa800cf410 msgr2=0x7faa800cc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:20.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.831+0000 7faa85984700 1 -- 172.21.15.87:0/122097491 shutdown_connections 2023-03-30T08:12:20.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:20.831+0000 7faa85984700 1 -- 172.21.15.87:0/122097491 wait complete. 2023-03-30T08:12:20.853 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-30T08:12:20.854 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-30T08:12:21.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.015+0000 7f7b54bef700 1 Processor -- start 2023-03-30T08:12:21.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.015+0000 7f7b54bef700 1 -- start start 2023-03-30T08:12:21.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b54bef700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7b500d27e0 0x7f7b500d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b54bef700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7b5006a3e0 0x7f7b500d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b54bef700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b50160ef0 con 0x7f7b500b8380 2023-03-30T08:12:21.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b54bef700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b500cd6a0 con 0x7f7b5006a3e0 2023-03-30T08:12:21.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b54bef700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b500cd3a0 con 0x7f7b500d27e0 2023-03-30T08:12:21.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b4ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7b5006a3e0 0x7f7b500d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b4ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7b5006a3e0 0x7f7b500d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39642/0 (socket says 172.21.15.87:39642) 2023-03-30T08:12:21.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b4ffff700 1 -- 172.21.15.87:0/2031930938 learned_addr learned my addr 172.21.15.87:0/2031930938 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:21.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b46ffd700 1 --2- 172.21.15.87:0/2031930938 >> v2:172.21.15.115:3300/0 conn(0x7f7b500d27e0 0x7f7b500d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b4ffff700 1 -- 172.21.15.87:0/2031930938 >> v2:172.21.15.115:3300/0 conn(0x7f7b500d27e0 msgr2=0x7f7b500d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:21.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b4ffff700 1 --2- 172.21.15.87:0/2031930938 >> v2:172.21.15.115:3300/0 conn(0x7f7b500d27e0 0x7f7b500d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b4ffff700 1 -- 172.21.15.87:0/2031930938 >> v1:172.21.15.115:6789/0 conn(0x7f7b500b8380 legacy=0x7f7b50069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b4ffff700 1 -- 172.21.15.87:0/2031930938 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b500cef00 con 0x7f7b5006a3e0 2023-03-30T08:12:21.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b4ffff700 1 --2- 172.21.15.87:0/2031930938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b5006a3e0 0x7f7b500d0880 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009910 tx=0x7f7b48009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a396142b1856ed server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:21.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b4effd700 1 -- 172.21.15.87:0/2031930938 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48011830 con 0x7f7b5006a3e0 2023-03-30T08:12:21.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b4effd700 1 -- 172.21.15.87:0/2031930938 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b48011990 con 0x7f7b5006a3e0 2023-03-30T08:12:21.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.019+0000 7f7b4effd700 1 -- 172.21.15.87:0/2031930938 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b48011d40 con 0x7f7b5006a3e0 2023-03-30T08:12:21.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.023+0000 7f7b54bef700 1 -- 172.21.15.87:0/2031930938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b5006a3e0 msgr2=0x7f7b500d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.023+0000 7f7b54bef700 1 --2- 172.21.15.87:0/2031930938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b5006a3e0 0x7f7b500d0880 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009910 tx=0x7f7b48009c20 comp rx=0 tx=0).stop 2023-03-30T08:12:21.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.023+0000 7f7b54bef700 1 -- 172.21.15.87:0/2031930938 shutdown_connections 2023-03-30T08:12:21.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.023+0000 7f7b54bef700 1 --2- 172.21.15.87:0/2031930938 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b5006a3e0 0x7f7b500d0880 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.023+0000 7f7b54bef700 1 --2- 172.21.15.87:0/2031930938 >> v2:172.21.15.115:3300/0 conn(0x7f7b500d27e0 0x7f7b500d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.023+0000 7f7b54bef700 1 -- 172.21.15.87:0/2031930938 >> 172.21.15.87:0/2031930938 conn(0x7f7b500b53f0 msgr2=0x7f7b500cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:21.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.023+0000 7f7b54bef700 1 -- 172.21.15.87:0/2031930938 shutdown_connections 2023-03-30T08:12:21.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.023+0000 7f7b54bef700 1 -- 172.21.15.87:0/2031930938 wait complete. 2023-03-30T08:12:21.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b54bef700 1 Processor -- start 2023-03-30T08:12:21.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b54bef700 1 -- start start 2023-03-30T08:12:21.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b54bef700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b5006a3e0 0x7f7b5014f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b54bef700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b500b8380 0x7f7b501f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b54bef700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b500c93e0 0x7f7b500cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b54bef700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b500cc2b0 con 0x7f7b500c93e0 2023-03-30T08:12:21.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b54bef700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b500c9fa0 con 0x7f7b5006a3e0 2023-03-30T08:12:21.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b54bef700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5014f6e0 con 0x7f7b500b8380 2023-03-30T08:12:21.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b4ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b500c93e0 0x7f7b500cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b4f7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b5006a3e0 0x7f7b5014f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b4ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b500c93e0 0x7f7b500cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39646/0 (socket says 172.21.15.87:39646) 2023-03-30T08:12:21.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b4ffff700 1 -- 172.21.15.87:0/1088927919 learned_addr learned my addr 172.21.15.87:0/1088927919 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:21.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b46ffd700 1 --2- 172.21.15.87:0/1088927919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b500b8380 0x7f7b501f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b4f7fe700 1 -- 172.21.15.87:0/1088927919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b500b8380 msgr2=0x7f7b501f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b4f7fe700 1 --2- 172.21.15.87:0/1088927919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b500b8380 0x7f7b501f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b4f7fe700 1 -- 172.21.15.87:0/1088927919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b500c93e0 msgr2=0x7f7b500cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b4f7fe700 1 --2- 172.21.15.87:0/1088927919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b500c93e0 0x7f7b500cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b4f7fe700 1 -- 172.21.15.87:0/1088927919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b48009570 con 0x7f7b5006a3e0 2023-03-30T08:12:21.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b4ffff700 1 --2- 172.21.15.87:0/1088927919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b500c93e0 0x7f7b500cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:12:21.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.027+0000 7f7b4f7fe700 1 --2- 172.21.15.87:0/1088927919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b5006a3e0 0x7f7b5014f1a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000cbb0 tx=0x7f7b4000cec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:21.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.031+0000 7f7b4cff9700 1 -- 172.21.15.87:0/1088927919 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40003c20 con 0x7f7b5006a3e0 2023-03-30T08:12:21.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.031+0000 7f7b4cff9700 1 -- 172.21.15.87:0/1088927919 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b40003d80 con 0x7f7b5006a3e0 2023-03-30T08:12:21.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.031+0000 7f7b4cff9700 1 -- 172.21.15.87:0/1088927919 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4000aae0 con 0x7f7b5006a3e0 2023-03-30T08:12:21.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.031+0000 7f7b54bef700 1 -- 172.21.15.87:0/1088927919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b500cf480 con 0x7f7b5006a3e0 2023-03-30T08:12:21.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.031+0000 7f7b54bef700 1 -- 172.21.15.87:0/1088927919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b500cf1a0 con 0x7f7b5006a3e0 2023-03-30T08:12:21.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.031+0000 7f7b54bef700 1 -- 172.21.15.87:0/1088927919 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b500b8750 con 0x7f7b5006a3e0 2023-03-30T08:12:21.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.031+0000 7f7b4cff9700 1 -- 172.21.15.87:0/1088927919 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f7b4000ac40 con 0x7f7b5006a3e0 2023-03-30T08:12:21.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.035+0000 7f7b4cff9700 1 --2- 172.21.15.87:0/1088927919 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7b300653f0 0x7f7b300678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.035+0000 7f7b4cff9700 1 -- 172.21.15.87:0/1088927919 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7b40082840 con 0x7f7b5006a3e0 2023-03-30T08:12:21.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.035+0000 7f7b46ffd700 1 --2- 172.21.15.87:0/1088927919 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7b300653f0 0x7f7b300678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.035+0000 7f7b46ffd700 1 --2- 172.21.15.87:0/1088927919 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7b300653f0 0x7f7b300678a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7b5015c910 tx=0x7f7b38009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:21.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.039+0000 7f7b4cff9700 1 -- 172.21.15.87:0/1088927919 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f7b40050410 con 0x7f7b5006a3e0 2023-03-30T08:12:21.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.207+0000 7f7b54bef700 1 -- 172.21.15.87:0/1088927919 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b50072cf0 con 0x7f7b300653f0 2023-03-30T08:12:21.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.223+0000 7f7b4cff9700 1 -- 172.21.15.87:0/1088927919 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306704 (secure 0 0 0) 0x7f7b50072cf0 con 0x7f7b300653f0 2023-03-30T08:12:21.229 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:21.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.227+0000 7f7b54bef700 1 -- 172.21.15.87:0/1088927919 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7b300653f0 msgr2=0x7f7b300678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.227+0000 7f7b54bef700 1 --2- 172.21.15.87:0/1088927919 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7b300653f0 0x7f7b300678a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7b5015c910 tx=0x7f7b38009240 comp rx=0 tx=0).stop 2023-03-30T08:12:21.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.227+0000 7f7b54bef700 1 -- 172.21.15.87:0/1088927919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b5006a3e0 msgr2=0x7f7b5014f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.231 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.227+0000 7f7b54bef700 1 --2- 172.21.15.87:0/1088927919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b5006a3e0 0x7f7b5014f1a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000cbb0 tx=0x7f7b4000cec0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.227+0000 7f7b54bef700 1 -- 172.21.15.87:0/1088927919 shutdown_connections 2023-03-30T08:12:21.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.227+0000 7f7b54bef700 1 --2- 172.21.15.87:0/1088927919 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7b300653f0 0x7f7b300678a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.227+0000 7f7b54bef700 1 --2- 172.21.15.87:0/1088927919 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b500c93e0 0x7f7b500cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.227+0000 7f7b54bef700 1 --2- 172.21.15.87:0/1088927919 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b500b8380 0x7f7b501f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.227+0000 7f7b54bef700 1 --2- 172.21.15.87:0/1088927919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b5006a3e0 0x7f7b5014f1a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.227+0000 7f7b54bef700 1 -- 172.21.15.87:0/1088927919 >> 172.21.15.87:0/1088927919 conn(0x7f7b500b53f0 msgr2=0x7f7b500b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:21.232 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.231+0000 7f7b54bef700 1 -- 172.21.15.87:0/1088927919 shutdown_connections 2023-03-30T08:12:21.233 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.231+0000 7f7b54bef700 1 -- 172.21.15.87:0/1088927919 wait complete. 2023-03-30T08:12:21.233 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-03-30T08:12:21.251 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-03-30T08:12:19.918826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592734,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71660,"kb_used_data":5036,"kb_used_omap":0,"kb_used_meta":66560,"kb_avail":754903060,"statfs":{"total":773094113280,"available":773020733440,"internally_reserved":0,"allocated":5156864,"data_stored":2929338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68157440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2366,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.401315"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080898+0000","last_change":"2023-03-30T08:12:16.986429+0000","last_active":"2023-03-30T08:12:18.080898+0000","last_peered":"2023-03-30T08:12:18.080898+0000","last_clean":"2023-03-30T08:12:18.080898+0000","last_became_active":"2023-03-30T08:12:16.986120+0000","last_became_peered":"2023-03-30T08:12:16.986120+0000","last_unstale":"2023-03-30T08:12:18.080898+0000","last_undegraded":"2023-03-30T08:12:18.080898+0000","last_fullsized":"2023-03-30T08:12:18.080898+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:37:50.533203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080445+0000","last_change":"2023-03-30T08:12:16.998494+0000","last_active":"2023-03-30T08:12:18.080445+0000","last_peered":"2023-03-30T08:12:18.080445+0000","last_clean":"2023-03-30T08:12:18.080445+0000","last_became_active":"2023-03-30T08:12:16.997985+0000","last_became_peered":"2023-03-30T08:12:16.997985+0000","last_unstale":"2023-03-30T08:12:18.080445+0000","last_undegraded":"2023-03-30T08:12:18.080445+0000","last_fullsized":"2023-03-30T08:12:18.080445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:07:57.345732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978517+0000","last_change":"2023-03-30T08:12:17.000935+0000","last_active":"2023-03-30T08:12:17.978517+0000","last_peered":"2023-03-30T08:12:17.978517+0000","last_clean":"2023-03-30T08:12:17.978517+0000","last_became_active":"2023-03-30T08:12:17.000530+0000","last_became_peered":"2023-03-30T08:12:17.000530+0000","last_unstale":"2023-03-30T08:12:17.978517+0000","last_undegraded":"2023-03-30T08:12:17.978517+0000","last_fullsized":"2023-03-30T08:12:17.978517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:21.266889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079294+0000","last_change":"2023-03-30T08:12:17.012729+0000","last_active":"2023-03-30T08:12:18.079294+0000","last_peered":"2023-03-30T08:12:18.079294+0000","last_clean":"2023-03-30T08:12:18.079294+0000","last_became_active":"2023-03-30T08:12:17.012355+0000","last_became_peered":"2023-03-30T08:12:17.012355+0000","last_unstale":"2023-03-30T08:12:18.079294+0000","last_undegraded":"2023-03-30T08:12:18.079294+0000","last_fullsized":"2023-03-30T08:12:18.079294+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:03:25.229617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079562+0000","last_change":"2023-03-30T08:12:16.998654+0000","last_active":"2023-03-30T08:12:18.079562+0000","last_peered":"2023-03-30T08:12:18.079562+0000","last_clean":"2023-03-30T08:12:18.079562+0000","last_became_active":"2023-03-30T08:12:16.998351+0000","last_became_peered":"2023-03-30T08:12:16.998351+0000","last_unstale":"2023-03-30T08:12:18.079562+0000","last_undegraded":"2023-03-30T08:12:18.079562+0000","last_fullsized":"2023-03-30T08:12:18.079562+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:50:18.929971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977159+0000","last_change":"2023-03-30T08:12:17.006222+0000","last_active":"2023-03-30T08:12:17.977159+0000","last_peered":"2023-03-30T08:12:17.977159+0000","last_clean":"2023-03-30T08:12:17.977159+0000","last_became_active":"2023-03-30T08:12:17.005960+0000","last_became_peered":"2023-03-30T08:12:17.005960+0000","last_unstale":"2023-03-30T08:12:17.977159+0000","last_undegraded":"2023-03-30T08:12:17.977159+0000","last_fullsized":"2023-03-30T08:12:17.977159+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:03:25.229617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080488+0000","last_change":"2023-03-30T08:12:16.985347+0000","last_active":"2023-03-30T08:12:18.080488+0000","last_peered":"2023-03-30T08:12:18.080488+0000","last_clean":"2023-03-30T08:12:18.080488+0000","last_became_active":"2023-03-30T08:12:16.985025+0000","last_became_peered":"2023-03-30T08:12:16.985025+0000","last_unstale":"2023-03-30T08:12:18.080488+0000","last_undegraded":"2023-03-30T08:12:18.080488+0000","last_fullsized":"2023-03-30T08:12:18.080488+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:08:49.114790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.078822+0000","last_change":"2023-03-30T08:12:17.004331+0000","last_active":"2023-03-30T08:12:18.078822+0000","last_peered":"2023-03-30T08:12:18.078822+0000","last_clean":"2023-03-30T08:12:18.078822+0000","last_became_active":"2023-03-30T08:12:17.002556+0000","last_became_peered":"2023-03-30T08:12:17.002556+0000","last_unstale":"2023-03-30T08:12:18.078822+0000","last_undegraded":"2023-03-30T08:12:18.078822+0000","last_fullsized":"2023-03-30T08:12:18.078822+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:06:08.985116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079917+0000","last_change":"2023-03-30T08:12:16.993604+0000","last_active":"2023-03-30T08:12:18.079917+0000","last_peered":"2023-03-30T08:12:18.079917+0000","last_clean":"2023-03-30T08:12:18.079917+0000","last_became_active":"2023-03-30T08:12:16.992038+0000","last_became_peered":"2023-03-30T08:12:16.992038+0000","last_unstale":"2023-03-30T08:12:18.079917+0000","last_undegraded":"2023-03-30T08:12:18.079917+0000","last_fullsized":"2023-03-30T08:12:18.079917+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:56:06.563816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079857+0000","last_change":"2023-03-30T08:12:17.012820+0000","last_active":"2023-03-30T08:12:18.079857+0000","last_peered":"2023-03-30T08:12:18.079857+0000","last_clean":"2023-03-30T08:12:18.079857+0000","last_became_active":"2023-03-30T08:12:17.011323+0000","last_became_peered":"2023-03-30T08:12:17.011323+0000","last_unstale":"2023-03-30T08:12:18.079857+0000","last_undegraded":"2023-03-30T08:12:18.079857+0000","last_fullsized":"2023-03-30T08:12:18.079857+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:22:36.863160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079024+0000","last_change":"2023-03-30T08:12:16.994557+0000","last_active":"2023-03-30T08:12:18.079024+0000","last_peered":"2023-03-30T08:12:18.079024+0000","last_clean":"2023-03-30T08:12:18.079024+0000","last_became_active":"2023-03-30T08:12:16.994317+0000","last_became_peered":"2023-03-30T08:12:16.994317+0000","last_unstale":"2023-03-30T08:12:18.079024+0000","last_undegraded":"2023-03-30T08:12:18.079024+0000","last_fullsized":"2023-03-30T08:12:18.079024+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:05:26.244498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079854+0000","last_change":"2023-03-30T08:12:17.006565+0000","last_active":"2023-03-30T08:12:18.079854+0000","last_peered":"2023-03-30T08:12:18.079854+0000","last_clean":"2023-03-30T08:12:18.079854+0000","last_became_active":"2023-03-30T08:12:17.005919+0000","last_became_peered":"2023-03-30T08:12:17.005919+0000","last_unstale":"2023-03-30T08:12:18.079854+0000","last_undegraded":"2023-03-30T08:12:18.079854+0000","last_fullsized":"2023-03-30T08:12:18.079854+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:26.536973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080327+0000","last_change":"2023-03-30T08:12:17.008181+0000","last_active":"2023-03-30T08:12:18.080327+0000","last_peered":"2023-03-30T08:12:18.080327+0000","last_clean":"2023-03-30T08:12:18.080327+0000","last_became_active":"2023-03-30T08:12:17.007629+0000","last_became_peered":"2023-03-30T08:12:17.007629+0000","last_unstale":"2023-03-30T08:12:18.080327+0000","last_undegraded":"2023-03-30T08:12:18.080327+0000","last_fullsized":"2023-03-30T08:12:18.080327+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:04:18.516254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079049+0000","last_change":"2023-03-30T08:12:16.996076+0000","last_active":"2023-03-30T08:12:18.079049+0000","last_peered":"2023-03-30T08:12:18.079049+0000","last_clean":"2023-03-30T08:12:18.079049+0000","last_became_active":"2023-03-30T08:12:16.991971+0000","last_became_peered":"2023-03-30T08:12:16.991971+0000","last_unstale":"2023-03-30T08:12:18.079049+0000","last_undegraded":"2023-03-30T08:12:18.079049+0000","last_fullsized":"2023-03-30T08:12:18.079049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:26:05.797669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977097+0000","last_change":"2023-03-30T08:12:17.011668+0000","last_active":"2023-03-30T08:12:17.977097+0000","last_peered":"2023-03-30T08:12:17.977097+0000","last_clean":"2023-03-30T08:12:17.977097+0000","last_became_active":"2023-03-30T08:12:17.011413+0000","last_became_peered":"2023-03-30T08:12:17.011413+0000","last_unstale":"2023-03-30T08:12:17.977097+0000","last_undegraded":"2023-03-30T08:12:17.977097+0000","last_fullsized":"2023-03-30T08:12:17.977097+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:05:26.244498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978541+0000","last_change":"2023-03-30T08:12:17.002386+0000","last_active":"2023-03-30T08:12:17.978541+0000","last_peered":"2023-03-30T08:12:17.978541+0000","last_clean":"2023-03-30T08:12:17.978541+0000","last_became_active":"2023-03-30T08:12:17.002061+0000","last_became_peered":"2023-03-30T08:12:17.002061+0000","last_unstale":"2023-03-30T08:12:17.978541+0000","last_undegraded":"2023-03-30T08:12:17.978541+0000","last_fullsized":"2023-03-30T08:12:17.978541+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:29:21.647500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978448+0000","last_change":"2023-03-30T08:12:17.010986+0000","last_active":"2023-03-30T08:12:17.978448+0000","last_peered":"2023-03-30T08:12:17.978448+0000","last_clean":"2023-03-30T08:12:17.978448+0000","last_became_active":"2023-03-30T08:12:17.010635+0000","last_became_peered":"2023-03-30T08:12:17.010635+0000","last_unstale":"2023-03-30T08:12:17.978448+0000","last_undegraded":"2023-03-30T08:12:17.978448+0000","last_fullsized":"2023-03-30T08:12:17.978448+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:28:20.680539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080755+0000","last_change":"2023-03-30T08:12:16.996418+0000","last_active":"2023-03-30T08:12:18.080755+0000","last_peered":"2023-03-30T08:12:18.080755+0000","last_clean":"2023-03-30T08:12:18.080755+0000","last_became_active":"2023-03-30T08:12:16.996143+0000","last_became_peered":"2023-03-30T08:12:16.996143+0000","last_unstale":"2023-03-30T08:12:18.080755+0000","last_undegraded":"2023-03-30T08:12:18.080755+0000","last_fullsized":"2023-03-30T08:12:18.080755+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:05:17.436393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977326+0000","last_change":"2023-03-30T08:12:17.014238+0000","last_active":"2023-03-30T08:12:17.977326+0000","last_peered":"2023-03-30T08:12:17.977326+0000","last_clean":"2023-03-30T08:12:17.977326+0000","last_became_active":"2023-03-30T08:12:17.013954+0000","last_became_peered":"2023-03-30T08:12:17.013954+0000","last_unstale":"2023-03-30T08:12:17.977326+0000","last_undegraded":"2023-03-30T08:12:17.977326+0000","last_fullsized":"2023-03-30T08:12:17.977326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:06:08.985116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079157+0000","last_change":"2023-03-30T08:12:17.011959+0000","last_active":"2023-03-30T08:12:18.079157+0000","last_peered":"2023-03-30T08:12:18.079157+0000","last_clean":"2023-03-30T08:12:18.079157+0000","last_became_active":"2023-03-30T08:12:17.011721+0000","last_became_peered":"2023-03-30T08:12:17.011721+0000","last_unstale":"2023-03-30T08:12:18.079157+0000","last_undegraded":"2023-03-30T08:12:18.079157+0000","last_fullsized":"2023-03-30T08:12:18.079157+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:07:57.345732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080530+0000","last_change":"2023-03-30T08:12:17.006434+0000","last_active":"2023-03-30T08:12:18.080530+0000","last_peered":"2023-03-30T08:12:18.080530+0000","last_clean":"2023-03-30T08:12:18.080530+0000","last_became_active":"2023-03-30T08:12:17.006131+0000","last_became_peered":"2023-03-30T08:12:17.006131+0000","last_unstale":"2023-03-30T08:12:18.080530+0000","last_undegraded":"2023-03-30T08:12:18.080530+0000","last_fullsized":"2023-03-30T08:12:18.080530+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:52:40.390325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978731+0000","last_change":"2023-03-30T08:12:17.001686+0000","last_active":"2023-03-30T08:12:17.978731+0000","last_peered":"2023-03-30T08:12:17.978731+0000","last_clean":"2023-03-30T08:12:17.978731+0000","last_became_active":"2023-03-30T08:12:17.001473+0000","last_became_peered":"2023-03-30T08:12:17.001473+0000","last_unstale":"2023-03-30T08:12:17.978731+0000","last_undegraded":"2023-03-30T08:12:17.978731+0000","last_fullsized":"2023-03-30T08:12:17.978731+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:08:24.903894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079935+0000","last_change":"2023-03-30T08:12:17.006386+0000","last_active":"2023-03-30T08:12:18.079935+0000","last_peered":"2023-03-30T08:12:18.079935+0000","last_clean":"2023-03-30T08:12:18.079935+0000","last_became_active":"2023-03-30T08:12:17.005560+0000","last_became_peered":"2023-03-30T08:12:17.005560+0000","last_unstale":"2023-03-30T08:12:18.079935+0000","last_undegraded":"2023-03-30T08:12:18.079935+0000","last_fullsized":"2023-03-30T08:12:18.079935+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:37:48.102205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978099+0000","last_change":"2023-03-30T08:12:17.003532+0000","last_active":"2023-03-30T08:12:17.978099+0000","last_peered":"2023-03-30T08:12:17.978099+0000","last_clean":"2023-03-30T08:12:17.978099+0000","last_became_active":"2023-03-30T08:12:17.003289+0000","last_became_peered":"2023-03-30T08:12:17.003289+0000","last_unstale":"2023-03-30T08:12:17.978099+0000","last_undegraded":"2023-03-30T08:12:17.978099+0000","last_fullsized":"2023-03-30T08:12:17.978099+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:59:28.247995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977239+0000","last_change":"2023-03-30T08:12:17.011340+0000","last_active":"2023-03-30T08:12:17.977239+0000","last_peered":"2023-03-30T08:12:17.977239+0000","last_clean":"2023-03-30T08:12:17.977239+0000","last_became_active":"2023-03-30T08:12:17.011050+0000","last_became_peered":"2023-03-30T08:12:17.011050+0000","last_unstale":"2023-03-30T08:12:17.977239+0000","last_undegraded":"2023-03-30T08:12:17.977239+0000","last_fullsized":"2023-03-30T08:12:17.977239+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:22:36.863160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080661+0000","last_change":"2023-03-30T08:12:16.985572+0000","last_active":"2023-03-30T08:12:18.080661+0000","last_peered":"2023-03-30T08:12:18.080661+0000","last_clean":"2023-03-30T08:12:18.080661+0000","last_became_active":"2023-03-30T08:12:16.985297+0000","last_became_peered":"2023-03-30T08:12:16.985297+0000","last_unstale":"2023-03-30T08:12:18.080661+0000","last_undegraded":"2023-03-30T08:12:18.080661+0000","last_fullsized":"2023-03-30T08:12:18.080661+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:06.573154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976674+0000","last_change":"2023-03-30T08:12:17.008837+0000","last_active":"2023-03-30T08:12:17.976674+0000","last_peered":"2023-03-30T08:12:17.976674+0000","last_clean":"2023-03-30T08:12:17.976674+0000","last_became_active":"2023-03-30T08:12:17.008571+0000","last_became_peered":"2023-03-30T08:12:17.008571+0000","last_unstale":"2023-03-30T08:12:17.976674+0000","last_undegraded":"2023-03-30T08:12:17.976674+0000","last_fullsized":"2023-03-30T08:12:17.976674+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:04:47.799662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978049+0000","last_change":"2023-03-30T08:12:16.548334+0000","last_active":"2023-03-30T08:12:17.978049+0000","last_peered":"2023-03-30T08:12:17.978049+0000","last_clean":"2023-03-30T08:12:17.978049+0000","last_became_active":"2023-03-30T08:12:16.548070+0000","last_became_peered":"2023-03-30T08:12:16.548070+0000","last_unstale":"2023-03-30T08:12:17.978049+0000","last_undegraded":"2023-03-30T08:12:17.978049+0000","last_fullsized":"2023-03-30T08:12:17.978049+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:06.227499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978631+0000","last_change":"2023-03-30T08:12:16.557857+0000","last_active":"2023-03-30T08:12:17.978631+0000","last_peered":"2023-03-30T08:12:17.978631+0000","last_clean":"2023-03-30T08:12:17.978631+0000","last_became_active":"2023-03-30T08:12:16.557576+0000","last_became_peered":"2023-03-30T08:12:16.557576+0000","last_unstale":"2023-03-30T08:12:17.978631+0000","last_undegraded":"2023-03-30T08:12:17.978631+0000","last_fullsized":"2023-03-30T08:12:17.978631+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:01:17.755013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080005+0000","last_change":"2023-03-30T08:12:17.008489+0000","last_active":"2023-03-30T08:12:18.080005+0000","last_peered":"2023-03-30T08:12:18.080005+0000","last_clean":"2023-03-30T08:12:18.080005+0000","last_became_active":"2023-03-30T08:12:17.008176+0000","last_became_peered":"2023-03-30T08:12:17.008176+0000","last_unstale":"2023-03-30T08:12:18.080005+0000","last_undegraded":"2023-03-30T08:12:18.080005+0000","last_fullsized":"2023-03-30T08:12:18.080005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:26:05.797669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976815+0000","last_change":"2023-03-30T08:12:16.546886+0000","last_active":"2023-03-30T08:12:17.976815+0000","last_peered":"2023-03-30T08:12:17.976815+0000","last_clean":"2023-03-30T08:12:17.976815+0000","last_became_active":"2023-03-30T08:12:16.546636+0000","last_became_peered":"2023-03-30T08:12:16.546636+0000","last_unstale":"2023-03-30T08:12:17.976815+0000","last_undegraded":"2023-03-30T08:12:17.976815+0000","last_fullsized":"2023-03-30T08:12:17.976815+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:45.801853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976838+0000","last_change":"2023-03-30T08:12:17.017294+0000","last_active":"2023-03-30T08:12:17.976838+0000","last_peered":"2023-03-30T08:12:17.976838+0000","last_clean":"2023-03-30T08:12:17.976838+0000","last_became_active":"2023-03-30T08:12:17.017029+0000","last_became_peered":"2023-03-30T08:12:17.017029+0000","last_unstale":"2023-03-30T08:12:17.976838+0000","last_undegraded":"2023-03-30T08:12:17.976838+0000","last_fullsized":"2023-03-30T08:12:17.976838+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:34:17.666643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080822+0000","last_change":"2023-03-30T08:12:16.556777+0000","last_active":"2023-03-30T08:12:18.080822+0000","last_peered":"2023-03-30T08:12:18.080822+0000","last_clean":"2023-03-30T08:12:18.080822+0000","last_became_active":"2023-03-30T08:12:16.556496+0000","last_became_peered":"2023-03-30T08:12:16.556496+0000","last_unstale":"2023-03-30T08:12:18.080822+0000","last_undegraded":"2023-03-30T08:12:18.080822+0000","last_fullsized":"2023-03-30T08:12:18.080822+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:53:00.750269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978100+0000","last_change":"2023-03-30T08:12:17.009878+0000","last_active":"2023-03-30T08:12:17.978100+0000","last_peered":"2023-03-30T08:12:17.978100+0000","last_clean":"2023-03-30T08:12:17.978100+0000","last_became_active":"2023-03-30T08:12:17.009270+0000","last_became_peered":"2023-03-30T08:12:17.009270+0000","last_unstale":"2023-03-30T08:12:17.978100+0000","last_undegraded":"2023-03-30T08:12:17.978100+0000","last_fullsized":"2023-03-30T08:12:17.978100+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:26:44.730508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977623+0000","last_change":"2023-03-30T08:12:16.552161+0000","last_active":"2023-03-30T08:12:17.977623+0000","last_peered":"2023-03-30T08:12:17.977623+0000","last_clean":"2023-03-30T08:12:17.977623+0000","last_became_active":"2023-03-30T08:12:16.551583+0000","last_became_peered":"2023-03-30T08:12:16.551583+0000","last_unstale":"2023-03-30T08:12:17.977623+0000","last_undegraded":"2023-03-30T08:12:17.977623+0000","last_fullsized":"2023-03-30T08:12:17.977623+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:30.770018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079799+0000","last_change":"2023-03-30T08:12:16.997050+0000","last_active":"2023-03-30T08:12:18.079799+0000","last_peered":"2023-03-30T08:12:18.079799+0000","last_clean":"2023-03-30T08:12:18.079799+0000","last_became_active":"2023-03-30T08:12:16.996757+0000","last_became_peered":"2023-03-30T08:12:16.996757+0000","last_unstale":"2023-03-30T08:12:18.079799+0000","last_undegraded":"2023-03-30T08:12:18.079799+0000","last_fullsized":"2023-03-30T08:12:18.079799+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:52.330866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978347+0000","last_change":"2023-03-30T08:12:16.556002+0000","last_active":"2023-03-30T08:12:17.978347+0000","last_peered":"2023-03-30T08:12:17.978347+0000","last_clean":"2023-03-30T08:12:17.978347+0000","last_became_active":"2023-03-30T08:12:16.555592+0000","last_became_peered":"2023-03-30T08:12:16.555592+0000","last_unstale":"2023-03-30T08:12:17.978347+0000","last_undegraded":"2023-03-30T08:12:17.978347+0000","last_fullsized":"2023-03-30T08:12:17.978347+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:13:46.653017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.078975+0000","last_change":"2023-03-30T08:12:17.003057+0000","last_active":"2023-03-30T08:12:18.078975+0000","last_peered":"2023-03-30T08:12:18.078975+0000","last_clean":"2023-03-30T08:12:18.078975+0000","last_became_active":"2023-03-30T08:12:17.002219+0000","last_became_peered":"2023-03-30T08:12:17.002219+0000","last_unstale":"2023-03-30T08:12:18.078975+0000","last_undegraded":"2023-03-30T08:12:18.078975+0000","last_fullsized":"2023-03-30T08:12:18.078975+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:49.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079250+0000","last_change":"2023-03-30T08:12:16.558995+0000","last_active":"2023-03-30T08:12:18.079250+0000","last_peered":"2023-03-30T08:12:18.079250+0000","last_clean":"2023-03-30T08:12:18.079250+0000","last_became_active":"2023-03-30T08:12:16.558550+0000","last_became_peered":"2023-03-30T08:12:16.558550+0000","last_unstale":"2023-03-30T08:12:18.079250+0000","last_undegraded":"2023-03-30T08:12:18.079250+0000","last_fullsized":"2023-03-30T08:12:18.079250+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:04:46.786826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079110+0000","last_change":"2023-03-30T08:12:16.555850+0000","last_active":"2023-03-30T08:12:18.079110+0000","last_peered":"2023-03-30T08:12:18.079110+0000","last_clean":"2023-03-30T08:12:18.079110+0000","last_became_active":"2023-03-30T08:12:16.553720+0000","last_became_peered":"2023-03-30T08:12:16.553720+0000","last_unstale":"2023-03-30T08:12:18.079110+0000","last_undegraded":"2023-03-30T08:12:18.079110+0000","last_fullsized":"2023-03-30T08:12:18.079110+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:04:17.503418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978586+0000","last_change":"2023-03-30T08:12:17.010413+0000","last_active":"2023-03-30T08:12:17.978586+0000","last_peered":"2023-03-30T08:12:17.978586+0000","last_clean":"2023-03-30T08:12:17.978586+0000","last_became_active":"2023-03-30T08:12:17.000709+0000","last_became_peered":"2023-03-30T08:12:17.000709+0000","last_unstale":"2023-03-30T08:12:17.978586+0000","last_undegraded":"2023-03-30T08:12:17.978586+0000","last_fullsized":"2023-03-30T08:12:17.978586+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:32:34.013372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978718+0000","last_change":"2023-03-30T08:12:16.550080+0000","last_active":"2023-03-30T08:12:17.978718+0000","last_peered":"2023-03-30T08:12:17.978718+0000","last_clean":"2023-03-30T08:12:17.978718+0000","last_became_active":"2023-03-30T08:12:16.549799+0000","last_became_peered":"2023-03-30T08:12:16.549799+0000","last_unstale":"2023-03-30T08:12:17.978718+0000","last_undegraded":"2023-03-30T08:12:17.978718+0000","last_fullsized":"2023-03-30T08:12:17.978718+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:14:32.503958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.081229+0000","last_change":"2023-03-30T08:12:17.003517+0000","last_active":"2023-03-30T08:12:18.081229+0000","last_peered":"2023-03-30T08:12:18.081229+0000","last_clean":"2023-03-30T08:12:18.081229+0000","last_became_active":"2023-03-30T08:12:17.002700+0000","last_became_peered":"2023-03-30T08:12:17.002700+0000","last_unstale":"2023-03-30T08:12:18.081229+0000","last_undegraded":"2023-03-30T08:12:18.081229+0000","last_fullsized":"2023-03-30T08:12:18.081229+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:08.812485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080114+0000","last_change":"2023-03-30T08:12:16.556210+0000","last_active":"2023-03-30T08:12:18.080114+0000","last_peered":"2023-03-30T08:12:18.080114+0000","last_clean":"2023-03-30T08:12:18.080114+0000","last_became_active":"2023-03-30T08:12:16.555938+0000","last_became_peered":"2023-03-30T08:12:16.555938+0000","last_unstale":"2023-03-30T08:12:18.080114+0000","last_undegraded":"2023-03-30T08:12:18.080114+0000","last_fullsized":"2023-03-30T08:12:18.080114+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:52:39.377489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977444+0000","last_change":"2023-03-30T08:12:17.006945+0000","last_active":"2023-03-30T08:12:17.977444+0000","last_peered":"2023-03-30T08:12:17.977444+0000","last_clean":"2023-03-30T08:12:17.977444+0000","last_became_active":"2023-03-30T08:12:17.006684+0000","last_became_peered":"2023-03-30T08:12:17.006684+0000","last_unstale":"2023-03-30T08:12:17.977444+0000","last_undegraded":"2023-03-30T08:12:17.977444+0000","last_fullsized":"2023-03-30T08:12:17.977444+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:44:10.477398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080887+0000","last_change":"2023-03-30T08:12:16.558102+0000","last_active":"2023-03-30T08:12:18.080887+0000","last_peered":"2023-03-30T08:12:18.080887+0000","last_clean":"2023-03-30T08:12:18.080887+0000","last_became_active":"2023-03-30T08:12:16.557590+0000","last_became_peered":"2023-03-30T08:12:16.557590+0000","last_unstale":"2023-03-30T08:12:18.080887+0000","last_undegraded":"2023-03-30T08:12:18.080887+0000","last_fullsized":"2023-03-30T08:12:18.080887+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:05.560318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080655+0000","last_change":"2023-03-30T08:12:16.984979+0000","last_active":"2023-03-30T08:12:18.080655+0000","last_peered":"2023-03-30T08:12:18.080655+0000","last_clean":"2023-03-30T08:12:18.080655+0000","last_became_active":"2023-03-30T08:12:16.984692+0000","last_became_peered":"2023-03-30T08:12:16.984692+0000","last_unstale":"2023-03-30T08:12:18.080655+0000","last_undegraded":"2023-03-30T08:12:18.080655+0000","last_fullsized":"2023-03-30T08:12:18.080655+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:00:53.087275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080887+0000","last_change":"2023-03-30T08:12:16.555005+0000","last_active":"2023-03-30T08:12:18.080887+0000","last_peered":"2023-03-30T08:12:18.080887+0000","last_clean":"2023-03-30T08:12:18.080887+0000","last_became_active":"2023-03-30T08:12:16.554754+0000","last_became_peered":"2023-03-30T08:12:16.554754+0000","last_unstale":"2023-03-30T08:12:18.080887+0000","last_undegraded":"2023-03-30T08:12:18.080887+0000","last_fullsized":"2023-03-30T08:12:18.080887+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:49:46.311228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977777+0000","last_change":"2023-03-30T08:12:16.552318+0000","last_active":"2023-03-30T08:12:17.977777+0000","last_peered":"2023-03-30T08:12:17.977777+0000","last_clean":"2023-03-30T08:12:17.977777+0000","last_became_active":"2023-03-30T08:12:16.551939+0000","last_became_peered":"2023-03-30T08:12:16.551939+0000","last_unstale":"2023-03-30T08:12:17.977777+0000","last_undegraded":"2023-03-30T08:12:17.977777+0000","last_fullsized":"2023-03-30T08:12:17.977777+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:07.799649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079989+0000","last_change":"2023-03-30T08:12:17.004827+0000","last_active":"2023-03-30T08:12:18.079989+0000","last_peered":"2023-03-30T08:12:18.079989+0000","last_clean":"2023-03-30T08:12:18.079989+0000","last_became_active":"2023-03-30T08:12:17.004521+0000","last_became_peered":"2023-03-30T08:12:17.004521+0000","last_unstale":"2023-03-30T08:12:18.079989+0000","last_undegraded":"2023-03-30T08:12:18.079989+0000","last_fullsized":"2023-03-30T08:12:18.079989+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:58:27.165546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080737+0000","last_change":"2023-03-30T08:12:16.551609+0000","last_active":"2023-03-30T08:12:18.080737+0000","last_peered":"2023-03-30T08:12:18.080737+0000","last_clean":"2023-03-30T08:12:18.080737+0000","last_became_active":"2023-03-30T08:12:16.551216+0000","last_became_peered":"2023-03-30T08:12:16.551216+0000","last_unstale":"2023-03-30T08:12:18.080737+0000","last_undegraded":"2023-03-30T08:12:18.080737+0000","last_fullsized":"2023-03-30T08:12:18.080737+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:45.801853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976910+0000","last_change":"2023-03-30T08:12:17.000583+0000","last_active":"2023-03-30T08:12:17.976910+0000","last_peered":"2023-03-30T08:12:17.976910+0000","last_clean":"2023-03-30T08:12:17.976910+0000","last_became_active":"2023-03-30T08:12:17.000340+0000","last_became_peered":"2023-03-30T08:12:17.000340+0000","last_unstale":"2023-03-30T08:12:17.976910+0000","last_undegraded":"2023-03-30T08:12:17.976910+0000","last_fullsized":"2023-03-30T08:12:17.976910+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:52.330866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977347+0000","last_change":"2023-03-30T08:12:16.547541+0000","last_active":"2023-03-30T08:12:17.977347+0000","last_peered":"2023-03-30T08:12:17.977347+0000","last_clean":"2023-03-30T08:12:17.977347+0000","last_became_active":"2023-03-30T08:12:16.547256+0000","last_became_peered":"2023-03-30T08:12:16.547256+0000","last_unstale":"2023-03-30T08:12:17.977347+0000","last_undegraded":"2023-03-30T08:12:17.977347+0000","last_fullsized":"2023-03-30T08:12:17.977347+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:04:46.786826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080672+0000","last_change":"2023-03-30T08:12:17.004589+0000","last_active":"2023-03-30T08:12:18.080672+0000","last_peered":"2023-03-30T08:12:18.080672+0000","last_clean":"2023-03-30T08:12:18.080672+0000","last_became_active":"2023-03-30T08:12:17.004326+0000","last_became_peered":"2023-03-30T08:12:17.004326+0000","last_unstale":"2023-03-30T08:12:18.080672+0000","last_undegraded":"2023-03-30T08:12:18.080672+0000","last_fullsized":"2023-03-30T08:12:18.080672+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:59:29.583333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079207+0000","last_change":"2023-03-30T08:12:16.551553+0000","last_active":"2023-03-30T08:12:18.079207+0000","last_peered":"2023-03-30T08:12:18.079207+0000","last_clean":"2023-03-30T08:12:18.079207+0000","last_became_active":"2023-03-30T08:12:16.550991+0000","last_became_peered":"2023-03-30T08:12:16.550991+0000","last_unstale":"2023-03-30T08:12:18.079207+0000","last_undegraded":"2023-03-30T08:12:18.079207+0000","last_fullsized":"2023-03-30T08:12:18.079207+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:45.801853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080538+0000","last_change":"2023-03-30T08:12:16.995421+0000","last_active":"2023-03-30T08:12:18.080538+0000","last_peered":"2023-03-30T08:12:18.080538+0000","last_clean":"2023-03-30T08:12:18.080538+0000","last_became_active":"2023-03-30T08:12:16.995140+0000","last_became_peered":"2023-03-30T08:12:16.995140+0000","last_unstale":"2023-03-30T08:12:18.080538+0000","last_undegraded":"2023-03-30T08:12:18.080538+0000","last_fullsized":"2023-03-30T08:12:18.080538+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:53:01.763105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080615+0000","last_change":"2023-03-30T08:12:16.560134+0000","last_active":"2023-03-30T08:12:18.080615+0000","last_peered":"2023-03-30T08:12:18.080615+0000","last_clean":"2023-03-30T08:12:18.080615+0000","last_became_active":"2023-03-30T08:12:16.559817+0000","last_became_peered":"2023-03-30T08:12:16.559817+0000","last_unstale":"2023-03-30T08:12:18.080615+0000","last_undegraded":"2023-03-30T08:12:18.080615+0000","last_fullsized":"2023-03-30T08:12:18.080615+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:24:46.330274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080109+0000","last_change":"2023-03-30T08:12:17.007078+0000","last_active":"2023-03-30T08:12:18.080109+0000","last_peered":"2023-03-30T08:12:18.080109+0000","last_clean":"2023-03-30T08:12:18.080109+0000","last_became_active":"2023-03-30T08:12:17.006834+0000","last_became_peered":"2023-03-30T08:12:17.006834+0000","last_unstale":"2023-03-30T08:12:18.080109+0000","last_undegraded":"2023-03-30T08:12:18.080109+0000","last_fullsized":"2023-03-30T08:12:18.080109+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T20:04:39.661536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978769+0000","last_change":"2023-03-30T08:12:16.554723+0000","last_active":"2023-03-30T08:12:17.978769+0000","last_peered":"2023-03-30T08:12:17.978769+0000","last_clean":"2023-03-30T08:12:17.978769+0000","last_became_active":"2023-03-30T08:12:16.554298+0000","last_became_peered":"2023-03-30T08:12:16.554298+0000","last_unstale":"2023-03-30T08:12:17.978769+0000","last_undegraded":"2023-03-30T08:12:17.978769+0000","last_fullsized":"2023-03-30T08:12:17.978769+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:22.712608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080211+0000","last_change":"2023-03-30T08:12:16.555215+0000","last_active":"2023-03-30T08:12:18.080211+0000","last_peered":"2023-03-30T08:12:18.080211+0000","last_clean":"2023-03-30T08:12:18.080211+0000","last_became_active":"2023-03-30T08:12:16.554899+0000","last_became_peered":"2023-03-30T08:12:16.554899+0000","last_unstale":"2023-03-30T08:12:18.080211+0000","last_undegraded":"2023-03-30T08:12:18.080211+0000","last_fullsized":"2023-03-30T08:12:18.080211+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:06.227499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977546+0000","last_change":"2023-03-30T08:12:16.548116+0000","last_active":"2023-03-30T08:12:17.977546+0000","last_peered":"2023-03-30T08:12:17.977546+0000","last_clean":"2023-03-30T08:12:17.977546+0000","last_became_active":"2023-03-30T08:12:16.547717+0000","last_became_peered":"2023-03-30T08:12:16.547717+0000","last_unstale":"2023-03-30T08:12:17.977546+0000","last_undegraded":"2023-03-30T08:12:17.977546+0000","last_fullsized":"2023-03-30T08:12:17.977546+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:23.831326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977373+0000","last_change":"2023-03-30T08:12:17.006005+0000","last_active":"2023-03-30T08:12:17.977373+0000","last_peered":"2023-03-30T08:12:17.977373+0000","last_clean":"2023-03-30T08:12:17.977373+0000","last_became_active":"2023-03-30T08:12:17.005629+0000","last_became_peered":"2023-03-30T08:12:17.005629+0000","last_unstale":"2023-03-30T08:12:17.977373+0000","last_undegraded":"2023-03-30T08:12:17.977373+0000","last_fullsized":"2023-03-30T08:12:17.977373+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T20:04:39.661536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977916+0000","last_change":"2023-03-30T08:12:16.552860+0000","last_active":"2023-03-30T08:12:17.977916+0000","last_peered":"2023-03-30T08:12:17.977916+0000","last_clean":"2023-03-30T08:12:17.977916+0000","last_became_active":"2023-03-30T08:12:16.552601+0000","last_became_peered":"2023-03-30T08:12:16.552601+0000","last_unstale":"2023-03-30T08:12:17.977916+0000","last_undegraded":"2023-03-30T08:12:17.977916+0000","last_fullsized":"2023-03-30T08:12:17.977916+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:34:16.653807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976467+0000","last_change":"2023-03-30T08:12:16.999806+0000","last_active":"2023-03-30T08:12:17.976467+0000","last_peered":"2023-03-30T08:12:17.976467+0000","last_clean":"2023-03-30T08:12:17.976467+0000","last_became_active":"2023-03-30T08:12:16.999536+0000","last_became_peered":"2023-03-30T08:12:16.999536+0000","last_unstale":"2023-03-30T08:12:17.976467+0000","last_undegraded":"2023-03-30T08:12:17.976467+0000","last_fullsized":"2023-03-30T08:12:17.976467+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:24.844161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079421+0000","last_change":"2023-03-30T08:12:16.553800+0000","last_active":"2023-03-30T08:12:18.079421+0000","last_peered":"2023-03-30T08:12:18.079421+0000","last_clean":"2023-03-30T08:12:18.079421+0000","last_became_active":"2023-03-30T08:12:16.553477+0000","last_became_peered":"2023-03-30T08:12:16.553477+0000","last_unstale":"2023-03-30T08:12:18.079421+0000","last_undegraded":"2023-03-30T08:12:18.079421+0000","last_fullsized":"2023-03-30T08:12:18.079421+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:23.831326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080580+0000","last_change":"2023-03-30T08:12:16.982961+0000","last_active":"2023-03-30T08:12:18.080580+0000","last_peered":"2023-03-30T08:12:18.080580+0000","last_clean":"2023-03-30T08:12:18.080580+0000","last_became_active":"2023-03-30T08:12:16.982681+0000","last_became_peered":"2023-03-30T08:12:16.982681+0000","last_unstale":"2023-03-30T08:12:18.080580+0000","last_undegraded":"2023-03-30T08:12:18.080580+0000","last_fullsized":"2023-03-30T08:12:18.080580+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:46.814689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079644+0000","last_change":"2023-03-30T08:12:16.552411+0000","last_active":"2023-03-30T08:12:18.079644+0000","last_peered":"2023-03-30T08:12:18.079644+0000","last_clean":"2023-03-30T08:12:18.079644+0000","last_became_active":"2023-03-30T08:12:16.551535+0000","last_became_peered":"2023-03-30T08:12:16.551535+0000","last_unstale":"2023-03-30T08:12:18.079644+0000","last_undegraded":"2023-03-30T08:12:18.079644+0000","last_fullsized":"2023-03-30T08:12:18.079644+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:05.560318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079475+0000","last_change":"2023-03-30T08:12:16.986695+0000","last_active":"2023-03-30T08:12:18.079475+0000","last_peered":"2023-03-30T08:12:18.079475+0000","last_clean":"2023-03-30T08:12:18.079475+0000","last_became_active":"2023-03-30T08:12:16.986439+0000","last_became_peered":"2023-03-30T08:12:16.986439+0000","last_unstale":"2023-03-30T08:12:18.079475+0000","last_undegraded":"2023-03-30T08:12:18.079475+0000","last_fullsized":"2023-03-30T08:12:18.079475+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:31.782854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080937+0000","last_change":"2023-03-30T08:12:16.552751+0000","last_active":"2023-03-30T08:12:18.080937+0000","last_peered":"2023-03-30T08:12:18.080937+0000","last_clean":"2023-03-30T08:12:18.080937+0000","last_became_active":"2023-03-30T08:12:16.552461+0000","last_became_peered":"2023-03-30T08:12:16.552461+0000","last_unstale":"2023-03-30T08:12:18.080937+0000","last_undegraded":"2023-03-30T08:12:18.080937+0000","last_fullsized":"2023-03-30T08:12:18.080937+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:53:32.695129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977601+0000","last_change":"2023-03-30T08:12:17.005810+0000","last_active":"2023-03-30T08:12:17.977601+0000","last_peered":"2023-03-30T08:12:17.977601+0000","last_clean":"2023-03-30T08:12:17.977601+0000","last_became_active":"2023-03-30T08:12:17.005266+0000","last_became_peered":"2023-03-30T08:12:17.005266+0000","last_unstale":"2023-03-30T08:12:17.977601+0000","last_undegraded":"2023-03-30T08:12:17.977601+0000","last_fullsized":"2023-03-30T08:12:17.977601+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:56:06.563816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.081399+0000","last_change":"2023-03-30T08:12:16.560203+0000","last_active":"2023-03-30T08:12:18.081399+0000","last_peered":"2023-03-30T08:12:18.081399+0000","last_clean":"2023-03-30T08:12:18.081399+0000","last_became_active":"2023-03-30T08:12:16.559904+0000","last_became_peered":"2023-03-30T08:12:16.559904+0000","last_unstale":"2023-03-30T08:12:18.081399+0000","last_undegraded":"2023-03-30T08:12:18.081399+0000","last_fullsized":"2023-03-30T08:12:18.081399+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:05:16.423557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-30T08:12:08.673664+0000","last_change":"2023-03-30T08:10:52.871133+0000","last_active":"2023-03-30T08:12:08.673664+0000","last_peered":"2023-03-30T08:12:08.673664+0000","last_clean":"2023-03-30T08:12:08.673664+0000","last_became_active":"2023-03-30T08:10:52.870678+0000","last_became_peered":"2023-03-30T08:10:52.870678+0000","last_unstale":"2023-03-30T08:12:08.673664+0000","last_undegraded":"2023-03-30T08:12:08.673664+0000","last_fullsized":"2023-03-30T08:12:08.673664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:51.162618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977475+0000","last_change":"2023-03-30T08:12:17.006743+0000","last_active":"2023-03-30T08:12:17.977475+0000","last_peered":"2023-03-30T08:12:17.977475+0000","last_clean":"2023-03-30T08:12:17.977475+0000","last_became_active":"2023-03-30T08:12:17.006424+0000","last_became_peered":"2023-03-30T08:12:17.006424+0000","last_unstale":"2023-03-30T08:12:17.977475+0000","last_undegraded":"2023-03-30T08:12:17.977475+0000","last_fullsized":"2023-03-30T08:12:17.977475+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:49.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978347+0000","last_change":"2023-03-30T08:12:16.559057+0000","last_active":"2023-03-30T08:12:17.978347+0000","last_peered":"2023-03-30T08:12:17.978347+0000","last_clean":"2023-03-30T08:12:17.978347+0000","last_became_active":"2023-03-30T08:12:16.558798+0000","last_became_peered":"2023-03-30T08:12:16.558798+0000","last_unstale":"2023-03-30T08:12:17.978347+0000","last_undegraded":"2023-03-30T08:12:17.978347+0000","last_fullsized":"2023-03-30T08:12:17.978347+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:04:47.794257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.973188+0000","last_change":"2023-03-30T08:10:52.871548+0000","last_active":"2023-03-30T08:12:16.973188+0000","last_peered":"2023-03-30T08:12:16.973188+0000","last_clean":"2023-03-30T08:12:16.973188+0000","last_became_active":"2023-03-30T08:10:52.871152+0000","last_became_peered":"2023-03-30T08:10:52.871152+0000","last_unstale":"2023-03-30T08:12:16.973188+0000","last_undegraded":"2023-03-30T08:12:16.973188+0000","last_fullsized":"2023-03-30T08:12:16.973188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079157+0000","last_change":"2023-03-30T08:12:16.994330+0000","last_active":"2023-03-30T08:12:18.079157+0000","last_peered":"2023-03-30T08:12:18.079157+0000","last_clean":"2023-03-30T08:12:18.079157+0000","last_became_active":"2023-03-30T08:12:16.994062+0000","last_became_peered":"2023-03-30T08:12:16.994062+0000","last_unstale":"2023-03-30T08:12:18.079157+0000","last_undegraded":"2023-03-30T08:12:18.079157+0000","last_fullsized":"2023-03-30T08:12:18.079157+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:04:29.223577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976601+0000","last_change":"2023-03-30T08:12:16.547995+0000","last_active":"2023-03-30T08:12:17.976601+0000","last_peered":"2023-03-30T08:12:17.976601+0000","last_clean":"2023-03-30T08:12:17.976601+0000","last_became_active":"2023-03-30T08:12:16.547723+0000","last_became_peered":"2023-03-30T08:12:16.547723+0000","last_unstale":"2023-03-30T08:12:17.976601+0000","last_undegraded":"2023-03-30T08:12:17.976601+0000","last_fullsized":"2023-03-30T08:12:17.976601+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:11:32.761870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.978187+0000","last_change":"2023-03-30T08:10:52.921525+0000","last_active":"2023-03-30T08:12:16.978187+0000","last_peered":"2023-03-30T08:12:16.978187+0000","last_clean":"2023-03-30T08:12:16.978187+0000","last_became_active":"2023-03-30T08:10:52.920885+0000","last_became_peered":"2023-03-30T08:10:52.920885+0000","last_unstale":"2023-03-30T08:12:16.978187+0000","last_undegraded":"2023-03-30T08:12:16.978187+0000","last_fullsized":"2023-03-30T08:12:16.978187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:38:27.041880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978096+0000","last_change":"2023-03-30T08:12:17.006956+0000","last_active":"2023-03-30T08:12:17.978096+0000","last_peered":"2023-03-30T08:12:17.978096+0000","last_clean":"2023-03-30T08:12:17.978096+0000","last_became_active":"2023-03-30T08:12:17.006648+0000","last_became_peered":"2023-03-30T08:12:17.006648+0000","last_unstale":"2023-03-30T08:12:17.978096+0000","last_undegraded":"2023-03-30T08:12:17.978096+0000","last_fullsized":"2023-03-30T08:12:17.978096+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:00:33.917851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079338+0000","last_change":"2023-03-30T08:12:16.549604+0000","last_active":"2023-03-30T08:12:18.079338+0000","last_peered":"2023-03-30T08:12:18.079338+0000","last_clean":"2023-03-30T08:12:18.079338+0000","last_became_active":"2023-03-30T08:12:16.549318+0000","last_became_peered":"2023-03-30T08:12:16.549318+0000","last_unstale":"2023-03-30T08:12:18.079338+0000","last_undegraded":"2023-03-30T08:12:18.079338+0000","last_fullsized":"2023-03-30T08:12:18.079338+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:05:16.423557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.972700+0000","last_change":"2023-03-30T08:10:52.921563+0000","last_active":"2023-03-30T08:12:16.972700+0000","last_peered":"2023-03-30T08:12:16.972700+0000","last_clean":"2023-03-30T08:12:16.972700+0000","last_became_active":"2023-03-30T08:10:52.921234+0000","last_became_peered":"2023-03-30T08:10:52.921234+0000","last_unstale":"2023-03-30T08:12:16.972700+0000","last_undegraded":"2023-03-30T08:12:16.972700+0000","last_fullsized":"2023-03-30T08:12:16.972700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.657150+0000","last_change":"2023-03-30T08:12:16.548759+0000","last_active":"2023-03-30T08:12:18.657150+0000","last_peered":"2023-03-30T08:12:18.657150+0000","last_clean":"2023-03-30T08:12:18.657150+0000","last_became_active":"2023-03-30T08:12:16.548522+0000","last_became_peered":"2023-03-30T08:12:16.548522+0000","last_unstale":"2023-03-30T08:12:18.657150+0000","last_undegraded":"2023-03-30T08:12:18.657150+0000","last_fullsized":"2023-03-30T08:12:18.657150+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:53.899438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.983880+0000","last_change":"2023-03-30T08:10:52.866272+0000","last_active":"2023-03-30T08:12:16.983880+0000","last_peered":"2023-03-30T08:12:16.983880+0000","last_clean":"2023-03-30T08:12:16.983880+0000","last_became_active":"2023-03-30T08:10:52.865919+0000","last_became_peered":"2023-03-30T08:10:52.865919+0000","last_unstale":"2023-03-30T08:12:16.983880+0000","last_undegraded":"2023-03-30T08:12:16.983880+0000","last_fullsized":"2023-03-30T08:12:16.983880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079319+0000","last_change":"2023-03-30T08:12:16.988070+0000","last_active":"2023-03-30T08:12:18.079319+0000","last_peered":"2023-03-30T08:12:18.079319+0000","last_clean":"2023-03-30T08:12:18.079319+0000","last_became_active":"2023-03-30T08:12:16.987820+0000","last_became_peered":"2023-03-30T08:12:16.987820+0000","last_unstale":"2023-03-30T08:12:18.079319+0000","last_undegraded":"2023-03-30T08:12:18.079319+0000","last_fullsized":"2023-03-30T08:12:18.079319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:44:10.477398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080967+0000","last_change":"2023-03-30T08:12:16.558215+0000","last_active":"2023-03-30T08:12:18.080967+0000","last_peered":"2023-03-30T08:12:18.080967+0000","last_clean":"2023-03-30T08:12:18.080967+0000","last_became_active":"2023-03-30T08:12:16.557938+0000","last_became_peered":"2023-03-30T08:12:16.557938+0000","last_unstale":"2023-03-30T08:12:18.080967+0000","last_undegraded":"2023-03-30T08:12:18.080967+0000","last_fullsized":"2023-03-30T08:12:18.080967+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:11:32.761870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.977269+0000","last_change":"2023-03-30T08:10:52.920796+0000","last_active":"2023-03-30T08:12:16.977269+0000","last_peered":"2023-03-30T08:12:16.977269+0000","last_clean":"2023-03-30T08:12:16.977269+0000","last_became_active":"2023-03-30T08:10:52.920327+0000","last_became_peered":"2023-03-30T08:10:52.920327+0000","last_unstale":"2023-03-30T08:12:16.977269+0000","last_undegraded":"2023-03-30T08:12:16.977269+0000","last_fullsized":"2023-03-30T08:12:16.977269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:17.416386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080801+0000","last_change":"2023-03-30T08:12:16.997115+0000","last_active":"2023-03-30T08:12:18.080801+0000","last_peered":"2023-03-30T08:12:18.080801+0000","last_clean":"2023-03-30T08:12:18.080801+0000","last_became_active":"2023-03-30T08:12:16.996842+0000","last_became_peered":"2023-03-30T08:12:16.996842+0000","last_unstale":"2023-03-30T08:12:18.080801+0000","last_undegraded":"2023-03-30T08:12:18.080801+0000","last_fullsized":"2023-03-30T08:12:18.080801+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:54.912274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976310+0000","last_change":"2023-03-30T08:12:16.548581+0000","last_active":"2023-03-30T08:12:17.976310+0000","last_peered":"2023-03-30T08:12:17.976310+0000","last_clean":"2023-03-30T08:12:17.976310+0000","last_became_active":"2023-03-30T08:12:16.548264+0000","last_became_peered":"2023-03-30T08:12:16.548264+0000","last_unstale":"2023-03-30T08:12:17.976310+0000","last_undegraded":"2023-03-30T08:12:17.976310+0000","last_fullsized":"2023-03-30T08:12:17.976310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:53:00.750269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.976809+0000","last_change":"2023-03-30T08:10:52.866412+0000","last_active":"2023-03-30T08:12:16.976809+0000","last_peered":"2023-03-30T08:12:16.976809+0000","last_clean":"2023-03-30T08:12:16.976809+0000","last_became_active":"2023-03-30T08:10:52.866055+0000","last_became_peered":"2023-03-30T08:10:52.866055+0000","last_unstale":"2023-03-30T08:12:16.976809+0000","last_undegraded":"2023-03-30T08:12:16.976809+0000","last_fullsized":"2023-03-30T08:12:16.976809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:39.045010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080009+0000","last_change":"2023-03-30T08:12:17.004094+0000","last_active":"2023-03-30T08:12:18.080009+0000","last_peered":"2023-03-30T08:12:18.080009+0000","last_clean":"2023-03-30T08:12:18.080009+0000","last_became_active":"2023-03-30T08:12:17.003834+0000","last_became_peered":"2023-03-30T08:12:17.003834+0000","last_unstale":"2023-03-30T08:12:18.080009+0000","last_undegraded":"2023-03-30T08:12:18.080009+0000","last_fullsized":"2023-03-30T08:12:18.080009+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:51:00.535247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.081006+0000","last_change":"2023-03-30T08:12:16.546137+0000","last_active":"2023-03-30T08:12:18.081006+0000","last_peered":"2023-03-30T08:12:18.081006+0000","last_clean":"2023-03-30T08:12:18.081006+0000","last_became_active":"2023-03-30T08:12:16.545844+0000","last_became_peered":"2023-03-30T08:12:16.545844+0000","last_unstale":"2023-03-30T08:12:18.081006+0000","last_undegraded":"2023-03-30T08:12:18.081006+0000","last_fullsized":"2023-03-30T08:12:18.081006+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:30.770018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.985121+0000","last_change":"2023-03-30T08:10:52.868170+0000","last_active":"2023-03-30T08:12:16.985121+0000","last_peered":"2023-03-30T08:12:16.985121+0000","last_clean":"2023-03-30T08:12:16.985121+0000","last_became_active":"2023-03-30T08:10:52.867790+0000","last_became_peered":"2023-03-30T08:10:52.867790+0000","last_unstale":"2023-03-30T08:12:16.985121+0000","last_undegraded":"2023-03-30T08:12:16.985121+0000","last_fullsized":"2023-03-30T08:12:16.985121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.977024+0000","last_change":"2023-03-30T08:10:45.713084+0000","last_active":"2023-03-30T08:12:16.977024+0000","last_peered":"2023-03-30T08:12:16.977024+0000","last_clean":"2023-03-30T08:12:16.977024+0000","last_became_active":"2023-03-30T08:10:45.711645+0000","last_became_peered":"2023-03-30T08:10:45.711645+0000","last_unstale":"2023-03-30T08:12:16.977024+0000","last_undegraded":"2023-03-30T08:12:16.977024+0000","last_fullsized":"2023-03-30T08:12:16.977024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_clean_scrub_stamp":"2023-03-30T08:10:44.620691+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:58:12.738262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2366,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8444,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363396,"statfs":{"total":96636764160,"available":96628117504,"internally_reserved":0,"allocated":446464,"data_stored":193866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.79500000000000004}]},{"osd":1,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":1.155}]},{"osd":2,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.3},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":0.93400000000000005}]},{"osd":3,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.0289999999999999}]},{"osd":4,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.181}]},{"osd":5,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.117},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.327}]},{"osd":7,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2789999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9844,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361996,"statfs":{"total":96636764160,"available":96626683904,"internally_reserved":0,"allocated":1093632,"data_stored":812175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.2170000000000001}]},{"osd":1,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.2709999999999999}]},{"osd":2,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.94099999999999995}]},{"osd":4,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.522}]},{"osd":5,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.3839999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":1.2,"5min":1.2,"15min":1.2},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.5860000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8688,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363152,"statfs":{"total":96636764160,"available":96627867648,"internally_reserved":0,"allocated":499712,"data_stored":221787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.012}]},{"osd":1,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.536},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.333}]},{"osd":2,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.302},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.1120000000000001}]},{"osd":3,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.4650000000000001}]},{"osd":4,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.133},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.2769999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.4950000000000001}]},{"osd":7,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":1.077,"5min":1.077,"15min":1.077},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.373},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.403}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8824,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363016,"statfs":{"total":96636764160,"available":96627728384,"internally_reserved":0,"allocated":507904,"data_stored":223281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.121}]},{"osd":1,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.627},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.2989999999999999}]},{"osd":2,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.573},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.98699999999999999}]},{"osd":3,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":1.667},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.3839999999999999}]},{"osd":5,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4119999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.345},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.8330000000000002,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.754}]},{"osd":6,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.6459999999999999,"5min":2.6459999999999999,"15min":2.6459999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":2.0129999999999999}]},{"osd":7,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":3.2599999999999998,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.413}]}]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8696,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363144,"statfs":{"total":96636764160,"available":96627859456,"internally_reserved":0,"allocated":507904,"data_stored":222359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.97199999999999998}]},{"osd":2,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0740000000000001}]},{"osd":4,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.127},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.355}]},{"osd":6,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.518},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":1.133,"5min":1.133,"15min":1.133},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.367}]},{"osd":7,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.454},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.3280000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8572,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363268,"statfs":{"total":96636764160,"available":96627986432,"internally_reserved":0,"allocated":512000,"data_stored":223303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.075},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.01}]},{"osd":1,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.3720000000000001}]},{"osd":3,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.5089999999999999}]},{"osd":4,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.655},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.411}]},{"osd":5,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.492,"5min":2.492,"15min":2.492},"last":1.5429999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":2.4390000000000001,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.3460000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8752,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363088,"statfs":{"total":96636764160,"available":96627802112,"internally_reserved":0,"allocated":499712,"data_stored":221787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.071}]},{"osd":2,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.137}]},{"osd":3,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.169}]},{"osd":4,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.9159999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.0389999999999999}]},{"osd":5,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.2549999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":3.6309999999999998,"5min":3.6309999999999998,"15min":3.6309999999999998},"last":1.109}]},{"osd":6,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.345},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.2330000000000001}]},{"osd":7,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.611},{"interface":"front","average":{"1min":1.45,"5min":1.45,"15min":1.45},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.2789999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9840,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362000,"statfs":{"total":96636764160,"available":96626688000,"internally_reserved":0,"allocated":1089536,"data_stored":810780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":1.2310000000000001}]},{"osd":2,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.081},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":1.1919999999999999}]},{"osd":4,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":1.417},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.494}]},{"osd":5,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.339},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.53}]},{"osd":6,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.5329999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.4390000000000001}]},{"osd":7,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.5980000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-30T08:12:21.258 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-30T08:12:21.453 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.451+0000 7f74d2a12700 1 Processor -- start 2023-03-30T08:12:21.454 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.451+0000 7f74d2a12700 1 -- start start 2023-03-30T08:12:21.455 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d2a12700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f74cc163dc0 0x7f74cc0c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d2a12700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74cc164190 0x7f74cc0c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d2a12700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74cc06b3a0 con 0x7f74cc0aea30 2023-03-30T08:12:21.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d2a12700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74cc06d810 con 0x7f74cc163dc0 2023-03-30T08:12:21.456 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d2a12700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc0cc1d0 con 0x7f74cc164190 2023-03-30T08:12:21.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d2211700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f74cc0aea30 0x7f74cc164600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59268/0 (socket says 172.21.15.87:59268) 2023-03-30T08:12:21.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d2211700 1 -- 172.21.15.87:0/660763826 learned_addr learned my addr 172.21.15.87:0/660763826 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:21.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d1a10700 1 --2- 172.21.15.87:0/660763826 >> v2:172.21.15.115:3300/0 conn(0x7f74cc163dc0 0x7f74cc0c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.457 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d120f700 1 --2- 172.21.15.87:0/660763826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74cc164190 0x7f74cc0c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d0a0e700 1 -- 172.21.15.87:0/660763826 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589357748 0 0) 0x7f74c4001490 con 0x7f74cc0aea30 2023-03-30T08:12:21.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d0a0e700 1 -- 172.21.15.87:0/660763826 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74b80035d0 con 0x7f74cc0aea30 2023-03-30T08:12:21.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d1a10700 1 -- 172.21.15.87:0/660763826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74cc164190 msgr2=0x7f74cc0c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:21.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d1a10700 1 --2- 172.21.15.87:0/660763826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74cc164190 0x7f74cc0c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d1a10700 1 -- 172.21.15.87:0/660763826 >> v1:172.21.15.87:6789/0 conn(0x7f74cc0aea30 legacy=0x7f74cc164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.458 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d1a10700 1 -- 172.21.15.87:0/660763826 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc069f00 con 0x7f74cc163dc0 2023-03-30T08:12:21.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d1a10700 1 --2- 172.21.15.87:0/660763826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74cc163dc0 0x7f74cc0c95c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009850 tx=0x7f74c8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c4ea0a90af2a331 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:21.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d0a0e700 1 -- 172.21.15.87:0/660763826 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8011830 con 0x7f74cc163dc0 2023-03-30T08:12:21.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d0a0e700 1 -- 172.21.15.87:0/660763826 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c8011990 con 0x7f74cc163dc0 2023-03-30T08:12:21.459 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.455+0000 7f74d0a0e700 1 -- 172.21.15.87:0/660763826 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8011d40 con 0x7f74cc163dc0 2023-03-30T08:12:21.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.459+0000 7f74d2a12700 1 -- 172.21.15.87:0/660763826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74cc163dc0 msgr2=0x7f74cc0c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.459+0000 7f74d2a12700 1 --2- 172.21.15.87:0/660763826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74cc163dc0 0x7f74cc0c95c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009850 tx=0x7f74c8009b60 comp rx=0 tx=0).stop 2023-03-30T08:12:21.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.459+0000 7f74d2a12700 1 -- 172.21.15.87:0/660763826 shutdown_connections 2023-03-30T08:12:21.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.459+0000 7f74d2a12700 1 --2- 172.21.15.87:0/660763826 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74cc164190 0x7f74cc0c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.459+0000 7f74d2a12700 1 --2- 172.21.15.87:0/660763826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74cc163dc0 0x7f74cc0c95c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.460 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.459+0000 7f74d2a12700 1 -- 172.21.15.87:0/660763826 >> 172.21.15.87:0/660763826 conn(0x7f74cc0cf410 msgr2=0x7f74cc0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:21.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.459+0000 7f74d2a12700 1 -- 172.21.15.87:0/660763826 shutdown_connections 2023-03-30T08:12:21.461 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.459+0000 7f74d2a12700 1 -- 172.21.15.87:0/660763826 wait complete. 2023-03-30T08:12:21.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.459+0000 7f74d2a12700 1 Processor -- start 2023-03-30T08:12:21.462 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.459+0000 7f74d2a12700 1 -- start start 2023-03-30T08:12:21.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d2a12700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74cc0aea30 0x7f74cc0cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d2a12700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74cc163dc0 0x7f74cc0cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.463 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d2a12700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74cc164190 0x7f74cc1f95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d2a12700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc0bfc00 con 0x7f74cc0aea30 2023-03-30T08:12:21.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d2a12700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc150280 con 0x7f74cc164190 2023-03-30T08:12:21.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d2a12700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc14f700 con 0x7f74cc163dc0 2023-03-30T08:12:21.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d1a10700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74cc0aea30 0x7f74cc0cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d1a10700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74cc0aea30 0x7f74cc0cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39660/0 (socket says 172.21.15.87:39660) 2023-03-30T08:12:21.464 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d1a10700 1 -- 172.21.15.87:0/3934711679 learned_addr learned my addr 172.21.15.87:0/3934711679 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:21.465 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d1a10700 1 -- 172.21.15.87:0/3934711679 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74cc163dc0 msgr2=0x7f74cc0cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d1a10700 1 --2- 172.21.15.87:0/3934711679 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74cc163dc0 0x7f74cc0cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d1a10700 1 -- 172.21.15.87:0/3934711679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74cc164190 msgr2=0x7f74cc1f95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d1a10700 1 --2- 172.21.15.87:0/3934711679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74cc164190 0x7f74cc1f95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d1a10700 1 -- 172.21.15.87:0/3934711679 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c80094b0 con 0x7f74cc0aea30 2023-03-30T08:12:21.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d1a10700 1 --2- 172.21.15.87:0/3934711679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74cc0aea30 0x7f74cc0cccc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f74c80090b0 tx=0x7f74c8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:21.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74c27fc700 1 -- 172.21.15.87:0/3934711679 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8004480 con 0x7f74cc0aea30 2023-03-30T08:12:21.466 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74c27fc700 1 -- 172.21.15.87:0/3934711679 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c801f070 con 0x7f74cc0aea30 2023-03-30T08:12:21.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d2a12700 1 -- 172.21.15.87:0/3934711679 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74cc06d250 con 0x7f74cc0aea30 2023-03-30T08:12:21.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74c27fc700 1 -- 172.21.15.87:0/3934711679 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8003900 con 0x7f74cc0aea30 2023-03-30T08:12:21.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d2a12700 1 -- 172.21.15.87:0/3934711679 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc06cf70 con 0x7f74cc0aea30 2023-03-30T08:12:21.467 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.463+0000 7f74d2a12700 1 -- 172.21.15.87:0/3934711679 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74cc06d530 con 0x7f74cc0aea30 2023-03-30T08:12:21.468 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.467+0000 7f74c27fc700 1 -- 172.21.15.87:0/3934711679 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f74c8021030 con 0x7f74cc0aea30 2023-03-30T08:12:21.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.467+0000 7f74c27fc700 1 --2- 172.21.15.87:0/3934711679 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f74b0065420 0x7f74b00678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.467+0000 7f74c27fc700 1 -- 172.21.15.87:0/3934711679 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f74c8083c90 con 0x7f74cc0aea30 2023-03-30T08:12:21.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.467+0000 7f74d120f700 1 --2- 172.21.15.87:0/3934711679 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f74b0065420 0x7f74b00678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.471 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.471+0000 7f74d120f700 1 --2- 172.21.15.87:0/3934711679 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f74b0065420 0x7f74b00678d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f74bc006b40 tx=0x7f74bc006ad0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:21.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.475+0000 7f74c27fc700 1 -- 172.21.15.87:0/3934711679 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f74c8051860 con 0x7f74cc0aea30 2023-03-30T08:12:21.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.635+0000 7f74d2a12700 1 -- 172.21.15.87:0/3934711679 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74cc0733a0 con 0x7f74b0065420 2023-03-30T08:12:21.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.651+0000 7f74c27fc700 1 -- 172.21.15.87:0/3934711679 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306704 (secure 0 0 0) 0x7f74cc0733a0 con 0x7f74b0065420 2023-03-30T08:12:21.656 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:21.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.659+0000 7f74d2a12700 1 -- 172.21.15.87:0/3934711679 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f74b0065420 msgr2=0x7f74b00678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.659+0000 7f74d2a12700 1 --2- 172.21.15.87:0/3934711679 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f74b0065420 0x7f74b00678d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f74bc006b40 tx=0x7f74bc006ad0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.659+0000 7f74d2a12700 1 -- 172.21.15.87:0/3934711679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74cc0aea30 msgr2=0x7f74cc0cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.659+0000 7f74d2a12700 1 --2- 172.21.15.87:0/3934711679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74cc0aea30 0x7f74cc0cccc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f74c80090b0 tx=0x7f74c8004770 comp rx=0 tx=0).stop 2023-03-30T08:12:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.659+0000 7f74d2a12700 1 -- 172.21.15.87:0/3934711679 shutdown_connections 2023-03-30T08:12:21.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.659+0000 7f74d2a12700 1 --2- 172.21.15.87:0/3934711679 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f74b0065420 0x7f74b00678d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.659+0000 7f74d2a12700 1 --2- 172.21.15.87:0/3934711679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74cc164190 0x7f74cc1f95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.659+0000 7f74d2a12700 1 --2- 172.21.15.87:0/3934711679 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74cc163dc0 0x7f74cc0cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.659+0000 7f74d2a12700 1 --2- 172.21.15.87:0/3934711679 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f74cc0aea30 0x7f74cc0cccc0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.659+0000 7f74d2a12700 1 -- 172.21.15.87:0/3934711679 >> 172.21.15.87:0/3934711679 conn(0x7f74cc0cf410 msgr2=0x7f74cc0af210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.663+0000 7f74d2a12700 1 -- 172.21.15.87:0/3934711679 shutdown_connections 2023-03-30T08:12:21.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.663+0000 7f74d2a12700 1 -- 172.21.15.87:0/3934711679 wait complete. 2023-03-30T08:12:21.665 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-03-30T08:12:21.682 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-03-30T08:12:19.918826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592734,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71660,"kb_used_data":5036,"kb_used_omap":0,"kb_used_meta":66560,"kb_avail":754903060,"statfs":{"total":773094113280,"available":773020733440,"internally_reserved":0,"allocated":5156864,"data_stored":2929338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68157440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2366,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.401315"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080898+0000","last_change":"2023-03-30T08:12:16.986429+0000","last_active":"2023-03-30T08:12:18.080898+0000","last_peered":"2023-03-30T08:12:18.080898+0000","last_clean":"2023-03-30T08:12:18.080898+0000","last_became_active":"2023-03-30T08:12:16.986120+0000","last_became_peered":"2023-03-30T08:12:16.986120+0000","last_unstale":"2023-03-30T08:12:18.080898+0000","last_undegraded":"2023-03-30T08:12:18.080898+0000","last_fullsized":"2023-03-30T08:12:18.080898+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:37:50.533203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080445+0000","last_change":"2023-03-30T08:12:16.998494+0000","last_active":"2023-03-30T08:12:18.080445+0000","last_peered":"2023-03-30T08:12:18.080445+0000","last_clean":"2023-03-30T08:12:18.080445+0000","last_became_active":"2023-03-30T08:12:16.997985+0000","last_became_peered":"2023-03-30T08:12:16.997985+0000","last_unstale":"2023-03-30T08:12:18.080445+0000","last_undegraded":"2023-03-30T08:12:18.080445+0000","last_fullsized":"2023-03-30T08:12:18.080445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:07:57.345732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978517+0000","last_change":"2023-03-30T08:12:17.000935+0000","last_active":"2023-03-30T08:12:17.978517+0000","last_peered":"2023-03-30T08:12:17.978517+0000","last_clean":"2023-03-30T08:12:17.978517+0000","last_became_active":"2023-03-30T08:12:17.000530+0000","last_became_peered":"2023-03-30T08:12:17.000530+0000","last_unstale":"2023-03-30T08:12:17.978517+0000","last_undegraded":"2023-03-30T08:12:17.978517+0000","last_fullsized":"2023-03-30T08:12:17.978517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:21.266889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079294+0000","last_change":"2023-03-30T08:12:17.012729+0000","last_active":"2023-03-30T08:12:18.079294+0000","last_peered":"2023-03-30T08:12:18.079294+0000","last_clean":"2023-03-30T08:12:18.079294+0000","last_became_active":"2023-03-30T08:12:17.012355+0000","last_became_peered":"2023-03-30T08:12:17.012355+0000","last_unstale":"2023-03-30T08:12:18.079294+0000","last_undegraded":"2023-03-30T08:12:18.079294+0000","last_fullsized":"2023-03-30T08:12:18.079294+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:03:25.229617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079562+0000","last_change":"2023-03-30T08:12:16.998654+0000","last_active":"2023-03-30T08:12:18.079562+0000","last_peered":"2023-03-30T08:12:18.079562+0000","last_clean":"2023-03-30T08:12:18.079562+0000","last_became_active":"2023-03-30T08:12:16.998351+0000","last_became_peered":"2023-03-30T08:12:16.998351+0000","last_unstale":"2023-03-30T08:12:18.079562+0000","last_undegraded":"2023-03-30T08:12:18.079562+0000","last_fullsized":"2023-03-30T08:12:18.079562+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:50:18.929971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977159+0000","last_change":"2023-03-30T08:12:17.006222+0000","last_active":"2023-03-30T08:12:17.977159+0000","last_peered":"2023-03-30T08:12:17.977159+0000","last_clean":"2023-03-30T08:12:17.977159+0000","last_became_active":"2023-03-30T08:12:17.005960+0000","last_became_peered":"2023-03-30T08:12:17.005960+0000","last_unstale":"2023-03-30T08:12:17.977159+0000","last_undegraded":"2023-03-30T08:12:17.977159+0000","last_fullsized":"2023-03-30T08:12:17.977159+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:03:25.229617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080488+0000","last_change":"2023-03-30T08:12:16.985347+0000","last_active":"2023-03-30T08:12:18.080488+0000","last_peered":"2023-03-30T08:12:18.080488+0000","last_clean":"2023-03-30T08:12:18.080488+0000","last_became_active":"2023-03-30T08:12:16.985025+0000","last_became_peered":"2023-03-30T08:12:16.985025+0000","last_unstale":"2023-03-30T08:12:18.080488+0000","last_undegraded":"2023-03-30T08:12:18.080488+0000","last_fullsized":"2023-03-30T08:12:18.080488+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:08:49.114790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.078822+0000","last_change":"2023-03-30T08:12:17.004331+0000","last_active":"2023-03-30T08:12:18.078822+0000","last_peered":"2023-03-30T08:12:18.078822+0000","last_clean":"2023-03-30T08:12:18.078822+0000","last_became_active":"2023-03-30T08:12:17.002556+0000","last_became_peered":"2023-03-30T08:12:17.002556+0000","last_unstale":"2023-03-30T08:12:18.078822+0000","last_undegraded":"2023-03-30T08:12:18.078822+0000","last_fullsized":"2023-03-30T08:12:18.078822+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:06:08.985116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079917+0000","last_change":"2023-03-30T08:12:16.993604+0000","last_active":"2023-03-30T08:12:18.079917+0000","last_peered":"2023-03-30T08:12:18.079917+0000","last_clean":"2023-03-30T08:12:18.079917+0000","last_became_active":"2023-03-30T08:12:16.992038+0000","last_became_peered":"2023-03-30T08:12:16.992038+0000","last_unstale":"2023-03-30T08:12:18.079917+0000","last_undegraded":"2023-03-30T08:12:18.079917+0000","last_fullsized":"2023-03-30T08:12:18.079917+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:56:06.563816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079857+0000","last_change":"2023-03-30T08:12:17.012820+0000","last_active":"2023-03-30T08:12:18.079857+0000","last_peered":"2023-03-30T08:12:18.079857+0000","last_clean":"2023-03-30T08:12:18.079857+0000","last_became_active":"2023-03-30T08:12:17.011323+0000","last_became_peered":"2023-03-30T08:12:17.011323+0000","last_unstale":"2023-03-30T08:12:18.079857+0000","last_undegraded":"2023-03-30T08:12:18.079857+0000","last_fullsized":"2023-03-30T08:12:18.079857+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:22:36.863160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079024+0000","last_change":"2023-03-30T08:12:16.994557+0000","last_active":"2023-03-30T08:12:18.079024+0000","last_peered":"2023-03-30T08:12:18.079024+0000","last_clean":"2023-03-30T08:12:18.079024+0000","last_became_active":"2023-03-30T08:12:16.994317+0000","last_became_peered":"2023-03-30T08:12:16.994317+0000","last_unstale":"2023-03-30T08:12:18.079024+0000","last_undegraded":"2023-03-30T08:12:18.079024+0000","last_fullsized":"2023-03-30T08:12:18.079024+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:05:26.244498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079854+0000","last_change":"2023-03-30T08:12:17.006565+0000","last_active":"2023-03-30T08:12:18.079854+0000","last_peered":"2023-03-30T08:12:18.079854+0000","last_clean":"2023-03-30T08:12:18.079854+0000","last_became_active":"2023-03-30T08:12:17.005919+0000","last_became_peered":"2023-03-30T08:12:17.005919+0000","last_unstale":"2023-03-30T08:12:18.079854+0000","last_undegraded":"2023-03-30T08:12:18.079854+0000","last_fullsized":"2023-03-30T08:12:18.079854+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:26.536973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080327+0000","last_change":"2023-03-30T08:12:17.008181+0000","last_active":"2023-03-30T08:12:18.080327+0000","last_peered":"2023-03-30T08:12:18.080327+0000","last_clean":"2023-03-30T08:12:18.080327+0000","last_became_active":"2023-03-30T08:12:17.007629+0000","last_became_peered":"2023-03-30T08:12:17.007629+0000","last_unstale":"2023-03-30T08:12:18.080327+0000","last_undegraded":"2023-03-30T08:12:18.080327+0000","last_fullsized":"2023-03-30T08:12:18.080327+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:04:18.516254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079049+0000","last_change":"2023-03-30T08:12:16.996076+0000","last_active":"2023-03-30T08:12:18.079049+0000","last_peered":"2023-03-30T08:12:18.079049+0000","last_clean":"2023-03-30T08:12:18.079049+0000","last_became_active":"2023-03-30T08:12:16.991971+0000","last_became_peered":"2023-03-30T08:12:16.991971+0000","last_unstale":"2023-03-30T08:12:18.079049+0000","last_undegraded":"2023-03-30T08:12:18.079049+0000","last_fullsized":"2023-03-30T08:12:18.079049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:26:05.797669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977097+0000","last_change":"2023-03-30T08:12:17.011668+0000","last_active":"2023-03-30T08:12:17.977097+0000","last_peered":"2023-03-30T08:12:17.977097+0000","last_clean":"2023-03-30T08:12:17.977097+0000","last_became_active":"2023-03-30T08:12:17.011413+0000","last_became_peered":"2023-03-30T08:12:17.011413+0000","last_unstale":"2023-03-30T08:12:17.977097+0000","last_undegraded":"2023-03-30T08:12:17.977097+0000","last_fullsized":"2023-03-30T08:12:17.977097+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:05:26.244498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978541+0000","last_change":"2023-03-30T08:12:17.002386+0000","last_active":"2023-03-30T08:12:17.978541+0000","last_peered":"2023-03-30T08:12:17.978541+0000","last_clean":"2023-03-30T08:12:17.978541+0000","last_became_active":"2023-03-30T08:12:17.002061+0000","last_became_peered":"2023-03-30T08:12:17.002061+0000","last_unstale":"2023-03-30T08:12:17.978541+0000","last_undegraded":"2023-03-30T08:12:17.978541+0000","last_fullsized":"2023-03-30T08:12:17.978541+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:29:21.647500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978448+0000","last_change":"2023-03-30T08:12:17.010986+0000","last_active":"2023-03-30T08:12:17.978448+0000","last_peered":"2023-03-30T08:12:17.978448+0000","last_clean":"2023-03-30T08:12:17.978448+0000","last_became_active":"2023-03-30T08:12:17.010635+0000","last_became_peered":"2023-03-30T08:12:17.010635+0000","last_unstale":"2023-03-30T08:12:17.978448+0000","last_undegraded":"2023-03-30T08:12:17.978448+0000","last_fullsized":"2023-03-30T08:12:17.978448+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:28:20.680539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080755+0000","last_change":"2023-03-30T08:12:16.996418+0000","last_active":"2023-03-30T08:12:18.080755+0000","last_peered":"2023-03-30T08:12:18.080755+0000","last_clean":"2023-03-30T08:12:18.080755+0000","last_became_active":"2023-03-30T08:12:16.996143+0000","last_became_peered":"2023-03-30T08:12:16.996143+0000","last_unstale":"2023-03-30T08:12:18.080755+0000","last_undegraded":"2023-03-30T08:12:18.080755+0000","last_fullsized":"2023-03-30T08:12:18.080755+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:05:17.436393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977326+0000","last_change":"2023-03-30T08:12:17.014238+0000","last_active":"2023-03-30T08:12:17.977326+0000","last_peered":"2023-03-30T08:12:17.977326+0000","last_clean":"2023-03-30T08:12:17.977326+0000","last_became_active":"2023-03-30T08:12:17.013954+0000","last_became_peered":"2023-03-30T08:12:17.013954+0000","last_unstale":"2023-03-30T08:12:17.977326+0000","last_undegraded":"2023-03-30T08:12:17.977326+0000","last_fullsized":"2023-03-30T08:12:17.977326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:06:08.985116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079157+0000","last_change":"2023-03-30T08:12:17.011959+0000","last_active":"2023-03-30T08:12:18.079157+0000","last_peered":"2023-03-30T08:12:18.079157+0000","last_clean":"2023-03-30T08:12:18.079157+0000","last_became_active":"2023-03-30T08:12:17.011721+0000","last_became_peered":"2023-03-30T08:12:17.011721+0000","last_unstale":"2023-03-30T08:12:18.079157+0000","last_undegraded":"2023-03-30T08:12:18.079157+0000","last_fullsized":"2023-03-30T08:12:18.079157+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:07:57.345732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080530+0000","last_change":"2023-03-30T08:12:17.006434+0000","last_active":"2023-03-30T08:12:18.080530+0000","last_peered":"2023-03-30T08:12:18.080530+0000","last_clean":"2023-03-30T08:12:18.080530+0000","last_became_active":"2023-03-30T08:12:17.006131+0000","last_became_peered":"2023-03-30T08:12:17.006131+0000","last_unstale":"2023-03-30T08:12:18.080530+0000","last_undegraded":"2023-03-30T08:12:18.080530+0000","last_fullsized":"2023-03-30T08:12:18.080530+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:52:40.390325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978731+0000","last_change":"2023-03-30T08:12:17.001686+0000","last_active":"2023-03-30T08:12:17.978731+0000","last_peered":"2023-03-30T08:12:17.978731+0000","last_clean":"2023-03-30T08:12:17.978731+0000","last_became_active":"2023-03-30T08:12:17.001473+0000","last_became_peered":"2023-03-30T08:12:17.001473+0000","last_unstale":"2023-03-30T08:12:17.978731+0000","last_undegraded":"2023-03-30T08:12:17.978731+0000","last_fullsized":"2023-03-30T08:12:17.978731+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:08:24.903894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079935+0000","last_change":"2023-03-30T08:12:17.006386+0000","last_active":"2023-03-30T08:12:18.079935+0000","last_peered":"2023-03-30T08:12:18.079935+0000","last_clean":"2023-03-30T08:12:18.079935+0000","last_became_active":"2023-03-30T08:12:17.005560+0000","last_became_peered":"2023-03-30T08:12:17.005560+0000","last_unstale":"2023-03-30T08:12:18.079935+0000","last_undegraded":"2023-03-30T08:12:18.079935+0000","last_fullsized":"2023-03-30T08:12:18.079935+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:37:48.102205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978099+0000","last_change":"2023-03-30T08:12:17.003532+0000","last_active":"2023-03-30T08:12:17.978099+0000","last_peered":"2023-03-30T08:12:17.978099+0000","last_clean":"2023-03-30T08:12:17.978099+0000","last_became_active":"2023-03-30T08:12:17.003289+0000","last_became_peered":"2023-03-30T08:12:17.003289+0000","last_unstale":"2023-03-30T08:12:17.978099+0000","last_undegraded":"2023-03-30T08:12:17.978099+0000","last_fullsized":"2023-03-30T08:12:17.978099+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:59:28.247995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977239+0000","last_change":"2023-03-30T08:12:17.011340+0000","last_active":"2023-03-30T08:12:17.977239+0000","last_peered":"2023-03-30T08:12:17.977239+0000","last_clean":"2023-03-30T08:12:17.977239+0000","last_became_active":"2023-03-30T08:12:17.011050+0000","last_became_peered":"2023-03-30T08:12:17.011050+0000","last_unstale":"2023-03-30T08:12:17.977239+0000","last_undegraded":"2023-03-30T08:12:17.977239+0000","last_fullsized":"2023-03-30T08:12:17.977239+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:22:36.863160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080661+0000","last_change":"2023-03-30T08:12:16.985572+0000","last_active":"2023-03-30T08:12:18.080661+0000","last_peered":"2023-03-30T08:12:18.080661+0000","last_clean":"2023-03-30T08:12:18.080661+0000","last_became_active":"2023-03-30T08:12:16.985297+0000","last_became_peered":"2023-03-30T08:12:16.985297+0000","last_unstale":"2023-03-30T08:12:18.080661+0000","last_undegraded":"2023-03-30T08:12:18.080661+0000","last_fullsized":"2023-03-30T08:12:18.080661+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:06.573154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976674+0000","last_change":"2023-03-30T08:12:17.008837+0000","last_active":"2023-03-30T08:12:17.976674+0000","last_peered":"2023-03-30T08:12:17.976674+0000","last_clean":"2023-03-30T08:12:17.976674+0000","last_became_active":"2023-03-30T08:12:17.008571+0000","last_became_peered":"2023-03-30T08:12:17.008571+0000","last_unstale":"2023-03-30T08:12:17.976674+0000","last_undegraded":"2023-03-30T08:12:17.976674+0000","last_fullsized":"2023-03-30T08:12:17.976674+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:04:47.799662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978049+0000","last_change":"2023-03-30T08:12:16.548334+0000","last_active":"2023-03-30T08:12:17.978049+0000","last_peered":"2023-03-30T08:12:17.978049+0000","last_clean":"2023-03-30T08:12:17.978049+0000","last_became_active":"2023-03-30T08:12:16.548070+0000","last_became_peered":"2023-03-30T08:12:16.548070+0000","last_unstale":"2023-03-30T08:12:17.978049+0000","last_undegraded":"2023-03-30T08:12:17.978049+0000","last_fullsized":"2023-03-30T08:12:17.978049+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:06.227499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978631+0000","last_change":"2023-03-30T08:12:16.557857+0000","last_active":"2023-03-30T08:12:17.978631+0000","last_peered":"2023-03-30T08:12:17.978631+0000","last_clean":"2023-03-30T08:12:17.978631+0000","last_became_active":"2023-03-30T08:12:16.557576+0000","last_became_peered":"2023-03-30T08:12:16.557576+0000","last_unstale":"2023-03-30T08:12:17.978631+0000","last_undegraded":"2023-03-30T08:12:17.978631+0000","last_fullsized":"2023-03-30T08:12:17.978631+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:01:17.755013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080005+0000","last_change":"2023-03-30T08:12:17.008489+0000","last_active":"2023-03-30T08:12:18.080005+0000","last_peered":"2023-03-30T08:12:18.080005+0000","last_clean":"2023-03-30T08:12:18.080005+0000","last_became_active":"2023-03-30T08:12:17.008176+0000","last_became_peered":"2023-03-30T08:12:17.008176+0000","last_unstale":"2023-03-30T08:12:18.080005+0000","last_undegraded":"2023-03-30T08:12:18.080005+0000","last_fullsized":"2023-03-30T08:12:18.080005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:26:05.797669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976815+0000","last_change":"2023-03-30T08:12:16.546886+0000","last_active":"2023-03-30T08:12:17.976815+0000","last_peered":"2023-03-30T08:12:17.976815+0000","last_clean":"2023-03-30T08:12:17.976815+0000","last_became_active":"2023-03-30T08:12:16.546636+0000","last_became_peered":"2023-03-30T08:12:16.546636+0000","last_unstale":"2023-03-30T08:12:17.976815+0000","last_undegraded":"2023-03-30T08:12:17.976815+0000","last_fullsized":"2023-03-30T08:12:17.976815+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:45.801853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976838+0000","last_change":"2023-03-30T08:12:17.017294+0000","last_active":"2023-03-30T08:12:17.976838+0000","last_peered":"2023-03-30T08:12:17.976838+0000","last_clean":"2023-03-30T08:12:17.976838+0000","last_became_active":"2023-03-30T08:12:17.017029+0000","last_became_peered":"2023-03-30T08:12:17.017029+0000","last_unstale":"2023-03-30T08:12:17.976838+0000","last_undegraded":"2023-03-30T08:12:17.976838+0000","last_fullsized":"2023-03-30T08:12:17.976838+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:34:17.666643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080822+0000","last_change":"2023-03-30T08:12:16.556777+0000","last_active":"2023-03-30T08:12:18.080822+0000","last_peered":"2023-03-30T08:12:18.080822+0000","last_clean":"2023-03-30T08:12:18.080822+0000","last_became_active":"2023-03-30T08:12:16.556496+0000","last_became_peered":"2023-03-30T08:12:16.556496+0000","last_unstale":"2023-03-30T08:12:18.080822+0000","last_undegraded":"2023-03-30T08:12:18.080822+0000","last_fullsized":"2023-03-30T08:12:18.080822+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:53:00.750269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978100+0000","last_change":"2023-03-30T08:12:17.009878+0000","last_active":"2023-03-30T08:12:17.978100+0000","last_peered":"2023-03-30T08:12:17.978100+0000","last_clean":"2023-03-30T08:12:17.978100+0000","last_became_active":"2023-03-30T08:12:17.009270+0000","last_became_peered":"2023-03-30T08:12:17.009270+0000","last_unstale":"2023-03-30T08:12:17.978100+0000","last_undegraded":"2023-03-30T08:12:17.978100+0000","last_fullsized":"2023-03-30T08:12:17.978100+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:26:44.730508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977623+0000","last_change":"2023-03-30T08:12:16.552161+0000","last_active":"2023-03-30T08:12:17.977623+0000","last_peered":"2023-03-30T08:12:17.977623+0000","last_clean":"2023-03-30T08:12:17.977623+0000","last_became_active":"2023-03-30T08:12:16.551583+0000","last_became_peered":"2023-03-30T08:12:16.551583+0000","last_unstale":"2023-03-30T08:12:17.977623+0000","last_undegraded":"2023-03-30T08:12:17.977623+0000","last_fullsized":"2023-03-30T08:12:17.977623+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:30.770018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079799+0000","last_change":"2023-03-30T08:12:16.997050+0000","last_active":"2023-03-30T08:12:18.079799+0000","last_peered":"2023-03-30T08:12:18.079799+0000","last_clean":"2023-03-30T08:12:18.079799+0000","last_became_active":"2023-03-30T08:12:16.996757+0000","last_became_peered":"2023-03-30T08:12:16.996757+0000","last_unstale":"2023-03-30T08:12:18.079799+0000","last_undegraded":"2023-03-30T08:12:18.079799+0000","last_fullsized":"2023-03-30T08:12:18.079799+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:52.330866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978347+0000","last_change":"2023-03-30T08:12:16.556002+0000","last_active":"2023-03-30T08:12:17.978347+0000","last_peered":"2023-03-30T08:12:17.978347+0000","last_clean":"2023-03-30T08:12:17.978347+0000","last_became_active":"2023-03-30T08:12:16.555592+0000","last_became_peered":"2023-03-30T08:12:16.555592+0000","last_unstale":"2023-03-30T08:12:17.978347+0000","last_undegraded":"2023-03-30T08:12:17.978347+0000","last_fullsized":"2023-03-30T08:12:17.978347+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:13:46.653017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.078975+0000","last_change":"2023-03-30T08:12:17.003057+0000","last_active":"2023-03-30T08:12:18.078975+0000","last_peered":"2023-03-30T08:12:18.078975+0000","last_clean":"2023-03-30T08:12:18.078975+0000","last_became_active":"2023-03-30T08:12:17.002219+0000","last_became_peered":"2023-03-30T08:12:17.002219+0000","last_unstale":"2023-03-30T08:12:18.078975+0000","last_undegraded":"2023-03-30T08:12:18.078975+0000","last_fullsized":"2023-03-30T08:12:18.078975+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:49.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079250+0000","last_change":"2023-03-30T08:12:16.558995+0000","last_active":"2023-03-30T08:12:18.079250+0000","last_peered":"2023-03-30T08:12:18.079250+0000","last_clean":"2023-03-30T08:12:18.079250+0000","last_became_active":"2023-03-30T08:12:16.558550+0000","last_became_peered":"2023-03-30T08:12:16.558550+0000","last_unstale":"2023-03-30T08:12:18.079250+0000","last_undegraded":"2023-03-30T08:12:18.079250+0000","last_fullsized":"2023-03-30T08:12:18.079250+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:04:46.786826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079110+0000","last_change":"2023-03-30T08:12:16.555850+0000","last_active":"2023-03-30T08:12:18.079110+0000","last_peered":"2023-03-30T08:12:18.079110+0000","last_clean":"2023-03-30T08:12:18.079110+0000","last_became_active":"2023-03-30T08:12:16.553720+0000","last_became_peered":"2023-03-30T08:12:16.553720+0000","last_unstale":"2023-03-30T08:12:18.079110+0000","last_undegraded":"2023-03-30T08:12:18.079110+0000","last_fullsized":"2023-03-30T08:12:18.079110+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:04:17.503418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978586+0000","last_change":"2023-03-30T08:12:17.010413+0000","last_active":"2023-03-30T08:12:17.978586+0000","last_peered":"2023-03-30T08:12:17.978586+0000","last_clean":"2023-03-30T08:12:17.978586+0000","last_became_active":"2023-03-30T08:12:17.000709+0000","last_became_peered":"2023-03-30T08:12:17.000709+0000","last_unstale":"2023-03-30T08:12:17.978586+0000","last_undegraded":"2023-03-30T08:12:17.978586+0000","last_fullsized":"2023-03-30T08:12:17.978586+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:32:34.013372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978718+0000","last_change":"2023-03-30T08:12:16.550080+0000","last_active":"2023-03-30T08:12:17.978718+0000","last_peered":"2023-03-30T08:12:17.978718+0000","last_clean":"2023-03-30T08:12:17.978718+0000","last_became_active":"2023-03-30T08:12:16.549799+0000","last_became_peered":"2023-03-30T08:12:16.549799+0000","last_unstale":"2023-03-30T08:12:17.978718+0000","last_undegraded":"2023-03-30T08:12:17.978718+0000","last_fullsized":"2023-03-30T08:12:17.978718+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:14:32.503958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.081229+0000","last_change":"2023-03-30T08:12:17.003517+0000","last_active":"2023-03-30T08:12:18.081229+0000","last_peered":"2023-03-30T08:12:18.081229+0000","last_clean":"2023-03-30T08:12:18.081229+0000","last_became_active":"2023-03-30T08:12:17.002700+0000","last_became_peered":"2023-03-30T08:12:17.002700+0000","last_unstale":"2023-03-30T08:12:18.081229+0000","last_undegraded":"2023-03-30T08:12:18.081229+0000","last_fullsized":"2023-03-30T08:12:18.081229+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:08.812485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080114+0000","last_change":"2023-03-30T08:12:16.556210+0000","last_active":"2023-03-30T08:12:18.080114+0000","last_peered":"2023-03-30T08:12:18.080114+0000","last_clean":"2023-03-30T08:12:18.080114+0000","last_became_active":"2023-03-30T08:12:16.555938+0000","last_became_peered":"2023-03-30T08:12:16.555938+0000","last_unstale":"2023-03-30T08:12:18.080114+0000","last_undegraded":"2023-03-30T08:12:18.080114+0000","last_fullsized":"2023-03-30T08:12:18.080114+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:52:39.377489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977444+0000","last_change":"2023-03-30T08:12:17.006945+0000","last_active":"2023-03-30T08:12:17.977444+0000","last_peered":"2023-03-30T08:12:17.977444+0000","last_clean":"2023-03-30T08:12:17.977444+0000","last_became_active":"2023-03-30T08:12:17.006684+0000","last_became_peered":"2023-03-30T08:12:17.006684+0000","last_unstale":"2023-03-30T08:12:17.977444+0000","last_undegraded":"2023-03-30T08:12:17.977444+0000","last_fullsized":"2023-03-30T08:12:17.977444+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:44:10.477398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080887+0000","last_change":"2023-03-30T08:12:16.558102+0000","last_active":"2023-03-30T08:12:18.080887+0000","last_peered":"2023-03-30T08:12:18.080887+0000","last_clean":"2023-03-30T08:12:18.080887+0000","last_became_active":"2023-03-30T08:12:16.557590+0000","last_became_peered":"2023-03-30T08:12:16.557590+0000","last_unstale":"2023-03-30T08:12:18.080887+0000","last_undegraded":"2023-03-30T08:12:18.080887+0000","last_fullsized":"2023-03-30T08:12:18.080887+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:05.560318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080655+0000","last_change":"2023-03-30T08:12:16.984979+0000","last_active":"2023-03-30T08:12:18.080655+0000","last_peered":"2023-03-30T08:12:18.080655+0000","last_clean":"2023-03-30T08:12:18.080655+0000","last_became_active":"2023-03-30T08:12:16.984692+0000","last_became_peered":"2023-03-30T08:12:16.984692+0000","last_unstale":"2023-03-30T08:12:18.080655+0000","last_undegraded":"2023-03-30T08:12:18.080655+0000","last_fullsized":"2023-03-30T08:12:18.080655+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:00:53.087275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080887+0000","last_change":"2023-03-30T08:12:16.555005+0000","last_active":"2023-03-30T08:12:18.080887+0000","last_peered":"2023-03-30T08:12:18.080887+0000","last_clean":"2023-03-30T08:12:18.080887+0000","last_became_active":"2023-03-30T08:12:16.554754+0000","last_became_peered":"2023-03-30T08:12:16.554754+0000","last_unstale":"2023-03-30T08:12:18.080887+0000","last_undegraded":"2023-03-30T08:12:18.080887+0000","last_fullsized":"2023-03-30T08:12:18.080887+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:49:46.311228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977777+0000","last_change":"2023-03-30T08:12:16.552318+0000","last_active":"2023-03-30T08:12:17.977777+0000","last_peered":"2023-03-30T08:12:17.977777+0000","last_clean":"2023-03-30T08:12:17.977777+0000","last_became_active":"2023-03-30T08:12:16.551939+0000","last_became_peered":"2023-03-30T08:12:16.551939+0000","last_unstale":"2023-03-30T08:12:17.977777+0000","last_undegraded":"2023-03-30T08:12:17.977777+0000","last_fullsized":"2023-03-30T08:12:17.977777+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:07.799649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079989+0000","last_change":"2023-03-30T08:12:17.004827+0000","last_active":"2023-03-30T08:12:18.079989+0000","last_peered":"2023-03-30T08:12:18.079989+0000","last_clean":"2023-03-30T08:12:18.079989+0000","last_became_active":"2023-03-30T08:12:17.004521+0000","last_became_peered":"2023-03-30T08:12:17.004521+0000","last_unstale":"2023-03-30T08:12:18.079989+0000","last_undegraded":"2023-03-30T08:12:18.079989+0000","last_fullsized":"2023-03-30T08:12:18.079989+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:58:27.165546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080737+0000","last_change":"2023-03-30T08:12:16.551609+0000","last_active":"2023-03-30T08:12:18.080737+0000","last_peered":"2023-03-30T08:12:18.080737+0000","last_clean":"2023-03-30T08:12:18.080737+0000","last_became_active":"2023-03-30T08:12:16.551216+0000","last_became_peered":"2023-03-30T08:12:16.551216+0000","last_unstale":"2023-03-30T08:12:18.080737+0000","last_undegraded":"2023-03-30T08:12:18.080737+0000","last_fullsized":"2023-03-30T08:12:18.080737+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:45.801853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976910+0000","last_change":"2023-03-30T08:12:17.000583+0000","last_active":"2023-03-30T08:12:17.976910+0000","last_peered":"2023-03-30T08:12:17.976910+0000","last_clean":"2023-03-30T08:12:17.976910+0000","last_became_active":"2023-03-30T08:12:17.000340+0000","last_became_peered":"2023-03-30T08:12:17.000340+0000","last_unstale":"2023-03-30T08:12:17.976910+0000","last_undegraded":"2023-03-30T08:12:17.976910+0000","last_fullsized":"2023-03-30T08:12:17.976910+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:52.330866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977347+0000","last_change":"2023-03-30T08:12:16.547541+0000","last_active":"2023-03-30T08:12:17.977347+0000","last_peered":"2023-03-30T08:12:17.977347+0000","last_clean":"2023-03-30T08:12:17.977347+0000","last_became_active":"2023-03-30T08:12:16.547256+0000","last_became_peered":"2023-03-30T08:12:16.547256+0000","last_unstale":"2023-03-30T08:12:17.977347+0000","last_undegraded":"2023-03-30T08:12:17.977347+0000","last_fullsized":"2023-03-30T08:12:17.977347+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:04:46.786826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080672+0000","last_change":"2023-03-30T08:12:17.004589+0000","last_active":"2023-03-30T08:12:18.080672+0000","last_peered":"2023-03-30T08:12:18.080672+0000","last_clean":"2023-03-30T08:12:18.080672+0000","last_became_active":"2023-03-30T08:12:17.004326+0000","last_became_peered":"2023-03-30T08:12:17.004326+0000","last_unstale":"2023-03-30T08:12:18.080672+0000","last_undegraded":"2023-03-30T08:12:18.080672+0000","last_fullsized":"2023-03-30T08:12:18.080672+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:59:29.583333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079207+0000","last_change":"2023-03-30T08:12:16.551553+0000","last_active":"2023-03-30T08:12:18.079207+0000","last_peered":"2023-03-30T08:12:18.079207+0000","last_clean":"2023-03-30T08:12:18.079207+0000","last_became_active":"2023-03-30T08:12:16.550991+0000","last_became_peered":"2023-03-30T08:12:16.550991+0000","last_unstale":"2023-03-30T08:12:18.079207+0000","last_undegraded":"2023-03-30T08:12:18.079207+0000","last_fullsized":"2023-03-30T08:12:18.079207+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:45.801853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080538+0000","last_change":"2023-03-30T08:12:16.995421+0000","last_active":"2023-03-30T08:12:18.080538+0000","last_peered":"2023-03-30T08:12:18.080538+0000","last_clean":"2023-03-30T08:12:18.080538+0000","last_became_active":"2023-03-30T08:12:16.995140+0000","last_became_peered":"2023-03-30T08:12:16.995140+0000","last_unstale":"2023-03-30T08:12:18.080538+0000","last_undegraded":"2023-03-30T08:12:18.080538+0000","last_fullsized":"2023-03-30T08:12:18.080538+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:53:01.763105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080615+0000","last_change":"2023-03-30T08:12:16.560134+0000","last_active":"2023-03-30T08:12:18.080615+0000","last_peered":"2023-03-30T08:12:18.080615+0000","last_clean":"2023-03-30T08:12:18.080615+0000","last_became_active":"2023-03-30T08:12:16.559817+0000","last_became_peered":"2023-03-30T08:12:16.559817+0000","last_unstale":"2023-03-30T08:12:18.080615+0000","last_undegraded":"2023-03-30T08:12:18.080615+0000","last_fullsized":"2023-03-30T08:12:18.080615+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:24:46.330274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080109+0000","last_change":"2023-03-30T08:12:17.007078+0000","last_active":"2023-03-30T08:12:18.080109+0000","last_peered":"2023-03-30T08:12:18.080109+0000","last_clean":"2023-03-30T08:12:18.080109+0000","last_became_active":"2023-03-30T08:12:17.006834+0000","last_became_peered":"2023-03-30T08:12:17.006834+0000","last_unstale":"2023-03-30T08:12:18.080109+0000","last_undegraded":"2023-03-30T08:12:18.080109+0000","last_fullsized":"2023-03-30T08:12:18.080109+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T20:04:39.661536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978769+0000","last_change":"2023-03-30T08:12:16.554723+0000","last_active":"2023-03-30T08:12:17.978769+0000","last_peered":"2023-03-30T08:12:17.978769+0000","last_clean":"2023-03-30T08:12:17.978769+0000","last_became_active":"2023-03-30T08:12:16.554298+0000","last_became_peered":"2023-03-30T08:12:16.554298+0000","last_unstale":"2023-03-30T08:12:17.978769+0000","last_undegraded":"2023-03-30T08:12:17.978769+0000","last_fullsized":"2023-03-30T08:12:17.978769+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:22.712608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080211+0000","last_change":"2023-03-30T08:12:16.555215+0000","last_active":"2023-03-30T08:12:18.080211+0000","last_peered":"2023-03-30T08:12:18.080211+0000","last_clean":"2023-03-30T08:12:18.080211+0000","last_became_active":"2023-03-30T08:12:16.554899+0000","last_became_peered":"2023-03-30T08:12:16.554899+0000","last_unstale":"2023-03-30T08:12:18.080211+0000","last_undegraded":"2023-03-30T08:12:18.080211+0000","last_fullsized":"2023-03-30T08:12:18.080211+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:06.227499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977546+0000","last_change":"2023-03-30T08:12:16.548116+0000","last_active":"2023-03-30T08:12:17.977546+0000","last_peered":"2023-03-30T08:12:17.977546+0000","last_clean":"2023-03-30T08:12:17.977546+0000","last_became_active":"2023-03-30T08:12:16.547717+0000","last_became_peered":"2023-03-30T08:12:16.547717+0000","last_unstale":"2023-03-30T08:12:17.977546+0000","last_undegraded":"2023-03-30T08:12:17.977546+0000","last_fullsized":"2023-03-30T08:12:17.977546+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:23.831326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977373+0000","last_change":"2023-03-30T08:12:17.006005+0000","last_active":"2023-03-30T08:12:17.977373+0000","last_peered":"2023-03-30T08:12:17.977373+0000","last_clean":"2023-03-30T08:12:17.977373+0000","last_became_active":"2023-03-30T08:12:17.005629+0000","last_became_peered":"2023-03-30T08:12:17.005629+0000","last_unstale":"2023-03-30T08:12:17.977373+0000","last_undegraded":"2023-03-30T08:12:17.977373+0000","last_fullsized":"2023-03-30T08:12:17.977373+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T20:04:39.661536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977916+0000","last_change":"2023-03-30T08:12:16.552860+0000","last_active":"2023-03-30T08:12:17.977916+0000","last_peered":"2023-03-30T08:12:17.977916+0000","last_clean":"2023-03-30T08:12:17.977916+0000","last_became_active":"2023-03-30T08:12:16.552601+0000","last_became_peered":"2023-03-30T08:12:16.552601+0000","last_unstale":"2023-03-30T08:12:17.977916+0000","last_undegraded":"2023-03-30T08:12:17.977916+0000","last_fullsized":"2023-03-30T08:12:17.977916+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:34:16.653807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976467+0000","last_change":"2023-03-30T08:12:16.999806+0000","last_active":"2023-03-30T08:12:17.976467+0000","last_peered":"2023-03-30T08:12:17.976467+0000","last_clean":"2023-03-30T08:12:17.976467+0000","last_became_active":"2023-03-30T08:12:16.999536+0000","last_became_peered":"2023-03-30T08:12:16.999536+0000","last_unstale":"2023-03-30T08:12:17.976467+0000","last_undegraded":"2023-03-30T08:12:17.976467+0000","last_fullsized":"2023-03-30T08:12:17.976467+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:24.844161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079421+0000","last_change":"2023-03-30T08:12:16.553800+0000","last_active":"2023-03-30T08:12:18.079421+0000","last_peered":"2023-03-30T08:12:18.079421+0000","last_clean":"2023-03-30T08:12:18.079421+0000","last_became_active":"2023-03-30T08:12:16.553477+0000","last_became_peered":"2023-03-30T08:12:16.553477+0000","last_unstale":"2023-03-30T08:12:18.079421+0000","last_undegraded":"2023-03-30T08:12:18.079421+0000","last_fullsized":"2023-03-30T08:12:18.079421+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:23.831326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080580+0000","last_change":"2023-03-30T08:12:16.982961+0000","last_active":"2023-03-30T08:12:18.080580+0000","last_peered":"2023-03-30T08:12:18.080580+0000","last_clean":"2023-03-30T08:12:18.080580+0000","last_became_active":"2023-03-30T08:12:16.982681+0000","last_became_peered":"2023-03-30T08:12:16.982681+0000","last_unstale":"2023-03-30T08:12:18.080580+0000","last_undegraded":"2023-03-30T08:12:18.080580+0000","last_fullsized":"2023-03-30T08:12:18.080580+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:46.814689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079644+0000","last_change":"2023-03-30T08:12:16.552411+0000","last_active":"2023-03-30T08:12:18.079644+0000","last_peered":"2023-03-30T08:12:18.079644+0000","last_clean":"2023-03-30T08:12:18.079644+0000","last_became_active":"2023-03-30T08:12:16.551535+0000","last_became_peered":"2023-03-30T08:12:16.551535+0000","last_unstale":"2023-03-30T08:12:18.079644+0000","last_undegraded":"2023-03-30T08:12:18.079644+0000","last_fullsized":"2023-03-30T08:12:18.079644+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:05.560318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079475+0000","last_change":"2023-03-30T08:12:16.986695+0000","last_active":"2023-03-30T08:12:18.079475+0000","last_peered":"2023-03-30T08:12:18.079475+0000","last_clean":"2023-03-30T08:12:18.079475+0000","last_became_active":"2023-03-30T08:12:16.986439+0000","last_became_peered":"2023-03-30T08:12:16.986439+0000","last_unstale":"2023-03-30T08:12:18.079475+0000","last_undegraded":"2023-03-30T08:12:18.079475+0000","last_fullsized":"2023-03-30T08:12:18.079475+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:31.782854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080937+0000","last_change":"2023-03-30T08:12:16.552751+0000","last_active":"2023-03-30T08:12:18.080937+0000","last_peered":"2023-03-30T08:12:18.080937+0000","last_clean":"2023-03-30T08:12:18.080937+0000","last_became_active":"2023-03-30T08:12:16.552461+0000","last_became_peered":"2023-03-30T08:12:16.552461+0000","last_unstale":"2023-03-30T08:12:18.080937+0000","last_undegraded":"2023-03-30T08:12:18.080937+0000","last_fullsized":"2023-03-30T08:12:18.080937+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:53:32.695129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977601+0000","last_change":"2023-03-30T08:12:17.005810+0000","last_active":"2023-03-30T08:12:17.977601+0000","last_peered":"2023-03-30T08:12:17.977601+0000","last_clean":"2023-03-30T08:12:17.977601+0000","last_became_active":"2023-03-30T08:12:17.005266+0000","last_became_peered":"2023-03-30T08:12:17.005266+0000","last_unstale":"2023-03-30T08:12:17.977601+0000","last_undegraded":"2023-03-30T08:12:17.977601+0000","last_fullsized":"2023-03-30T08:12:17.977601+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:56:06.563816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.081399+0000","last_change":"2023-03-30T08:12:16.560203+0000","last_active":"2023-03-30T08:12:18.081399+0000","last_peered":"2023-03-30T08:12:18.081399+0000","last_clean":"2023-03-30T08:12:18.081399+0000","last_became_active":"2023-03-30T08:12:16.559904+0000","last_became_peered":"2023-03-30T08:12:16.559904+0000","last_unstale":"2023-03-30T08:12:18.081399+0000","last_undegraded":"2023-03-30T08:12:18.081399+0000","last_fullsized":"2023-03-30T08:12:18.081399+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:05:16.423557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-30T08:12:08.673664+0000","last_change":"2023-03-30T08:10:52.871133+0000","last_active":"2023-03-30T08:12:08.673664+0000","last_peered":"2023-03-30T08:12:08.673664+0000","last_clean":"2023-03-30T08:12:08.673664+0000","last_became_active":"2023-03-30T08:10:52.870678+0000","last_became_peered":"2023-03-30T08:10:52.870678+0000","last_unstale":"2023-03-30T08:12:08.673664+0000","last_undegraded":"2023-03-30T08:12:08.673664+0000","last_fullsized":"2023-03-30T08:12:08.673664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:51.162618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977475+0000","last_change":"2023-03-30T08:12:17.006743+0000","last_active":"2023-03-30T08:12:17.977475+0000","last_peered":"2023-03-30T08:12:17.977475+0000","last_clean":"2023-03-30T08:12:17.977475+0000","last_became_active":"2023-03-30T08:12:17.006424+0000","last_became_peered":"2023-03-30T08:12:17.006424+0000","last_unstale":"2023-03-30T08:12:17.977475+0000","last_undegraded":"2023-03-30T08:12:17.977475+0000","last_fullsized":"2023-03-30T08:12:17.977475+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:49.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978347+0000","last_change":"2023-03-30T08:12:16.559057+0000","last_active":"2023-03-30T08:12:17.978347+0000","last_peered":"2023-03-30T08:12:17.978347+0000","last_clean":"2023-03-30T08:12:17.978347+0000","last_became_active":"2023-03-30T08:12:16.558798+0000","last_became_peered":"2023-03-30T08:12:16.558798+0000","last_unstale":"2023-03-30T08:12:17.978347+0000","last_undegraded":"2023-03-30T08:12:17.978347+0000","last_fullsized":"2023-03-30T08:12:17.978347+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:04:47.794257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.973188+0000","last_change":"2023-03-30T08:10:52.871548+0000","last_active":"2023-03-30T08:12:16.973188+0000","last_peered":"2023-03-30T08:12:16.973188+0000","last_clean":"2023-03-30T08:12:16.973188+0000","last_became_active":"2023-03-30T08:10:52.871152+0000","last_became_peered":"2023-03-30T08:10:52.871152+0000","last_unstale":"2023-03-30T08:12:16.973188+0000","last_undegraded":"2023-03-30T08:12:16.973188+0000","last_fullsized":"2023-03-30T08:12:16.973188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079157+0000","last_change":"2023-03-30T08:12:16.994330+0000","last_active":"2023-03-30T08:12:18.079157+0000","last_peered":"2023-03-30T08:12:18.079157+0000","last_clean":"2023-03-30T08:12:18.079157+0000","last_became_active":"2023-03-30T08:12:16.994062+0000","last_became_peered":"2023-03-30T08:12:16.994062+0000","last_unstale":"2023-03-30T08:12:18.079157+0000","last_undegraded":"2023-03-30T08:12:18.079157+0000","last_fullsized":"2023-03-30T08:12:18.079157+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:04:29.223577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976601+0000","last_change":"2023-03-30T08:12:16.547995+0000","last_active":"2023-03-30T08:12:17.976601+0000","last_peered":"2023-03-30T08:12:17.976601+0000","last_clean":"2023-03-30T08:12:17.976601+0000","last_became_active":"2023-03-30T08:12:16.547723+0000","last_became_peered":"2023-03-30T08:12:16.547723+0000","last_unstale":"2023-03-30T08:12:17.976601+0000","last_undegraded":"2023-03-30T08:12:17.976601+0000","last_fullsized":"2023-03-30T08:12:17.976601+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:11:32.761870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.978187+0000","last_change":"2023-03-30T08:10:52.921525+0000","last_active":"2023-03-30T08:12:16.978187+0000","last_peered":"2023-03-30T08:12:16.978187+0000","last_clean":"2023-03-30T08:12:16.978187+0000","last_became_active":"2023-03-30T08:10:52.920885+0000","last_became_peered":"2023-03-30T08:10:52.920885+0000","last_unstale":"2023-03-30T08:12:16.978187+0000","last_undegraded":"2023-03-30T08:12:16.978187+0000","last_fullsized":"2023-03-30T08:12:16.978187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:38:27.041880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978096+0000","last_change":"2023-03-30T08:12:17.006956+0000","last_active":"2023-03-30T08:12:17.978096+0000","last_peered":"2023-03-30T08:12:17.978096+0000","last_clean":"2023-03-30T08:12:17.978096+0000","last_became_active":"2023-03-30T08:12:17.006648+0000","last_became_peered":"2023-03-30T08:12:17.006648+0000","last_unstale":"2023-03-30T08:12:17.978096+0000","last_undegraded":"2023-03-30T08:12:17.978096+0000","last_fullsized":"2023-03-30T08:12:17.978096+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:00:33.917851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079338+0000","last_change":"2023-03-30T08:12:16.549604+0000","last_active":"2023-03-30T08:12:18.079338+0000","last_peered":"2023-03-30T08:12:18.079338+0000","last_clean":"2023-03-30T08:12:18.079338+0000","last_became_active":"2023-03-30T08:12:16.549318+0000","last_became_peered":"2023-03-30T08:12:16.549318+0000","last_unstale":"2023-03-30T08:12:18.079338+0000","last_undegraded":"2023-03-30T08:12:18.079338+0000","last_fullsized":"2023-03-30T08:12:18.079338+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:05:16.423557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.972700+0000","last_change":"2023-03-30T08:10:52.921563+0000","last_active":"2023-03-30T08:12:16.972700+0000","last_peered":"2023-03-30T08:12:16.972700+0000","last_clean":"2023-03-30T08:12:16.972700+0000","last_became_active":"2023-03-30T08:10:52.921234+0000","last_became_peered":"2023-03-30T08:10:52.921234+0000","last_unstale":"2023-03-30T08:12:16.972700+0000","last_undegraded":"2023-03-30T08:12:16.972700+0000","last_fullsized":"2023-03-30T08:12:16.972700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-30T08:12:16.515324+0000","last_change":"2023-03-30T08:12:16.515324+0000","last_active":"2023-03-30T08:12:16.515324+0000","last_peered":"2023-03-30T08:12:16.515324+0000","last_clean":"2023-03-30T08:12:16.515324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-30T08:12:16.515324+0000","last_undegraded":"2023-03-30T08:12:16.515324+0000","last_fullsized":"2023-03-30T08:12:16.515324+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.657150+0000","last_change":"2023-03-30T08:12:16.548759+0000","last_active":"2023-03-30T08:12:18.657150+0000","last_peered":"2023-03-30T08:12:18.657150+0000","last_clean":"2023-03-30T08:12:18.657150+0000","last_became_active":"2023-03-30T08:12:16.548522+0000","last_became_peered":"2023-03-30T08:12:16.548522+0000","last_unstale":"2023-03-30T08:12:18.657150+0000","last_undegraded":"2023-03-30T08:12:18.657150+0000","last_fullsized":"2023-03-30T08:12:18.657150+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:53.899438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.983880+0000","last_change":"2023-03-30T08:10:52.866272+0000","last_active":"2023-03-30T08:12:16.983880+0000","last_peered":"2023-03-30T08:12:16.983880+0000","last_clean":"2023-03-30T08:12:16.983880+0000","last_became_active":"2023-03-30T08:10:52.865919+0000","last_became_peered":"2023-03-30T08:10:52.865919+0000","last_unstale":"2023-03-30T08:12:16.983880+0000","last_undegraded":"2023-03-30T08:12:16.983880+0000","last_fullsized":"2023-03-30T08:12:16.983880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079319+0000","last_change":"2023-03-30T08:12:16.988070+0000","last_active":"2023-03-30T08:12:18.079319+0000","last_peered":"2023-03-30T08:12:18.079319+0000","last_clean":"2023-03-30T08:12:18.079319+0000","last_became_active":"2023-03-30T08:12:16.987820+0000","last_became_peered":"2023-03-30T08:12:16.987820+0000","last_unstale":"2023-03-30T08:12:18.079319+0000","last_undegraded":"2023-03-30T08:12:18.079319+0000","last_fullsized":"2023-03-30T08:12:18.079319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:44:10.477398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080967+0000","last_change":"2023-03-30T08:12:16.558215+0000","last_active":"2023-03-30T08:12:18.080967+0000","last_peered":"2023-03-30T08:12:18.080967+0000","last_clean":"2023-03-30T08:12:18.080967+0000","last_became_active":"2023-03-30T08:12:16.557938+0000","last_became_peered":"2023-03-30T08:12:16.557938+0000","last_unstale":"2023-03-30T08:12:18.080967+0000","last_undegraded":"2023-03-30T08:12:18.080967+0000","last_fullsized":"2023-03-30T08:12:18.080967+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:11:32.761870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.977269+0000","last_change":"2023-03-30T08:10:52.920796+0000","last_active":"2023-03-30T08:12:16.977269+0000","last_peered":"2023-03-30T08:12:16.977269+0000","last_clean":"2023-03-30T08:12:16.977269+0000","last_became_active":"2023-03-30T08:10:52.920327+0000","last_became_peered":"2023-03-30T08:10:52.920327+0000","last_unstale":"2023-03-30T08:12:16.977269+0000","last_undegraded":"2023-03-30T08:12:16.977269+0000","last_fullsized":"2023-03-30T08:12:16.977269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:17.416386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080801+0000","last_change":"2023-03-30T08:12:16.997115+0000","last_active":"2023-03-30T08:12:18.080801+0000","last_peered":"2023-03-30T08:12:18.080801+0000","last_clean":"2023-03-30T08:12:18.080801+0000","last_became_active":"2023-03-30T08:12:16.996842+0000","last_became_peered":"2023-03-30T08:12:16.996842+0000","last_unstale":"2023-03-30T08:12:18.080801+0000","last_undegraded":"2023-03-30T08:12:18.080801+0000","last_fullsized":"2023-03-30T08:12:18.080801+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:54.912274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976310+0000","last_change":"2023-03-30T08:12:16.548581+0000","last_active":"2023-03-30T08:12:17.976310+0000","last_peered":"2023-03-30T08:12:17.976310+0000","last_clean":"2023-03-30T08:12:17.976310+0000","last_became_active":"2023-03-30T08:12:16.548264+0000","last_became_peered":"2023-03-30T08:12:16.548264+0000","last_unstale":"2023-03-30T08:12:17.976310+0000","last_undegraded":"2023-03-30T08:12:17.976310+0000","last_fullsized":"2023-03-30T08:12:17.976310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:53:00.750269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.976809+0000","last_change":"2023-03-30T08:10:52.866412+0000","last_active":"2023-03-30T08:12:16.976809+0000","last_peered":"2023-03-30T08:12:16.976809+0000","last_clean":"2023-03-30T08:12:16.976809+0000","last_became_active":"2023-03-30T08:10:52.866055+0000","last_became_peered":"2023-03-30T08:10:52.866055+0000","last_unstale":"2023-03-30T08:12:16.976809+0000","last_undegraded":"2023-03-30T08:12:16.976809+0000","last_fullsized":"2023-03-30T08:12:16.976809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:39.045010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080009+0000","last_change":"2023-03-30T08:12:17.004094+0000","last_active":"2023-03-30T08:12:18.080009+0000","last_peered":"2023-03-30T08:12:18.080009+0000","last_clean":"2023-03-30T08:12:18.080009+0000","last_became_active":"2023-03-30T08:12:17.003834+0000","last_became_peered":"2023-03-30T08:12:17.003834+0000","last_unstale":"2023-03-30T08:12:18.080009+0000","last_undegraded":"2023-03-30T08:12:18.080009+0000","last_fullsized":"2023-03-30T08:12:18.080009+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:51:00.535247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.081006+0000","last_change":"2023-03-30T08:12:16.546137+0000","last_active":"2023-03-30T08:12:18.081006+0000","last_peered":"2023-03-30T08:12:18.081006+0000","last_clean":"2023-03-30T08:12:18.081006+0000","last_became_active":"2023-03-30T08:12:16.545844+0000","last_became_peered":"2023-03-30T08:12:16.545844+0000","last_unstale":"2023-03-30T08:12:18.081006+0000","last_undegraded":"2023-03-30T08:12:18.081006+0000","last_fullsized":"2023-03-30T08:12:18.081006+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:30.770018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.985121+0000","last_change":"2023-03-30T08:10:52.868170+0000","last_active":"2023-03-30T08:12:16.985121+0000","last_peered":"2023-03-30T08:12:16.985121+0000","last_clean":"2023-03-30T08:12:16.985121+0000","last_became_active":"2023-03-30T08:10:52.867790+0000","last_became_peered":"2023-03-30T08:10:52.867790+0000","last_unstale":"2023-03-30T08:12:16.985121+0000","last_undegraded":"2023-03-30T08:12:16.985121+0000","last_fullsized":"2023-03-30T08:12:16.985121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.977024+0000","last_change":"2023-03-30T08:10:45.713084+0000","last_active":"2023-03-30T08:12:16.977024+0000","last_peered":"2023-03-30T08:12:16.977024+0000","last_clean":"2023-03-30T08:12:16.977024+0000","last_became_active":"2023-03-30T08:10:45.711645+0000","last_became_peered":"2023-03-30T08:10:45.711645+0000","last_unstale":"2023-03-30T08:12:16.977024+0000","last_undegraded":"2023-03-30T08:12:16.977024+0000","last_fullsized":"2023-03-30T08:12:16.977024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_clean_scrub_stamp":"2023-03-30T08:10:44.620691+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:58:12.738262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2366,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8444,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363396,"statfs":{"total":96636764160,"available":96628117504,"internally_reserved":0,"allocated":446464,"data_stored":193866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.79500000000000004}]},{"osd":1,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":1.155}]},{"osd":2,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.3},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":0.93400000000000005}]},{"osd":3,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.0289999999999999}]},{"osd":4,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.181}]},{"osd":5,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.117},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.327}]},{"osd":7,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2789999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9844,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361996,"statfs":{"total":96636764160,"available":96626683904,"internally_reserved":0,"allocated":1093632,"data_stored":812175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.2170000000000001}]},{"osd":1,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.2709999999999999}]},{"osd":2,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.94099999999999995}]},{"osd":4,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.522}]},{"osd":5,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.3839999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":1.2,"5min":1.2,"15min":1.2},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.5860000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8688,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363152,"statfs":{"total":96636764160,"available":96627867648,"internally_reserved":0,"allocated":499712,"data_stored":221787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.012}]},{"osd":1,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.536},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.333}]},{"osd":2,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.302},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.1120000000000001}]},{"osd":3,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.4650000000000001}]},{"osd":4,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.133},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.2769999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.4950000000000001}]},{"osd":7,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":1.077,"5min":1.077,"15min":1.077},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.373},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.403}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8824,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363016,"statfs":{"total":96636764160,"available":96627728384,"internally_reserved":0,"allocated":507904,"data_stored":223281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.121}]},{"osd":1,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.627},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.2989999999999999}]},{"osd":2,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.573},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.98699999999999999}]},{"osd":3,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":1.667},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.3839999999999999}]},{"osd":5,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4119999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.345},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.8330000000000002,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.754}]},{"osd":6,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.6459999999999999,"5min":2.6459999999999999,"15min":2.6459999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":2.0129999999999999}]},{"osd":7,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":3.2599999999999998,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.413}]}]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8696,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363144,"statfs":{"total":96636764160,"available":96627859456,"internally_reserved":0,"allocated":507904,"data_stored":222359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.97199999999999998}]},{"osd":2,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0740000000000001}]},{"osd":4,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.127},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.355}]},{"osd":6,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.518},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":1.133,"5min":1.133,"15min":1.133},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.367}]},{"osd":7,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.454},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.3280000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8572,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363268,"statfs":{"total":96636764160,"available":96627986432,"internally_reserved":0,"allocated":512000,"data_stored":223303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.075},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.01}]},{"osd":1,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.3720000000000001}]},{"osd":3,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.5089999999999999}]},{"osd":4,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.655},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.411}]},{"osd":5,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.492,"5min":2.492,"15min":2.492},"last":1.5429999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":2.4390000000000001,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.3460000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8752,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363088,"statfs":{"total":96636764160,"available":96627802112,"internally_reserved":0,"allocated":499712,"data_stored":221787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.071}]},{"osd":2,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.137}]},{"osd":3,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.169}]},{"osd":4,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.9159999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.0389999999999999}]},{"osd":5,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.2549999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":3.6309999999999998,"5min":3.6309999999999998,"15min":3.6309999999999998},"last":1.109}]},{"osd":6,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.345},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.2330000000000001}]},{"osd":7,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.611},{"interface":"front","average":{"1min":1.45,"5min":1.45,"15min":1.45},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.2789999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9840,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362000,"statfs":{"total":96636764160,"available":96626688000,"internally_reserved":0,"allocated":1089536,"data_stored":810780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":1.2310000000000001}]},{"osd":2,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.081},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":1.1919999999999999}]},{"osd":4,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":1.417},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.494}]},{"osd":5,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.339},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.53}]},{"osd":6,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.5329999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.4390000000000001}]},{"osd":7,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.5980000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-30T08:12:21.691 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-30T08:12:21.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.891+0000 7f1362fb4700 1 Processor -- start 2023-03-30T08:12:21.895 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.895+0000 7f1362fb4700 1 -- start start 2023-03-30T08:12:21.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.895+0000 7f1362fb4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f135c1600d0 0x7f135c06a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.895+0000 7f1362fb4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f135c06aab0 0x7f135c0abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.895+0000 7f1362fb4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135c06a0e0 con 0x7f135c0ad640 2023-03-30T08:12:21.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.895+0000 7f1362fb4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135c0c9db0 con 0x7f135c1600d0 2023-03-30T08:12:21.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.895+0000 7f1362fb4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0ca090 con 0x7f135c06aab0 2023-03-30T08:12:21.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.895+0000 7f1361fb2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f135c1600d0 0x7f135c06a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.895+0000 7f1361fb2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f135c1600d0 0x7f135c06a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39670/0 (socket says 172.21.15.87:39670) 2023-03-30T08:12:21.900 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.895+0000 7f1361fb2700 1 -- 172.21.15.87:0/478732673 learned_addr learned my addr 172.21.15.87:0/478732673 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:21.900 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f13617b1700 1 --2- 172.21.15.87:0/478732673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f135c06aab0 0x7f135c0abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.900 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1361fb2700 1 -- 172.21.15.87:0/478732673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f135c06aab0 msgr2=0x7f135c0abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:21.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1361fb2700 1 --2- 172.21.15.87:0/478732673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f135c06aab0 0x7f135c0abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1361fb2700 1 -- 172.21.15.87:0/478732673 >> v1:172.21.15.115:6789/0 conn(0x7f135c0ad640 legacy=0x7f135c1604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1361fb2700 1 -- 172.21.15.87:0/478732673 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c069d70 con 0x7f135c1600d0 2023-03-30T08:12:21.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1361fb2700 1 --2- 172.21.15.87:0/478732673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f135c1600d0 0x7f135c06a570 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1358009910 tx=0x7f1358009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0c0a6e10d4ad89 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:21.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1360fb0700 1 -- 172.21.15.87:0/478732673 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358011830 con 0x7f135c1600d0 2023-03-30T08:12:21.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1360fb0700 1 -- 172.21.15.87:0/478732673 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1358011990 con 0x7f135c1600d0 2023-03-30T08:12:21.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1360fb0700 1 -- 172.21.15.87:0/478732673 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358011d40 con 0x7f135c1600d0 2023-03-30T08:12:21.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1362fb4700 1 -- 172.21.15.87:0/478732673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f135c1600d0 msgr2=0x7f135c06a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1362fb4700 1 --2- 172.21.15.87:0/478732673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f135c1600d0 0x7f135c06a570 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1358009910 tx=0x7f1358009c20 comp rx=0 tx=0).stop 2023-03-30T08:12:21.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1362fb4700 1 -- 172.21.15.87:0/478732673 shutdown_connections 2023-03-30T08:12:21.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1362fb4700 1 --2- 172.21.15.87:0/478732673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f135c06aab0 0x7f135c0abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1362fb4700 1 --2- 172.21.15.87:0/478732673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f135c1600d0 0x7f135c06a570 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1362fb4700 1 -- 172.21.15.87:0/478732673 >> 172.21.15.87:0/478732673 conn(0x7f135c0cf410 msgr2=0x7f135c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:21.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1362fb4700 1 -- 172.21.15.87:0/478732673 shutdown_connections 2023-03-30T08:12:21.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.899+0000 7f1362fb4700 1 -- 172.21.15.87:0/478732673 wait complete. 2023-03-30T08:12:21.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.903+0000 7f1362fb4700 1 Processor -- start 2023-03-30T08:12:21.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.903+0000 7f1362fb4700 1 -- start start 2023-03-30T08:12:21.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.903+0000 7f1362fb4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f135c06aab0 0x7f135c0b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.903+0000 7f1362fb4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f135c0ad640 0x7f135c0c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.903+0000 7f1362fb4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f135c1600d0 0x7f135c0cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.903+0000 7f1362fb4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c1f2150 con 0x7f135c06aab0 2023-03-30T08:12:21.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.903+0000 7f1362fb4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0b10b0 con 0x7f135c0ad640 2023-03-30T08:12:21.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.903+0000 7f1362fb4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c0c5010 con 0x7f135c1600d0 2023-03-30T08:12:21.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.903+0000 7f1361fb2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f135c06aab0 0x7f135c0b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.903+0000 7f1361fb2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f135c06aab0 0x7f135c0b03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39682/0 (socket says 172.21.15.87:39682) 2023-03-30T08:12:21.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.903+0000 7f1361fb2700 1 -- 172.21.15.87:0/2252667341 learned_addr learned my addr 172.21.15.87:0/2252667341 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:21.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.903+0000 7f13627b3700 1 --2- 172.21.15.87:0/2252667341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f135c1600d0 0x7f135c0cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.903+0000 7f13617b1700 1 --2- 172.21.15.87:0/2252667341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f135c0ad640 0x7f135c0c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.907+0000 7f1361fb2700 1 -- 172.21.15.87:0/2252667341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f135c1600d0 msgr2=0x7f135c0cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.907+0000 7f1361fb2700 1 --2- 172.21.15.87:0/2252667341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f135c1600d0 0x7f135c0cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.907+0000 7f1361fb2700 1 -- 172.21.15.87:0/2252667341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f135c0ad640 msgr2=0x7f135c0c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:21.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.907+0000 7f1361fb2700 1 --2- 172.21.15.87:0/2252667341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f135c0ad640 0x7f135c0c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:21.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.907+0000 7f1361fb2700 1 -- 172.21.15.87:0/2252667341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1358009570 con 0x7f135c06aab0 2023-03-30T08:12:21.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.907+0000 7f1361fb2700 1 --2- 172.21.15.87:0/2252667341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f135c06aab0 0x7f135c0b03f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1358000c00 tx=0x7f1358004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:21.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.907+0000 7f13527fc700 1 -- 172.21.15.87:0/2252667341 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358004510 con 0x7f135c06aab0 2023-03-30T08:12:21.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.907+0000 7f13527fc700 1 -- 172.21.15.87:0/2252667341 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135801e070 con 0x7f135c06aab0 2023-03-30T08:12:21.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.907+0000 7f1362fb4700 1 -- 172.21.15.87:0/2252667341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c0addc0 con 0x7f135c06aab0 2023-03-30T08:12:21.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.907+0000 7f13527fc700 1 -- 172.21.15.87:0/2252667341 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358003900 con 0x7f135c06aab0 2023-03-30T08:12:21.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.907+0000 7f1362fb4700 1 -- 172.21.15.87:0/2252667341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135c0ca370 con 0x7f135c06aab0 2023-03-30T08:12:21.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.907+0000 7f1362fb4700 1 -- 172.21.15.87:0/2252667341 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135c15d8c0 con 0x7f135c06aab0 2023-03-30T08:12:21.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.911+0000 7f13527fc700 1 -- 172.21.15.87:0/2252667341 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f1358003a60 con 0x7f135c06aab0 2023-03-30T08:12:21.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.911+0000 7f13527fc700 1 --2- 172.21.15.87:0/2252667341 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f13400653f0 0x7f13400678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:21.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.911+0000 7f13527fc700 1 -- 172.21.15.87:0/2252667341 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f13580839d0 con 0x7f135c06aab0 2023-03-30T08:12:21.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.911+0000 7f13617b1700 1 --2- 172.21.15.87:0/2252667341 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f13400653f0 0x7f13400678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:21.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.911+0000 7f13617b1700 1 --2- 172.21.15.87:0/2252667341 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f13400653f0 0x7f13400678a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f135c070b60 tx=0x7f134c009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:21.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:21.919+0000 7f13527fc700 1 -- 172.21.15.87:0/2252667341 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f1358051660 con 0x7f135c06aab0 2023-03-30T08:12:22.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.087+0000 7f1362fb4700 1 -- 172.21.15.87:0/2252667341 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f135c0733a0 con 0x7f13400653f0 2023-03-30T08:12:22.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.103+0000 7f13527fc700 1 -- 172.21.15.87:0/2252667341 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308567 (secure 0 0 0) 0x7f135c0733a0 con 0x7f13400653f0 2023-03-30T08:12:22.106 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:22.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.111+0000 7f1362fb4700 1 -- 172.21.15.87:0/2252667341 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f13400653f0 msgr2=0x7f13400678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:22.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.111+0000 7f1362fb4700 1 --2- 172.21.15.87:0/2252667341 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f13400653f0 0x7f13400678a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f135c070b60 tx=0x7f134c009240 comp rx=0 tx=0).stop 2023-03-30T08:12:22.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.111+0000 7f1362fb4700 1 -- 172.21.15.87:0/2252667341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f135c06aab0 msgr2=0x7f135c0b03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:22.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.111+0000 7f1362fb4700 1 --2- 172.21.15.87:0/2252667341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f135c06aab0 0x7f135c0b03f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1358000c00 tx=0x7f1358004770 comp rx=0 tx=0).stop 2023-03-30T08:12:22.113 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.111+0000 7f1362fb4700 1 -- 172.21.15.87:0/2252667341 shutdown_connections 2023-03-30T08:12:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.111+0000 7f1362fb4700 1 --2- 172.21.15.87:0/2252667341 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f13400653f0 0x7f13400678a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.111+0000 7f1362fb4700 1 --2- 172.21.15.87:0/2252667341 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f135c1600d0 0x7f135c0cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.111+0000 7f1362fb4700 1 --2- 172.21.15.87:0/2252667341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f135c0ad640 0x7f135c0c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.111+0000 7f1362fb4700 1 --2- 172.21.15.87:0/2252667341 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f135c06aab0 0x7f135c0b03f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.111+0000 7f1362fb4700 1 -- 172.21.15.87:0/2252667341 >> 172.21.15.87:0/2252667341 conn(0x7f135c0cf410 msgr2=0x7f135c070180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.111+0000 7f1362fb4700 1 -- 172.21.15.87:0/2252667341 shutdown_connections 2023-03-30T08:12:22.114 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.111+0000 7f1362fb4700 1 -- 172.21.15.87:0/2252667341 wait complete. 2023-03-30T08:12:22.115 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-03-30T08:12:22.131 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2023-03-30T08:12:21.919589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592734,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71908,"kb_used_data":5092,"kb_used_omap":0,"kb_used_meta":66752,"kb_avail":754902812,"statfs":{"total":773094113280,"available":773020479488,"internally_reserved":0,"allocated":5214208,"data_stored":2957861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68354048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2366,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001707"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080898+0000","last_change":"2023-03-30T08:12:16.986429+0000","last_active":"2023-03-30T08:12:18.080898+0000","last_peered":"2023-03-30T08:12:18.080898+0000","last_clean":"2023-03-30T08:12:18.080898+0000","last_became_active":"2023-03-30T08:12:16.986120+0000","last_became_peered":"2023-03-30T08:12:16.986120+0000","last_unstale":"2023-03-30T08:12:18.080898+0000","last_undegraded":"2023-03-30T08:12:18.080898+0000","last_fullsized":"2023-03-30T08:12:18.080898+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:37:50.533203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080445+0000","last_change":"2023-03-30T08:12:16.998494+0000","last_active":"2023-03-30T08:12:18.080445+0000","last_peered":"2023-03-30T08:12:18.080445+0000","last_clean":"2023-03-30T08:12:18.080445+0000","last_became_active":"2023-03-30T08:12:16.997985+0000","last_became_peered":"2023-03-30T08:12:16.997985+0000","last_unstale":"2023-03-30T08:12:18.080445+0000","last_undegraded":"2023-03-30T08:12:18.080445+0000","last_fullsized":"2023-03-30T08:12:18.080445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:07:57.345732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978517+0000","last_change":"2023-03-30T08:12:17.000935+0000","last_active":"2023-03-30T08:12:17.978517+0000","last_peered":"2023-03-30T08:12:17.978517+0000","last_clean":"2023-03-30T08:12:17.978517+0000","last_became_active":"2023-03-30T08:12:17.000530+0000","last_became_peered":"2023-03-30T08:12:17.000530+0000","last_unstale":"2023-03-30T08:12:17.978517+0000","last_undegraded":"2023-03-30T08:12:17.978517+0000","last_fullsized":"2023-03-30T08:12:17.978517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:21.266889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079294+0000","last_change":"2023-03-30T08:12:17.012729+0000","last_active":"2023-03-30T08:12:18.079294+0000","last_peered":"2023-03-30T08:12:18.079294+0000","last_clean":"2023-03-30T08:12:18.079294+0000","last_became_active":"2023-03-30T08:12:17.012355+0000","last_became_peered":"2023-03-30T08:12:17.012355+0000","last_unstale":"2023-03-30T08:12:18.079294+0000","last_undegraded":"2023-03-30T08:12:18.079294+0000","last_fullsized":"2023-03-30T08:12:18.079294+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:03:25.229617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079562+0000","last_change":"2023-03-30T08:12:16.998654+0000","last_active":"2023-03-30T08:12:18.079562+0000","last_peered":"2023-03-30T08:12:18.079562+0000","last_clean":"2023-03-30T08:12:18.079562+0000","last_became_active":"2023-03-30T08:12:16.998351+0000","last_became_peered":"2023-03-30T08:12:16.998351+0000","last_unstale":"2023-03-30T08:12:18.079562+0000","last_undegraded":"2023-03-30T08:12:18.079562+0000","last_fullsized":"2023-03-30T08:12:18.079562+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:50:18.929971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977159+0000","last_change":"2023-03-30T08:12:17.006222+0000","last_active":"2023-03-30T08:12:17.977159+0000","last_peered":"2023-03-30T08:12:17.977159+0000","last_clean":"2023-03-30T08:12:17.977159+0000","last_became_active":"2023-03-30T08:12:17.005960+0000","last_became_peered":"2023-03-30T08:12:17.005960+0000","last_unstale":"2023-03-30T08:12:17.977159+0000","last_undegraded":"2023-03-30T08:12:17.977159+0000","last_fullsized":"2023-03-30T08:12:17.977159+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:03:25.229617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080488+0000","last_change":"2023-03-30T08:12:16.985347+0000","last_active":"2023-03-30T08:12:18.080488+0000","last_peered":"2023-03-30T08:12:18.080488+0000","last_clean":"2023-03-30T08:12:18.080488+0000","last_became_active":"2023-03-30T08:12:16.985025+0000","last_became_peered":"2023-03-30T08:12:16.985025+0000","last_unstale":"2023-03-30T08:12:18.080488+0000","last_undegraded":"2023-03-30T08:12:18.080488+0000","last_fullsized":"2023-03-30T08:12:18.080488+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:08:49.114790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.078822+0000","last_change":"2023-03-30T08:12:17.004331+0000","last_active":"2023-03-30T08:12:18.078822+0000","last_peered":"2023-03-30T08:12:18.078822+0000","last_clean":"2023-03-30T08:12:18.078822+0000","last_became_active":"2023-03-30T08:12:17.002556+0000","last_became_peered":"2023-03-30T08:12:17.002556+0000","last_unstale":"2023-03-30T08:12:18.078822+0000","last_undegraded":"2023-03-30T08:12:18.078822+0000","last_fullsized":"2023-03-30T08:12:18.078822+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:06:08.985116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079917+0000","last_change":"2023-03-30T08:12:16.993604+0000","last_active":"2023-03-30T08:12:18.079917+0000","last_peered":"2023-03-30T08:12:18.079917+0000","last_clean":"2023-03-30T08:12:18.079917+0000","last_became_active":"2023-03-30T08:12:16.992038+0000","last_became_peered":"2023-03-30T08:12:16.992038+0000","last_unstale":"2023-03-30T08:12:18.079917+0000","last_undegraded":"2023-03-30T08:12:18.079917+0000","last_fullsized":"2023-03-30T08:12:18.079917+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:56:06.563816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079857+0000","last_change":"2023-03-30T08:12:17.012820+0000","last_active":"2023-03-30T08:12:18.079857+0000","last_peered":"2023-03-30T08:12:18.079857+0000","last_clean":"2023-03-30T08:12:18.079857+0000","last_became_active":"2023-03-30T08:12:17.011323+0000","last_became_peered":"2023-03-30T08:12:17.011323+0000","last_unstale":"2023-03-30T08:12:18.079857+0000","last_undegraded":"2023-03-30T08:12:18.079857+0000","last_fullsized":"2023-03-30T08:12:18.079857+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:22:36.863160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079024+0000","last_change":"2023-03-30T08:12:16.994557+0000","last_active":"2023-03-30T08:12:18.079024+0000","last_peered":"2023-03-30T08:12:18.079024+0000","last_clean":"2023-03-30T08:12:18.079024+0000","last_became_active":"2023-03-30T08:12:16.994317+0000","last_became_peered":"2023-03-30T08:12:16.994317+0000","last_unstale":"2023-03-30T08:12:18.079024+0000","last_undegraded":"2023-03-30T08:12:18.079024+0000","last_fullsized":"2023-03-30T08:12:18.079024+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:05:26.244498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079854+0000","last_change":"2023-03-30T08:12:17.006565+0000","last_active":"2023-03-30T08:12:18.079854+0000","last_peered":"2023-03-30T08:12:18.079854+0000","last_clean":"2023-03-30T08:12:18.079854+0000","last_became_active":"2023-03-30T08:12:17.005919+0000","last_became_peered":"2023-03-30T08:12:17.005919+0000","last_unstale":"2023-03-30T08:12:18.079854+0000","last_undegraded":"2023-03-30T08:12:18.079854+0000","last_fullsized":"2023-03-30T08:12:18.079854+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:26.536973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080327+0000","last_change":"2023-03-30T08:12:17.008181+0000","last_active":"2023-03-30T08:12:18.080327+0000","last_peered":"2023-03-30T08:12:18.080327+0000","last_clean":"2023-03-30T08:12:18.080327+0000","last_became_active":"2023-03-30T08:12:17.007629+0000","last_became_peered":"2023-03-30T08:12:17.007629+0000","last_unstale":"2023-03-30T08:12:18.080327+0000","last_undegraded":"2023-03-30T08:12:18.080327+0000","last_fullsized":"2023-03-30T08:12:18.080327+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:04:18.516254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079049+0000","last_change":"2023-03-30T08:12:16.996076+0000","last_active":"2023-03-30T08:12:18.079049+0000","last_peered":"2023-03-30T08:12:18.079049+0000","last_clean":"2023-03-30T08:12:18.079049+0000","last_became_active":"2023-03-30T08:12:16.991971+0000","last_became_peered":"2023-03-30T08:12:16.991971+0000","last_unstale":"2023-03-30T08:12:18.079049+0000","last_undegraded":"2023-03-30T08:12:18.079049+0000","last_fullsized":"2023-03-30T08:12:18.079049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:26:05.797669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977097+0000","last_change":"2023-03-30T08:12:17.011668+0000","last_active":"2023-03-30T08:12:17.977097+0000","last_peered":"2023-03-30T08:12:17.977097+0000","last_clean":"2023-03-30T08:12:17.977097+0000","last_became_active":"2023-03-30T08:12:17.011413+0000","last_became_peered":"2023-03-30T08:12:17.011413+0000","last_unstale":"2023-03-30T08:12:17.977097+0000","last_undegraded":"2023-03-30T08:12:17.977097+0000","last_fullsized":"2023-03-30T08:12:17.977097+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:05:26.244498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082011+0000","last_change":"2023-03-30T08:12:16.998858+0000","last_active":"2023-03-30T08:12:18.082011+0000","last_peered":"2023-03-30T08:12:18.082011+0000","last_clean":"2023-03-30T08:12:18.082011+0000","last_became_active":"2023-03-30T08:12:16.998571+0000","last_became_peered":"2023-03-30T08:12:16.998571+0000","last_unstale":"2023-03-30T08:12:18.082011+0000","last_undegraded":"2023-03-30T08:12:18.082011+0000","last_fullsized":"2023-03-30T08:12:18.082011+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:13:16.134694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978541+0000","last_change":"2023-03-30T08:12:17.002386+0000","last_active":"2023-03-30T08:12:17.978541+0000","last_peered":"2023-03-30T08:12:17.978541+0000","last_clean":"2023-03-30T08:12:17.978541+0000","last_became_active":"2023-03-30T08:12:17.002061+0000","last_became_peered":"2023-03-30T08:12:17.002061+0000","last_unstale":"2023-03-30T08:12:17.978541+0000","last_undegraded":"2023-03-30T08:12:17.978541+0000","last_fullsized":"2023-03-30T08:12:17.978541+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:29:21.647500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978448+0000","last_change":"2023-03-30T08:12:17.010986+0000","last_active":"2023-03-30T08:12:17.978448+0000","last_peered":"2023-03-30T08:12:17.978448+0000","last_clean":"2023-03-30T08:12:17.978448+0000","last_became_active":"2023-03-30T08:12:17.010635+0000","last_became_peered":"2023-03-30T08:12:17.010635+0000","last_unstale":"2023-03-30T08:12:17.978448+0000","last_undegraded":"2023-03-30T08:12:17.978448+0000","last_fullsized":"2023-03-30T08:12:17.978448+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:28:20.680539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082826+0000","last_change":"2023-03-30T08:12:17.017401+0000","last_active":"2023-03-30T08:12:18.082826+0000","last_peered":"2023-03-30T08:12:18.082826+0000","last_clean":"2023-03-30T08:12:18.082826+0000","last_became_active":"2023-03-30T08:12:17.016782+0000","last_became_peered":"2023-03-30T08:12:17.016782+0000","last_unstale":"2023-03-30T08:12:18.082826+0000","last_undegraded":"2023-03-30T08:12:18.082826+0000","last_fullsized":"2023-03-30T08:12:18.082826+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:06:09.492248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080755+0000","last_change":"2023-03-30T08:12:16.996418+0000","last_active":"2023-03-30T08:12:18.080755+0000","last_peered":"2023-03-30T08:12:18.080755+0000","last_clean":"2023-03-30T08:12:18.080755+0000","last_became_active":"2023-03-30T08:12:16.996143+0000","last_became_peered":"2023-03-30T08:12:16.996143+0000","last_unstale":"2023-03-30T08:12:18.080755+0000","last_undegraded":"2023-03-30T08:12:18.080755+0000","last_fullsized":"2023-03-30T08:12:18.080755+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:05:17.436393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977326+0000","last_change":"2023-03-30T08:12:17.014238+0000","last_active":"2023-03-30T08:12:17.977326+0000","last_peered":"2023-03-30T08:12:17.977326+0000","last_clean":"2023-03-30T08:12:17.977326+0000","last_became_active":"2023-03-30T08:12:17.013954+0000","last_became_peered":"2023-03-30T08:12:17.013954+0000","last_unstale":"2023-03-30T08:12:17.977326+0000","last_undegraded":"2023-03-30T08:12:17.977326+0000","last_fullsized":"2023-03-30T08:12:17.977326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:06:08.985116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079157+0000","last_change":"2023-03-30T08:12:17.011959+0000","last_active":"2023-03-30T08:12:18.079157+0000","last_peered":"2023-03-30T08:12:18.079157+0000","last_clean":"2023-03-30T08:12:18.079157+0000","last_became_active":"2023-03-30T08:12:17.011721+0000","last_became_peered":"2023-03-30T08:12:17.011721+0000","last_unstale":"2023-03-30T08:12:18.079157+0000","last_undegraded":"2023-03-30T08:12:18.079157+0000","last_fullsized":"2023-03-30T08:12:18.079157+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:07:57.345732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082334+0000","last_change":"2023-03-30T08:12:17.012004+0000","last_active":"2023-03-30T08:12:18.082334+0000","last_peered":"2023-03-30T08:12:18.082334+0000","last_clean":"2023-03-30T08:12:18.082334+0000","last_became_active":"2023-03-30T08:12:17.011745+0000","last_became_peered":"2023-03-30T08:12:17.011745+0000","last_unstale":"2023-03-30T08:12:18.082334+0000","last_undegraded":"2023-03-30T08:12:18.082334+0000","last_fullsized":"2023-03-30T08:12:18.082334+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:26:25.721563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082008+0000","last_change":"2023-03-30T08:12:17.003716+0000","last_active":"2023-03-30T08:12:18.082008+0000","last_peered":"2023-03-30T08:12:18.082008+0000","last_clean":"2023-03-30T08:12:18.082008+0000","last_became_active":"2023-03-30T08:12:17.003422+0000","last_became_peered":"2023-03-30T08:12:17.003422+0000","last_unstale":"2023-03-30T08:12:18.082008+0000","last_undegraded":"2023-03-30T08:12:18.082008+0000","last_fullsized":"2023-03-30T08:12:18.082008+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:13:22.103589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082466+0000","last_change":"2023-03-30T08:12:17.017132+0000","last_active":"2023-03-30T08:12:18.082466+0000","last_peered":"2023-03-30T08:12:18.082466+0000","last_clean":"2023-03-30T08:12:18.082466+0000","last_became_active":"2023-03-30T08:12:17.016386+0000","last_became_peered":"2023-03-30T08:12:17.016386+0000","last_unstale":"2023-03-30T08:12:18.082466+0000","last_undegraded":"2023-03-30T08:12:18.082466+0000","last_fullsized":"2023-03-30T08:12:18.082466+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:30:36.341938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080530+0000","last_change":"2023-03-30T08:12:17.006434+0000","last_active":"2023-03-30T08:12:18.080530+0000","last_peered":"2023-03-30T08:12:18.080530+0000","last_clean":"2023-03-30T08:12:18.080530+0000","last_became_active":"2023-03-30T08:12:17.006131+0000","last_became_peered":"2023-03-30T08:12:17.006131+0000","last_unstale":"2023-03-30T08:12:18.080530+0000","last_undegraded":"2023-03-30T08:12:18.080530+0000","last_fullsized":"2023-03-30T08:12:18.080530+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:52:40.390325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978731+0000","last_change":"2023-03-30T08:12:17.001686+0000","last_active":"2023-03-30T08:12:17.978731+0000","last_peered":"2023-03-30T08:12:17.978731+0000","last_clean":"2023-03-30T08:12:17.978731+0000","last_became_active":"2023-03-30T08:12:17.001473+0000","last_became_peered":"2023-03-30T08:12:17.001473+0000","last_unstale":"2023-03-30T08:12:17.978731+0000","last_undegraded":"2023-03-30T08:12:17.978731+0000","last_fullsized":"2023-03-30T08:12:17.978731+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:08:24.903894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079935+0000","last_change":"2023-03-30T08:12:17.006386+0000","last_active":"2023-03-30T08:12:18.079935+0000","last_peered":"2023-03-30T08:12:18.079935+0000","last_clean":"2023-03-30T08:12:18.079935+0000","last_became_active":"2023-03-30T08:12:17.005560+0000","last_became_peered":"2023-03-30T08:12:17.005560+0000","last_unstale":"2023-03-30T08:12:18.079935+0000","last_undegraded":"2023-03-30T08:12:18.079935+0000","last_fullsized":"2023-03-30T08:12:18.079935+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:37:48.102205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.083003+0000","last_change":"2023-03-30T08:12:16.995546+0000","last_active":"2023-03-30T08:12:18.083003+0000","last_peered":"2023-03-30T08:12:18.083003+0000","last_clean":"2023-03-30T08:12:18.083003+0000","last_became_active":"2023-03-30T08:12:16.995169+0000","last_became_peered":"2023-03-30T08:12:16.995169+0000","last_unstale":"2023-03-30T08:12:18.083003+0000","last_undegraded":"2023-03-30T08:12:18.083003+0000","last_fullsized":"2023-03-30T08:12:18.083003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:47:13.571528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978099+0000","last_change":"2023-03-30T08:12:17.003532+0000","last_active":"2023-03-30T08:12:17.978099+0000","last_peered":"2023-03-30T08:12:17.978099+0000","last_clean":"2023-03-30T08:12:17.978099+0000","last_became_active":"2023-03-30T08:12:17.003289+0000","last_became_peered":"2023-03-30T08:12:17.003289+0000","last_unstale":"2023-03-30T08:12:17.978099+0000","last_undegraded":"2023-03-30T08:12:17.978099+0000","last_fullsized":"2023-03-30T08:12:17.978099+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:59:28.247995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977239+0000","last_change":"2023-03-30T08:12:17.011340+0000","last_active":"2023-03-30T08:12:17.977239+0000","last_peered":"2023-03-30T08:12:17.977239+0000","last_clean":"2023-03-30T08:12:17.977239+0000","last_became_active":"2023-03-30T08:12:17.011050+0000","last_became_peered":"2023-03-30T08:12:17.011050+0000","last_unstale":"2023-03-30T08:12:17.977239+0000","last_undegraded":"2023-03-30T08:12:17.977239+0000","last_fullsized":"2023-03-30T08:12:17.977239+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:22:36.863160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080661+0000","last_change":"2023-03-30T08:12:16.985572+0000","last_active":"2023-03-30T08:12:18.080661+0000","last_peered":"2023-03-30T08:12:18.080661+0000","last_clean":"2023-03-30T08:12:18.080661+0000","last_became_active":"2023-03-30T08:12:16.985297+0000","last_became_peered":"2023-03-30T08:12:16.985297+0000","last_unstale":"2023-03-30T08:12:18.080661+0000","last_undegraded":"2023-03-30T08:12:18.080661+0000","last_fullsized":"2023-03-30T08:12:18.080661+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:06.573154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976674+0000","last_change":"2023-03-30T08:12:17.008837+0000","last_active":"2023-03-30T08:12:17.976674+0000","last_peered":"2023-03-30T08:12:17.976674+0000","last_clean":"2023-03-30T08:12:17.976674+0000","last_became_active":"2023-03-30T08:12:17.008571+0000","last_became_peered":"2023-03-30T08:12:17.008571+0000","last_unstale":"2023-03-30T08:12:17.976674+0000","last_undegraded":"2023-03-30T08:12:17.976674+0000","last_fullsized":"2023-03-30T08:12:17.976674+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:04:47.799662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978049+0000","last_change":"2023-03-30T08:12:16.548334+0000","last_active":"2023-03-30T08:12:17.978049+0000","last_peered":"2023-03-30T08:12:17.978049+0000","last_clean":"2023-03-30T08:12:17.978049+0000","last_became_active":"2023-03-30T08:12:16.548070+0000","last_became_peered":"2023-03-30T08:12:16.548070+0000","last_unstale":"2023-03-30T08:12:17.978049+0000","last_undegraded":"2023-03-30T08:12:17.978049+0000","last_fullsized":"2023-03-30T08:12:17.978049+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:06.227499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082701+0000","last_change":"2023-03-30T08:12:17.016751+0000","last_active":"2023-03-30T08:12:18.082701+0000","last_peered":"2023-03-30T08:12:18.082701+0000","last_clean":"2023-03-30T08:12:18.082701+0000","last_became_active":"2023-03-30T08:12:17.016023+0000","last_became_peered":"2023-03-30T08:12:17.016023+0000","last_unstale":"2023-03-30T08:12:18.082701+0000","last_undegraded":"2023-03-30T08:12:18.082701+0000","last_fullsized":"2023-03-30T08:12:18.082701+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:02:28.197304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978631+0000","last_change":"2023-03-30T08:12:16.557857+0000","last_active":"2023-03-30T08:12:17.978631+0000","last_peered":"2023-03-30T08:12:17.978631+0000","last_clean":"2023-03-30T08:12:17.978631+0000","last_became_active":"2023-03-30T08:12:16.557576+0000","last_became_peered":"2023-03-30T08:12:16.557576+0000","last_unstale":"2023-03-30T08:12:17.978631+0000","last_undegraded":"2023-03-30T08:12:17.978631+0000","last_fullsized":"2023-03-30T08:12:17.978631+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:01:17.755013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080005+0000","last_change":"2023-03-30T08:12:17.008489+0000","last_active":"2023-03-30T08:12:18.080005+0000","last_peered":"2023-03-30T08:12:18.080005+0000","last_clean":"2023-03-30T08:12:18.080005+0000","last_became_active":"2023-03-30T08:12:17.008176+0000","last_became_peered":"2023-03-30T08:12:17.008176+0000","last_unstale":"2023-03-30T08:12:18.080005+0000","last_undegraded":"2023-03-30T08:12:18.080005+0000","last_fullsized":"2023-03-30T08:12:18.080005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:26:05.797669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976815+0000","last_change":"2023-03-30T08:12:16.546886+0000","last_active":"2023-03-30T08:12:17.976815+0000","last_peered":"2023-03-30T08:12:17.976815+0000","last_clean":"2023-03-30T08:12:17.976815+0000","last_became_active":"2023-03-30T08:12:16.546636+0000","last_became_peered":"2023-03-30T08:12:16.546636+0000","last_unstale":"2023-03-30T08:12:17.976815+0000","last_undegraded":"2023-03-30T08:12:17.976815+0000","last_fullsized":"2023-03-30T08:12:17.976815+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:45.801853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976838+0000","last_change":"2023-03-30T08:12:17.017294+0000","last_active":"2023-03-30T08:12:17.976838+0000","last_peered":"2023-03-30T08:12:17.976838+0000","last_clean":"2023-03-30T08:12:17.976838+0000","last_became_active":"2023-03-30T08:12:17.017029+0000","last_became_peered":"2023-03-30T08:12:17.017029+0000","last_unstale":"2023-03-30T08:12:17.976838+0000","last_undegraded":"2023-03-30T08:12:17.976838+0000","last_fullsized":"2023-03-30T08:12:17.976838+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:34:17.666643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080822+0000","last_change":"2023-03-30T08:12:16.556777+0000","last_active":"2023-03-30T08:12:18.080822+0000","last_peered":"2023-03-30T08:12:18.080822+0000","last_clean":"2023-03-30T08:12:18.080822+0000","last_became_active":"2023-03-30T08:12:16.556496+0000","last_became_peered":"2023-03-30T08:12:16.556496+0000","last_unstale":"2023-03-30T08:12:18.080822+0000","last_undegraded":"2023-03-30T08:12:18.080822+0000","last_fullsized":"2023-03-30T08:12:18.080822+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:53:00.750269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978100+0000","last_change":"2023-03-30T08:12:17.009878+0000","last_active":"2023-03-30T08:12:17.978100+0000","last_peered":"2023-03-30T08:12:17.978100+0000","last_clean":"2023-03-30T08:12:17.978100+0000","last_became_active":"2023-03-30T08:12:17.009270+0000","last_became_peered":"2023-03-30T08:12:17.009270+0000","last_unstale":"2023-03-30T08:12:17.978100+0000","last_undegraded":"2023-03-30T08:12:17.978100+0000","last_fullsized":"2023-03-30T08:12:17.978100+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:26:44.730508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977623+0000","last_change":"2023-03-30T08:12:16.552161+0000","last_active":"2023-03-30T08:12:17.977623+0000","last_peered":"2023-03-30T08:12:17.977623+0000","last_clean":"2023-03-30T08:12:17.977623+0000","last_became_active":"2023-03-30T08:12:16.551583+0000","last_became_peered":"2023-03-30T08:12:16.551583+0000","last_unstale":"2023-03-30T08:12:17.977623+0000","last_undegraded":"2023-03-30T08:12:17.977623+0000","last_fullsized":"2023-03-30T08:12:17.977623+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:30.770018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079799+0000","last_change":"2023-03-30T08:12:16.997050+0000","last_active":"2023-03-30T08:12:18.079799+0000","last_peered":"2023-03-30T08:12:18.079799+0000","last_clean":"2023-03-30T08:12:18.079799+0000","last_became_active":"2023-03-30T08:12:16.996757+0000","last_became_peered":"2023-03-30T08:12:16.996757+0000","last_unstale":"2023-03-30T08:12:18.079799+0000","last_undegraded":"2023-03-30T08:12:18.079799+0000","last_fullsized":"2023-03-30T08:12:18.079799+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:52.330866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978347+0000","last_change":"2023-03-30T08:12:16.556002+0000","last_active":"2023-03-30T08:12:17.978347+0000","last_peered":"2023-03-30T08:12:17.978347+0000","last_clean":"2023-03-30T08:12:17.978347+0000","last_became_active":"2023-03-30T08:12:16.555592+0000","last_became_peered":"2023-03-30T08:12:16.555592+0000","last_unstale":"2023-03-30T08:12:17.978347+0000","last_undegraded":"2023-03-30T08:12:17.978347+0000","last_fullsized":"2023-03-30T08:12:17.978347+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:13:46.653017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.078975+0000","last_change":"2023-03-30T08:12:17.003057+0000","last_active":"2023-03-30T08:12:18.078975+0000","last_peered":"2023-03-30T08:12:18.078975+0000","last_clean":"2023-03-30T08:12:18.078975+0000","last_became_active":"2023-03-30T08:12:17.002219+0000","last_became_peered":"2023-03-30T08:12:17.002219+0000","last_unstale":"2023-03-30T08:12:18.078975+0000","last_undegraded":"2023-03-30T08:12:18.078975+0000","last_fullsized":"2023-03-30T08:12:18.078975+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:49.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079250+0000","last_change":"2023-03-30T08:12:16.558995+0000","last_active":"2023-03-30T08:12:18.079250+0000","last_peered":"2023-03-30T08:12:18.079250+0000","last_clean":"2023-03-30T08:12:18.079250+0000","last_became_active":"2023-03-30T08:12:16.558550+0000","last_became_peered":"2023-03-30T08:12:16.558550+0000","last_unstale":"2023-03-30T08:12:18.079250+0000","last_undegraded":"2023-03-30T08:12:18.079250+0000","last_fullsized":"2023-03-30T08:12:18.079250+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:04:46.786826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082104+0000","last_change":"2023-03-30T08:12:17.004043+0000","last_active":"2023-03-30T08:12:18.082104+0000","last_peered":"2023-03-30T08:12:18.082104+0000","last_clean":"2023-03-30T08:12:18.082104+0000","last_became_active":"2023-03-30T08:12:17.003704+0000","last_became_peered":"2023-03-30T08:12:17.003704+0000","last_unstale":"2023-03-30T08:12:18.082104+0000","last_undegraded":"2023-03-30T08:12:18.082104+0000","last_fullsized":"2023-03-30T08:12:18.082104+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:32:55.752647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079110+0000","last_change":"2023-03-30T08:12:16.555850+0000","last_active":"2023-03-30T08:12:18.079110+0000","last_peered":"2023-03-30T08:12:18.079110+0000","last_clean":"2023-03-30T08:12:18.079110+0000","last_became_active":"2023-03-30T08:12:16.553720+0000","last_became_peered":"2023-03-30T08:12:16.553720+0000","last_unstale":"2023-03-30T08:12:18.079110+0000","last_undegraded":"2023-03-30T08:12:18.079110+0000","last_fullsized":"2023-03-30T08:12:18.079110+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:04:17.503418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978586+0000","last_change":"2023-03-30T08:12:17.010413+0000","last_active":"2023-03-30T08:12:17.978586+0000","last_peered":"2023-03-30T08:12:17.978586+0000","last_clean":"2023-03-30T08:12:17.978586+0000","last_became_active":"2023-03-30T08:12:17.000709+0000","last_became_peered":"2023-03-30T08:12:17.000709+0000","last_unstale":"2023-03-30T08:12:17.978586+0000","last_undegraded":"2023-03-30T08:12:17.978586+0000","last_fullsized":"2023-03-30T08:12:17.978586+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:32:34.013372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978718+0000","last_change":"2023-03-30T08:12:16.550080+0000","last_active":"2023-03-30T08:12:17.978718+0000","last_peered":"2023-03-30T08:12:17.978718+0000","last_clean":"2023-03-30T08:12:17.978718+0000","last_became_active":"2023-03-30T08:12:16.549799+0000","last_became_peered":"2023-03-30T08:12:16.549799+0000","last_unstale":"2023-03-30T08:12:17.978718+0000","last_undegraded":"2023-03-30T08:12:17.978718+0000","last_fullsized":"2023-03-30T08:12:17.978718+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:14:32.503958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.081229+0000","last_change":"2023-03-30T08:12:17.003517+0000","last_active":"2023-03-30T08:12:18.081229+0000","last_peered":"2023-03-30T08:12:18.081229+0000","last_clean":"2023-03-30T08:12:18.081229+0000","last_became_active":"2023-03-30T08:12:17.002700+0000","last_became_peered":"2023-03-30T08:12:17.002700+0000","last_unstale":"2023-03-30T08:12:18.081229+0000","last_undegraded":"2023-03-30T08:12:18.081229+0000","last_fullsized":"2023-03-30T08:12:18.081229+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:08.812485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080114+0000","last_change":"2023-03-30T08:12:16.556210+0000","last_active":"2023-03-30T08:12:18.080114+0000","last_peered":"2023-03-30T08:12:18.080114+0000","last_clean":"2023-03-30T08:12:18.080114+0000","last_became_active":"2023-03-30T08:12:16.555938+0000","last_became_peered":"2023-03-30T08:12:16.555938+0000","last_unstale":"2023-03-30T08:12:18.080114+0000","last_undegraded":"2023-03-30T08:12:18.080114+0000","last_fullsized":"2023-03-30T08:12:18.080114+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:52:39.377489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977444+0000","last_change":"2023-03-30T08:12:17.006945+0000","last_active":"2023-03-30T08:12:17.977444+0000","last_peered":"2023-03-30T08:12:17.977444+0000","last_clean":"2023-03-30T08:12:17.977444+0000","last_became_active":"2023-03-30T08:12:17.006684+0000","last_became_peered":"2023-03-30T08:12:17.006684+0000","last_unstale":"2023-03-30T08:12:17.977444+0000","last_undegraded":"2023-03-30T08:12:17.977444+0000","last_fullsized":"2023-03-30T08:12:17.977444+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:44:10.477398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080887+0000","last_change":"2023-03-30T08:12:16.558102+0000","last_active":"2023-03-30T08:12:18.080887+0000","last_peered":"2023-03-30T08:12:18.080887+0000","last_clean":"2023-03-30T08:12:18.080887+0000","last_became_active":"2023-03-30T08:12:16.557590+0000","last_became_peered":"2023-03-30T08:12:16.557590+0000","last_unstale":"2023-03-30T08:12:18.080887+0000","last_undegraded":"2023-03-30T08:12:18.080887+0000","last_fullsized":"2023-03-30T08:12:18.080887+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:05.560318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080655+0000","last_change":"2023-03-30T08:12:16.984979+0000","last_active":"2023-03-30T08:12:18.080655+0000","last_peered":"2023-03-30T08:12:18.080655+0000","last_clean":"2023-03-30T08:12:18.080655+0000","last_became_active":"2023-03-30T08:12:16.984692+0000","last_became_peered":"2023-03-30T08:12:16.984692+0000","last_unstale":"2023-03-30T08:12:18.080655+0000","last_undegraded":"2023-03-30T08:12:18.080655+0000","last_fullsized":"2023-03-30T08:12:18.080655+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:00:53.087275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080887+0000","last_change":"2023-03-30T08:12:16.555005+0000","last_active":"2023-03-30T08:12:18.080887+0000","last_peered":"2023-03-30T08:12:18.080887+0000","last_clean":"2023-03-30T08:12:18.080887+0000","last_became_active":"2023-03-30T08:12:16.554754+0000","last_became_peered":"2023-03-30T08:12:16.554754+0000","last_unstale":"2023-03-30T08:12:18.080887+0000","last_undegraded":"2023-03-30T08:12:18.080887+0000","last_fullsized":"2023-03-30T08:12:18.080887+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:49:46.311228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082537+0000","last_change":"2023-03-30T08:12:16.999005+0000","last_active":"2023-03-30T08:12:18.082537+0000","last_peered":"2023-03-30T08:12:18.082537+0000","last_clean":"2023-03-30T08:12:18.082537+0000","last_became_active":"2023-03-30T08:12:16.998688+0000","last_became_peered":"2023-03-30T08:12:16.998688+0000","last_unstale":"2023-03-30T08:12:18.082537+0000","last_undegraded":"2023-03-30T08:12:18.082537+0000","last_fullsized":"2023-03-30T08:12:18.082537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:45:00.032812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977777+0000","last_change":"2023-03-30T08:12:16.552318+0000","last_active":"2023-03-30T08:12:17.977777+0000","last_peered":"2023-03-30T08:12:17.977777+0000","last_clean":"2023-03-30T08:12:17.977777+0000","last_became_active":"2023-03-30T08:12:16.551939+0000","last_became_peered":"2023-03-30T08:12:16.551939+0000","last_unstale":"2023-03-30T08:12:17.977777+0000","last_undegraded":"2023-03-30T08:12:17.977777+0000","last_fullsized":"2023-03-30T08:12:17.977777+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:07.799649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079989+0000","last_change":"2023-03-30T08:12:17.004827+0000","last_active":"2023-03-30T08:12:18.079989+0000","last_peered":"2023-03-30T08:12:18.079989+0000","last_clean":"2023-03-30T08:12:18.079989+0000","last_became_active":"2023-03-30T08:12:17.004521+0000","last_became_peered":"2023-03-30T08:12:17.004521+0000","last_unstale":"2023-03-30T08:12:18.079989+0000","last_undegraded":"2023-03-30T08:12:18.079989+0000","last_fullsized":"2023-03-30T08:12:18.079989+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:58:27.165546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080737+0000","last_change":"2023-03-30T08:12:16.551609+0000","last_active":"2023-03-30T08:12:18.080737+0000","last_peered":"2023-03-30T08:12:18.080737+0000","last_clean":"2023-03-30T08:12:18.080737+0000","last_became_active":"2023-03-30T08:12:16.551216+0000","last_became_peered":"2023-03-30T08:12:16.551216+0000","last_unstale":"2023-03-30T08:12:18.080737+0000","last_undegraded":"2023-03-30T08:12:18.080737+0000","last_fullsized":"2023-03-30T08:12:18.080737+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:45.801853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976910+0000","last_change":"2023-03-30T08:12:17.000583+0000","last_active":"2023-03-30T08:12:17.976910+0000","last_peered":"2023-03-30T08:12:17.976910+0000","last_clean":"2023-03-30T08:12:17.976910+0000","last_became_active":"2023-03-30T08:12:17.000340+0000","last_became_peered":"2023-03-30T08:12:17.000340+0000","last_unstale":"2023-03-30T08:12:17.976910+0000","last_undegraded":"2023-03-30T08:12:17.976910+0000","last_fullsized":"2023-03-30T08:12:17.976910+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:52.330866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977347+0000","last_change":"2023-03-30T08:12:16.547541+0000","last_active":"2023-03-30T08:12:17.977347+0000","last_peered":"2023-03-30T08:12:17.977347+0000","last_clean":"2023-03-30T08:12:17.977347+0000","last_became_active":"2023-03-30T08:12:16.547256+0000","last_became_peered":"2023-03-30T08:12:16.547256+0000","last_unstale":"2023-03-30T08:12:17.977347+0000","last_undegraded":"2023-03-30T08:12:17.977347+0000","last_fullsized":"2023-03-30T08:12:17.977347+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:04:46.786826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080672+0000","last_change":"2023-03-30T08:12:17.004589+0000","last_active":"2023-03-30T08:12:18.080672+0000","last_peered":"2023-03-30T08:12:18.080672+0000","last_clean":"2023-03-30T08:12:18.080672+0000","last_became_active":"2023-03-30T08:12:17.004326+0000","last_became_peered":"2023-03-30T08:12:17.004326+0000","last_unstale":"2023-03-30T08:12:18.080672+0000","last_undegraded":"2023-03-30T08:12:18.080672+0000","last_fullsized":"2023-03-30T08:12:18.080672+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:59:29.583333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079207+0000","last_change":"2023-03-30T08:12:16.551553+0000","last_active":"2023-03-30T08:12:18.079207+0000","last_peered":"2023-03-30T08:12:18.079207+0000","last_clean":"2023-03-30T08:12:18.079207+0000","last_became_active":"2023-03-30T08:12:16.550991+0000","last_became_peered":"2023-03-30T08:12:16.550991+0000","last_unstale":"2023-03-30T08:12:18.079207+0000","last_undegraded":"2023-03-30T08:12:18.079207+0000","last_fullsized":"2023-03-30T08:12:18.079207+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:45.801853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080538+0000","last_change":"2023-03-30T08:12:16.995421+0000","last_active":"2023-03-30T08:12:18.080538+0000","last_peered":"2023-03-30T08:12:18.080538+0000","last_clean":"2023-03-30T08:12:18.080538+0000","last_became_active":"2023-03-30T08:12:16.995140+0000","last_became_peered":"2023-03-30T08:12:16.995140+0000","last_unstale":"2023-03-30T08:12:18.080538+0000","last_undegraded":"2023-03-30T08:12:18.080538+0000","last_fullsized":"2023-03-30T08:12:18.080538+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:53:01.763105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080615+0000","last_change":"2023-03-30T08:12:16.560134+0000","last_active":"2023-03-30T08:12:18.080615+0000","last_peered":"2023-03-30T08:12:18.080615+0000","last_clean":"2023-03-30T08:12:18.080615+0000","last_became_active":"2023-03-30T08:12:16.559817+0000","last_became_peered":"2023-03-30T08:12:16.559817+0000","last_unstale":"2023-03-30T08:12:18.080615+0000","last_undegraded":"2023-03-30T08:12:18.080615+0000","last_fullsized":"2023-03-30T08:12:18.080615+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:24:46.330274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080109+0000","last_change":"2023-03-30T08:12:17.007078+0000","last_active":"2023-03-30T08:12:18.080109+0000","last_peered":"2023-03-30T08:12:18.080109+0000","last_clean":"2023-03-30T08:12:18.080109+0000","last_became_active":"2023-03-30T08:12:17.006834+0000","last_became_peered":"2023-03-30T08:12:17.006834+0000","last_unstale":"2023-03-30T08:12:18.080109+0000","last_undegraded":"2023-03-30T08:12:18.080109+0000","last_fullsized":"2023-03-30T08:12:18.080109+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T20:04:39.661536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978769+0000","last_change":"2023-03-30T08:12:16.554723+0000","last_active":"2023-03-30T08:12:17.978769+0000","last_peered":"2023-03-30T08:12:17.978769+0000","last_clean":"2023-03-30T08:12:17.978769+0000","last_became_active":"2023-03-30T08:12:16.554298+0000","last_became_peered":"2023-03-30T08:12:16.554298+0000","last_unstale":"2023-03-30T08:12:17.978769+0000","last_undegraded":"2023-03-30T08:12:17.978769+0000","last_fullsized":"2023-03-30T08:12:17.978769+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:22.712608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082879+0000","last_change":"2023-03-30T08:12:17.012709+0000","last_active":"2023-03-30T08:12:18.082879+0000","last_peered":"2023-03-30T08:12:18.082879+0000","last_clean":"2023-03-30T08:12:18.082879+0000","last_became_active":"2023-03-30T08:12:17.012454+0000","last_became_peered":"2023-03-30T08:12:17.012454+0000","last_unstale":"2023-03-30T08:12:18.082879+0000","last_undegraded":"2023-03-30T08:12:18.082879+0000","last_fullsized":"2023-03-30T08:12:18.082879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:26:09.003526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080211+0000","last_change":"2023-03-30T08:12:16.555215+0000","last_active":"2023-03-30T08:12:18.080211+0000","last_peered":"2023-03-30T08:12:18.080211+0000","last_clean":"2023-03-30T08:12:18.080211+0000","last_became_active":"2023-03-30T08:12:16.554899+0000","last_became_peered":"2023-03-30T08:12:16.554899+0000","last_unstale":"2023-03-30T08:12:18.080211+0000","last_undegraded":"2023-03-30T08:12:18.080211+0000","last_fullsized":"2023-03-30T08:12:18.080211+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:06.227499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082539+0000","last_change":"2023-03-30T08:12:17.017135+0000","last_active":"2023-03-30T08:12:18.082539+0000","last_peered":"2023-03-30T08:12:18.082539+0000","last_clean":"2023-03-30T08:12:18.082539+0000","last_became_active":"2023-03-30T08:12:17.016491+0000","last_became_peered":"2023-03-30T08:12:17.016491+0000","last_unstale":"2023-03-30T08:12:18.082539+0000","last_undegraded":"2023-03-30T08:12:18.082539+0000","last_fullsized":"2023-03-30T08:12:18.082539+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:09:09.014943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977546+0000","last_change":"2023-03-30T08:12:16.548116+0000","last_active":"2023-03-30T08:12:17.977546+0000","last_peered":"2023-03-30T08:12:17.977546+0000","last_clean":"2023-03-30T08:12:17.977546+0000","last_became_active":"2023-03-30T08:12:16.547717+0000","last_became_peered":"2023-03-30T08:12:16.547717+0000","last_unstale":"2023-03-30T08:12:17.977546+0000","last_undegraded":"2023-03-30T08:12:17.977546+0000","last_fullsized":"2023-03-30T08:12:17.977546+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:23.831326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977373+0000","last_change":"2023-03-30T08:12:17.006005+0000","last_active":"2023-03-30T08:12:17.977373+0000","last_peered":"2023-03-30T08:12:17.977373+0000","last_clean":"2023-03-30T08:12:17.977373+0000","last_became_active":"2023-03-30T08:12:17.005629+0000","last_became_peered":"2023-03-30T08:12:17.005629+0000","last_unstale":"2023-03-30T08:12:17.977373+0000","last_undegraded":"2023-03-30T08:12:17.977373+0000","last_fullsized":"2023-03-30T08:12:17.977373+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T20:04:39.661536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977916+0000","last_change":"2023-03-30T08:12:16.552860+0000","last_active":"2023-03-30T08:12:17.977916+0000","last_peered":"2023-03-30T08:12:17.977916+0000","last_clean":"2023-03-30T08:12:17.977916+0000","last_became_active":"2023-03-30T08:12:16.552601+0000","last_became_peered":"2023-03-30T08:12:16.552601+0000","last_unstale":"2023-03-30T08:12:17.977916+0000","last_undegraded":"2023-03-30T08:12:17.977916+0000","last_fullsized":"2023-03-30T08:12:17.977916+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:34:16.653807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976467+0000","last_change":"2023-03-30T08:12:16.999806+0000","last_active":"2023-03-30T08:12:17.976467+0000","last_peered":"2023-03-30T08:12:17.976467+0000","last_clean":"2023-03-30T08:12:17.976467+0000","last_became_active":"2023-03-30T08:12:16.999536+0000","last_became_peered":"2023-03-30T08:12:16.999536+0000","last_unstale":"2023-03-30T08:12:17.976467+0000","last_undegraded":"2023-03-30T08:12:17.976467+0000","last_fullsized":"2023-03-30T08:12:17.976467+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:24.844161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079421+0000","last_change":"2023-03-30T08:12:16.553800+0000","last_active":"2023-03-30T08:12:18.079421+0000","last_peered":"2023-03-30T08:12:18.079421+0000","last_clean":"2023-03-30T08:12:18.079421+0000","last_became_active":"2023-03-30T08:12:16.553477+0000","last_became_peered":"2023-03-30T08:12:16.553477+0000","last_unstale":"2023-03-30T08:12:18.079421+0000","last_undegraded":"2023-03-30T08:12:18.079421+0000","last_fullsized":"2023-03-30T08:12:18.079421+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:23.831326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080580+0000","last_change":"2023-03-30T08:12:16.982961+0000","last_active":"2023-03-30T08:12:18.080580+0000","last_peered":"2023-03-30T08:12:18.080580+0000","last_clean":"2023-03-30T08:12:18.080580+0000","last_became_active":"2023-03-30T08:12:16.982681+0000","last_became_peered":"2023-03-30T08:12:16.982681+0000","last_unstale":"2023-03-30T08:12:18.080580+0000","last_undegraded":"2023-03-30T08:12:18.080580+0000","last_fullsized":"2023-03-30T08:12:18.080580+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:46.814689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079644+0000","last_change":"2023-03-30T08:12:16.552411+0000","last_active":"2023-03-30T08:12:18.079644+0000","last_peered":"2023-03-30T08:12:18.079644+0000","last_clean":"2023-03-30T08:12:18.079644+0000","last_became_active":"2023-03-30T08:12:16.551535+0000","last_became_peered":"2023-03-30T08:12:16.551535+0000","last_unstale":"2023-03-30T08:12:18.079644+0000","last_undegraded":"2023-03-30T08:12:18.079644+0000","last_fullsized":"2023-03-30T08:12:18.079644+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:05.560318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079475+0000","last_change":"2023-03-30T08:12:16.986695+0000","last_active":"2023-03-30T08:12:18.079475+0000","last_peered":"2023-03-30T08:12:18.079475+0000","last_clean":"2023-03-30T08:12:18.079475+0000","last_became_active":"2023-03-30T08:12:16.986439+0000","last_became_peered":"2023-03-30T08:12:16.986439+0000","last_unstale":"2023-03-30T08:12:18.079475+0000","last_undegraded":"2023-03-30T08:12:18.079475+0000","last_fullsized":"2023-03-30T08:12:18.079475+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:31.782854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080937+0000","last_change":"2023-03-30T08:12:16.552751+0000","last_active":"2023-03-30T08:12:18.080937+0000","last_peered":"2023-03-30T08:12:18.080937+0000","last_clean":"2023-03-30T08:12:18.080937+0000","last_became_active":"2023-03-30T08:12:16.552461+0000","last_became_peered":"2023-03-30T08:12:16.552461+0000","last_unstale":"2023-03-30T08:12:18.080937+0000","last_undegraded":"2023-03-30T08:12:18.080937+0000","last_fullsized":"2023-03-30T08:12:18.080937+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:53:32.695129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977601+0000","last_change":"2023-03-30T08:12:17.005810+0000","last_active":"2023-03-30T08:12:17.977601+0000","last_peered":"2023-03-30T08:12:17.977601+0000","last_clean":"2023-03-30T08:12:17.977601+0000","last_became_active":"2023-03-30T08:12:17.005266+0000","last_became_peered":"2023-03-30T08:12:17.005266+0000","last_unstale":"2023-03-30T08:12:17.977601+0000","last_undegraded":"2023-03-30T08:12:17.977601+0000","last_fullsized":"2023-03-30T08:12:17.977601+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:56:06.563816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.081399+0000","last_change":"2023-03-30T08:12:16.560203+0000","last_active":"2023-03-30T08:12:18.081399+0000","last_peered":"2023-03-30T08:12:18.081399+0000","last_clean":"2023-03-30T08:12:18.081399+0000","last_became_active":"2023-03-30T08:12:16.559904+0000","last_became_peered":"2023-03-30T08:12:16.559904+0000","last_unstale":"2023-03-30T08:12:18.081399+0000","last_undegraded":"2023-03-30T08:12:18.081399+0000","last_fullsized":"2023-03-30T08:12:18.081399+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:05:16.423557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.995126+0000","last_change":"2023-03-30T08:10:52.871133+0000","last_active":"2023-03-30T08:12:16.995126+0000","last_peered":"2023-03-30T08:12:16.995126+0000","last_clean":"2023-03-30T08:12:16.995126+0000","last_became_active":"2023-03-30T08:10:52.870678+0000","last_became_peered":"2023-03-30T08:10:52.870678+0000","last_unstale":"2023-03-30T08:12:16.995126+0000","last_undegraded":"2023-03-30T08:12:16.995126+0000","last_fullsized":"2023-03-30T08:12:16.995126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:51.162618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977475+0000","last_change":"2023-03-30T08:12:17.006743+0000","last_active":"2023-03-30T08:12:17.977475+0000","last_peered":"2023-03-30T08:12:17.977475+0000","last_clean":"2023-03-30T08:12:17.977475+0000","last_became_active":"2023-03-30T08:12:17.006424+0000","last_became_peered":"2023-03-30T08:12:17.006424+0000","last_unstale":"2023-03-30T08:12:17.977475+0000","last_undegraded":"2023-03-30T08:12:17.977475+0000","last_fullsized":"2023-03-30T08:12:17.977475+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:49.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978347+0000","last_change":"2023-03-30T08:12:16.559057+0000","last_active":"2023-03-30T08:12:17.978347+0000","last_peered":"2023-03-30T08:12:17.978347+0000","last_clean":"2023-03-30T08:12:17.978347+0000","last_became_active":"2023-03-30T08:12:16.558798+0000","last_became_peered":"2023-03-30T08:12:16.558798+0000","last_unstale":"2023-03-30T08:12:17.978347+0000","last_undegraded":"2023-03-30T08:12:17.978347+0000","last_fullsized":"2023-03-30T08:12:17.978347+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:04:47.794257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.973188+0000","last_change":"2023-03-30T08:10:52.871548+0000","last_active":"2023-03-30T08:12:16.973188+0000","last_peered":"2023-03-30T08:12:16.973188+0000","last_clean":"2023-03-30T08:12:16.973188+0000","last_became_active":"2023-03-30T08:10:52.871152+0000","last_became_peered":"2023-03-30T08:10:52.871152+0000","last_unstale":"2023-03-30T08:12:16.973188+0000","last_undegraded":"2023-03-30T08:12:16.973188+0000","last_fullsized":"2023-03-30T08:12:16.973188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079157+0000","last_change":"2023-03-30T08:12:16.994330+0000","last_active":"2023-03-30T08:12:18.079157+0000","last_peered":"2023-03-30T08:12:18.079157+0000","last_clean":"2023-03-30T08:12:18.079157+0000","last_became_active":"2023-03-30T08:12:16.994062+0000","last_became_peered":"2023-03-30T08:12:16.994062+0000","last_unstale":"2023-03-30T08:12:18.079157+0000","last_undegraded":"2023-03-30T08:12:18.079157+0000","last_fullsized":"2023-03-30T08:12:18.079157+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:04:29.223577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976601+0000","last_change":"2023-03-30T08:12:16.547995+0000","last_active":"2023-03-30T08:12:17.976601+0000","last_peered":"2023-03-30T08:12:17.976601+0000","last_clean":"2023-03-30T08:12:17.976601+0000","last_became_active":"2023-03-30T08:12:16.547723+0000","last_became_peered":"2023-03-30T08:12:16.547723+0000","last_unstale":"2023-03-30T08:12:17.976601+0000","last_undegraded":"2023-03-30T08:12:17.976601+0000","last_fullsized":"2023-03-30T08:12:17.976601+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:11:32.761870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.978187+0000","last_change":"2023-03-30T08:10:52.921525+0000","last_active":"2023-03-30T08:12:16.978187+0000","last_peered":"2023-03-30T08:12:16.978187+0000","last_clean":"2023-03-30T08:12:16.978187+0000","last_became_active":"2023-03-30T08:10:52.920885+0000","last_became_peered":"2023-03-30T08:10:52.920885+0000","last_unstale":"2023-03-30T08:12:16.978187+0000","last_undegraded":"2023-03-30T08:12:16.978187+0000","last_fullsized":"2023-03-30T08:12:16.978187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:38:27.041880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978096+0000","last_change":"2023-03-30T08:12:17.006956+0000","last_active":"2023-03-30T08:12:17.978096+0000","last_peered":"2023-03-30T08:12:17.978096+0000","last_clean":"2023-03-30T08:12:17.978096+0000","last_became_active":"2023-03-30T08:12:17.006648+0000","last_became_peered":"2023-03-30T08:12:17.006648+0000","last_unstale":"2023-03-30T08:12:17.978096+0000","last_undegraded":"2023-03-30T08:12:17.978096+0000","last_fullsized":"2023-03-30T08:12:17.978096+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:00:33.917851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079338+0000","last_change":"2023-03-30T08:12:16.549604+0000","last_active":"2023-03-30T08:12:18.079338+0000","last_peered":"2023-03-30T08:12:18.079338+0000","last_clean":"2023-03-30T08:12:18.079338+0000","last_became_active":"2023-03-30T08:12:16.549318+0000","last_became_peered":"2023-03-30T08:12:16.549318+0000","last_unstale":"2023-03-30T08:12:18.079338+0000","last_undegraded":"2023-03-30T08:12:18.079338+0000","last_fullsized":"2023-03-30T08:12:18.079338+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:05:16.423557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.972700+0000","last_change":"2023-03-30T08:10:52.921563+0000","last_active":"2023-03-30T08:12:16.972700+0000","last_peered":"2023-03-30T08:12:16.972700+0000","last_clean":"2023-03-30T08:12:16.972700+0000","last_became_active":"2023-03-30T08:10:52.921234+0000","last_became_peered":"2023-03-30T08:10:52.921234+0000","last_unstale":"2023-03-30T08:12:16.972700+0000","last_undegraded":"2023-03-30T08:12:16.972700+0000","last_fullsized":"2023-03-30T08:12:16.972700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082783+0000","last_change":"2023-03-30T08:12:17.017163+0000","last_active":"2023-03-30T08:12:18.082783+0000","last_peered":"2023-03-30T08:12:18.082783+0000","last_clean":"2023-03-30T08:12:18.082783+0000","last_became_active":"2023-03-30T08:12:17.016231+0000","last_became_peered":"2023-03-30T08:12:17.016231+0000","last_unstale":"2023-03-30T08:12:18.082783+0000","last_undegraded":"2023-03-30T08:12:18.082783+0000","last_fullsized":"2023-03-30T08:12:18.082783+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:24:17.298639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.657150+0000","last_change":"2023-03-30T08:12:16.548759+0000","last_active":"2023-03-30T08:12:18.657150+0000","last_peered":"2023-03-30T08:12:18.657150+0000","last_clean":"2023-03-30T08:12:18.657150+0000","last_became_active":"2023-03-30T08:12:16.548522+0000","last_became_peered":"2023-03-30T08:12:16.548522+0000","last_unstale":"2023-03-30T08:12:18.657150+0000","last_undegraded":"2023-03-30T08:12:18.657150+0000","last_fullsized":"2023-03-30T08:12:18.657150+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:53.899438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.983880+0000","last_change":"2023-03-30T08:10:52.866272+0000","last_active":"2023-03-30T08:12:16.983880+0000","last_peered":"2023-03-30T08:12:16.983880+0000","last_clean":"2023-03-30T08:12:16.983880+0000","last_became_active":"2023-03-30T08:10:52.865919+0000","last_became_peered":"2023-03-30T08:10:52.865919+0000","last_unstale":"2023-03-30T08:12:16.983880+0000","last_undegraded":"2023-03-30T08:12:16.983880+0000","last_fullsized":"2023-03-30T08:12:16.983880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079319+0000","last_change":"2023-03-30T08:12:16.988070+0000","last_active":"2023-03-30T08:12:18.079319+0000","last_peered":"2023-03-30T08:12:18.079319+0000","last_clean":"2023-03-30T08:12:18.079319+0000","last_became_active":"2023-03-30T08:12:16.987820+0000","last_became_peered":"2023-03-30T08:12:16.987820+0000","last_unstale":"2023-03-30T08:12:18.079319+0000","last_undegraded":"2023-03-30T08:12:18.079319+0000","last_fullsized":"2023-03-30T08:12:18.079319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:44:10.477398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080967+0000","last_change":"2023-03-30T08:12:16.558215+0000","last_active":"2023-03-30T08:12:18.080967+0000","last_peered":"2023-03-30T08:12:18.080967+0000","last_clean":"2023-03-30T08:12:18.080967+0000","last_became_active":"2023-03-30T08:12:16.557938+0000","last_became_peered":"2023-03-30T08:12:16.557938+0000","last_unstale":"2023-03-30T08:12:18.080967+0000","last_undegraded":"2023-03-30T08:12:18.080967+0000","last_fullsized":"2023-03-30T08:12:18.080967+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:11:32.761870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.977269+0000","last_change":"2023-03-30T08:10:52.920796+0000","last_active":"2023-03-30T08:12:16.977269+0000","last_peered":"2023-03-30T08:12:16.977269+0000","last_clean":"2023-03-30T08:12:16.977269+0000","last_became_active":"2023-03-30T08:10:52.920327+0000","last_became_peered":"2023-03-30T08:10:52.920327+0000","last_unstale":"2023-03-30T08:12:16.977269+0000","last_undegraded":"2023-03-30T08:12:16.977269+0000","last_fullsized":"2023-03-30T08:12:16.977269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:17.416386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080801+0000","last_change":"2023-03-30T08:12:16.997115+0000","last_active":"2023-03-30T08:12:18.080801+0000","last_peered":"2023-03-30T08:12:18.080801+0000","last_clean":"2023-03-30T08:12:18.080801+0000","last_became_active":"2023-03-30T08:12:16.996842+0000","last_became_peered":"2023-03-30T08:12:16.996842+0000","last_unstale":"2023-03-30T08:12:18.080801+0000","last_undegraded":"2023-03-30T08:12:18.080801+0000","last_fullsized":"2023-03-30T08:12:18.080801+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:54.912274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976310+0000","last_change":"2023-03-30T08:12:16.548581+0000","last_active":"2023-03-30T08:12:17.976310+0000","last_peered":"2023-03-30T08:12:17.976310+0000","last_clean":"2023-03-30T08:12:17.976310+0000","last_became_active":"2023-03-30T08:12:16.548264+0000","last_became_peered":"2023-03-30T08:12:16.548264+0000","last_unstale":"2023-03-30T08:12:17.976310+0000","last_undegraded":"2023-03-30T08:12:17.976310+0000","last_fullsized":"2023-03-30T08:12:17.976310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:53:00.750269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.976809+0000","last_change":"2023-03-30T08:10:52.866412+0000","last_active":"2023-03-30T08:12:16.976809+0000","last_peered":"2023-03-30T08:12:16.976809+0000","last_clean":"2023-03-30T08:12:16.976809+0000","last_became_active":"2023-03-30T08:10:52.866055+0000","last_became_peered":"2023-03-30T08:10:52.866055+0000","last_unstale":"2023-03-30T08:12:16.976809+0000","last_undegraded":"2023-03-30T08:12:16.976809+0000","last_fullsized":"2023-03-30T08:12:16.976809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:39.045010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080009+0000","last_change":"2023-03-30T08:12:17.004094+0000","last_active":"2023-03-30T08:12:18.080009+0000","last_peered":"2023-03-30T08:12:18.080009+0000","last_clean":"2023-03-30T08:12:18.080009+0000","last_became_active":"2023-03-30T08:12:17.003834+0000","last_became_peered":"2023-03-30T08:12:17.003834+0000","last_unstale":"2023-03-30T08:12:18.080009+0000","last_undegraded":"2023-03-30T08:12:18.080009+0000","last_fullsized":"2023-03-30T08:12:18.080009+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:51:00.535247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.081006+0000","last_change":"2023-03-30T08:12:16.546137+0000","last_active":"2023-03-30T08:12:18.081006+0000","last_peered":"2023-03-30T08:12:18.081006+0000","last_clean":"2023-03-30T08:12:18.081006+0000","last_became_active":"2023-03-30T08:12:16.545844+0000","last_became_peered":"2023-03-30T08:12:16.545844+0000","last_unstale":"2023-03-30T08:12:18.081006+0000","last_undegraded":"2023-03-30T08:12:18.081006+0000","last_fullsized":"2023-03-30T08:12:18.081006+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:30.770018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.985121+0000","last_change":"2023-03-30T08:10:52.868170+0000","last_active":"2023-03-30T08:12:16.985121+0000","last_peered":"2023-03-30T08:12:16.985121+0000","last_clean":"2023-03-30T08:12:16.985121+0000","last_became_active":"2023-03-30T08:10:52.867790+0000","last_became_peered":"2023-03-30T08:10:52.867790+0000","last_unstale":"2023-03-30T08:12:16.985121+0000","last_undegraded":"2023-03-30T08:12:16.985121+0000","last_fullsized":"2023-03-30T08:12:16.985121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.977024+0000","last_change":"2023-03-30T08:10:45.713084+0000","last_active":"2023-03-30T08:12:16.977024+0000","last_peered":"2023-03-30T08:12:16.977024+0000","last_clean":"2023-03-30T08:12:16.977024+0000","last_became_active":"2023-03-30T08:10:45.711645+0000","last_became_peered":"2023-03-30T08:10:45.711645+0000","last_unstale":"2023-03-30T08:12:16.977024+0000","last_undegraded":"2023-03-30T08:12:16.977024+0000","last_fullsized":"2023-03-30T08:12:16.977024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_clean_scrub_stamp":"2023-03-30T08:10:44.620691+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:58:12.738262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2366,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8692,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363148,"statfs":{"total":96636764160,"available":96627863552,"internally_reserved":0,"allocated":503808,"data_stored":222389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":1.1830000000000001}]},{"osd":2,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.056},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.274},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.1559999999999999}]},{"osd":4,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.2490000000000001}]},{"osd":5,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.421}]},{"osd":7,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.3089999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9844,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361996,"statfs":{"total":96636764160,"available":96626683904,"internally_reserved":0,"allocated":1093632,"data_stored":812175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.2170000000000001}]},{"osd":1,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.2709999999999999}]},{"osd":2,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.94099999999999995}]},{"osd":4,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.522}]},{"osd":5,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.3839999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":1.2,"5min":1.2,"15min":1.2},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.5860000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8688,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363152,"statfs":{"total":96636764160,"available":96627867648,"internally_reserved":0,"allocated":499712,"data_stored":221787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.012}]},{"osd":1,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.536},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.333}]},{"osd":2,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.302},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.1120000000000001}]},{"osd":3,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.4650000000000001}]},{"osd":4,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.133},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.2769999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.4950000000000001}]},{"osd":7,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":1.077,"5min":1.077,"15min":1.077},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.373},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.403}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8824,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363016,"statfs":{"total":96636764160,"available":96627728384,"internally_reserved":0,"allocated":507904,"data_stored":223281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.121}]},{"osd":1,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.627},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.2989999999999999}]},{"osd":2,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.573},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.98699999999999999}]},{"osd":3,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":1.667},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.3839999999999999}]},{"osd":5,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4119999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.345},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.8330000000000002,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.754}]},{"osd":6,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.6459999999999999,"5min":2.6459999999999999,"15min":2.6459999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":2.0129999999999999}]},{"osd":7,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":3.2599999999999998,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.413}]}]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8696,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363144,"statfs":{"total":96636764160,"available":96627859456,"internally_reserved":0,"allocated":507904,"data_stored":222359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.97199999999999998}]},{"osd":2,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0740000000000001}]},{"osd":4,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.127},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.355}]},{"osd":6,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.518},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":1.133,"5min":1.133,"15min":1.133},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.367}]},{"osd":7,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.454},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.3280000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8572,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363268,"statfs":{"total":96636764160,"available":96627986432,"internally_reserved":0,"allocated":512000,"data_stored":223303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.075},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.01}]},{"osd":1,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.3720000000000001}]},{"osd":3,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.5089999999999999}]},{"osd":4,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.655},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.411}]},{"osd":5,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.492,"5min":2.492,"15min":2.492},"last":1.5429999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":2.4390000000000001,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.3460000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8752,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363088,"statfs":{"total":96636764160,"available":96627802112,"internally_reserved":0,"allocated":499712,"data_stored":221787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.071}]},{"osd":2,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.137}]},{"osd":3,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.169}]},{"osd":4,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.9159999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.0389999999999999}]},{"osd":5,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.2549999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":3.6309999999999998,"5min":3.6309999999999998,"15min":3.6309999999999998},"last":1.109}]},{"osd":6,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.345},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.2330000000000001}]},{"osd":7,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.611},{"interface":"front","average":{"1min":1.45,"5min":1.45,"15min":1.45},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.2789999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9840,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362000,"statfs":{"total":96636764160,"available":96626688000,"internally_reserved":0,"allocated":1089536,"data_stored":810780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":1.2310000000000001}]},{"osd":2,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.081},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":1.1919999999999999}]},{"osd":4,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":1.417},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.494}]},{"osd":5,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.339},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.53}]},{"osd":6,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.5329999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.4390000000000001}]},{"osd":7,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.5980000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-30T08:12:22.138 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-03-30T08:12:22.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.339+0000 7fb4156eb700 1 Processor -- start 2023-03-30T08:12:22.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.339+0000 7fb4156eb700 1 -- start start 2023-03-30T08:12:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.339+0000 7fb4156eb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb41015a390 0x7fb4100b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:22.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.339+0000 7fb4156eb700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb4100cd590 0x7fb4100b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.339+0000 7fb4156eb700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb4100b20d0 0x7fb41015dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.339+0000 7fb4156eb700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4100b46e0 con 0x7fb4100cd590 2023-03-30T08:12:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.339+0000 7fb4156eb700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4100ca760 con 0x7fb4100b20d0 2023-03-30T08:12:22.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.339+0000 7fb4156eb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4100b2550 con 0x7fb41015a390 2023-03-30T08:12:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4067fc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb4100cd590 0x7fb4100b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4067fc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb4100cd590 0x7fb4100b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39690/0 (socket says 172.21.15.87:39690) 2023-03-30T08:12:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4067fc700 1 -- 172.21.15.87:0/927521287 learned_addr learned my addr 172.21.15.87:0/927521287 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:22.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb40effd700 1 --2- 172.21.15.87:0/927521287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb41015a390 0x7fb4100b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb40ffff700 1 --2- 172.21.15.87:0/927521287 >> v2:172.21.15.115:3300/0 conn(0x7fb4100b20d0 0x7fb41015dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4067fc700 1 -- 172.21.15.87:0/927521287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb41015a390 msgr2=0x7fb4100b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:22.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4067fc700 1 --2- 172.21.15.87:0/927521287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb41015a390 0x7fb4100b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4067fc700 1 -- 172.21.15.87:0/927521287 >> v2:172.21.15.115:3300/0 conn(0x7fb4100b20d0 msgr2=0x7fb41015dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4067fc700 1 --2- 172.21.15.87:0/927521287 >> v2:172.21.15.115:3300/0 conn(0x7fb4100b20d0 0x7fb41015dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4067fc700 1 -- 172.21.15.87:0/927521287 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4100b3430 con 0x7fb4100cd590 2023-03-30T08:12:22.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4067fc700 1 --2- 172.21.15.87:0/927521287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4100cd590 0x7fb4100b1b90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb4100670e0 tx=0x7fb3f8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf32312f33e403c server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb40e7fc700 1 -- 172.21.15.87:0/927521287 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8011830 con 0x7fb4100cd590 2023-03-30T08:12:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb40e7fc700 1 -- 172.21.15.87:0/927521287 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f8011990 con 0x7fb4100cd590 2023-03-30T08:12:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb40e7fc700 1 -- 172.21.15.87:0/927521287 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8011d20 con 0x7fb4100cd590 2023-03-30T08:12:22.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4156eb700 1 -- 172.21.15.87:0/927521287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4100cd590 msgr2=0x7fb4100b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4156eb700 1 --2- 172.21.15.87:0/927521287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4100cd590 0x7fb4100b1b90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb4100670e0 tx=0x7fb3f8009bf0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4156eb700 1 -- 172.21.15.87:0/927521287 shutdown_connections 2023-03-30T08:12:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4156eb700 1 --2- 172.21.15.87:0/927521287 >> v2:172.21.15.115:3300/0 conn(0x7fb4100b20d0 0x7fb41015dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4156eb700 1 --2- 172.21.15.87:0/927521287 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4100cd590 0x7fb4100b1b90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4156eb700 1 --2- 172.21.15.87:0/927521287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb41015a390 0x7fb4100b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4156eb700 1 -- 172.21.15.87:0/927521287 >> 172.21.15.87:0/927521287 conn(0x7fb41006e950 msgr2=0x7fb4100ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4156eb700 1 -- 172.21.15.87:0/927521287 shutdown_connections 2023-03-30T08:12:22.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.343+0000 7fb4156eb700 1 -- 172.21.15.87:0/927521287 wait complete. 2023-03-30T08:12:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.347+0000 7fb4156eb700 1 Processor -- start 2023-03-30T08:12:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.347+0000 7fb4156eb700 1 -- start start 2023-03-30T08:12:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb4156eb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4100b20d0 0x7fb410154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:22.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb4156eb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4100cd590 0x7fb4100ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb4156eb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb41015a390 0x7fb4100ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb4156eb700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4100c8230 con 0x7fb4100b20d0 2023-03-30T08:12:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb4156eb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb410155310 con 0x7fb4100cd590 2023-03-30T08:12:22.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb4156eb700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4101560c0 con 0x7fb41015a390 2023-03-30T08:12:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb40effd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4100b20d0 0x7fb410154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb40effd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4100b20d0 0x7fb410154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39706/0 (socket says 172.21.15.87:39706) 2023-03-30T08:12:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb40effd700 1 -- 172.21.15.87:0/752335812 learned_addr learned my addr 172.21.15.87:0/752335812 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:22.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb4067fc700 1 --2- 172.21.15.87:0/752335812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4100cd590 0x7fb4100ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb40ffff700 1 --2- 172.21.15.87:0/752335812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb41015a390 0x7fb4100ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb40effd700 1 -- 172.21.15.87:0/752335812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb41015a390 msgr2=0x7fb4100ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:22.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb40effd700 1 --2- 172.21.15.87:0/752335812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb41015a390 0x7fb4100ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb40effd700 1 -- 172.21.15.87:0/752335812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4100cd590 msgr2=0x7fb4100ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb40effd700 1 --2- 172.21.15.87:0/752335812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4100cd590 0x7fb4100ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb40effd700 1 -- 172.21.15.87:0/752335812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f8009570 con 0x7fb4100b20d0 2023-03-30T08:12:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb40effd700 1 --2- 172.21.15.87:0/752335812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4100b20d0 0x7fb410154dd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb40000e8a0 tx=0x7fb40000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:22.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb407fff700 1 -- 172.21.15.87:0/752335812 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4000095c0 con 0x7fb4100b20d0 2023-03-30T08:12:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb407fff700 1 -- 172.21.15.87:0/752335812 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40000eea0 con 0x7fb4100b20d0 2023-03-30T08:12:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb407fff700 1 -- 172.21.15.87:0/752335812 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40000ca70 con 0x7fb4100b20d0 2023-03-30T08:12:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb4156eb700 1 -- 172.21.15.87:0/752335812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4100ca970 con 0x7fb4100b20d0 2023-03-30T08:12:22.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb4156eb700 1 -- 172.21.15.87:0/752335812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4100b4400 con 0x7fb4100b20d0 2023-03-30T08:12:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.351+0000 7fb4156eb700 1 -- 172.21.15.87:0/752335812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4100cac50 con 0x7fb4100b20d0 2023-03-30T08:12:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.355+0000 7fb407fff700 1 -- 172.21.15.87:0/752335812 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fb40000cbf0 con 0x7fb4100b20d0 2023-03-30T08:12:22.817 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.355+0000 7fb407fff700 1 --2- 172.21.15.87:0/752335812 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3f00653f0 0x7fb3f00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:22.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.355+0000 7fb407fff700 1 -- 172.21.15.87:0/752335812 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb400082aa0 con 0x7fb4100b20d0 2023-03-30T08:12:22.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.355+0000 7fb4067fc700 1 --2- 172.21.15.87:0/752335812 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3f00653f0 0x7fb3f00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:22.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.359+0000 7fb4067fc700 1 --2- 172.21.15.87:0/752335812 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3f00653f0 0x7fb3f00678a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8000c00 tx=0x7fb3f8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:22.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.363+0000 7fb407fff700 1 -- 172.21.15.87:0/752335812 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fb400053f80 con 0x7fb4100b20d0 2023-03-30T08:12:22.818 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.595+0000 7fb4156eb700 1 -- 172.21.15.87:0/752335812 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb410073ee0 con 0x7fb4100b20d0 2023-03-30T08:12:22.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.595+0000 7fb407fff700 1 -- 172.21.15.87:0/752335812 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1174 (secure 0 0 0) 0x7fb4000594b0 con 0x7fb4100b20d0 2023-03-30T08:12:22.819 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:22.820 INFO:teuthology.orchestra.run.smithi087.stdout:{"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":110,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":43,"num_osds":8,"num_up_osds":8,"osd_up_since":1680163844,"num_in_osds":8,"osd_in_since":1680163835,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592734,"bytes_used":73633792,"bytes_avail":773020479488,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5346}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-03-30T08:11:55.911836+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-03-30T08:12:22.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.595+0000 7fb4156eb700 1 -- 172.21.15.87:0/752335812 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3f00653f0 msgr2=0x7fb3f00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:22.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.595+0000 7fb4156eb700 1 --2- 172.21.15.87:0/752335812 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3f00653f0 0x7fb3f00678a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8000c00 tx=0x7fb3f8008030 comp rx=0 tx=0).stop 2023-03-30T08:12:22.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.595+0000 7fb4156eb700 1 -- 172.21.15.87:0/752335812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4100b20d0 msgr2=0x7fb410154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:22.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.595+0000 7fb4156eb700 1 --2- 172.21.15.87:0/752335812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4100b20d0 0x7fb410154dd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb40000e8a0 tx=0x7fb40000ec60 comp rx=0 tx=0).stop 2023-03-30T08:12:22.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.599+0000 7fb4156eb700 1 -- 172.21.15.87:0/752335812 shutdown_connections 2023-03-30T08:12:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.599+0000 7fb4156eb700 1 --2- 172.21.15.87:0/752335812 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb3f00653f0 0x7fb3f00678a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.599+0000 7fb4156eb700 1 --2- 172.21.15.87:0/752335812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb41015a390 0x7fb4100ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.599+0000 7fb4156eb700 1 --2- 172.21.15.87:0/752335812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb4100cd590 0x7fb4100ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.599+0000 7fb4156eb700 1 --2- 172.21.15.87:0/752335812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4100b20d0 0x7fb410154dd0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.599+0000 7fb4156eb700 1 -- 172.21.15.87:0/752335812 >> 172.21.15.87:0/752335812 conn(0x7fb41006e950 msgr2=0x7fb4100afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:22.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.599+0000 7fb4156eb700 1 -- 172.21.15.87:0/752335812 shutdown_connections 2023-03-30T08:12:22.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.599+0000 7fb4156eb700 1 -- 172.21.15.87:0/752335812 wait complete. 2023-03-30T08:12:22.825 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-03-30T08:12:22.825 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-30T08:12:22.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.983+0000 7f571aa4c700 1 Processor -- start 2023-03-30T08:12:22.985 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.983+0000 7f571aa4c700 1 -- start start 2023-03-30T08:12:22.987 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f571aa4c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f57140d27e0 0x7f57140d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:22.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f571aa4c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5714160ef0 con 0x7f57140b8380 2023-03-30T08:12:22.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f571aa4c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57140cd6a0 con 0x7f571406a3e0 2023-03-30T08:12:22.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5719a4a700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f57140b8380 0x7f5714069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59276/0 (socket says 172.21.15.87:59276) 2023-03-30T08:12:22.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5719a4a700 1 -- 172.21.15.87:0/2961628924 learned_addr learned my addr 172.21.15.87:0/2961628924 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:22.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f571aa4c700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57140cd3a0 con 0x7f57140d27e0 2023-03-30T08:12:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5719249700 1 --2- 172.21.15.87:0/2961628924 >> v2:172.21.15.115:3300/0 conn(0x7f57140d27e0 0x7f57140d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5718a48700 1 -- 172.21.15.87:0/2961628924 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628880716 0 0) 0x7f5714160ef0 con 0x7f57140b8380 2023-03-30T08:12:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5718a48700 1 -- 172.21.15.87:0/2961628924 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57000035d0 con 0x7f57140b8380 2023-03-30T08:12:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5718a48700 1 -- 172.21.15.87:0/2961628924 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1873485511 0 0) 0x7f57000035d0 con 0x7f57140b8380 2023-03-30T08:12:22.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5718a48700 1 -- 172.21.15.87:0/2961628924 >> v2:172.21.15.115:3300/0 conn(0x7f57140d27e0 msgr2=0x7f57140d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:22.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5718a48700 1 --2- 172.21.15.87:0/2961628924 >> v2:172.21.15.115:3300/0 conn(0x7f57140d27e0 0x7f57140d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5718a48700 1 -- 172.21.15.87:0/2961628924 >> v1:172.21.15.115:6789/0 conn(0x7f571406a3e0 legacy=0x7f57140d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:22.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5718a48700 1 -- 172.21.15.87:0/2961628924 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57140cef00 con 0x7f57140b8380 2023-03-30T08:12:22.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5718a48700 1 -- 172.21.15.87:0/2961628924 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f5710001670 con 0x7f57140b8380 2023-03-30T08:12:22.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5718a48700 1 -- 172.21.15.87:0/2961628924 >> v1:172.21.15.87:6789/0 conn(0x7f57140b8380 legacy=0x7f5714069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:22.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5718a48700 1 --2- 172.21.15.87:0/2961628924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5700003a20 0x7f5700003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:22.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5718a48700 1 --2- 172.21.15.87:0/2961628924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5700004870 0x7f5700004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:22.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5718a48700 1 --2- 172.21.15.87:0/2961628924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5700005220 0x7f570000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:22.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5718a48700 1 -- 172.21.15.87:0/2961628924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57140cd3a0 con 0x7f5700003a20 2023-03-30T08:12:22.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5718a48700 1 -- 172.21.15.87:0/2961628924 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570000c0a0 con 0x7f5700004870 2023-03-30T08:12:22.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5718a48700 1 -- 172.21.15.87:0/2961628924 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570000c260 con 0x7f5700005220 2023-03-30T08:12:22.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5719a4a700 1 --2- 172.21.15.87:0/2961628924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5700003a20 0x7f5700003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:22.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f571a24b700 1 --2- 172.21.15.87:0/2961628924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5700005220 0x7f570000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:22.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5719249700 1 --2- 172.21.15.87:0/2961628924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5700004870 0x7f5700004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:22.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5719a4a700 1 -- 172.21.15.87:0/2961628924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5700005220 msgr2=0x7f570000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:22.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5719a4a700 1 --2- 172.21.15.87:0/2961628924 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5700005220 0x7f570000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5719a4a700 1 -- 172.21.15.87:0/2961628924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5700004870 msgr2=0x7f5700004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:22.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5719a4a700 1 --2- 172.21.15.87:0/2961628924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5700004870 0x7f5700004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f5719a4a700 1 -- 172.21.15.87:0/2961628924 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57000035d0 con 0x7f5700003a20 2023-03-30T08:12:22.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.987+0000 7f571a24b700 1 -- 172.21.15.87:0/2961628924 reap_dead start 2023-03-30T08:12:22.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.991+0000 7f5719a4a700 1 --2- 172.21.15.87:0/2961628924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5700003a20 0x7f5700003e30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f571000c2a0 tx=0x7f57000058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebabc59705c72686 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:22.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.991+0000 7f5718a48700 1 -- 172.21.15.87:0/2961628924 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710007c30 con 0x7f5700003a20 2023-03-30T08:12:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.991+0000 7f5718a48700 1 -- 172.21.15.87:0/2961628924 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571000cdc0 con 0x7f5700003a20 2023-03-30T08:12:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.991+0000 7f5718a48700 1 -- 172.21.15.87:0/2961628924 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710005bc0 con 0x7f5700003a20 2023-03-30T08:12:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.991+0000 7f571aa4c700 1 -- 172.21.15.87:0/2961628924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5700003a20 msgr2=0x7f5700003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.991+0000 7f571aa4c700 1 --2- 172.21.15.87:0/2961628924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5700003a20 0x7f5700003e30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f571000c2a0 tx=0x7f57000058a0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.991+0000 7f571aa4c700 1 -- 172.21.15.87:0/2961628924 shutdown_connections 2023-03-30T08:12:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.991+0000 7f571aa4c700 1 --2- 172.21.15.87:0/2961628924 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5700003a20 0x7f5700003e30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.991+0000 7f571aa4c700 1 -- 172.21.15.87:0/2961628924 >> 172.21.15.87:0/2961628924 conn(0x7f57140b53f0 msgr2=0x7f57140cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:22.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.991+0000 7f571aa4c700 1 -- 172.21.15.87:0/2961628924 shutdown_connections 2023-03-30T08:12:22.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.991+0000 7f571aa4c700 1 -- 172.21.15.87:0/2961628924 wait complete. 2023-03-30T08:12:22.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.995+0000 7f571aa4c700 1 Processor -- start 2023-03-30T08:12:22.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.995+0000 7f571aa4c700 1 -- start start 2023-03-30T08:12:22.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.995+0000 7f571aa4c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5700003a20 0x7f57140ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:22.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.995+0000 7f571aa4c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f571414bdb0 0x7f57140a9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:22.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.995+0000 7f571aa4c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57141f2590 0x7f57140b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:22.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.995+0000 7f571aa4c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57141f2100 con 0x7f571414bdb0 2023-03-30T08:12:22.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.995+0000 7f571aa4c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57140a9b60 con 0x7f5700003a20 2023-03-30T08:12:22.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.995+0000 7f571aa4c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57141f1ad0 con 0x7f57141f2590 2023-03-30T08:12:22.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.995+0000 7f5719249700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f571414bdb0 0x7f57140a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:22.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.995+0000 7f5719249700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f571414bdb0 0x7f57140a9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39726/0 (socket says 172.21.15.87:39726) 2023-03-30T08:12:23.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.995+0000 7f5719249700 1 -- 172.21.15.87:0/2162665816 learned_addr learned my addr 172.21.15.87:0/2162665816 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:23.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.995+0000 7f5719a4a700 1 --2- 172.21.15.87:0/2162665816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5700003a20 0x7f57140ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:23.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.999+0000 7f571a24b700 1 --2- 172.21.15.87:0/2162665816 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57141f2590 0x7f57140b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:23.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.999+0000 7f5719249700 1 -- 172.21.15.87:0/2162665816 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57141f2590 msgr2=0x7f57140b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:23.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.999+0000 7f5719249700 1 --2- 172.21.15.87:0/2162665816 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57141f2590 0x7f57140b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:23.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.999+0000 7f5719249700 1 -- 172.21.15.87:0/2162665816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5700003a20 msgr2=0x7f57140ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:23.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.999+0000 7f5719249700 1 --2- 172.21.15.87:0/2162665816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5700003a20 0x7f57140ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:23.001 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.999+0000 7f5719249700 1 -- 172.21.15.87:0/2162665816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57140cf480 con 0x7f571414bdb0 2023-03-30T08:12:23.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.999+0000 7f5719249700 1 --2- 172.21.15.87:0/2162665816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f571414bdb0 0x7f57140a9620 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5704011600 tx=0x7f5704011910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:23.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.999+0000 7f570a7fc700 1 -- 172.21.15.87:0/2162665816 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704004440 con 0x7f571414bdb0 2023-03-30T08:12:23.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.999+0000 7f570a7fc700 1 -- 172.21.15.87:0/2162665816 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57040045a0 con 0x7f571414bdb0 2023-03-30T08:12:23.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.999+0000 7f570a7fc700 1 -- 172.21.15.87:0/2162665816 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57040038c0 con 0x7f571414bdb0 2023-03-30T08:12:23.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.999+0000 7f571aa4c700 1 -- 172.21.15.87:0/2162665816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57140cf1a0 con 0x7f571414bdb0 2023-03-30T08:12:23.002 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.999+0000 7f571aa4c700 1 -- 172.21.15.87:0/2162665816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57140b8750 con 0x7f571414bdb0 2023-03-30T08:12:23.003 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:22.999+0000 7f571aa4c700 1 -- 172.21.15.87:0/2162665816 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5714072cf0 con 0x7f571414bdb0 2023-03-30T08:12:23.003 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.003+0000 7f570a7fc700 1 -- 172.21.15.87:0/2162665816 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f5704003a20 con 0x7f571414bdb0 2023-03-30T08:12:23.005 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.003+0000 7f570a7fc700 1 --2- 172.21.15.87:0/2162665816 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f56f8065420 0x7f56f80678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:23.005 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.003+0000 7f570a7fc700 1 -- 172.21.15.87:0/2162665816 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5704082ca0 con 0x7f571414bdb0 2023-03-30T08:12:23.005 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.003+0000 7f5719a4a700 1 --2- 172.21.15.87:0/2162665816 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f56f8065420 0x7f56f80678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:23.006 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.003+0000 7f5719a4a700 1 --2- 172.21.15.87:0/2162665816 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f56f8065420 0x7f56f80678d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5710000c00 tx=0x7f5710007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:23.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.011+0000 7f570a7fc700 1 -- 172.21.15.87:0/2162665816 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f57040507d0 con 0x7f571414bdb0 2023-03-30T08:12:23.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.179+0000 7f571aa4c700 1 -- 172.21.15.87:0/2162665816 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5714067250 con 0x7f56f8065420 2023-03-30T08:12:23.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.195+0000 7f570a7fc700 1 -- 172.21.15.87:0/2162665816 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308567 (secure 0 0 0) 0x7f5710007c10 con 0x7f56f8065420 2023-03-30T08:12:23.198 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:23.205 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.203+0000 7f571aa4c700 1 -- 172.21.15.87:0/2162665816 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f56f8065420 msgr2=0x7f56f80678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:23.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.203+0000 7f571aa4c700 1 --2- 172.21.15.87:0/2162665816 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f56f8065420 0x7f56f80678d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5710000c00 tx=0x7f5710007000 comp rx=0 tx=0).stop 2023-03-30T08:12:23.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.203+0000 7f571aa4c700 1 -- 172.21.15.87:0/2162665816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f571414bdb0 msgr2=0x7f57140a9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:23.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.203+0000 7f571aa4c700 1 --2- 172.21.15.87:0/2162665816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f571414bdb0 0x7f57140a9620 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5704011600 tx=0x7f5704011910 comp rx=0 tx=0).stop 2023-03-30T08:12:23.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.203+0000 7f571aa4c700 1 -- 172.21.15.87:0/2162665816 shutdown_connections 2023-03-30T08:12:23.206 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.203+0000 7f571aa4c700 1 --2- 172.21.15.87:0/2162665816 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f56f8065420 0x7f56f80678d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.203+0000 7f571aa4c700 1 --2- 172.21.15.87:0/2162665816 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f57141f2590 0x7f57140b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.203+0000 7f571aa4c700 1 --2- 172.21.15.87:0/2162665816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f571414bdb0 0x7f57140a9620 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.203+0000 7f571aa4c700 1 --2- 172.21.15.87:0/2162665816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5700003a20 0x7f57140ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.203+0000 7f571aa4c700 1 -- 172.21.15.87:0/2162665816 >> 172.21.15.87:0/2162665816 conn(0x7f57140b53f0 msgr2=0x7f57140b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.203+0000 7f571aa4c700 1 -- 172.21.15.87:0/2162665816 shutdown_connections 2023-03-30T08:12:23.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:23.203+0000 7f571aa4c700 1 -- 172.21.15.87:0/2162665816 wait complete. 2023-03-30T08:12:23.208 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-03-30T08:12:23.225 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2023-03-30T08:12:21.919589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592734,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71908,"kb_used_data":5092,"kb_used_omap":0,"kb_used_meta":66752,"kb_avail":754902812,"statfs":{"total":773094113280,"available":773020479488,"internally_reserved":0,"allocated":5214208,"data_stored":2957861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68354048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2366,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001707"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080898+0000","last_change":"2023-03-30T08:12:16.986429+0000","last_active":"2023-03-30T08:12:18.080898+0000","last_peered":"2023-03-30T08:12:18.080898+0000","last_clean":"2023-03-30T08:12:18.080898+0000","last_became_active":"2023-03-30T08:12:16.986120+0000","last_became_peered":"2023-03-30T08:12:16.986120+0000","last_unstale":"2023-03-30T08:12:18.080898+0000","last_undegraded":"2023-03-30T08:12:18.080898+0000","last_fullsized":"2023-03-30T08:12:18.080898+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:37:50.533203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080445+0000","last_change":"2023-03-30T08:12:16.998494+0000","last_active":"2023-03-30T08:12:18.080445+0000","last_peered":"2023-03-30T08:12:18.080445+0000","last_clean":"2023-03-30T08:12:18.080445+0000","last_became_active":"2023-03-30T08:12:16.997985+0000","last_became_peered":"2023-03-30T08:12:16.997985+0000","last_unstale":"2023-03-30T08:12:18.080445+0000","last_undegraded":"2023-03-30T08:12:18.080445+0000","last_fullsized":"2023-03-30T08:12:18.080445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:07:57.345732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978517+0000","last_change":"2023-03-30T08:12:17.000935+0000","last_active":"2023-03-30T08:12:17.978517+0000","last_peered":"2023-03-30T08:12:17.978517+0000","last_clean":"2023-03-30T08:12:17.978517+0000","last_became_active":"2023-03-30T08:12:17.000530+0000","last_became_peered":"2023-03-30T08:12:17.000530+0000","last_unstale":"2023-03-30T08:12:17.978517+0000","last_undegraded":"2023-03-30T08:12:17.978517+0000","last_fullsized":"2023-03-30T08:12:17.978517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:21.266889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079294+0000","last_change":"2023-03-30T08:12:17.012729+0000","last_active":"2023-03-30T08:12:18.079294+0000","last_peered":"2023-03-30T08:12:18.079294+0000","last_clean":"2023-03-30T08:12:18.079294+0000","last_became_active":"2023-03-30T08:12:17.012355+0000","last_became_peered":"2023-03-30T08:12:17.012355+0000","last_unstale":"2023-03-30T08:12:18.079294+0000","last_undegraded":"2023-03-30T08:12:18.079294+0000","last_fullsized":"2023-03-30T08:12:18.079294+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:03:25.229617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079562+0000","last_change":"2023-03-30T08:12:16.998654+0000","last_active":"2023-03-30T08:12:18.079562+0000","last_peered":"2023-03-30T08:12:18.079562+0000","last_clean":"2023-03-30T08:12:18.079562+0000","last_became_active":"2023-03-30T08:12:16.998351+0000","last_became_peered":"2023-03-30T08:12:16.998351+0000","last_unstale":"2023-03-30T08:12:18.079562+0000","last_undegraded":"2023-03-30T08:12:18.079562+0000","last_fullsized":"2023-03-30T08:12:18.079562+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:50:18.929971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977159+0000","last_change":"2023-03-30T08:12:17.006222+0000","last_active":"2023-03-30T08:12:17.977159+0000","last_peered":"2023-03-30T08:12:17.977159+0000","last_clean":"2023-03-30T08:12:17.977159+0000","last_became_active":"2023-03-30T08:12:17.005960+0000","last_became_peered":"2023-03-30T08:12:17.005960+0000","last_unstale":"2023-03-30T08:12:17.977159+0000","last_undegraded":"2023-03-30T08:12:17.977159+0000","last_fullsized":"2023-03-30T08:12:17.977159+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:03:25.229617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080488+0000","last_change":"2023-03-30T08:12:16.985347+0000","last_active":"2023-03-30T08:12:18.080488+0000","last_peered":"2023-03-30T08:12:18.080488+0000","last_clean":"2023-03-30T08:12:18.080488+0000","last_became_active":"2023-03-30T08:12:16.985025+0000","last_became_peered":"2023-03-30T08:12:16.985025+0000","last_unstale":"2023-03-30T08:12:18.080488+0000","last_undegraded":"2023-03-30T08:12:18.080488+0000","last_fullsized":"2023-03-30T08:12:18.080488+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:08:49.114790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.078822+0000","last_change":"2023-03-30T08:12:17.004331+0000","last_active":"2023-03-30T08:12:18.078822+0000","last_peered":"2023-03-30T08:12:18.078822+0000","last_clean":"2023-03-30T08:12:18.078822+0000","last_became_active":"2023-03-30T08:12:17.002556+0000","last_became_peered":"2023-03-30T08:12:17.002556+0000","last_unstale":"2023-03-30T08:12:18.078822+0000","last_undegraded":"2023-03-30T08:12:18.078822+0000","last_fullsized":"2023-03-30T08:12:18.078822+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:06:08.985116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079917+0000","last_change":"2023-03-30T08:12:16.993604+0000","last_active":"2023-03-30T08:12:18.079917+0000","last_peered":"2023-03-30T08:12:18.079917+0000","last_clean":"2023-03-30T08:12:18.079917+0000","last_became_active":"2023-03-30T08:12:16.992038+0000","last_became_peered":"2023-03-30T08:12:16.992038+0000","last_unstale":"2023-03-30T08:12:18.079917+0000","last_undegraded":"2023-03-30T08:12:18.079917+0000","last_fullsized":"2023-03-30T08:12:18.079917+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:56:06.563816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079857+0000","last_change":"2023-03-30T08:12:17.012820+0000","last_active":"2023-03-30T08:12:18.079857+0000","last_peered":"2023-03-30T08:12:18.079857+0000","last_clean":"2023-03-30T08:12:18.079857+0000","last_became_active":"2023-03-30T08:12:17.011323+0000","last_became_peered":"2023-03-30T08:12:17.011323+0000","last_unstale":"2023-03-30T08:12:18.079857+0000","last_undegraded":"2023-03-30T08:12:18.079857+0000","last_fullsized":"2023-03-30T08:12:18.079857+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:22:36.863160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079024+0000","last_change":"2023-03-30T08:12:16.994557+0000","last_active":"2023-03-30T08:12:18.079024+0000","last_peered":"2023-03-30T08:12:18.079024+0000","last_clean":"2023-03-30T08:12:18.079024+0000","last_became_active":"2023-03-30T08:12:16.994317+0000","last_became_peered":"2023-03-30T08:12:16.994317+0000","last_unstale":"2023-03-30T08:12:18.079024+0000","last_undegraded":"2023-03-30T08:12:18.079024+0000","last_fullsized":"2023-03-30T08:12:18.079024+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:05:26.244498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079854+0000","last_change":"2023-03-30T08:12:17.006565+0000","last_active":"2023-03-30T08:12:18.079854+0000","last_peered":"2023-03-30T08:12:18.079854+0000","last_clean":"2023-03-30T08:12:18.079854+0000","last_became_active":"2023-03-30T08:12:17.005919+0000","last_became_peered":"2023-03-30T08:12:17.005919+0000","last_unstale":"2023-03-30T08:12:18.079854+0000","last_undegraded":"2023-03-30T08:12:18.079854+0000","last_fullsized":"2023-03-30T08:12:18.079854+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:26.536973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080327+0000","last_change":"2023-03-30T08:12:17.008181+0000","last_active":"2023-03-30T08:12:18.080327+0000","last_peered":"2023-03-30T08:12:18.080327+0000","last_clean":"2023-03-30T08:12:18.080327+0000","last_became_active":"2023-03-30T08:12:17.007629+0000","last_became_peered":"2023-03-30T08:12:17.007629+0000","last_unstale":"2023-03-30T08:12:18.080327+0000","last_undegraded":"2023-03-30T08:12:18.080327+0000","last_fullsized":"2023-03-30T08:12:18.080327+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:04:18.516254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079049+0000","last_change":"2023-03-30T08:12:16.996076+0000","last_active":"2023-03-30T08:12:18.079049+0000","last_peered":"2023-03-30T08:12:18.079049+0000","last_clean":"2023-03-30T08:12:18.079049+0000","last_became_active":"2023-03-30T08:12:16.991971+0000","last_became_peered":"2023-03-30T08:12:16.991971+0000","last_unstale":"2023-03-30T08:12:18.079049+0000","last_undegraded":"2023-03-30T08:12:18.079049+0000","last_fullsized":"2023-03-30T08:12:18.079049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:26:05.797669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977097+0000","last_change":"2023-03-30T08:12:17.011668+0000","last_active":"2023-03-30T08:12:17.977097+0000","last_peered":"2023-03-30T08:12:17.977097+0000","last_clean":"2023-03-30T08:12:17.977097+0000","last_became_active":"2023-03-30T08:12:17.011413+0000","last_became_peered":"2023-03-30T08:12:17.011413+0000","last_unstale":"2023-03-30T08:12:17.977097+0000","last_undegraded":"2023-03-30T08:12:17.977097+0000","last_fullsized":"2023-03-30T08:12:17.977097+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:05:26.244498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082011+0000","last_change":"2023-03-30T08:12:16.998858+0000","last_active":"2023-03-30T08:12:18.082011+0000","last_peered":"2023-03-30T08:12:18.082011+0000","last_clean":"2023-03-30T08:12:18.082011+0000","last_became_active":"2023-03-30T08:12:16.998571+0000","last_became_peered":"2023-03-30T08:12:16.998571+0000","last_unstale":"2023-03-30T08:12:18.082011+0000","last_undegraded":"2023-03-30T08:12:18.082011+0000","last_fullsized":"2023-03-30T08:12:18.082011+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:13:16.134694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978541+0000","last_change":"2023-03-30T08:12:17.002386+0000","last_active":"2023-03-30T08:12:17.978541+0000","last_peered":"2023-03-30T08:12:17.978541+0000","last_clean":"2023-03-30T08:12:17.978541+0000","last_became_active":"2023-03-30T08:12:17.002061+0000","last_became_peered":"2023-03-30T08:12:17.002061+0000","last_unstale":"2023-03-30T08:12:17.978541+0000","last_undegraded":"2023-03-30T08:12:17.978541+0000","last_fullsized":"2023-03-30T08:12:17.978541+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:29:21.647500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978448+0000","last_change":"2023-03-30T08:12:17.010986+0000","last_active":"2023-03-30T08:12:17.978448+0000","last_peered":"2023-03-30T08:12:17.978448+0000","last_clean":"2023-03-30T08:12:17.978448+0000","last_became_active":"2023-03-30T08:12:17.010635+0000","last_became_peered":"2023-03-30T08:12:17.010635+0000","last_unstale":"2023-03-30T08:12:17.978448+0000","last_undegraded":"2023-03-30T08:12:17.978448+0000","last_fullsized":"2023-03-30T08:12:17.978448+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:28:20.680539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082826+0000","last_change":"2023-03-30T08:12:17.017401+0000","last_active":"2023-03-30T08:12:18.082826+0000","last_peered":"2023-03-30T08:12:18.082826+0000","last_clean":"2023-03-30T08:12:18.082826+0000","last_became_active":"2023-03-30T08:12:17.016782+0000","last_became_peered":"2023-03-30T08:12:17.016782+0000","last_unstale":"2023-03-30T08:12:18.082826+0000","last_undegraded":"2023-03-30T08:12:18.082826+0000","last_fullsized":"2023-03-30T08:12:18.082826+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:06:09.492248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080755+0000","last_change":"2023-03-30T08:12:16.996418+0000","last_active":"2023-03-30T08:12:18.080755+0000","last_peered":"2023-03-30T08:12:18.080755+0000","last_clean":"2023-03-30T08:12:18.080755+0000","last_became_active":"2023-03-30T08:12:16.996143+0000","last_became_peered":"2023-03-30T08:12:16.996143+0000","last_unstale":"2023-03-30T08:12:18.080755+0000","last_undegraded":"2023-03-30T08:12:18.080755+0000","last_fullsized":"2023-03-30T08:12:18.080755+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:05:17.436393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977326+0000","last_change":"2023-03-30T08:12:17.014238+0000","last_active":"2023-03-30T08:12:17.977326+0000","last_peered":"2023-03-30T08:12:17.977326+0000","last_clean":"2023-03-30T08:12:17.977326+0000","last_became_active":"2023-03-30T08:12:17.013954+0000","last_became_peered":"2023-03-30T08:12:17.013954+0000","last_unstale":"2023-03-30T08:12:17.977326+0000","last_undegraded":"2023-03-30T08:12:17.977326+0000","last_fullsized":"2023-03-30T08:12:17.977326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:06:08.985116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079157+0000","last_change":"2023-03-30T08:12:17.011959+0000","last_active":"2023-03-30T08:12:18.079157+0000","last_peered":"2023-03-30T08:12:18.079157+0000","last_clean":"2023-03-30T08:12:18.079157+0000","last_became_active":"2023-03-30T08:12:17.011721+0000","last_became_peered":"2023-03-30T08:12:17.011721+0000","last_unstale":"2023-03-30T08:12:18.079157+0000","last_undegraded":"2023-03-30T08:12:18.079157+0000","last_fullsized":"2023-03-30T08:12:18.079157+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:07:57.345732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082334+0000","last_change":"2023-03-30T08:12:17.012004+0000","last_active":"2023-03-30T08:12:18.082334+0000","last_peered":"2023-03-30T08:12:18.082334+0000","last_clean":"2023-03-30T08:12:18.082334+0000","last_became_active":"2023-03-30T08:12:17.011745+0000","last_became_peered":"2023-03-30T08:12:17.011745+0000","last_unstale":"2023-03-30T08:12:18.082334+0000","last_undegraded":"2023-03-30T08:12:18.082334+0000","last_fullsized":"2023-03-30T08:12:18.082334+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:26:25.721563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082008+0000","last_change":"2023-03-30T08:12:17.003716+0000","last_active":"2023-03-30T08:12:18.082008+0000","last_peered":"2023-03-30T08:12:18.082008+0000","last_clean":"2023-03-30T08:12:18.082008+0000","last_became_active":"2023-03-30T08:12:17.003422+0000","last_became_peered":"2023-03-30T08:12:17.003422+0000","last_unstale":"2023-03-30T08:12:18.082008+0000","last_undegraded":"2023-03-30T08:12:18.082008+0000","last_fullsized":"2023-03-30T08:12:18.082008+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:13:22.103589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082466+0000","last_change":"2023-03-30T08:12:17.017132+0000","last_active":"2023-03-30T08:12:18.082466+0000","last_peered":"2023-03-30T08:12:18.082466+0000","last_clean":"2023-03-30T08:12:18.082466+0000","last_became_active":"2023-03-30T08:12:17.016386+0000","last_became_peered":"2023-03-30T08:12:17.016386+0000","last_unstale":"2023-03-30T08:12:18.082466+0000","last_undegraded":"2023-03-30T08:12:18.082466+0000","last_fullsized":"2023-03-30T08:12:18.082466+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:30:36.341938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080530+0000","last_change":"2023-03-30T08:12:17.006434+0000","last_active":"2023-03-30T08:12:18.080530+0000","last_peered":"2023-03-30T08:12:18.080530+0000","last_clean":"2023-03-30T08:12:18.080530+0000","last_became_active":"2023-03-30T08:12:17.006131+0000","last_became_peered":"2023-03-30T08:12:17.006131+0000","last_unstale":"2023-03-30T08:12:18.080530+0000","last_undegraded":"2023-03-30T08:12:18.080530+0000","last_fullsized":"2023-03-30T08:12:18.080530+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:52:40.390325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978731+0000","last_change":"2023-03-30T08:12:17.001686+0000","last_active":"2023-03-30T08:12:17.978731+0000","last_peered":"2023-03-30T08:12:17.978731+0000","last_clean":"2023-03-30T08:12:17.978731+0000","last_became_active":"2023-03-30T08:12:17.001473+0000","last_became_peered":"2023-03-30T08:12:17.001473+0000","last_unstale":"2023-03-30T08:12:17.978731+0000","last_undegraded":"2023-03-30T08:12:17.978731+0000","last_fullsized":"2023-03-30T08:12:17.978731+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:08:24.903894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079935+0000","last_change":"2023-03-30T08:12:17.006386+0000","last_active":"2023-03-30T08:12:18.079935+0000","last_peered":"2023-03-30T08:12:18.079935+0000","last_clean":"2023-03-30T08:12:18.079935+0000","last_became_active":"2023-03-30T08:12:17.005560+0000","last_became_peered":"2023-03-30T08:12:17.005560+0000","last_unstale":"2023-03-30T08:12:18.079935+0000","last_undegraded":"2023-03-30T08:12:18.079935+0000","last_fullsized":"2023-03-30T08:12:18.079935+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:37:48.102205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.083003+0000","last_change":"2023-03-30T08:12:16.995546+0000","last_active":"2023-03-30T08:12:18.083003+0000","last_peered":"2023-03-30T08:12:18.083003+0000","last_clean":"2023-03-30T08:12:18.083003+0000","last_became_active":"2023-03-30T08:12:16.995169+0000","last_became_peered":"2023-03-30T08:12:16.995169+0000","last_unstale":"2023-03-30T08:12:18.083003+0000","last_undegraded":"2023-03-30T08:12:18.083003+0000","last_fullsized":"2023-03-30T08:12:18.083003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:47:13.571528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978099+0000","last_change":"2023-03-30T08:12:17.003532+0000","last_active":"2023-03-30T08:12:17.978099+0000","last_peered":"2023-03-30T08:12:17.978099+0000","last_clean":"2023-03-30T08:12:17.978099+0000","last_became_active":"2023-03-30T08:12:17.003289+0000","last_became_peered":"2023-03-30T08:12:17.003289+0000","last_unstale":"2023-03-30T08:12:17.978099+0000","last_undegraded":"2023-03-30T08:12:17.978099+0000","last_fullsized":"2023-03-30T08:12:17.978099+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:59:28.247995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977239+0000","last_change":"2023-03-30T08:12:17.011340+0000","last_active":"2023-03-30T08:12:17.977239+0000","last_peered":"2023-03-30T08:12:17.977239+0000","last_clean":"2023-03-30T08:12:17.977239+0000","last_became_active":"2023-03-30T08:12:17.011050+0000","last_became_peered":"2023-03-30T08:12:17.011050+0000","last_unstale":"2023-03-30T08:12:17.977239+0000","last_undegraded":"2023-03-30T08:12:17.977239+0000","last_fullsized":"2023-03-30T08:12:17.977239+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:22:36.863160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080661+0000","last_change":"2023-03-30T08:12:16.985572+0000","last_active":"2023-03-30T08:12:18.080661+0000","last_peered":"2023-03-30T08:12:18.080661+0000","last_clean":"2023-03-30T08:12:18.080661+0000","last_became_active":"2023-03-30T08:12:16.985297+0000","last_became_peered":"2023-03-30T08:12:16.985297+0000","last_unstale":"2023-03-30T08:12:18.080661+0000","last_undegraded":"2023-03-30T08:12:18.080661+0000","last_fullsized":"2023-03-30T08:12:18.080661+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:06.573154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976674+0000","last_change":"2023-03-30T08:12:17.008837+0000","last_active":"2023-03-30T08:12:17.976674+0000","last_peered":"2023-03-30T08:12:17.976674+0000","last_clean":"2023-03-30T08:12:17.976674+0000","last_became_active":"2023-03-30T08:12:17.008571+0000","last_became_peered":"2023-03-30T08:12:17.008571+0000","last_unstale":"2023-03-30T08:12:17.976674+0000","last_undegraded":"2023-03-30T08:12:17.976674+0000","last_fullsized":"2023-03-30T08:12:17.976674+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:04:47.799662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978049+0000","last_change":"2023-03-30T08:12:16.548334+0000","last_active":"2023-03-30T08:12:17.978049+0000","last_peered":"2023-03-30T08:12:17.978049+0000","last_clean":"2023-03-30T08:12:17.978049+0000","last_became_active":"2023-03-30T08:12:16.548070+0000","last_became_peered":"2023-03-30T08:12:16.548070+0000","last_unstale":"2023-03-30T08:12:17.978049+0000","last_undegraded":"2023-03-30T08:12:17.978049+0000","last_fullsized":"2023-03-30T08:12:17.978049+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:06.227499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082701+0000","last_change":"2023-03-30T08:12:17.016751+0000","last_active":"2023-03-30T08:12:18.082701+0000","last_peered":"2023-03-30T08:12:18.082701+0000","last_clean":"2023-03-30T08:12:18.082701+0000","last_became_active":"2023-03-30T08:12:17.016023+0000","last_became_peered":"2023-03-30T08:12:17.016023+0000","last_unstale":"2023-03-30T08:12:18.082701+0000","last_undegraded":"2023-03-30T08:12:18.082701+0000","last_fullsized":"2023-03-30T08:12:18.082701+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:02:28.197304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978631+0000","last_change":"2023-03-30T08:12:16.557857+0000","last_active":"2023-03-30T08:12:17.978631+0000","last_peered":"2023-03-30T08:12:17.978631+0000","last_clean":"2023-03-30T08:12:17.978631+0000","last_became_active":"2023-03-30T08:12:16.557576+0000","last_became_peered":"2023-03-30T08:12:16.557576+0000","last_unstale":"2023-03-30T08:12:17.978631+0000","last_undegraded":"2023-03-30T08:12:17.978631+0000","last_fullsized":"2023-03-30T08:12:17.978631+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:01:17.755013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080005+0000","last_change":"2023-03-30T08:12:17.008489+0000","last_active":"2023-03-30T08:12:18.080005+0000","last_peered":"2023-03-30T08:12:18.080005+0000","last_clean":"2023-03-30T08:12:18.080005+0000","last_became_active":"2023-03-30T08:12:17.008176+0000","last_became_peered":"2023-03-30T08:12:17.008176+0000","last_unstale":"2023-03-30T08:12:18.080005+0000","last_undegraded":"2023-03-30T08:12:18.080005+0000","last_fullsized":"2023-03-30T08:12:18.080005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:26:05.797669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976815+0000","last_change":"2023-03-30T08:12:16.546886+0000","last_active":"2023-03-30T08:12:17.976815+0000","last_peered":"2023-03-30T08:12:17.976815+0000","last_clean":"2023-03-30T08:12:17.976815+0000","last_became_active":"2023-03-30T08:12:16.546636+0000","last_became_peered":"2023-03-30T08:12:16.546636+0000","last_unstale":"2023-03-30T08:12:17.976815+0000","last_undegraded":"2023-03-30T08:12:17.976815+0000","last_fullsized":"2023-03-30T08:12:17.976815+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:45.801853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976838+0000","last_change":"2023-03-30T08:12:17.017294+0000","last_active":"2023-03-30T08:12:17.976838+0000","last_peered":"2023-03-30T08:12:17.976838+0000","last_clean":"2023-03-30T08:12:17.976838+0000","last_became_active":"2023-03-30T08:12:17.017029+0000","last_became_peered":"2023-03-30T08:12:17.017029+0000","last_unstale":"2023-03-30T08:12:17.976838+0000","last_undegraded":"2023-03-30T08:12:17.976838+0000","last_fullsized":"2023-03-30T08:12:17.976838+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:34:17.666643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080822+0000","last_change":"2023-03-30T08:12:16.556777+0000","last_active":"2023-03-30T08:12:18.080822+0000","last_peered":"2023-03-30T08:12:18.080822+0000","last_clean":"2023-03-30T08:12:18.080822+0000","last_became_active":"2023-03-30T08:12:16.556496+0000","last_became_peered":"2023-03-30T08:12:16.556496+0000","last_unstale":"2023-03-30T08:12:18.080822+0000","last_undegraded":"2023-03-30T08:12:18.080822+0000","last_fullsized":"2023-03-30T08:12:18.080822+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:53:00.750269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978100+0000","last_change":"2023-03-30T08:12:17.009878+0000","last_active":"2023-03-30T08:12:17.978100+0000","last_peered":"2023-03-30T08:12:17.978100+0000","last_clean":"2023-03-30T08:12:17.978100+0000","last_became_active":"2023-03-30T08:12:17.009270+0000","last_became_peered":"2023-03-30T08:12:17.009270+0000","last_unstale":"2023-03-30T08:12:17.978100+0000","last_undegraded":"2023-03-30T08:12:17.978100+0000","last_fullsized":"2023-03-30T08:12:17.978100+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:26:44.730508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977623+0000","last_change":"2023-03-30T08:12:16.552161+0000","last_active":"2023-03-30T08:12:17.977623+0000","last_peered":"2023-03-30T08:12:17.977623+0000","last_clean":"2023-03-30T08:12:17.977623+0000","last_became_active":"2023-03-30T08:12:16.551583+0000","last_became_peered":"2023-03-30T08:12:16.551583+0000","last_unstale":"2023-03-30T08:12:17.977623+0000","last_undegraded":"2023-03-30T08:12:17.977623+0000","last_fullsized":"2023-03-30T08:12:17.977623+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:30.770018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079799+0000","last_change":"2023-03-30T08:12:16.997050+0000","last_active":"2023-03-30T08:12:18.079799+0000","last_peered":"2023-03-30T08:12:18.079799+0000","last_clean":"2023-03-30T08:12:18.079799+0000","last_became_active":"2023-03-30T08:12:16.996757+0000","last_became_peered":"2023-03-30T08:12:16.996757+0000","last_unstale":"2023-03-30T08:12:18.079799+0000","last_undegraded":"2023-03-30T08:12:18.079799+0000","last_fullsized":"2023-03-30T08:12:18.079799+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:52.330866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978347+0000","last_change":"2023-03-30T08:12:16.556002+0000","last_active":"2023-03-30T08:12:17.978347+0000","last_peered":"2023-03-30T08:12:17.978347+0000","last_clean":"2023-03-30T08:12:17.978347+0000","last_became_active":"2023-03-30T08:12:16.555592+0000","last_became_peered":"2023-03-30T08:12:16.555592+0000","last_unstale":"2023-03-30T08:12:17.978347+0000","last_undegraded":"2023-03-30T08:12:17.978347+0000","last_fullsized":"2023-03-30T08:12:17.978347+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:13:46.653017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.078975+0000","last_change":"2023-03-30T08:12:17.003057+0000","last_active":"2023-03-30T08:12:18.078975+0000","last_peered":"2023-03-30T08:12:18.078975+0000","last_clean":"2023-03-30T08:12:18.078975+0000","last_became_active":"2023-03-30T08:12:17.002219+0000","last_became_peered":"2023-03-30T08:12:17.002219+0000","last_unstale":"2023-03-30T08:12:18.078975+0000","last_undegraded":"2023-03-30T08:12:18.078975+0000","last_fullsized":"2023-03-30T08:12:18.078975+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:49.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079250+0000","last_change":"2023-03-30T08:12:16.558995+0000","last_active":"2023-03-30T08:12:18.079250+0000","last_peered":"2023-03-30T08:12:18.079250+0000","last_clean":"2023-03-30T08:12:18.079250+0000","last_became_active":"2023-03-30T08:12:16.558550+0000","last_became_peered":"2023-03-30T08:12:16.558550+0000","last_unstale":"2023-03-30T08:12:18.079250+0000","last_undegraded":"2023-03-30T08:12:18.079250+0000","last_fullsized":"2023-03-30T08:12:18.079250+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:04:46.786826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082104+0000","last_change":"2023-03-30T08:12:17.004043+0000","last_active":"2023-03-30T08:12:18.082104+0000","last_peered":"2023-03-30T08:12:18.082104+0000","last_clean":"2023-03-30T08:12:18.082104+0000","last_became_active":"2023-03-30T08:12:17.003704+0000","last_became_peered":"2023-03-30T08:12:17.003704+0000","last_unstale":"2023-03-30T08:12:18.082104+0000","last_undegraded":"2023-03-30T08:12:18.082104+0000","last_fullsized":"2023-03-30T08:12:18.082104+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:32:55.752647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079110+0000","last_change":"2023-03-30T08:12:16.555850+0000","last_active":"2023-03-30T08:12:18.079110+0000","last_peered":"2023-03-30T08:12:18.079110+0000","last_clean":"2023-03-30T08:12:18.079110+0000","last_became_active":"2023-03-30T08:12:16.553720+0000","last_became_peered":"2023-03-30T08:12:16.553720+0000","last_unstale":"2023-03-30T08:12:18.079110+0000","last_undegraded":"2023-03-30T08:12:18.079110+0000","last_fullsized":"2023-03-30T08:12:18.079110+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:04:17.503418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978586+0000","last_change":"2023-03-30T08:12:17.010413+0000","last_active":"2023-03-30T08:12:17.978586+0000","last_peered":"2023-03-30T08:12:17.978586+0000","last_clean":"2023-03-30T08:12:17.978586+0000","last_became_active":"2023-03-30T08:12:17.000709+0000","last_became_peered":"2023-03-30T08:12:17.000709+0000","last_unstale":"2023-03-30T08:12:17.978586+0000","last_undegraded":"2023-03-30T08:12:17.978586+0000","last_fullsized":"2023-03-30T08:12:17.978586+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:32:34.013372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978718+0000","last_change":"2023-03-30T08:12:16.550080+0000","last_active":"2023-03-30T08:12:17.978718+0000","last_peered":"2023-03-30T08:12:17.978718+0000","last_clean":"2023-03-30T08:12:17.978718+0000","last_became_active":"2023-03-30T08:12:16.549799+0000","last_became_peered":"2023-03-30T08:12:16.549799+0000","last_unstale":"2023-03-30T08:12:17.978718+0000","last_undegraded":"2023-03-30T08:12:17.978718+0000","last_fullsized":"2023-03-30T08:12:17.978718+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:14:32.503958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.081229+0000","last_change":"2023-03-30T08:12:17.003517+0000","last_active":"2023-03-30T08:12:18.081229+0000","last_peered":"2023-03-30T08:12:18.081229+0000","last_clean":"2023-03-30T08:12:18.081229+0000","last_became_active":"2023-03-30T08:12:17.002700+0000","last_became_peered":"2023-03-30T08:12:17.002700+0000","last_unstale":"2023-03-30T08:12:18.081229+0000","last_undegraded":"2023-03-30T08:12:18.081229+0000","last_fullsized":"2023-03-30T08:12:18.081229+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:08.812485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080114+0000","last_change":"2023-03-30T08:12:16.556210+0000","last_active":"2023-03-30T08:12:18.080114+0000","last_peered":"2023-03-30T08:12:18.080114+0000","last_clean":"2023-03-30T08:12:18.080114+0000","last_became_active":"2023-03-30T08:12:16.555938+0000","last_became_peered":"2023-03-30T08:12:16.555938+0000","last_unstale":"2023-03-30T08:12:18.080114+0000","last_undegraded":"2023-03-30T08:12:18.080114+0000","last_fullsized":"2023-03-30T08:12:18.080114+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:52:39.377489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977444+0000","last_change":"2023-03-30T08:12:17.006945+0000","last_active":"2023-03-30T08:12:17.977444+0000","last_peered":"2023-03-30T08:12:17.977444+0000","last_clean":"2023-03-30T08:12:17.977444+0000","last_became_active":"2023-03-30T08:12:17.006684+0000","last_became_peered":"2023-03-30T08:12:17.006684+0000","last_unstale":"2023-03-30T08:12:17.977444+0000","last_undegraded":"2023-03-30T08:12:17.977444+0000","last_fullsized":"2023-03-30T08:12:17.977444+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:44:10.477398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080887+0000","last_change":"2023-03-30T08:12:16.558102+0000","last_active":"2023-03-30T08:12:18.080887+0000","last_peered":"2023-03-30T08:12:18.080887+0000","last_clean":"2023-03-30T08:12:18.080887+0000","last_became_active":"2023-03-30T08:12:16.557590+0000","last_became_peered":"2023-03-30T08:12:16.557590+0000","last_unstale":"2023-03-30T08:12:18.080887+0000","last_undegraded":"2023-03-30T08:12:18.080887+0000","last_fullsized":"2023-03-30T08:12:18.080887+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:05.560318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080655+0000","last_change":"2023-03-30T08:12:16.984979+0000","last_active":"2023-03-30T08:12:18.080655+0000","last_peered":"2023-03-30T08:12:18.080655+0000","last_clean":"2023-03-30T08:12:18.080655+0000","last_became_active":"2023-03-30T08:12:16.984692+0000","last_became_peered":"2023-03-30T08:12:16.984692+0000","last_unstale":"2023-03-30T08:12:18.080655+0000","last_undegraded":"2023-03-30T08:12:18.080655+0000","last_fullsized":"2023-03-30T08:12:18.080655+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:00:53.087275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080887+0000","last_change":"2023-03-30T08:12:16.555005+0000","last_active":"2023-03-30T08:12:18.080887+0000","last_peered":"2023-03-30T08:12:18.080887+0000","last_clean":"2023-03-30T08:12:18.080887+0000","last_became_active":"2023-03-30T08:12:16.554754+0000","last_became_peered":"2023-03-30T08:12:16.554754+0000","last_unstale":"2023-03-30T08:12:18.080887+0000","last_undegraded":"2023-03-30T08:12:18.080887+0000","last_fullsized":"2023-03-30T08:12:18.080887+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:49:46.311228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082537+0000","last_change":"2023-03-30T08:12:16.999005+0000","last_active":"2023-03-30T08:12:18.082537+0000","last_peered":"2023-03-30T08:12:18.082537+0000","last_clean":"2023-03-30T08:12:18.082537+0000","last_became_active":"2023-03-30T08:12:16.998688+0000","last_became_peered":"2023-03-30T08:12:16.998688+0000","last_unstale":"2023-03-30T08:12:18.082537+0000","last_undegraded":"2023-03-30T08:12:18.082537+0000","last_fullsized":"2023-03-30T08:12:18.082537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:45:00.032812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977777+0000","last_change":"2023-03-30T08:12:16.552318+0000","last_active":"2023-03-30T08:12:17.977777+0000","last_peered":"2023-03-30T08:12:17.977777+0000","last_clean":"2023-03-30T08:12:17.977777+0000","last_became_active":"2023-03-30T08:12:16.551939+0000","last_became_peered":"2023-03-30T08:12:16.551939+0000","last_unstale":"2023-03-30T08:12:17.977777+0000","last_undegraded":"2023-03-30T08:12:17.977777+0000","last_fullsized":"2023-03-30T08:12:17.977777+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:07.799649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079989+0000","last_change":"2023-03-30T08:12:17.004827+0000","last_active":"2023-03-30T08:12:18.079989+0000","last_peered":"2023-03-30T08:12:18.079989+0000","last_clean":"2023-03-30T08:12:18.079989+0000","last_became_active":"2023-03-30T08:12:17.004521+0000","last_became_peered":"2023-03-30T08:12:17.004521+0000","last_unstale":"2023-03-30T08:12:18.079989+0000","last_undegraded":"2023-03-30T08:12:18.079989+0000","last_fullsized":"2023-03-30T08:12:18.079989+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:58:27.165546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080737+0000","last_change":"2023-03-30T08:12:16.551609+0000","last_active":"2023-03-30T08:12:18.080737+0000","last_peered":"2023-03-30T08:12:18.080737+0000","last_clean":"2023-03-30T08:12:18.080737+0000","last_became_active":"2023-03-30T08:12:16.551216+0000","last_became_peered":"2023-03-30T08:12:16.551216+0000","last_unstale":"2023-03-30T08:12:18.080737+0000","last_undegraded":"2023-03-30T08:12:18.080737+0000","last_fullsized":"2023-03-30T08:12:18.080737+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:45.801853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976910+0000","last_change":"2023-03-30T08:12:17.000583+0000","last_active":"2023-03-30T08:12:17.976910+0000","last_peered":"2023-03-30T08:12:17.976910+0000","last_clean":"2023-03-30T08:12:17.976910+0000","last_became_active":"2023-03-30T08:12:17.000340+0000","last_became_peered":"2023-03-30T08:12:17.000340+0000","last_unstale":"2023-03-30T08:12:17.976910+0000","last_undegraded":"2023-03-30T08:12:17.976910+0000","last_fullsized":"2023-03-30T08:12:17.976910+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:52.330866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977347+0000","last_change":"2023-03-30T08:12:16.547541+0000","last_active":"2023-03-30T08:12:17.977347+0000","last_peered":"2023-03-30T08:12:17.977347+0000","last_clean":"2023-03-30T08:12:17.977347+0000","last_became_active":"2023-03-30T08:12:16.547256+0000","last_became_peered":"2023-03-30T08:12:16.547256+0000","last_unstale":"2023-03-30T08:12:17.977347+0000","last_undegraded":"2023-03-30T08:12:17.977347+0000","last_fullsized":"2023-03-30T08:12:17.977347+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:04:46.786826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080672+0000","last_change":"2023-03-30T08:12:17.004589+0000","last_active":"2023-03-30T08:12:18.080672+0000","last_peered":"2023-03-30T08:12:18.080672+0000","last_clean":"2023-03-30T08:12:18.080672+0000","last_became_active":"2023-03-30T08:12:17.004326+0000","last_became_peered":"2023-03-30T08:12:17.004326+0000","last_unstale":"2023-03-30T08:12:18.080672+0000","last_undegraded":"2023-03-30T08:12:18.080672+0000","last_fullsized":"2023-03-30T08:12:18.080672+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:59:29.583333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079207+0000","last_change":"2023-03-30T08:12:16.551553+0000","last_active":"2023-03-30T08:12:18.079207+0000","last_peered":"2023-03-30T08:12:18.079207+0000","last_clean":"2023-03-30T08:12:18.079207+0000","last_became_active":"2023-03-30T08:12:16.550991+0000","last_became_peered":"2023-03-30T08:12:16.550991+0000","last_unstale":"2023-03-30T08:12:18.079207+0000","last_undegraded":"2023-03-30T08:12:18.079207+0000","last_fullsized":"2023-03-30T08:12:18.079207+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:45.801853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080538+0000","last_change":"2023-03-30T08:12:16.995421+0000","last_active":"2023-03-30T08:12:18.080538+0000","last_peered":"2023-03-30T08:12:18.080538+0000","last_clean":"2023-03-30T08:12:18.080538+0000","last_became_active":"2023-03-30T08:12:16.995140+0000","last_became_peered":"2023-03-30T08:12:16.995140+0000","last_unstale":"2023-03-30T08:12:18.080538+0000","last_undegraded":"2023-03-30T08:12:18.080538+0000","last_fullsized":"2023-03-30T08:12:18.080538+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:53:01.763105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080615+0000","last_change":"2023-03-30T08:12:16.560134+0000","last_active":"2023-03-30T08:12:18.080615+0000","last_peered":"2023-03-30T08:12:18.080615+0000","last_clean":"2023-03-30T08:12:18.080615+0000","last_became_active":"2023-03-30T08:12:16.559817+0000","last_became_peered":"2023-03-30T08:12:16.559817+0000","last_unstale":"2023-03-30T08:12:18.080615+0000","last_undegraded":"2023-03-30T08:12:18.080615+0000","last_fullsized":"2023-03-30T08:12:18.080615+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:24:46.330274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080109+0000","last_change":"2023-03-30T08:12:17.007078+0000","last_active":"2023-03-30T08:12:18.080109+0000","last_peered":"2023-03-30T08:12:18.080109+0000","last_clean":"2023-03-30T08:12:18.080109+0000","last_became_active":"2023-03-30T08:12:17.006834+0000","last_became_peered":"2023-03-30T08:12:17.006834+0000","last_unstale":"2023-03-30T08:12:18.080109+0000","last_undegraded":"2023-03-30T08:12:18.080109+0000","last_fullsized":"2023-03-30T08:12:18.080109+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T20:04:39.661536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978769+0000","last_change":"2023-03-30T08:12:16.554723+0000","last_active":"2023-03-30T08:12:17.978769+0000","last_peered":"2023-03-30T08:12:17.978769+0000","last_clean":"2023-03-30T08:12:17.978769+0000","last_became_active":"2023-03-30T08:12:16.554298+0000","last_became_peered":"2023-03-30T08:12:16.554298+0000","last_unstale":"2023-03-30T08:12:17.978769+0000","last_undegraded":"2023-03-30T08:12:17.978769+0000","last_fullsized":"2023-03-30T08:12:17.978769+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:22.712608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082879+0000","last_change":"2023-03-30T08:12:17.012709+0000","last_active":"2023-03-30T08:12:18.082879+0000","last_peered":"2023-03-30T08:12:18.082879+0000","last_clean":"2023-03-30T08:12:18.082879+0000","last_became_active":"2023-03-30T08:12:17.012454+0000","last_became_peered":"2023-03-30T08:12:17.012454+0000","last_unstale":"2023-03-30T08:12:18.082879+0000","last_undegraded":"2023-03-30T08:12:18.082879+0000","last_fullsized":"2023-03-30T08:12:18.082879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:26:09.003526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080211+0000","last_change":"2023-03-30T08:12:16.555215+0000","last_active":"2023-03-30T08:12:18.080211+0000","last_peered":"2023-03-30T08:12:18.080211+0000","last_clean":"2023-03-30T08:12:18.080211+0000","last_became_active":"2023-03-30T08:12:16.554899+0000","last_became_peered":"2023-03-30T08:12:16.554899+0000","last_unstale":"2023-03-30T08:12:18.080211+0000","last_undegraded":"2023-03-30T08:12:18.080211+0000","last_fullsized":"2023-03-30T08:12:18.080211+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:06.227499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082539+0000","last_change":"2023-03-30T08:12:17.017135+0000","last_active":"2023-03-30T08:12:18.082539+0000","last_peered":"2023-03-30T08:12:18.082539+0000","last_clean":"2023-03-30T08:12:18.082539+0000","last_became_active":"2023-03-30T08:12:17.016491+0000","last_became_peered":"2023-03-30T08:12:17.016491+0000","last_unstale":"2023-03-30T08:12:18.082539+0000","last_undegraded":"2023-03-30T08:12:18.082539+0000","last_fullsized":"2023-03-30T08:12:18.082539+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:09:09.014943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977546+0000","last_change":"2023-03-30T08:12:16.548116+0000","last_active":"2023-03-30T08:12:17.977546+0000","last_peered":"2023-03-30T08:12:17.977546+0000","last_clean":"2023-03-30T08:12:17.977546+0000","last_became_active":"2023-03-30T08:12:16.547717+0000","last_became_peered":"2023-03-30T08:12:16.547717+0000","last_unstale":"2023-03-30T08:12:17.977546+0000","last_undegraded":"2023-03-30T08:12:17.977546+0000","last_fullsized":"2023-03-30T08:12:17.977546+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:23.831326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977373+0000","last_change":"2023-03-30T08:12:17.006005+0000","last_active":"2023-03-30T08:12:17.977373+0000","last_peered":"2023-03-30T08:12:17.977373+0000","last_clean":"2023-03-30T08:12:17.977373+0000","last_became_active":"2023-03-30T08:12:17.005629+0000","last_became_peered":"2023-03-30T08:12:17.005629+0000","last_unstale":"2023-03-30T08:12:17.977373+0000","last_undegraded":"2023-03-30T08:12:17.977373+0000","last_fullsized":"2023-03-30T08:12:17.977373+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T20:04:39.661536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977916+0000","last_change":"2023-03-30T08:12:16.552860+0000","last_active":"2023-03-30T08:12:17.977916+0000","last_peered":"2023-03-30T08:12:17.977916+0000","last_clean":"2023-03-30T08:12:17.977916+0000","last_became_active":"2023-03-30T08:12:16.552601+0000","last_became_peered":"2023-03-30T08:12:16.552601+0000","last_unstale":"2023-03-30T08:12:17.977916+0000","last_undegraded":"2023-03-30T08:12:17.977916+0000","last_fullsized":"2023-03-30T08:12:17.977916+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:34:16.653807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976467+0000","last_change":"2023-03-30T08:12:16.999806+0000","last_active":"2023-03-30T08:12:17.976467+0000","last_peered":"2023-03-30T08:12:17.976467+0000","last_clean":"2023-03-30T08:12:17.976467+0000","last_became_active":"2023-03-30T08:12:16.999536+0000","last_became_peered":"2023-03-30T08:12:16.999536+0000","last_unstale":"2023-03-30T08:12:17.976467+0000","last_undegraded":"2023-03-30T08:12:17.976467+0000","last_fullsized":"2023-03-30T08:12:17.976467+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:24.844161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079421+0000","last_change":"2023-03-30T08:12:16.553800+0000","last_active":"2023-03-30T08:12:18.079421+0000","last_peered":"2023-03-30T08:12:18.079421+0000","last_clean":"2023-03-30T08:12:18.079421+0000","last_became_active":"2023-03-30T08:12:16.553477+0000","last_became_peered":"2023-03-30T08:12:16.553477+0000","last_unstale":"2023-03-30T08:12:18.079421+0000","last_undegraded":"2023-03-30T08:12:18.079421+0000","last_fullsized":"2023-03-30T08:12:18.079421+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:23.831326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080580+0000","last_change":"2023-03-30T08:12:16.982961+0000","last_active":"2023-03-30T08:12:18.080580+0000","last_peered":"2023-03-30T08:12:18.080580+0000","last_clean":"2023-03-30T08:12:18.080580+0000","last_became_active":"2023-03-30T08:12:16.982681+0000","last_became_peered":"2023-03-30T08:12:16.982681+0000","last_unstale":"2023-03-30T08:12:18.080580+0000","last_undegraded":"2023-03-30T08:12:18.080580+0000","last_fullsized":"2023-03-30T08:12:18.080580+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:46.814689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079644+0000","last_change":"2023-03-30T08:12:16.552411+0000","last_active":"2023-03-30T08:12:18.079644+0000","last_peered":"2023-03-30T08:12:18.079644+0000","last_clean":"2023-03-30T08:12:18.079644+0000","last_became_active":"2023-03-30T08:12:16.551535+0000","last_became_peered":"2023-03-30T08:12:16.551535+0000","last_unstale":"2023-03-30T08:12:18.079644+0000","last_undegraded":"2023-03-30T08:12:18.079644+0000","last_fullsized":"2023-03-30T08:12:18.079644+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:05.560318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079475+0000","last_change":"2023-03-30T08:12:16.986695+0000","last_active":"2023-03-30T08:12:18.079475+0000","last_peered":"2023-03-30T08:12:18.079475+0000","last_clean":"2023-03-30T08:12:18.079475+0000","last_became_active":"2023-03-30T08:12:16.986439+0000","last_became_peered":"2023-03-30T08:12:16.986439+0000","last_unstale":"2023-03-30T08:12:18.079475+0000","last_undegraded":"2023-03-30T08:12:18.079475+0000","last_fullsized":"2023-03-30T08:12:18.079475+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:31.782854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080937+0000","last_change":"2023-03-30T08:12:16.552751+0000","last_active":"2023-03-30T08:12:18.080937+0000","last_peered":"2023-03-30T08:12:18.080937+0000","last_clean":"2023-03-30T08:12:18.080937+0000","last_became_active":"2023-03-30T08:12:16.552461+0000","last_became_peered":"2023-03-30T08:12:16.552461+0000","last_unstale":"2023-03-30T08:12:18.080937+0000","last_undegraded":"2023-03-30T08:12:18.080937+0000","last_fullsized":"2023-03-30T08:12:18.080937+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:53:32.695129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977601+0000","last_change":"2023-03-30T08:12:17.005810+0000","last_active":"2023-03-30T08:12:17.977601+0000","last_peered":"2023-03-30T08:12:17.977601+0000","last_clean":"2023-03-30T08:12:17.977601+0000","last_became_active":"2023-03-30T08:12:17.005266+0000","last_became_peered":"2023-03-30T08:12:17.005266+0000","last_unstale":"2023-03-30T08:12:17.977601+0000","last_undegraded":"2023-03-30T08:12:17.977601+0000","last_fullsized":"2023-03-30T08:12:17.977601+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:56:06.563816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.081399+0000","last_change":"2023-03-30T08:12:16.560203+0000","last_active":"2023-03-30T08:12:18.081399+0000","last_peered":"2023-03-30T08:12:18.081399+0000","last_clean":"2023-03-30T08:12:18.081399+0000","last_became_active":"2023-03-30T08:12:16.559904+0000","last_became_peered":"2023-03-30T08:12:16.559904+0000","last_unstale":"2023-03-30T08:12:18.081399+0000","last_undegraded":"2023-03-30T08:12:18.081399+0000","last_fullsized":"2023-03-30T08:12:18.081399+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:05:16.423557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.995126+0000","last_change":"2023-03-30T08:10:52.871133+0000","last_active":"2023-03-30T08:12:16.995126+0000","last_peered":"2023-03-30T08:12:16.995126+0000","last_clean":"2023-03-30T08:12:16.995126+0000","last_became_active":"2023-03-30T08:10:52.870678+0000","last_became_peered":"2023-03-30T08:10:52.870678+0000","last_unstale":"2023-03-30T08:12:16.995126+0000","last_undegraded":"2023-03-30T08:12:16.995126+0000","last_fullsized":"2023-03-30T08:12:16.995126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:51.162618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977475+0000","last_change":"2023-03-30T08:12:17.006743+0000","last_active":"2023-03-30T08:12:17.977475+0000","last_peered":"2023-03-30T08:12:17.977475+0000","last_clean":"2023-03-30T08:12:17.977475+0000","last_became_active":"2023-03-30T08:12:17.006424+0000","last_became_peered":"2023-03-30T08:12:17.006424+0000","last_unstale":"2023-03-30T08:12:17.977475+0000","last_undegraded":"2023-03-30T08:12:17.977475+0000","last_fullsized":"2023-03-30T08:12:17.977475+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:49.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978347+0000","last_change":"2023-03-30T08:12:16.559057+0000","last_active":"2023-03-30T08:12:17.978347+0000","last_peered":"2023-03-30T08:12:17.978347+0000","last_clean":"2023-03-30T08:12:17.978347+0000","last_became_active":"2023-03-30T08:12:16.558798+0000","last_became_peered":"2023-03-30T08:12:16.558798+0000","last_unstale":"2023-03-30T08:12:17.978347+0000","last_undegraded":"2023-03-30T08:12:17.978347+0000","last_fullsized":"2023-03-30T08:12:17.978347+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:04:47.794257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.973188+0000","last_change":"2023-03-30T08:10:52.871548+0000","last_active":"2023-03-30T08:12:16.973188+0000","last_peered":"2023-03-30T08:12:16.973188+0000","last_clean":"2023-03-30T08:12:16.973188+0000","last_became_active":"2023-03-30T08:10:52.871152+0000","last_became_peered":"2023-03-30T08:10:52.871152+0000","last_unstale":"2023-03-30T08:12:16.973188+0000","last_undegraded":"2023-03-30T08:12:16.973188+0000","last_fullsized":"2023-03-30T08:12:16.973188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079157+0000","last_change":"2023-03-30T08:12:16.994330+0000","last_active":"2023-03-30T08:12:18.079157+0000","last_peered":"2023-03-30T08:12:18.079157+0000","last_clean":"2023-03-30T08:12:18.079157+0000","last_became_active":"2023-03-30T08:12:16.994062+0000","last_became_peered":"2023-03-30T08:12:16.994062+0000","last_unstale":"2023-03-30T08:12:18.079157+0000","last_undegraded":"2023-03-30T08:12:18.079157+0000","last_fullsized":"2023-03-30T08:12:18.079157+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:04:29.223577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976601+0000","last_change":"2023-03-30T08:12:16.547995+0000","last_active":"2023-03-30T08:12:17.976601+0000","last_peered":"2023-03-30T08:12:17.976601+0000","last_clean":"2023-03-30T08:12:17.976601+0000","last_became_active":"2023-03-30T08:12:16.547723+0000","last_became_peered":"2023-03-30T08:12:16.547723+0000","last_unstale":"2023-03-30T08:12:17.976601+0000","last_undegraded":"2023-03-30T08:12:17.976601+0000","last_fullsized":"2023-03-30T08:12:17.976601+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:11:32.761870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.978187+0000","last_change":"2023-03-30T08:10:52.921525+0000","last_active":"2023-03-30T08:12:16.978187+0000","last_peered":"2023-03-30T08:12:16.978187+0000","last_clean":"2023-03-30T08:12:16.978187+0000","last_became_active":"2023-03-30T08:10:52.920885+0000","last_became_peered":"2023-03-30T08:10:52.920885+0000","last_unstale":"2023-03-30T08:12:16.978187+0000","last_undegraded":"2023-03-30T08:12:16.978187+0000","last_fullsized":"2023-03-30T08:12:16.978187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:38:27.041880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978096+0000","last_change":"2023-03-30T08:12:17.006956+0000","last_active":"2023-03-30T08:12:17.978096+0000","last_peered":"2023-03-30T08:12:17.978096+0000","last_clean":"2023-03-30T08:12:17.978096+0000","last_became_active":"2023-03-30T08:12:17.006648+0000","last_became_peered":"2023-03-30T08:12:17.006648+0000","last_unstale":"2023-03-30T08:12:17.978096+0000","last_undegraded":"2023-03-30T08:12:17.978096+0000","last_fullsized":"2023-03-30T08:12:17.978096+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:00:33.917851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079338+0000","last_change":"2023-03-30T08:12:16.549604+0000","last_active":"2023-03-30T08:12:18.079338+0000","last_peered":"2023-03-30T08:12:18.079338+0000","last_clean":"2023-03-30T08:12:18.079338+0000","last_became_active":"2023-03-30T08:12:16.549318+0000","last_became_peered":"2023-03-30T08:12:16.549318+0000","last_unstale":"2023-03-30T08:12:18.079338+0000","last_undegraded":"2023-03-30T08:12:18.079338+0000","last_fullsized":"2023-03-30T08:12:18.079338+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:05:16.423557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.972700+0000","last_change":"2023-03-30T08:10:52.921563+0000","last_active":"2023-03-30T08:12:16.972700+0000","last_peered":"2023-03-30T08:12:16.972700+0000","last_clean":"2023-03-30T08:12:16.972700+0000","last_became_active":"2023-03-30T08:10:52.921234+0000","last_became_peered":"2023-03-30T08:10:52.921234+0000","last_unstale":"2023-03-30T08:12:16.972700+0000","last_undegraded":"2023-03-30T08:12:16.972700+0000","last_fullsized":"2023-03-30T08:12:16.972700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082783+0000","last_change":"2023-03-30T08:12:17.017163+0000","last_active":"2023-03-30T08:12:18.082783+0000","last_peered":"2023-03-30T08:12:18.082783+0000","last_clean":"2023-03-30T08:12:18.082783+0000","last_became_active":"2023-03-30T08:12:17.016231+0000","last_became_peered":"2023-03-30T08:12:17.016231+0000","last_unstale":"2023-03-30T08:12:18.082783+0000","last_undegraded":"2023-03-30T08:12:18.082783+0000","last_fullsized":"2023-03-30T08:12:18.082783+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:24:17.298639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.657150+0000","last_change":"2023-03-30T08:12:16.548759+0000","last_active":"2023-03-30T08:12:18.657150+0000","last_peered":"2023-03-30T08:12:18.657150+0000","last_clean":"2023-03-30T08:12:18.657150+0000","last_became_active":"2023-03-30T08:12:16.548522+0000","last_became_peered":"2023-03-30T08:12:16.548522+0000","last_unstale":"2023-03-30T08:12:18.657150+0000","last_undegraded":"2023-03-30T08:12:18.657150+0000","last_fullsized":"2023-03-30T08:12:18.657150+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:53.899438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.983880+0000","last_change":"2023-03-30T08:10:52.866272+0000","last_active":"2023-03-30T08:12:16.983880+0000","last_peered":"2023-03-30T08:12:16.983880+0000","last_clean":"2023-03-30T08:12:16.983880+0000","last_became_active":"2023-03-30T08:10:52.865919+0000","last_became_peered":"2023-03-30T08:10:52.865919+0000","last_unstale":"2023-03-30T08:12:16.983880+0000","last_undegraded":"2023-03-30T08:12:16.983880+0000","last_fullsized":"2023-03-30T08:12:16.983880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079319+0000","last_change":"2023-03-30T08:12:16.988070+0000","last_active":"2023-03-30T08:12:18.079319+0000","last_peered":"2023-03-30T08:12:18.079319+0000","last_clean":"2023-03-30T08:12:18.079319+0000","last_became_active":"2023-03-30T08:12:16.987820+0000","last_became_peered":"2023-03-30T08:12:16.987820+0000","last_unstale":"2023-03-30T08:12:18.079319+0000","last_undegraded":"2023-03-30T08:12:18.079319+0000","last_fullsized":"2023-03-30T08:12:18.079319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:44:10.477398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080967+0000","last_change":"2023-03-30T08:12:16.558215+0000","last_active":"2023-03-30T08:12:18.080967+0000","last_peered":"2023-03-30T08:12:18.080967+0000","last_clean":"2023-03-30T08:12:18.080967+0000","last_became_active":"2023-03-30T08:12:16.557938+0000","last_became_peered":"2023-03-30T08:12:16.557938+0000","last_unstale":"2023-03-30T08:12:18.080967+0000","last_undegraded":"2023-03-30T08:12:18.080967+0000","last_fullsized":"2023-03-30T08:12:18.080967+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:11:32.761870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.977269+0000","last_change":"2023-03-30T08:10:52.920796+0000","last_active":"2023-03-30T08:12:16.977269+0000","last_peered":"2023-03-30T08:12:16.977269+0000","last_clean":"2023-03-30T08:12:16.977269+0000","last_became_active":"2023-03-30T08:10:52.920327+0000","last_became_peered":"2023-03-30T08:10:52.920327+0000","last_unstale":"2023-03-30T08:12:16.977269+0000","last_undegraded":"2023-03-30T08:12:16.977269+0000","last_fullsized":"2023-03-30T08:12:16.977269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:17.416386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080801+0000","last_change":"2023-03-30T08:12:16.997115+0000","last_active":"2023-03-30T08:12:18.080801+0000","last_peered":"2023-03-30T08:12:18.080801+0000","last_clean":"2023-03-30T08:12:18.080801+0000","last_became_active":"2023-03-30T08:12:16.996842+0000","last_became_peered":"2023-03-30T08:12:16.996842+0000","last_unstale":"2023-03-30T08:12:18.080801+0000","last_undegraded":"2023-03-30T08:12:18.080801+0000","last_fullsized":"2023-03-30T08:12:18.080801+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:54.912274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976310+0000","last_change":"2023-03-30T08:12:16.548581+0000","last_active":"2023-03-30T08:12:17.976310+0000","last_peered":"2023-03-30T08:12:17.976310+0000","last_clean":"2023-03-30T08:12:17.976310+0000","last_became_active":"2023-03-30T08:12:16.548264+0000","last_became_peered":"2023-03-30T08:12:16.548264+0000","last_unstale":"2023-03-30T08:12:17.976310+0000","last_undegraded":"2023-03-30T08:12:17.976310+0000","last_fullsized":"2023-03-30T08:12:17.976310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:53:00.750269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.976809+0000","last_change":"2023-03-30T08:10:52.866412+0000","last_active":"2023-03-30T08:12:16.976809+0000","last_peered":"2023-03-30T08:12:16.976809+0000","last_clean":"2023-03-30T08:12:16.976809+0000","last_became_active":"2023-03-30T08:10:52.866055+0000","last_became_peered":"2023-03-30T08:10:52.866055+0000","last_unstale":"2023-03-30T08:12:16.976809+0000","last_undegraded":"2023-03-30T08:12:16.976809+0000","last_fullsized":"2023-03-30T08:12:16.976809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:39.045010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080009+0000","last_change":"2023-03-30T08:12:17.004094+0000","last_active":"2023-03-30T08:12:18.080009+0000","last_peered":"2023-03-30T08:12:18.080009+0000","last_clean":"2023-03-30T08:12:18.080009+0000","last_became_active":"2023-03-30T08:12:17.003834+0000","last_became_peered":"2023-03-30T08:12:17.003834+0000","last_unstale":"2023-03-30T08:12:18.080009+0000","last_undegraded":"2023-03-30T08:12:18.080009+0000","last_fullsized":"2023-03-30T08:12:18.080009+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:51:00.535247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.081006+0000","last_change":"2023-03-30T08:12:16.546137+0000","last_active":"2023-03-30T08:12:18.081006+0000","last_peered":"2023-03-30T08:12:18.081006+0000","last_clean":"2023-03-30T08:12:18.081006+0000","last_became_active":"2023-03-30T08:12:16.545844+0000","last_became_peered":"2023-03-30T08:12:16.545844+0000","last_unstale":"2023-03-30T08:12:18.081006+0000","last_undegraded":"2023-03-30T08:12:18.081006+0000","last_fullsized":"2023-03-30T08:12:18.081006+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:30.770018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.985121+0000","last_change":"2023-03-30T08:10:52.868170+0000","last_active":"2023-03-30T08:12:16.985121+0000","last_peered":"2023-03-30T08:12:16.985121+0000","last_clean":"2023-03-30T08:12:16.985121+0000","last_became_active":"2023-03-30T08:10:52.867790+0000","last_became_peered":"2023-03-30T08:10:52.867790+0000","last_unstale":"2023-03-30T08:12:16.985121+0000","last_undegraded":"2023-03-30T08:12:16.985121+0000","last_fullsized":"2023-03-30T08:12:16.985121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.977024+0000","last_change":"2023-03-30T08:10:45.713084+0000","last_active":"2023-03-30T08:12:16.977024+0000","last_peered":"2023-03-30T08:12:16.977024+0000","last_clean":"2023-03-30T08:12:16.977024+0000","last_became_active":"2023-03-30T08:10:45.711645+0000","last_became_peered":"2023-03-30T08:10:45.711645+0000","last_unstale":"2023-03-30T08:12:16.977024+0000","last_undegraded":"2023-03-30T08:12:16.977024+0000","last_fullsized":"2023-03-30T08:12:16.977024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_clean_scrub_stamp":"2023-03-30T08:10:44.620691+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:58:12.738262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2366,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8692,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363148,"statfs":{"total":96636764160,"available":96627863552,"internally_reserved":0,"allocated":503808,"data_stored":222389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":1.1830000000000001}]},{"osd":2,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.056},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.274},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.1559999999999999}]},{"osd":4,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.2490000000000001}]},{"osd":5,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.421}]},{"osd":7,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.3089999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9844,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361996,"statfs":{"total":96636764160,"available":96626683904,"internally_reserved":0,"allocated":1093632,"data_stored":812175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.2170000000000001}]},{"osd":1,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.2709999999999999}]},{"osd":2,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.94099999999999995}]},{"osd":4,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.522}]},{"osd":5,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.3839999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":1.2,"5min":1.2,"15min":1.2},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.5860000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8688,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363152,"statfs":{"total":96636764160,"available":96627867648,"internally_reserved":0,"allocated":499712,"data_stored":221787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.012}]},{"osd":1,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.536},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.333}]},{"osd":2,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.302},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.1120000000000001}]},{"osd":3,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.4650000000000001}]},{"osd":4,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.133},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.2769999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.4950000000000001}]},{"osd":7,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":1.077,"5min":1.077,"15min":1.077},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.373},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.403}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8824,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363016,"statfs":{"total":96636764160,"available":96627728384,"internally_reserved":0,"allocated":507904,"data_stored":223281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.121}]},{"osd":1,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.627},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.2989999999999999}]},{"osd":2,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.573},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.98699999999999999}]},{"osd":3,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":1.667},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.3839999999999999}]},{"osd":5,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4119999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.345},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.8330000000000002,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.754}]},{"osd":6,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.6459999999999999,"5min":2.6459999999999999,"15min":2.6459999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":2.0129999999999999}]},{"osd":7,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":3.2599999999999998,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.413}]}]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8696,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363144,"statfs":{"total":96636764160,"available":96627859456,"internally_reserved":0,"allocated":507904,"data_stored":222359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.97199999999999998}]},{"osd":2,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0740000000000001}]},{"osd":4,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.127},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.355}]},{"osd":6,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.518},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":1.133,"5min":1.133,"15min":1.133},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.367}]},{"osd":7,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.454},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.3280000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8572,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363268,"statfs":{"total":96636764160,"available":96627986432,"internally_reserved":0,"allocated":512000,"data_stored":223303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.075},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.01}]},{"osd":1,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.3720000000000001}]},{"osd":3,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.5089999999999999}]},{"osd":4,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.655},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.411}]},{"osd":5,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.492,"5min":2.492,"15min":2.492},"last":1.5429999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":2.4390000000000001,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.3460000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8752,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363088,"statfs":{"total":96636764160,"available":96627802112,"internally_reserved":0,"allocated":499712,"data_stored":221787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.071}]},{"osd":2,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.137}]},{"osd":3,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.169}]},{"osd":4,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.9159999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.0389999999999999}]},{"osd":5,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.2549999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":3.6309999999999998,"5min":3.6309999999999998,"15min":3.6309999999999998},"last":1.109}]},{"osd":6,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.345},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.2330000000000001}]},{"osd":7,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.611},{"interface":"front","average":{"1min":1.45,"5min":1.45,"15min":1.45},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.2789999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9840,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362000,"statfs":{"total":96636764160,"available":96626688000,"internally_reserved":0,"allocated":1089536,"data_stored":810780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":1.2310000000000001}]},{"osd":2,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.081},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":1.1919999999999999}]},{"osd":4,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":1.417},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.494}]},{"osd":5,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.339},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.53}]},{"osd":6,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.5329999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.4390000000000001}]},{"osd":7,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.5980000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-30T08:12:26.232 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-30T08:12:26.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.399+0000 7ffa55812700 1 Processor -- start 2023-03-30T08:12:26.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.399+0000 7ffa55812700 1 -- start start 2023-03-30T08:12:26.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.399+0000 7ffa55812700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa50164190 0x7ffa500c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:26.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.399+0000 7ffa55812700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa50069f00 con 0x7ffa50163dc0 2023-03-30T08:12:26.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.399+0000 7ffa55812700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5006cf70 con 0x7ffa500aea30 2023-03-30T08:12:26.402 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.399+0000 7ffa55812700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5006d810 con 0x7ffa50164190 2023-03-30T08:12:26.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.399+0000 7ffa54810700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ffa50163dc0 0x7ffa500c95c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59292/0 (socket says 172.21.15.87:59292) 2023-03-30T08:12:26.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.399+0000 7ffa54810700 1 -- 172.21.15.87:0/3287106808 learned_addr learned my addr 172.21.15.87:0/3287106808 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:26.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.399+0000 7ffa4ffff700 1 --2- 172.21.15.87:0/3287106808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa50164190 0x7ffa500c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:26.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa4f7fe700 1 -- 172.21.15.87:0/3287106808 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125688375 0 0) 0x7ffa50069f00 con 0x7ffa50163dc0 2023-03-30T08:12:26.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa4f7fe700 1 -- 172.21.15.87:0/3287106808 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa400035d0 con 0x7ffa50163dc0 2023-03-30T08:12:26.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa4f7fe700 1 -- 172.21.15.87:0/3287106808 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980446272 0 0) 0x7ffa5006cf70 con 0x7ffa500aea30 2023-03-30T08:12:26.404 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa4f7fe700 1 -- 172.21.15.87:0/3287106808 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa50069f00 con 0x7ffa500aea30 2023-03-30T08:12:26.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa4ffff700 1 -- 172.21.15.87:0/3287106808 >> v1:172.21.15.115:6789/0 conn(0x7ffa500aea30 legacy=0x7ffa5006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:26.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa4f7fe700 1 -- 172.21.15.87:0/3287106808 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 135951196 0 0) 0x7ffa400035d0 con 0x7ffa50163dc0 2023-03-30T08:12:26.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa4ffff700 1 -- 172.21.15.87:0/3287106808 >> v1:172.21.15.87:6789/0 conn(0x7ffa50163dc0 legacy=0x7ffa500c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:26.405 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa4ffff700 1 -- 172.21.15.87:0/3287106808 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5006d250 con 0x7ffa50164190 2023-03-30T08:12:26.406 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa4ffff700 1 --2- 172.21.15.87:0/3287106808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa50164190 0x7ffa500c9cd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009880 tx=0x7ffa3c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41d9405d34bd7c06 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:26.406 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa4f7fe700 1 -- 172.21.15.87:0/3287106808 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44001670 con 0x7ffa50164190 2023-03-30T08:12:26.406 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa4f7fe700 1 -- 172.21.15.87:0/3287106808 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3c004030 con 0x7ffa50164190 2023-03-30T08:12:26.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa4f7fe700 1 -- 172.21.15.87:0/3287106808 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0043c0 con 0x7ffa50164190 2023-03-30T08:12:26.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa55812700 1 -- 172.21.15.87:0/3287106808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa50164190 msgr2=0x7ffa500c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:26.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa55812700 1 --2- 172.21.15.87:0/3287106808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa50164190 0x7ffa500c9cd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009880 tx=0x7ffa3c009b90 comp rx=0 tx=0).stop 2023-03-30T08:12:26.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa55812700 1 -- 172.21.15.87:0/3287106808 shutdown_connections 2023-03-30T08:12:26.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa55812700 1 --2- 172.21.15.87:0/3287106808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa50164190 0x7ffa500c9cd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:26.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa55812700 1 -- 172.21.15.87:0/3287106808 >> 172.21.15.87:0/3287106808 conn(0x7ffa500cf410 msgr2=0x7ffa500cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:26.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa55812700 1 -- 172.21.15.87:0/3287106808 shutdown_connections 2023-03-30T08:12:26.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.403+0000 7ffa55812700 1 -- 172.21.15.87:0/3287106808 wait complete. 2023-03-30T08:12:26.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.407+0000 7ffa55812700 1 Processor -- start 2023-03-30T08:12:26.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.407+0000 7ffa55812700 1 -- start start 2023-03-30T08:12:26.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.407+0000 7ffa55812700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa500aea30 0x7ffa501595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:26.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.407+0000 7ffa55812700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa50163dc0 0x7ffa500b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:26.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.407+0000 7ffa55812700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa50164190 0x7ffa500b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:26.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.407+0000 7ffa55812700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa50159bc0 con 0x7ffa50164190 2023-03-30T08:12:26.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.407+0000 7ffa55812700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa50159ea0 con 0x7ffa500aea30 2023-03-30T08:12:26.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.407+0000 7ffa55812700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5015a180 con 0x7ffa50163dc0 2023-03-30T08:12:26.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.407+0000 7ffa55011700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa50164190 0x7ffa500b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:26.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.407+0000 7ffa55011700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa50164190 0x7ffa500b0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39728/0 (socket says 172.21.15.87:39728) 2023-03-30T08:12:26.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.407+0000 7ffa55011700 1 -- 172.21.15.87:0/3610056078 learned_addr learned my addr 172.21.15.87:0/3610056078 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:26.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.407+0000 7ffa4ffff700 1 --2- 172.21.15.87:0/3610056078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa50163dc0 0x7ffa500b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:26.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.407+0000 7ffa54810700 1 --2- 172.21.15.87:0/3610056078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa500aea30 0x7ffa501595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:26.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.411+0000 7ffa55011700 1 -- 172.21.15.87:0/3610056078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa50163dc0 msgr2=0x7ffa500b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:26.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.411+0000 7ffa55011700 1 --2- 172.21.15.87:0/3610056078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa50163dc0 0x7ffa500b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:26.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.411+0000 7ffa55011700 1 -- 172.21.15.87:0/3610056078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa500aea30 msgr2=0x7ffa501595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:26.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.411+0000 7ffa55011700 1 --2- 172.21.15.87:0/3610056078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa500aea30 0x7ffa501595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:26.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.411+0000 7ffa55011700 1 -- 172.21.15.87:0/3610056078 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c0094b0 con 0x7ffa50164190 2023-03-30T08:12:26.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.411+0000 7ffa54810700 1 --2- 172.21.15.87:0/3610056078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa500aea30 0x7ffa501595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:26.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.411+0000 7ffa55011700 1 --2- 172.21.15.87:0/3610056078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa50164190 0x7ffa500b0250 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800cb90 tx=0x7ffa4800cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:26.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.411+0000 7ffa4d7fa700 1 -- 172.21.15.87:0/3610056078 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48003c20 con 0x7ffa50164190 2023-03-30T08:12:26.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.411+0000 7ffa4d7fa700 1 -- 172.21.15.87:0/3610056078 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa48003d80 con 0x7ffa50164190 2023-03-30T08:12:26.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.411+0000 7ffa4d7fa700 1 -- 172.21.15.87:0/3610056078 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800ab00 con 0x7ffa50164190 2023-03-30T08:12:26.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.411+0000 7ffa55812700 1 -- 172.21.15.87:0/3610056078 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5006cc40 con 0x7ffa50164190 2023-03-30T08:12:26.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.411+0000 7ffa55812700 1 -- 172.21.15.87:0/3610056078 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5006d530 con 0x7ffa50164190 2023-03-30T08:12:26.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.411+0000 7ffa55812700 1 -- 172.21.15.87:0/3610056078 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa500ca210 con 0x7ffa50164190 2023-03-30T08:12:26.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.415+0000 7ffa4d7fa700 1 -- 172.21.15.87:0/3610056078 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ffa4800ac60 con 0x7ffa50164190 2023-03-30T08:12:26.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.415+0000 7ffa4d7fa700 1 --2- 172.21.15.87:0/3610056078 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffa34065420 0x7ffa340678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:26.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.415+0000 7ffa4d7fa700 1 -- 172.21.15.87:0/3610056078 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ffa48082a20 con 0x7ffa50164190 2023-03-30T08:12:26.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.415+0000 7ffa54810700 1 --2- 172.21.15.87:0/3610056078 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffa34065420 0x7ffa340678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:26.418 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.415+0000 7ffa54810700 1 --2- 172.21.15.87:0/3610056078 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffa34065420 0x7ffa340678d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffa44001860 tx=0x7ffa440016d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:26.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.423+0000 7ffa4d7fa700 1 -- 172.21.15.87:0/3610056078 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7ffa480504c0 con 0x7ffa50164190 2023-03-30T08:12:26.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.591+0000 7ffa55812700 1 -- 172.21.15.87:0/3610056078 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa500733a0 con 0x7ffa34065420 2023-03-30T08:12:26.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.607+0000 7ffa4d7fa700 1 -- 172.21.15.87:0/3610056078 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308545 (secure 0 0 0) 0x7ffa500733a0 con 0x7ffa34065420 2023-03-30T08:12:26.613 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:26.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.615+0000 7ffa55812700 1 -- 172.21.15.87:0/3610056078 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffa34065420 msgr2=0x7ffa340678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:26.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.615+0000 7ffa55812700 1 --2- 172.21.15.87:0/3610056078 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffa34065420 0x7ffa340678d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffa44001860 tx=0x7ffa440016d0 comp rx=0 tx=0).stop 2023-03-30T08:12:26.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.615+0000 7ffa55812700 1 -- 172.21.15.87:0/3610056078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa50164190 msgr2=0x7ffa500b0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:26.617 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.615+0000 7ffa55812700 1 --2- 172.21.15.87:0/3610056078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa50164190 0x7ffa500b0250 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800cb90 tx=0x7ffa4800cea0 comp rx=0 tx=0).stop 2023-03-30T08:12:26.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.615+0000 7ffa55812700 1 -- 172.21.15.87:0/3610056078 shutdown_connections 2023-03-30T08:12:26.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.615+0000 7ffa55812700 1 --2- 172.21.15.87:0/3610056078 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ffa34065420 0x7ffa340678d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:26.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.615+0000 7ffa55812700 1 --2- 172.21.15.87:0/3610056078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa50164190 0x7ffa500b0250 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:26.618 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.615+0000 7ffa55812700 1 --2- 172.21.15.87:0/3610056078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa50163dc0 0x7ffa500b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:26.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.615+0000 7ffa55812700 1 --2- 172.21.15.87:0/3610056078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa500aea30 0x7ffa501595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:26.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.615+0000 7ffa55812700 1 -- 172.21.15.87:0/3610056078 >> 172.21.15.87:0/3610056078 conn(0x7ffa500cf410 msgr2=0x7ffa5015e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:26.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.615+0000 7ffa55812700 1 -- 172.21.15.87:0/3610056078 shutdown_connections 2023-03-30T08:12:26.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.615+0000 7ffa55812700 1 -- 172.21.15.87:0/3610056078 wait complete. 2023-03-30T08:12:26.620 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-03-30T08:12:26.638 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-03-30T08:12:25.920536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592734,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71908,"kb_used_data":5092,"kb_used_omap":0,"kb_used_meta":66752,"kb_avail":754902812,"statfs":{"total":773094113280,"available":773020479488,"internally_reserved":0,"allocated":5214208,"data_stored":2957861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68354048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2366,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.947162"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080898+0000","last_change":"2023-03-30T08:12:16.986429+0000","last_active":"2023-03-30T08:12:18.080898+0000","last_peered":"2023-03-30T08:12:18.080898+0000","last_clean":"2023-03-30T08:12:18.080898+0000","last_became_active":"2023-03-30T08:12:16.986120+0000","last_became_peered":"2023-03-30T08:12:16.986120+0000","last_unstale":"2023-03-30T08:12:18.080898+0000","last_undegraded":"2023-03-30T08:12:18.080898+0000","last_fullsized":"2023-03-30T08:12:18.080898+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:37:50.533203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080445+0000","last_change":"2023-03-30T08:12:16.998494+0000","last_active":"2023-03-30T08:12:18.080445+0000","last_peered":"2023-03-30T08:12:18.080445+0000","last_clean":"2023-03-30T08:12:18.080445+0000","last_became_active":"2023-03-30T08:12:16.997985+0000","last_became_peered":"2023-03-30T08:12:16.997985+0000","last_unstale":"2023-03-30T08:12:18.080445+0000","last_undegraded":"2023-03-30T08:12:18.080445+0000","last_fullsized":"2023-03-30T08:12:18.080445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:07:57.345732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978517+0000","last_change":"2023-03-30T08:12:17.000935+0000","last_active":"2023-03-30T08:12:17.978517+0000","last_peered":"2023-03-30T08:12:17.978517+0000","last_clean":"2023-03-30T08:12:17.978517+0000","last_became_active":"2023-03-30T08:12:17.000530+0000","last_became_peered":"2023-03-30T08:12:17.000530+0000","last_unstale":"2023-03-30T08:12:17.978517+0000","last_undegraded":"2023-03-30T08:12:17.978517+0000","last_fullsized":"2023-03-30T08:12:17.978517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:21.266889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079294+0000","last_change":"2023-03-30T08:12:17.012729+0000","last_active":"2023-03-30T08:12:18.079294+0000","last_peered":"2023-03-30T08:12:18.079294+0000","last_clean":"2023-03-30T08:12:18.079294+0000","last_became_active":"2023-03-30T08:12:17.012355+0000","last_became_peered":"2023-03-30T08:12:17.012355+0000","last_unstale":"2023-03-30T08:12:18.079294+0000","last_undegraded":"2023-03-30T08:12:18.079294+0000","last_fullsized":"2023-03-30T08:12:18.079294+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:03:25.229617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079562+0000","last_change":"2023-03-30T08:12:16.998654+0000","last_active":"2023-03-30T08:12:18.079562+0000","last_peered":"2023-03-30T08:12:18.079562+0000","last_clean":"2023-03-30T08:12:18.079562+0000","last_became_active":"2023-03-30T08:12:16.998351+0000","last_became_peered":"2023-03-30T08:12:16.998351+0000","last_unstale":"2023-03-30T08:12:18.079562+0000","last_undegraded":"2023-03-30T08:12:18.079562+0000","last_fullsized":"2023-03-30T08:12:18.079562+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:50:18.929971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977159+0000","last_change":"2023-03-30T08:12:17.006222+0000","last_active":"2023-03-30T08:12:17.977159+0000","last_peered":"2023-03-30T08:12:17.977159+0000","last_clean":"2023-03-30T08:12:17.977159+0000","last_became_active":"2023-03-30T08:12:17.005960+0000","last_became_peered":"2023-03-30T08:12:17.005960+0000","last_unstale":"2023-03-30T08:12:17.977159+0000","last_undegraded":"2023-03-30T08:12:17.977159+0000","last_fullsized":"2023-03-30T08:12:17.977159+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:03:25.229617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080488+0000","last_change":"2023-03-30T08:12:16.985347+0000","last_active":"2023-03-30T08:12:18.080488+0000","last_peered":"2023-03-30T08:12:18.080488+0000","last_clean":"2023-03-30T08:12:18.080488+0000","last_became_active":"2023-03-30T08:12:16.985025+0000","last_became_peered":"2023-03-30T08:12:16.985025+0000","last_unstale":"2023-03-30T08:12:18.080488+0000","last_undegraded":"2023-03-30T08:12:18.080488+0000","last_fullsized":"2023-03-30T08:12:18.080488+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:08:49.114790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.078822+0000","last_change":"2023-03-30T08:12:17.004331+0000","last_active":"2023-03-30T08:12:18.078822+0000","last_peered":"2023-03-30T08:12:18.078822+0000","last_clean":"2023-03-30T08:12:18.078822+0000","last_became_active":"2023-03-30T08:12:17.002556+0000","last_became_peered":"2023-03-30T08:12:17.002556+0000","last_unstale":"2023-03-30T08:12:18.078822+0000","last_undegraded":"2023-03-30T08:12:18.078822+0000","last_fullsized":"2023-03-30T08:12:18.078822+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:06:08.985116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079917+0000","last_change":"2023-03-30T08:12:16.993604+0000","last_active":"2023-03-30T08:12:18.079917+0000","last_peered":"2023-03-30T08:12:18.079917+0000","last_clean":"2023-03-30T08:12:18.079917+0000","last_became_active":"2023-03-30T08:12:16.992038+0000","last_became_peered":"2023-03-30T08:12:16.992038+0000","last_unstale":"2023-03-30T08:12:18.079917+0000","last_undegraded":"2023-03-30T08:12:18.079917+0000","last_fullsized":"2023-03-30T08:12:18.079917+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:56:06.563816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079857+0000","last_change":"2023-03-30T08:12:17.012820+0000","last_active":"2023-03-30T08:12:18.079857+0000","last_peered":"2023-03-30T08:12:18.079857+0000","last_clean":"2023-03-30T08:12:18.079857+0000","last_became_active":"2023-03-30T08:12:17.011323+0000","last_became_peered":"2023-03-30T08:12:17.011323+0000","last_unstale":"2023-03-30T08:12:18.079857+0000","last_undegraded":"2023-03-30T08:12:18.079857+0000","last_fullsized":"2023-03-30T08:12:18.079857+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:22:36.863160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079024+0000","last_change":"2023-03-30T08:12:16.994557+0000","last_active":"2023-03-30T08:12:18.079024+0000","last_peered":"2023-03-30T08:12:18.079024+0000","last_clean":"2023-03-30T08:12:18.079024+0000","last_became_active":"2023-03-30T08:12:16.994317+0000","last_became_peered":"2023-03-30T08:12:16.994317+0000","last_unstale":"2023-03-30T08:12:18.079024+0000","last_undegraded":"2023-03-30T08:12:18.079024+0000","last_fullsized":"2023-03-30T08:12:18.079024+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:05:26.244498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079854+0000","last_change":"2023-03-30T08:12:17.006565+0000","last_active":"2023-03-30T08:12:18.079854+0000","last_peered":"2023-03-30T08:12:18.079854+0000","last_clean":"2023-03-30T08:12:18.079854+0000","last_became_active":"2023-03-30T08:12:17.005919+0000","last_became_peered":"2023-03-30T08:12:17.005919+0000","last_unstale":"2023-03-30T08:12:18.079854+0000","last_undegraded":"2023-03-30T08:12:18.079854+0000","last_fullsized":"2023-03-30T08:12:18.079854+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:30:26.536973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080327+0000","last_change":"2023-03-30T08:12:17.008181+0000","last_active":"2023-03-30T08:12:18.080327+0000","last_peered":"2023-03-30T08:12:18.080327+0000","last_clean":"2023-03-30T08:12:18.080327+0000","last_became_active":"2023-03-30T08:12:17.007629+0000","last_became_peered":"2023-03-30T08:12:17.007629+0000","last_unstale":"2023-03-30T08:12:18.080327+0000","last_undegraded":"2023-03-30T08:12:18.080327+0000","last_fullsized":"2023-03-30T08:12:18.080327+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:04:18.516254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079049+0000","last_change":"2023-03-30T08:12:16.996076+0000","last_active":"2023-03-30T08:12:18.079049+0000","last_peered":"2023-03-30T08:12:18.079049+0000","last_clean":"2023-03-30T08:12:18.079049+0000","last_became_active":"2023-03-30T08:12:16.991971+0000","last_became_peered":"2023-03-30T08:12:16.991971+0000","last_unstale":"2023-03-30T08:12:18.079049+0000","last_undegraded":"2023-03-30T08:12:18.079049+0000","last_fullsized":"2023-03-30T08:12:18.079049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:26:05.797669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977097+0000","last_change":"2023-03-30T08:12:17.011668+0000","last_active":"2023-03-30T08:12:17.977097+0000","last_peered":"2023-03-30T08:12:17.977097+0000","last_clean":"2023-03-30T08:12:17.977097+0000","last_became_active":"2023-03-30T08:12:17.011413+0000","last_became_peered":"2023-03-30T08:12:17.011413+0000","last_unstale":"2023-03-30T08:12:17.977097+0000","last_undegraded":"2023-03-30T08:12:17.977097+0000","last_fullsized":"2023-03-30T08:12:17.977097+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:05:26.244498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082011+0000","last_change":"2023-03-30T08:12:16.998858+0000","last_active":"2023-03-30T08:12:18.082011+0000","last_peered":"2023-03-30T08:12:18.082011+0000","last_clean":"2023-03-30T08:12:18.082011+0000","last_became_active":"2023-03-30T08:12:16.998571+0000","last_became_peered":"2023-03-30T08:12:16.998571+0000","last_unstale":"2023-03-30T08:12:18.082011+0000","last_undegraded":"2023-03-30T08:12:18.082011+0000","last_fullsized":"2023-03-30T08:12:18.082011+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:13:16.134694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978541+0000","last_change":"2023-03-30T08:12:17.002386+0000","last_active":"2023-03-30T08:12:17.978541+0000","last_peered":"2023-03-30T08:12:17.978541+0000","last_clean":"2023-03-30T08:12:17.978541+0000","last_became_active":"2023-03-30T08:12:17.002061+0000","last_became_peered":"2023-03-30T08:12:17.002061+0000","last_unstale":"2023-03-30T08:12:17.978541+0000","last_undegraded":"2023-03-30T08:12:17.978541+0000","last_fullsized":"2023-03-30T08:12:17.978541+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:29:21.647500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978448+0000","last_change":"2023-03-30T08:12:17.010986+0000","last_active":"2023-03-30T08:12:17.978448+0000","last_peered":"2023-03-30T08:12:17.978448+0000","last_clean":"2023-03-30T08:12:17.978448+0000","last_became_active":"2023-03-30T08:12:17.010635+0000","last_became_peered":"2023-03-30T08:12:17.010635+0000","last_unstale":"2023-03-30T08:12:17.978448+0000","last_undegraded":"2023-03-30T08:12:17.978448+0000","last_fullsized":"2023-03-30T08:12:17.978448+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:28:20.680539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082826+0000","last_change":"2023-03-30T08:12:17.017401+0000","last_active":"2023-03-30T08:12:18.082826+0000","last_peered":"2023-03-30T08:12:18.082826+0000","last_clean":"2023-03-30T08:12:18.082826+0000","last_became_active":"2023-03-30T08:12:17.016782+0000","last_became_peered":"2023-03-30T08:12:17.016782+0000","last_unstale":"2023-03-30T08:12:18.082826+0000","last_undegraded":"2023-03-30T08:12:18.082826+0000","last_fullsized":"2023-03-30T08:12:18.082826+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:06:09.492248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080755+0000","last_change":"2023-03-30T08:12:16.996418+0000","last_active":"2023-03-30T08:12:18.080755+0000","last_peered":"2023-03-30T08:12:18.080755+0000","last_clean":"2023-03-30T08:12:18.080755+0000","last_became_active":"2023-03-30T08:12:16.996143+0000","last_became_peered":"2023-03-30T08:12:16.996143+0000","last_unstale":"2023-03-30T08:12:18.080755+0000","last_undegraded":"2023-03-30T08:12:18.080755+0000","last_fullsized":"2023-03-30T08:12:18.080755+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:05:17.436393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977326+0000","last_change":"2023-03-30T08:12:17.014238+0000","last_active":"2023-03-30T08:12:17.977326+0000","last_peered":"2023-03-30T08:12:17.977326+0000","last_clean":"2023-03-30T08:12:17.977326+0000","last_became_active":"2023-03-30T08:12:17.013954+0000","last_became_peered":"2023-03-30T08:12:17.013954+0000","last_unstale":"2023-03-30T08:12:17.977326+0000","last_undegraded":"2023-03-30T08:12:17.977326+0000","last_fullsized":"2023-03-30T08:12:17.977326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:06:08.985116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079157+0000","last_change":"2023-03-30T08:12:17.011959+0000","last_active":"2023-03-30T08:12:18.079157+0000","last_peered":"2023-03-30T08:12:18.079157+0000","last_clean":"2023-03-30T08:12:18.079157+0000","last_became_active":"2023-03-30T08:12:17.011721+0000","last_became_peered":"2023-03-30T08:12:17.011721+0000","last_unstale":"2023-03-30T08:12:18.079157+0000","last_undegraded":"2023-03-30T08:12:18.079157+0000","last_fullsized":"2023-03-30T08:12:18.079157+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:07:57.345732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082334+0000","last_change":"2023-03-30T08:12:17.012004+0000","last_active":"2023-03-30T08:12:18.082334+0000","last_peered":"2023-03-30T08:12:18.082334+0000","last_clean":"2023-03-30T08:12:18.082334+0000","last_became_active":"2023-03-30T08:12:17.011745+0000","last_became_peered":"2023-03-30T08:12:17.011745+0000","last_unstale":"2023-03-30T08:12:18.082334+0000","last_undegraded":"2023-03-30T08:12:18.082334+0000","last_fullsized":"2023-03-30T08:12:18.082334+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:26:25.721563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082008+0000","last_change":"2023-03-30T08:12:17.003716+0000","last_active":"2023-03-30T08:12:18.082008+0000","last_peered":"2023-03-30T08:12:18.082008+0000","last_clean":"2023-03-30T08:12:18.082008+0000","last_became_active":"2023-03-30T08:12:17.003422+0000","last_became_peered":"2023-03-30T08:12:17.003422+0000","last_unstale":"2023-03-30T08:12:18.082008+0000","last_undegraded":"2023-03-30T08:12:18.082008+0000","last_fullsized":"2023-03-30T08:12:18.082008+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:13:22.103589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082466+0000","last_change":"2023-03-30T08:12:17.017132+0000","last_active":"2023-03-30T08:12:18.082466+0000","last_peered":"2023-03-30T08:12:18.082466+0000","last_clean":"2023-03-30T08:12:18.082466+0000","last_became_active":"2023-03-30T08:12:17.016386+0000","last_became_peered":"2023-03-30T08:12:17.016386+0000","last_unstale":"2023-03-30T08:12:18.082466+0000","last_undegraded":"2023-03-30T08:12:18.082466+0000","last_fullsized":"2023-03-30T08:12:18.082466+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:30:36.341938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080530+0000","last_change":"2023-03-30T08:12:17.006434+0000","last_active":"2023-03-30T08:12:18.080530+0000","last_peered":"2023-03-30T08:12:18.080530+0000","last_clean":"2023-03-30T08:12:18.080530+0000","last_became_active":"2023-03-30T08:12:17.006131+0000","last_became_peered":"2023-03-30T08:12:17.006131+0000","last_unstale":"2023-03-30T08:12:18.080530+0000","last_undegraded":"2023-03-30T08:12:18.080530+0000","last_fullsized":"2023-03-30T08:12:18.080530+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:52:40.390325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978731+0000","last_change":"2023-03-30T08:12:17.001686+0000","last_active":"2023-03-30T08:12:17.978731+0000","last_peered":"2023-03-30T08:12:17.978731+0000","last_clean":"2023-03-30T08:12:17.978731+0000","last_became_active":"2023-03-30T08:12:17.001473+0000","last_became_peered":"2023-03-30T08:12:17.001473+0000","last_unstale":"2023-03-30T08:12:17.978731+0000","last_undegraded":"2023-03-30T08:12:17.978731+0000","last_fullsized":"2023-03-30T08:12:17.978731+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:08:24.903894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079935+0000","last_change":"2023-03-30T08:12:17.006386+0000","last_active":"2023-03-30T08:12:18.079935+0000","last_peered":"2023-03-30T08:12:18.079935+0000","last_clean":"2023-03-30T08:12:18.079935+0000","last_became_active":"2023-03-30T08:12:17.005560+0000","last_became_peered":"2023-03-30T08:12:17.005560+0000","last_unstale":"2023-03-30T08:12:18.079935+0000","last_undegraded":"2023-03-30T08:12:18.079935+0000","last_fullsized":"2023-03-30T08:12:18.079935+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:37:48.102205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.083003+0000","last_change":"2023-03-30T08:12:16.995546+0000","last_active":"2023-03-30T08:12:18.083003+0000","last_peered":"2023-03-30T08:12:18.083003+0000","last_clean":"2023-03-30T08:12:18.083003+0000","last_became_active":"2023-03-30T08:12:16.995169+0000","last_became_peered":"2023-03-30T08:12:16.995169+0000","last_unstale":"2023-03-30T08:12:18.083003+0000","last_undegraded":"2023-03-30T08:12:18.083003+0000","last_fullsized":"2023-03-30T08:12:18.083003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:47:13.571528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978099+0000","last_change":"2023-03-30T08:12:17.003532+0000","last_active":"2023-03-30T08:12:17.978099+0000","last_peered":"2023-03-30T08:12:17.978099+0000","last_clean":"2023-03-30T08:12:17.978099+0000","last_became_active":"2023-03-30T08:12:17.003289+0000","last_became_peered":"2023-03-30T08:12:17.003289+0000","last_unstale":"2023-03-30T08:12:17.978099+0000","last_undegraded":"2023-03-30T08:12:17.978099+0000","last_fullsized":"2023-03-30T08:12:17.978099+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:59:28.247995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977239+0000","last_change":"2023-03-30T08:12:17.011340+0000","last_active":"2023-03-30T08:12:17.977239+0000","last_peered":"2023-03-30T08:12:17.977239+0000","last_clean":"2023-03-30T08:12:17.977239+0000","last_became_active":"2023-03-30T08:12:17.011050+0000","last_became_peered":"2023-03-30T08:12:17.011050+0000","last_unstale":"2023-03-30T08:12:17.977239+0000","last_undegraded":"2023-03-30T08:12:17.977239+0000","last_fullsized":"2023-03-30T08:12:17.977239+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:22:36.863160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080661+0000","last_change":"2023-03-30T08:12:16.985572+0000","last_active":"2023-03-30T08:12:18.080661+0000","last_peered":"2023-03-30T08:12:18.080661+0000","last_clean":"2023-03-30T08:12:18.080661+0000","last_became_active":"2023-03-30T08:12:16.985297+0000","last_became_peered":"2023-03-30T08:12:16.985297+0000","last_unstale":"2023-03-30T08:12:18.080661+0000","last_undegraded":"2023-03-30T08:12:18.080661+0000","last_fullsized":"2023-03-30T08:12:18.080661+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:06.573154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976674+0000","last_change":"2023-03-30T08:12:17.008837+0000","last_active":"2023-03-30T08:12:17.976674+0000","last_peered":"2023-03-30T08:12:17.976674+0000","last_clean":"2023-03-30T08:12:17.976674+0000","last_became_active":"2023-03-30T08:12:17.008571+0000","last_became_peered":"2023-03-30T08:12:17.008571+0000","last_unstale":"2023-03-30T08:12:17.976674+0000","last_undegraded":"2023-03-30T08:12:17.976674+0000","last_fullsized":"2023-03-30T08:12:17.976674+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:04:47.799662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978049+0000","last_change":"2023-03-30T08:12:16.548334+0000","last_active":"2023-03-30T08:12:17.978049+0000","last_peered":"2023-03-30T08:12:17.978049+0000","last_clean":"2023-03-30T08:12:17.978049+0000","last_became_active":"2023-03-30T08:12:16.548070+0000","last_became_peered":"2023-03-30T08:12:16.548070+0000","last_unstale":"2023-03-30T08:12:17.978049+0000","last_undegraded":"2023-03-30T08:12:17.978049+0000","last_fullsized":"2023-03-30T08:12:17.978049+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:06.227499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082701+0000","last_change":"2023-03-30T08:12:17.016751+0000","last_active":"2023-03-30T08:12:18.082701+0000","last_peered":"2023-03-30T08:12:18.082701+0000","last_clean":"2023-03-30T08:12:18.082701+0000","last_became_active":"2023-03-30T08:12:17.016023+0000","last_became_peered":"2023-03-30T08:12:17.016023+0000","last_unstale":"2023-03-30T08:12:18.082701+0000","last_undegraded":"2023-03-30T08:12:18.082701+0000","last_fullsized":"2023-03-30T08:12:18.082701+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:02:28.197304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978631+0000","last_change":"2023-03-30T08:12:16.557857+0000","last_active":"2023-03-30T08:12:17.978631+0000","last_peered":"2023-03-30T08:12:17.978631+0000","last_clean":"2023-03-30T08:12:17.978631+0000","last_became_active":"2023-03-30T08:12:16.557576+0000","last_became_peered":"2023-03-30T08:12:16.557576+0000","last_unstale":"2023-03-30T08:12:17.978631+0000","last_undegraded":"2023-03-30T08:12:17.978631+0000","last_fullsized":"2023-03-30T08:12:17.978631+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:01:17.755013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080005+0000","last_change":"2023-03-30T08:12:17.008489+0000","last_active":"2023-03-30T08:12:18.080005+0000","last_peered":"2023-03-30T08:12:18.080005+0000","last_clean":"2023-03-30T08:12:18.080005+0000","last_became_active":"2023-03-30T08:12:17.008176+0000","last_became_peered":"2023-03-30T08:12:17.008176+0000","last_unstale":"2023-03-30T08:12:18.080005+0000","last_undegraded":"2023-03-30T08:12:18.080005+0000","last_fullsized":"2023-03-30T08:12:18.080005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:26:05.797669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976815+0000","last_change":"2023-03-30T08:12:16.546886+0000","last_active":"2023-03-30T08:12:17.976815+0000","last_peered":"2023-03-30T08:12:17.976815+0000","last_clean":"2023-03-30T08:12:17.976815+0000","last_became_active":"2023-03-30T08:12:16.546636+0000","last_became_peered":"2023-03-30T08:12:16.546636+0000","last_unstale":"2023-03-30T08:12:17.976815+0000","last_undegraded":"2023-03-30T08:12:17.976815+0000","last_fullsized":"2023-03-30T08:12:17.976815+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:45.801853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976838+0000","last_change":"2023-03-30T08:12:17.017294+0000","last_active":"2023-03-30T08:12:17.976838+0000","last_peered":"2023-03-30T08:12:17.976838+0000","last_clean":"2023-03-30T08:12:17.976838+0000","last_became_active":"2023-03-30T08:12:17.017029+0000","last_became_peered":"2023-03-30T08:12:17.017029+0000","last_unstale":"2023-03-30T08:12:17.976838+0000","last_undegraded":"2023-03-30T08:12:17.976838+0000","last_fullsized":"2023-03-30T08:12:17.976838+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:34:17.666643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080822+0000","last_change":"2023-03-30T08:12:16.556777+0000","last_active":"2023-03-30T08:12:18.080822+0000","last_peered":"2023-03-30T08:12:18.080822+0000","last_clean":"2023-03-30T08:12:18.080822+0000","last_became_active":"2023-03-30T08:12:16.556496+0000","last_became_peered":"2023-03-30T08:12:16.556496+0000","last_unstale":"2023-03-30T08:12:18.080822+0000","last_undegraded":"2023-03-30T08:12:18.080822+0000","last_fullsized":"2023-03-30T08:12:18.080822+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:53:00.750269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978100+0000","last_change":"2023-03-30T08:12:17.009878+0000","last_active":"2023-03-30T08:12:17.978100+0000","last_peered":"2023-03-30T08:12:17.978100+0000","last_clean":"2023-03-30T08:12:17.978100+0000","last_became_active":"2023-03-30T08:12:17.009270+0000","last_became_peered":"2023-03-30T08:12:17.009270+0000","last_unstale":"2023-03-30T08:12:17.978100+0000","last_undegraded":"2023-03-30T08:12:17.978100+0000","last_fullsized":"2023-03-30T08:12:17.978100+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:26:44.730508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977623+0000","last_change":"2023-03-30T08:12:16.552161+0000","last_active":"2023-03-30T08:12:17.977623+0000","last_peered":"2023-03-30T08:12:17.977623+0000","last_clean":"2023-03-30T08:12:17.977623+0000","last_became_active":"2023-03-30T08:12:16.551583+0000","last_became_peered":"2023-03-30T08:12:16.551583+0000","last_unstale":"2023-03-30T08:12:17.977623+0000","last_undegraded":"2023-03-30T08:12:17.977623+0000","last_fullsized":"2023-03-30T08:12:17.977623+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:30.770018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079799+0000","last_change":"2023-03-30T08:12:16.997050+0000","last_active":"2023-03-30T08:12:18.079799+0000","last_peered":"2023-03-30T08:12:18.079799+0000","last_clean":"2023-03-30T08:12:18.079799+0000","last_became_active":"2023-03-30T08:12:16.996757+0000","last_became_peered":"2023-03-30T08:12:16.996757+0000","last_unstale":"2023-03-30T08:12:18.079799+0000","last_undegraded":"2023-03-30T08:12:18.079799+0000","last_fullsized":"2023-03-30T08:12:18.079799+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:52.330866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978347+0000","last_change":"2023-03-30T08:12:16.556002+0000","last_active":"2023-03-30T08:12:17.978347+0000","last_peered":"2023-03-30T08:12:17.978347+0000","last_clean":"2023-03-30T08:12:17.978347+0000","last_became_active":"2023-03-30T08:12:16.555592+0000","last_became_peered":"2023-03-30T08:12:16.555592+0000","last_unstale":"2023-03-30T08:12:17.978347+0000","last_undegraded":"2023-03-30T08:12:17.978347+0000","last_fullsized":"2023-03-30T08:12:17.978347+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:13:46.653017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.078975+0000","last_change":"2023-03-30T08:12:17.003057+0000","last_active":"2023-03-30T08:12:18.078975+0000","last_peered":"2023-03-30T08:12:18.078975+0000","last_clean":"2023-03-30T08:12:18.078975+0000","last_became_active":"2023-03-30T08:12:17.002219+0000","last_became_peered":"2023-03-30T08:12:17.002219+0000","last_unstale":"2023-03-30T08:12:18.078975+0000","last_undegraded":"2023-03-30T08:12:18.078975+0000","last_fullsized":"2023-03-30T08:12:18.078975+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:49.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079250+0000","last_change":"2023-03-30T08:12:16.558995+0000","last_active":"2023-03-30T08:12:18.079250+0000","last_peered":"2023-03-30T08:12:18.079250+0000","last_clean":"2023-03-30T08:12:18.079250+0000","last_became_active":"2023-03-30T08:12:16.558550+0000","last_became_peered":"2023-03-30T08:12:16.558550+0000","last_unstale":"2023-03-30T08:12:18.079250+0000","last_undegraded":"2023-03-30T08:12:18.079250+0000","last_fullsized":"2023-03-30T08:12:18.079250+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:04:46.786826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082104+0000","last_change":"2023-03-30T08:12:17.004043+0000","last_active":"2023-03-30T08:12:18.082104+0000","last_peered":"2023-03-30T08:12:18.082104+0000","last_clean":"2023-03-30T08:12:18.082104+0000","last_became_active":"2023-03-30T08:12:17.003704+0000","last_became_peered":"2023-03-30T08:12:17.003704+0000","last_unstale":"2023-03-30T08:12:18.082104+0000","last_undegraded":"2023-03-30T08:12:18.082104+0000","last_fullsized":"2023-03-30T08:12:18.082104+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:32:55.752647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079110+0000","last_change":"2023-03-30T08:12:16.555850+0000","last_active":"2023-03-30T08:12:18.079110+0000","last_peered":"2023-03-30T08:12:18.079110+0000","last_clean":"2023-03-30T08:12:18.079110+0000","last_became_active":"2023-03-30T08:12:16.553720+0000","last_became_peered":"2023-03-30T08:12:16.553720+0000","last_unstale":"2023-03-30T08:12:18.079110+0000","last_undegraded":"2023-03-30T08:12:18.079110+0000","last_fullsized":"2023-03-30T08:12:18.079110+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:04:17.503418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978586+0000","last_change":"2023-03-30T08:12:17.010413+0000","last_active":"2023-03-30T08:12:17.978586+0000","last_peered":"2023-03-30T08:12:17.978586+0000","last_clean":"2023-03-30T08:12:17.978586+0000","last_became_active":"2023-03-30T08:12:17.000709+0000","last_became_peered":"2023-03-30T08:12:17.000709+0000","last_unstale":"2023-03-30T08:12:17.978586+0000","last_undegraded":"2023-03-30T08:12:17.978586+0000","last_fullsized":"2023-03-30T08:12:17.978586+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:32:34.013372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978718+0000","last_change":"2023-03-30T08:12:16.550080+0000","last_active":"2023-03-30T08:12:17.978718+0000","last_peered":"2023-03-30T08:12:17.978718+0000","last_clean":"2023-03-30T08:12:17.978718+0000","last_became_active":"2023-03-30T08:12:16.549799+0000","last_became_peered":"2023-03-30T08:12:16.549799+0000","last_unstale":"2023-03-30T08:12:17.978718+0000","last_undegraded":"2023-03-30T08:12:17.978718+0000","last_fullsized":"2023-03-30T08:12:17.978718+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:14:32.503958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.081229+0000","last_change":"2023-03-30T08:12:17.003517+0000","last_active":"2023-03-30T08:12:18.081229+0000","last_peered":"2023-03-30T08:12:18.081229+0000","last_clean":"2023-03-30T08:12:18.081229+0000","last_became_active":"2023-03-30T08:12:17.002700+0000","last_became_peered":"2023-03-30T08:12:17.002700+0000","last_unstale":"2023-03-30T08:12:18.081229+0000","last_undegraded":"2023-03-30T08:12:18.081229+0000","last_fullsized":"2023-03-30T08:12:18.081229+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:08.812485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080114+0000","last_change":"2023-03-30T08:12:16.556210+0000","last_active":"2023-03-30T08:12:18.080114+0000","last_peered":"2023-03-30T08:12:18.080114+0000","last_clean":"2023-03-30T08:12:18.080114+0000","last_became_active":"2023-03-30T08:12:16.555938+0000","last_became_peered":"2023-03-30T08:12:16.555938+0000","last_unstale":"2023-03-30T08:12:18.080114+0000","last_undegraded":"2023-03-30T08:12:18.080114+0000","last_fullsized":"2023-03-30T08:12:18.080114+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:52:39.377489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977444+0000","last_change":"2023-03-30T08:12:17.006945+0000","last_active":"2023-03-30T08:12:17.977444+0000","last_peered":"2023-03-30T08:12:17.977444+0000","last_clean":"2023-03-30T08:12:17.977444+0000","last_became_active":"2023-03-30T08:12:17.006684+0000","last_became_peered":"2023-03-30T08:12:17.006684+0000","last_unstale":"2023-03-30T08:12:17.977444+0000","last_undegraded":"2023-03-30T08:12:17.977444+0000","last_fullsized":"2023-03-30T08:12:17.977444+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:44:10.477398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080887+0000","last_change":"2023-03-30T08:12:16.558102+0000","last_active":"2023-03-30T08:12:18.080887+0000","last_peered":"2023-03-30T08:12:18.080887+0000","last_clean":"2023-03-30T08:12:18.080887+0000","last_became_active":"2023-03-30T08:12:16.557590+0000","last_became_peered":"2023-03-30T08:12:16.557590+0000","last_unstale":"2023-03-30T08:12:18.080887+0000","last_undegraded":"2023-03-30T08:12:18.080887+0000","last_fullsized":"2023-03-30T08:12:18.080887+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:05.560318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080655+0000","last_change":"2023-03-30T08:12:16.984979+0000","last_active":"2023-03-30T08:12:18.080655+0000","last_peered":"2023-03-30T08:12:18.080655+0000","last_clean":"2023-03-30T08:12:18.080655+0000","last_became_active":"2023-03-30T08:12:16.984692+0000","last_became_peered":"2023-03-30T08:12:16.984692+0000","last_unstale":"2023-03-30T08:12:18.080655+0000","last_undegraded":"2023-03-30T08:12:18.080655+0000","last_fullsized":"2023-03-30T08:12:18.080655+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:00:53.087275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080887+0000","last_change":"2023-03-30T08:12:16.555005+0000","last_active":"2023-03-30T08:12:18.080887+0000","last_peered":"2023-03-30T08:12:18.080887+0000","last_clean":"2023-03-30T08:12:18.080887+0000","last_became_active":"2023-03-30T08:12:16.554754+0000","last_became_peered":"2023-03-30T08:12:16.554754+0000","last_unstale":"2023-03-30T08:12:18.080887+0000","last_undegraded":"2023-03-30T08:12:18.080887+0000","last_fullsized":"2023-03-30T08:12:18.080887+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:49:46.311228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082537+0000","last_change":"2023-03-30T08:12:16.999005+0000","last_active":"2023-03-30T08:12:18.082537+0000","last_peered":"2023-03-30T08:12:18.082537+0000","last_clean":"2023-03-30T08:12:18.082537+0000","last_became_active":"2023-03-30T08:12:16.998688+0000","last_became_peered":"2023-03-30T08:12:16.998688+0000","last_unstale":"2023-03-30T08:12:18.082537+0000","last_undegraded":"2023-03-30T08:12:18.082537+0000","last_fullsized":"2023-03-30T08:12:18.082537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:45:00.032812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977777+0000","last_change":"2023-03-30T08:12:16.552318+0000","last_active":"2023-03-30T08:12:17.977777+0000","last_peered":"2023-03-30T08:12:17.977777+0000","last_clean":"2023-03-30T08:12:17.977777+0000","last_became_active":"2023-03-30T08:12:16.551939+0000","last_became_peered":"2023-03-30T08:12:16.551939+0000","last_unstale":"2023-03-30T08:12:17.977777+0000","last_undegraded":"2023-03-30T08:12:17.977777+0000","last_fullsized":"2023-03-30T08:12:17.977777+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:07.799649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079989+0000","last_change":"2023-03-30T08:12:17.004827+0000","last_active":"2023-03-30T08:12:18.079989+0000","last_peered":"2023-03-30T08:12:18.079989+0000","last_clean":"2023-03-30T08:12:18.079989+0000","last_became_active":"2023-03-30T08:12:17.004521+0000","last_became_peered":"2023-03-30T08:12:17.004521+0000","last_unstale":"2023-03-30T08:12:18.079989+0000","last_undegraded":"2023-03-30T08:12:18.079989+0000","last_fullsized":"2023-03-30T08:12:18.079989+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:58:27.165546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080737+0000","last_change":"2023-03-30T08:12:16.551609+0000","last_active":"2023-03-30T08:12:18.080737+0000","last_peered":"2023-03-30T08:12:18.080737+0000","last_clean":"2023-03-30T08:12:18.080737+0000","last_became_active":"2023-03-30T08:12:16.551216+0000","last_became_peered":"2023-03-30T08:12:16.551216+0000","last_unstale":"2023-03-30T08:12:18.080737+0000","last_undegraded":"2023-03-30T08:12:18.080737+0000","last_fullsized":"2023-03-30T08:12:18.080737+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:45.801853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976910+0000","last_change":"2023-03-30T08:12:17.000583+0000","last_active":"2023-03-30T08:12:17.976910+0000","last_peered":"2023-03-30T08:12:17.976910+0000","last_clean":"2023-03-30T08:12:17.976910+0000","last_became_active":"2023-03-30T08:12:17.000340+0000","last_became_peered":"2023-03-30T08:12:17.000340+0000","last_unstale":"2023-03-30T08:12:17.976910+0000","last_undegraded":"2023-03-30T08:12:17.976910+0000","last_fullsized":"2023-03-30T08:12:17.976910+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:52.330866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977347+0000","last_change":"2023-03-30T08:12:16.547541+0000","last_active":"2023-03-30T08:12:17.977347+0000","last_peered":"2023-03-30T08:12:17.977347+0000","last_clean":"2023-03-30T08:12:17.977347+0000","last_became_active":"2023-03-30T08:12:16.547256+0000","last_became_peered":"2023-03-30T08:12:16.547256+0000","last_unstale":"2023-03-30T08:12:17.977347+0000","last_undegraded":"2023-03-30T08:12:17.977347+0000","last_fullsized":"2023-03-30T08:12:17.977347+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:04:46.786826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080672+0000","last_change":"2023-03-30T08:12:17.004589+0000","last_active":"2023-03-30T08:12:18.080672+0000","last_peered":"2023-03-30T08:12:18.080672+0000","last_clean":"2023-03-30T08:12:18.080672+0000","last_became_active":"2023-03-30T08:12:17.004326+0000","last_became_peered":"2023-03-30T08:12:17.004326+0000","last_unstale":"2023-03-30T08:12:18.080672+0000","last_undegraded":"2023-03-30T08:12:18.080672+0000","last_fullsized":"2023-03-30T08:12:18.080672+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:59:29.583333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079207+0000","last_change":"2023-03-30T08:12:16.551553+0000","last_active":"2023-03-30T08:12:18.079207+0000","last_peered":"2023-03-30T08:12:18.079207+0000","last_clean":"2023-03-30T08:12:18.079207+0000","last_became_active":"2023-03-30T08:12:16.550991+0000","last_became_peered":"2023-03-30T08:12:16.550991+0000","last_unstale":"2023-03-30T08:12:18.079207+0000","last_undegraded":"2023-03-30T08:12:18.079207+0000","last_fullsized":"2023-03-30T08:12:18.079207+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:45.801853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080538+0000","last_change":"2023-03-30T08:12:16.995421+0000","last_active":"2023-03-30T08:12:18.080538+0000","last_peered":"2023-03-30T08:12:18.080538+0000","last_clean":"2023-03-30T08:12:18.080538+0000","last_became_active":"2023-03-30T08:12:16.995140+0000","last_became_peered":"2023-03-30T08:12:16.995140+0000","last_unstale":"2023-03-30T08:12:18.080538+0000","last_undegraded":"2023-03-30T08:12:18.080538+0000","last_fullsized":"2023-03-30T08:12:18.080538+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:53:01.763105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080615+0000","last_change":"2023-03-30T08:12:16.560134+0000","last_active":"2023-03-30T08:12:18.080615+0000","last_peered":"2023-03-30T08:12:18.080615+0000","last_clean":"2023-03-30T08:12:18.080615+0000","last_became_active":"2023-03-30T08:12:16.559817+0000","last_became_peered":"2023-03-30T08:12:16.559817+0000","last_unstale":"2023-03-30T08:12:18.080615+0000","last_undegraded":"2023-03-30T08:12:18.080615+0000","last_fullsized":"2023-03-30T08:12:18.080615+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:24:46.330274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080109+0000","last_change":"2023-03-30T08:12:17.007078+0000","last_active":"2023-03-30T08:12:18.080109+0000","last_peered":"2023-03-30T08:12:18.080109+0000","last_clean":"2023-03-30T08:12:18.080109+0000","last_became_active":"2023-03-30T08:12:17.006834+0000","last_became_peered":"2023-03-30T08:12:17.006834+0000","last_unstale":"2023-03-30T08:12:18.080109+0000","last_undegraded":"2023-03-30T08:12:18.080109+0000","last_fullsized":"2023-03-30T08:12:18.080109+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T20:04:39.661536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978769+0000","last_change":"2023-03-30T08:12:16.554723+0000","last_active":"2023-03-30T08:12:17.978769+0000","last_peered":"2023-03-30T08:12:17.978769+0000","last_clean":"2023-03-30T08:12:17.978769+0000","last_became_active":"2023-03-30T08:12:16.554298+0000","last_became_peered":"2023-03-30T08:12:16.554298+0000","last_unstale":"2023-03-30T08:12:17.978769+0000","last_undegraded":"2023-03-30T08:12:17.978769+0000","last_fullsized":"2023-03-30T08:12:17.978769+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:22.712608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082879+0000","last_change":"2023-03-30T08:12:17.012709+0000","last_active":"2023-03-30T08:12:18.082879+0000","last_peered":"2023-03-30T08:12:18.082879+0000","last_clean":"2023-03-30T08:12:18.082879+0000","last_became_active":"2023-03-30T08:12:17.012454+0000","last_became_peered":"2023-03-30T08:12:17.012454+0000","last_unstale":"2023-03-30T08:12:18.082879+0000","last_undegraded":"2023-03-30T08:12:18.082879+0000","last_fullsized":"2023-03-30T08:12:18.082879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:26:09.003526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080211+0000","last_change":"2023-03-30T08:12:16.555215+0000","last_active":"2023-03-30T08:12:18.080211+0000","last_peered":"2023-03-30T08:12:18.080211+0000","last_clean":"2023-03-30T08:12:18.080211+0000","last_became_active":"2023-03-30T08:12:16.554899+0000","last_became_peered":"2023-03-30T08:12:16.554899+0000","last_unstale":"2023-03-30T08:12:18.080211+0000","last_undegraded":"2023-03-30T08:12:18.080211+0000","last_fullsized":"2023-03-30T08:12:18.080211+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T10:18:06.227499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082539+0000","last_change":"2023-03-30T08:12:17.017135+0000","last_active":"2023-03-30T08:12:18.082539+0000","last_peered":"2023-03-30T08:12:18.082539+0000","last_clean":"2023-03-30T08:12:18.082539+0000","last_became_active":"2023-03-30T08:12:17.016491+0000","last_became_peered":"2023-03-30T08:12:17.016491+0000","last_unstale":"2023-03-30T08:12:18.082539+0000","last_undegraded":"2023-03-30T08:12:18.082539+0000","last_fullsized":"2023-03-30T08:12:18.082539+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:09:09.014943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977546+0000","last_change":"2023-03-30T08:12:16.548116+0000","last_active":"2023-03-30T08:12:17.977546+0000","last_peered":"2023-03-30T08:12:17.977546+0000","last_clean":"2023-03-30T08:12:17.977546+0000","last_became_active":"2023-03-30T08:12:16.547717+0000","last_became_peered":"2023-03-30T08:12:16.547717+0000","last_unstale":"2023-03-30T08:12:17.977546+0000","last_undegraded":"2023-03-30T08:12:17.977546+0000","last_fullsized":"2023-03-30T08:12:17.977546+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:23.831326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977373+0000","last_change":"2023-03-30T08:12:17.006005+0000","last_active":"2023-03-30T08:12:17.977373+0000","last_peered":"2023-03-30T08:12:17.977373+0000","last_clean":"2023-03-30T08:12:17.977373+0000","last_became_active":"2023-03-30T08:12:17.005629+0000","last_became_peered":"2023-03-30T08:12:17.005629+0000","last_unstale":"2023-03-30T08:12:17.977373+0000","last_undegraded":"2023-03-30T08:12:17.977373+0000","last_fullsized":"2023-03-30T08:12:17.977373+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T20:04:39.661536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977916+0000","last_change":"2023-03-30T08:12:16.552860+0000","last_active":"2023-03-30T08:12:17.977916+0000","last_peered":"2023-03-30T08:12:17.977916+0000","last_clean":"2023-03-30T08:12:17.977916+0000","last_became_active":"2023-03-30T08:12:16.552601+0000","last_became_peered":"2023-03-30T08:12:16.552601+0000","last_unstale":"2023-03-30T08:12:17.977916+0000","last_undegraded":"2023-03-30T08:12:17.977916+0000","last_fullsized":"2023-03-30T08:12:17.977916+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:34:16.653807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976467+0000","last_change":"2023-03-30T08:12:16.999806+0000","last_active":"2023-03-30T08:12:17.976467+0000","last_peered":"2023-03-30T08:12:17.976467+0000","last_clean":"2023-03-30T08:12:17.976467+0000","last_became_active":"2023-03-30T08:12:16.999536+0000","last_became_peered":"2023-03-30T08:12:16.999536+0000","last_unstale":"2023-03-30T08:12:17.976467+0000","last_undegraded":"2023-03-30T08:12:17.976467+0000","last_fullsized":"2023-03-30T08:12:17.976467+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:24.844161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079421+0000","last_change":"2023-03-30T08:12:16.553800+0000","last_active":"2023-03-30T08:12:18.079421+0000","last_peered":"2023-03-30T08:12:18.079421+0000","last_clean":"2023-03-30T08:12:18.079421+0000","last_became_active":"2023-03-30T08:12:16.553477+0000","last_became_peered":"2023-03-30T08:12:16.553477+0000","last_unstale":"2023-03-30T08:12:18.079421+0000","last_undegraded":"2023-03-30T08:12:18.079421+0000","last_fullsized":"2023-03-30T08:12:18.079421+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:23.831326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080580+0000","last_change":"2023-03-30T08:12:16.982961+0000","last_active":"2023-03-30T08:12:18.080580+0000","last_peered":"2023-03-30T08:12:18.080580+0000","last_clean":"2023-03-30T08:12:18.080580+0000","last_became_active":"2023-03-30T08:12:16.982681+0000","last_became_peered":"2023-03-30T08:12:16.982681+0000","last_unstale":"2023-03-30T08:12:18.080580+0000","last_undegraded":"2023-03-30T08:12:18.080580+0000","last_fullsized":"2023-03-30T08:12:18.080580+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:38:46.814689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079644+0000","last_change":"2023-03-30T08:12:16.552411+0000","last_active":"2023-03-30T08:12:18.079644+0000","last_peered":"2023-03-30T08:12:18.079644+0000","last_clean":"2023-03-30T08:12:18.079644+0000","last_became_active":"2023-03-30T08:12:16.551535+0000","last_became_peered":"2023-03-30T08:12:16.551535+0000","last_unstale":"2023-03-30T08:12:18.079644+0000","last_undegraded":"2023-03-30T08:12:18.079644+0000","last_fullsized":"2023-03-30T08:12:18.079644+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:19:05.560318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079475+0000","last_change":"2023-03-30T08:12:16.986695+0000","last_active":"2023-03-30T08:12:18.079475+0000","last_peered":"2023-03-30T08:12:18.079475+0000","last_clean":"2023-03-30T08:12:18.079475+0000","last_became_active":"2023-03-30T08:12:16.986439+0000","last_became_peered":"2023-03-30T08:12:16.986439+0000","last_unstale":"2023-03-30T08:12:18.079475+0000","last_undegraded":"2023-03-30T08:12:18.079475+0000","last_fullsized":"2023-03-30T08:12:18.079475+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:31.782854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080937+0000","last_change":"2023-03-30T08:12:16.552751+0000","last_active":"2023-03-30T08:12:18.080937+0000","last_peered":"2023-03-30T08:12:18.080937+0000","last_clean":"2023-03-30T08:12:18.080937+0000","last_became_active":"2023-03-30T08:12:16.552461+0000","last_became_peered":"2023-03-30T08:12:16.552461+0000","last_unstale":"2023-03-30T08:12:18.080937+0000","last_undegraded":"2023-03-30T08:12:18.080937+0000","last_fullsized":"2023-03-30T08:12:18.080937+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T08:53:32.695129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977601+0000","last_change":"2023-03-30T08:12:17.005810+0000","last_active":"2023-03-30T08:12:17.977601+0000","last_peered":"2023-03-30T08:12:17.977601+0000","last_clean":"2023-03-30T08:12:17.977601+0000","last_became_active":"2023-03-30T08:12:17.005266+0000","last_became_peered":"2023-03-30T08:12:17.005266+0000","last_unstale":"2023-03-30T08:12:17.977601+0000","last_undegraded":"2023-03-30T08:12:17.977601+0000","last_fullsized":"2023-03-30T08:12:17.977601+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:56:06.563816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.081399+0000","last_change":"2023-03-30T08:12:16.560203+0000","last_active":"2023-03-30T08:12:18.081399+0000","last_peered":"2023-03-30T08:12:18.081399+0000","last_clean":"2023-03-30T08:12:18.081399+0000","last_became_active":"2023-03-30T08:12:16.559904+0000","last_became_peered":"2023-03-30T08:12:16.559904+0000","last_unstale":"2023-03-30T08:12:18.081399+0000","last_undegraded":"2023-03-30T08:12:18.081399+0000","last_fullsized":"2023-03-30T08:12:18.081399+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:05:16.423557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.995126+0000","last_change":"2023-03-30T08:10:52.871133+0000","last_active":"2023-03-30T08:12:16.995126+0000","last_peered":"2023-03-30T08:12:16.995126+0000","last_clean":"2023-03-30T08:12:16.995126+0000","last_became_active":"2023-03-30T08:10:52.870678+0000","last_became_peered":"2023-03-30T08:10:52.870678+0000","last_unstale":"2023-03-30T08:12:16.995126+0000","last_undegraded":"2023-03-30T08:12:16.995126+0000","last_fullsized":"2023-03-30T08:12:16.995126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:51.162618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.977475+0000","last_change":"2023-03-30T08:12:17.006743+0000","last_active":"2023-03-30T08:12:17.977475+0000","last_peered":"2023-03-30T08:12:17.977475+0000","last_clean":"2023-03-30T08:12:17.977475+0000","last_became_active":"2023-03-30T08:12:17.006424+0000","last_became_peered":"2023-03-30T08:12:17.006424+0000","last_unstale":"2023-03-30T08:12:17.977475+0000","last_undegraded":"2023-03-30T08:12:17.977475+0000","last_fullsized":"2023-03-30T08:12:17.977475+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:14:49.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978347+0000","last_change":"2023-03-30T08:12:16.559057+0000","last_active":"2023-03-30T08:12:17.978347+0000","last_peered":"2023-03-30T08:12:17.978347+0000","last_clean":"2023-03-30T08:12:17.978347+0000","last_became_active":"2023-03-30T08:12:16.558798+0000","last_became_peered":"2023-03-30T08:12:16.558798+0000","last_unstale":"2023-03-30T08:12:17.978347+0000","last_undegraded":"2023-03-30T08:12:17.978347+0000","last_fullsized":"2023-03-30T08:12:17.978347+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:04:47.794257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.973188+0000","last_change":"2023-03-30T08:10:52.871548+0000","last_active":"2023-03-30T08:12:16.973188+0000","last_peered":"2023-03-30T08:12:16.973188+0000","last_clean":"2023-03-30T08:12:16.973188+0000","last_became_active":"2023-03-30T08:10:52.871152+0000","last_became_peered":"2023-03-30T08:10:52.871152+0000","last_unstale":"2023-03-30T08:12:16.973188+0000","last_undegraded":"2023-03-30T08:12:16.973188+0000","last_fullsized":"2023-03-30T08:12:16.973188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079157+0000","last_change":"2023-03-30T08:12:16.994330+0000","last_active":"2023-03-30T08:12:18.079157+0000","last_peered":"2023-03-30T08:12:18.079157+0000","last_clean":"2023-03-30T08:12:18.079157+0000","last_became_active":"2023-03-30T08:12:16.994062+0000","last_became_peered":"2023-03-30T08:12:16.994062+0000","last_unstale":"2023-03-30T08:12:18.079157+0000","last_undegraded":"2023-03-30T08:12:18.079157+0000","last_fullsized":"2023-03-30T08:12:18.079157+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:04:29.223577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976601+0000","last_change":"2023-03-30T08:12:16.547995+0000","last_active":"2023-03-30T08:12:17.976601+0000","last_peered":"2023-03-30T08:12:17.976601+0000","last_clean":"2023-03-30T08:12:17.976601+0000","last_became_active":"2023-03-30T08:12:16.547723+0000","last_became_peered":"2023-03-30T08:12:16.547723+0000","last_unstale":"2023-03-30T08:12:17.976601+0000","last_undegraded":"2023-03-30T08:12:17.976601+0000","last_fullsized":"2023-03-30T08:12:17.976601+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:11:32.761870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.978187+0000","last_change":"2023-03-30T08:10:52.921525+0000","last_active":"2023-03-30T08:12:16.978187+0000","last_peered":"2023-03-30T08:12:16.978187+0000","last_clean":"2023-03-30T08:12:16.978187+0000","last_became_active":"2023-03-30T08:10:52.920885+0000","last_became_peered":"2023-03-30T08:10:52.920885+0000","last_unstale":"2023-03-30T08:12:16.978187+0000","last_undegraded":"2023-03-30T08:12:16.978187+0000","last_fullsized":"2023-03-30T08:12:16.978187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:38:27.041880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.978096+0000","last_change":"2023-03-30T08:12:17.006956+0000","last_active":"2023-03-30T08:12:17.978096+0000","last_peered":"2023-03-30T08:12:17.978096+0000","last_clean":"2023-03-30T08:12:17.978096+0000","last_became_active":"2023-03-30T08:12:17.006648+0000","last_became_peered":"2023-03-30T08:12:17.006648+0000","last_unstale":"2023-03-30T08:12:17.978096+0000","last_undegraded":"2023-03-30T08:12:17.978096+0000","last_fullsized":"2023-03-30T08:12:17.978096+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:00:33.917851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079338+0000","last_change":"2023-03-30T08:12:16.549604+0000","last_active":"2023-03-30T08:12:18.079338+0000","last_peered":"2023-03-30T08:12:18.079338+0000","last_clean":"2023-03-30T08:12:18.079338+0000","last_became_active":"2023-03-30T08:12:16.549318+0000","last_became_peered":"2023-03-30T08:12:16.549318+0000","last_unstale":"2023-03-30T08:12:18.079338+0000","last_undegraded":"2023-03-30T08:12:18.079338+0000","last_fullsized":"2023-03-30T08:12:18.079338+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:05:16.423557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.972700+0000","last_change":"2023-03-30T08:10:52.921563+0000","last_active":"2023-03-30T08:12:16.972700+0000","last_peered":"2023-03-30T08:12:16.972700+0000","last_clean":"2023-03-30T08:12:16.972700+0000","last_became_active":"2023-03-30T08:10:52.921234+0000","last_became_peered":"2023-03-30T08:10:52.921234+0000","last_unstale":"2023-03-30T08:12:16.972700+0000","last_undegraded":"2023-03-30T08:12:16.972700+0000","last_fullsized":"2023-03-30T08:12:16.972700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.082783+0000","last_change":"2023-03-30T08:12:17.017163+0000","last_active":"2023-03-30T08:12:18.082783+0000","last_peered":"2023-03-30T08:12:18.082783+0000","last_clean":"2023-03-30T08:12:18.082783+0000","last_became_active":"2023-03-30T08:12:17.016231+0000","last_became_peered":"2023-03-30T08:12:17.016231+0000","last_unstale":"2023-03-30T08:12:18.082783+0000","last_undegraded":"2023-03-30T08:12:18.082783+0000","last_fullsized":"2023-03-30T08:12:18.082783+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:24:17.298639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.657150+0000","last_change":"2023-03-30T08:12:16.548759+0000","last_active":"2023-03-30T08:12:18.657150+0000","last_peered":"2023-03-30T08:12:18.657150+0000","last_clean":"2023-03-30T08:12:18.657150+0000","last_became_active":"2023-03-30T08:12:16.548522+0000","last_became_peered":"2023-03-30T08:12:16.548522+0000","last_unstale":"2023-03-30T08:12:18.657150+0000","last_undegraded":"2023-03-30T08:12:18.657150+0000","last_fullsized":"2023-03-30T08:12:18.657150+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:53.899438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.983880+0000","last_change":"2023-03-30T08:10:52.866272+0000","last_active":"2023-03-30T08:12:16.983880+0000","last_peered":"2023-03-30T08:12:16.983880+0000","last_clean":"2023-03-30T08:12:16.983880+0000","last_became_active":"2023-03-30T08:10:52.865919+0000","last_became_peered":"2023-03-30T08:10:52.865919+0000","last_unstale":"2023-03-30T08:12:16.983880+0000","last_undegraded":"2023-03-30T08:12:16.983880+0000","last_fullsized":"2023-03-30T08:12:16.983880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.079319+0000","last_change":"2023-03-30T08:12:16.988070+0000","last_active":"2023-03-30T08:12:18.079319+0000","last_peered":"2023-03-30T08:12:18.079319+0000","last_clean":"2023-03-30T08:12:18.079319+0000","last_became_active":"2023-03-30T08:12:16.987820+0000","last_became_peered":"2023-03-30T08:12:16.987820+0000","last_unstale":"2023-03-30T08:12:18.079319+0000","last_undegraded":"2023-03-30T08:12:18.079319+0000","last_fullsized":"2023-03-30T08:12:18.079319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:44:10.477398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080967+0000","last_change":"2023-03-30T08:12:16.558215+0000","last_active":"2023-03-30T08:12:18.080967+0000","last_peered":"2023-03-30T08:12:18.080967+0000","last_clean":"2023-03-30T08:12:18.080967+0000","last_became_active":"2023-03-30T08:12:16.557938+0000","last_became_peered":"2023-03-30T08:12:16.557938+0000","last_unstale":"2023-03-30T08:12:18.080967+0000","last_undegraded":"2023-03-30T08:12:18.080967+0000","last_fullsized":"2023-03-30T08:12:18.080967+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:11:32.761870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.977269+0000","last_change":"2023-03-30T08:10:52.920796+0000","last_active":"2023-03-30T08:12:16.977269+0000","last_peered":"2023-03-30T08:12:16.977269+0000","last_clean":"2023-03-30T08:12:16.977269+0000","last_became_active":"2023-03-30T08:10:52.920327+0000","last_became_peered":"2023-03-30T08:10:52.920327+0000","last_unstale":"2023-03-30T08:12:16.977269+0000","last_undegraded":"2023-03-30T08:12:16.977269+0000","last_fullsized":"2023-03-30T08:12:16.977269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:17.416386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080801+0000","last_change":"2023-03-30T08:12:16.997115+0000","last_active":"2023-03-30T08:12:18.080801+0000","last_peered":"2023-03-30T08:12:18.080801+0000","last_clean":"2023-03-30T08:12:18.080801+0000","last_became_active":"2023-03-30T08:12:16.996842+0000","last_became_peered":"2023-03-30T08:12:16.996842+0000","last_unstale":"2023-03-30T08:12:18.080801+0000","last_undegraded":"2023-03-30T08:12:18.080801+0000","last_fullsized":"2023-03-30T08:12:18.080801+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T13:14:54.912274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:17.976310+0000","last_change":"2023-03-30T08:12:16.548581+0000","last_active":"2023-03-30T08:12:17.976310+0000","last_peered":"2023-03-30T08:12:17.976310+0000","last_clean":"2023-03-30T08:12:17.976310+0000","last_became_active":"2023-03-30T08:12:16.548264+0000","last_became_peered":"2023-03-30T08:12:16.548264+0000","last_unstale":"2023-03-30T08:12:17.976310+0000","last_undegraded":"2023-03-30T08:12:17.976310+0000","last_fullsized":"2023-03-30T08:12:17.976310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T09:53:00.750269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.976809+0000","last_change":"2023-03-30T08:10:52.866412+0000","last_active":"2023-03-30T08:12:16.976809+0000","last_peered":"2023-03-30T08:12:16.976809+0000","last_clean":"2023-03-30T08:12:16.976809+0000","last_became_active":"2023-03-30T08:10:52.866055+0000","last_became_peered":"2023-03-30T08:10:52.866055+0000","last_unstale":"2023-03-30T08:12:16.976809+0000","last_undegraded":"2023-03-30T08:12:16.976809+0000","last_fullsized":"2023-03-30T08:12:16.976809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:39.045010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.080009+0000","last_change":"2023-03-30T08:12:17.004094+0000","last_active":"2023-03-30T08:12:18.080009+0000","last_peered":"2023-03-30T08:12:18.080009+0000","last_clean":"2023-03-30T08:12:18.080009+0000","last_became_active":"2023-03-30T08:12:17.003834+0000","last_became_peered":"2023-03-30T08:12:17.003834+0000","last_unstale":"2023-03-30T08:12:18.080009+0000","last_undegraded":"2023-03-30T08:12:18.080009+0000","last_fullsized":"2023-03-30T08:12:18.080009+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:16.515324+0000","last_clean_scrub_stamp":"2023-03-30T08:12:16.515324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T15:51:00.535247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-03-30T08:12:18.081006+0000","last_change":"2023-03-30T08:12:16.546137+0000","last_active":"2023-03-30T08:12:18.081006+0000","last_peered":"2023-03-30T08:12:18.081006+0000","last_clean":"2023-03-30T08:12:18.081006+0000","last_became_active":"2023-03-30T08:12:16.545844+0000","last_became_peered":"2023-03-30T08:12:16.545844+0000","last_unstale":"2023-03-30T08:12:18.081006+0000","last_undegraded":"2023-03-30T08:12:18.081006+0000","last_fullsized":"2023-03-30T08:12:18.081006+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:12:15.502489+0000","last_clean_scrub_stamp":"2023-03-30T08:12:15.502489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T12:27:30.770018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.985121+0000","last_change":"2023-03-30T08:10:52.868170+0000","last_active":"2023-03-30T08:12:16.985121+0000","last_peered":"2023-03-30T08:12:16.985121+0000","last_clean":"2023-03-30T08:12:16.985121+0000","last_became_active":"2023-03-30T08:10:52.867790+0000","last_became_peered":"2023-03-30T08:10:52.867790+0000","last_unstale":"2023-03-30T08:12:16.985121+0000","last_undegraded":"2023-03-30T08:12:16.985121+0000","last_fullsized":"2023-03-30T08:12:16.985121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-03-30T08:12:16.977024+0000","last_change":"2023-03-30T08:10:45.713084+0000","last_active":"2023-03-30T08:12:16.977024+0000","last_peered":"2023-03-30T08:12:16.977024+0000","last_clean":"2023-03-30T08:12:16.977024+0000","last_became_active":"2023-03-30T08:10:45.711645+0000","last_became_peered":"2023-03-30T08:10:45.711645+0000","last_unstale":"2023-03-30T08:12:16.977024+0000","last_undegraded":"2023-03-30T08:12:16.977024+0000","last_fullsized":"2023-03-30T08:12:16.977024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_clean_scrub_stamp":"2023-03-30T08:10:44.620691+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:58:12.738262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2366,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8692,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363148,"statfs":{"total":96636764160,"available":96627863552,"internally_reserved":0,"allocated":503808,"data_stored":222389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.3169999999999999}]},{"osd":1,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.996},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":3.8620000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":1.218}]},{"osd":2,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.268},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":1.173}]},{"osd":3,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.0329999999999999}]},{"osd":4,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.115}]},{"osd":5,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.3420000000000001}]},{"osd":7,"last update":"Thu Mar 30 08:11:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.194},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.099}]}]},{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9844,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94361996,"statfs":{"total":96636764160,"available":96626683904,"internally_reserved":0,"allocated":1093632,"data_stored":812175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.2170000000000001}]},{"osd":1,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.2709999999999999}]},{"osd":2,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.94099999999999995}]},{"osd":4,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.522}]},{"osd":5,"last update":"Thu Mar 30 08:11:43 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.3839999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:47 2023","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":1.2,"5min":1.2,"15min":1.2},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":1.5860000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542167,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8688,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363152,"statfs":{"total":96636764160,"available":96627867648,"internally_reserved":0,"allocated":499712,"data_stored":221787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.423},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.91900000000000004}]},{"osd":1,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.2889999999999999}]},{"osd":2,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.246}]},{"osd":3,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.5109999999999999}]},{"osd":4,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.645},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.5369999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.488},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.4590000000000001}]},{"osd":7,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":1.077,"5min":1.077,"15min":1.077},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.5920000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8824,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363016,"statfs":{"total":96636764160,"available":96627728384,"internally_reserved":0,"allocated":507904,"data_stored":223281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0249999999999999}]},{"osd":1,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":0.96799999999999997}]},{"osd":2,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.92400000000000004}]},{"osd":3,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.109}]},{"osd":5,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4119999999999999,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.365},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.8330000000000002,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":1.3180000000000001}]},{"osd":6,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.6459999999999999,"5min":2.6459999999999999,"15min":2.6459999999999999},"last":1.409},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.052}]},{"osd":7,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":3.2599999999999998,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.4570000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8696,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363144,"statfs":{"total":96636764160,"available":96627859456,"internally_reserved":0,"allocated":507904,"data_stored":222359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.3420000000000001}]},{"osd":1,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.88400000000000001}]},{"osd":2,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.1499999999999999}]},{"osd":4,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":0.995}]},{"osd":5,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.3799999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.214},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":1.133,"5min":1.133,"15min":1.133},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.101}]},{"osd":7,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":1.0669999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8572,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363268,"statfs":{"total":96636764160,"available":96627986432,"internally_reserved":0,"allocated":512000,"data_stored":223303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.077}]},{"osd":1,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.96399999999999997}]},{"osd":3,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.381},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.119}]},{"osd":4,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.347},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":1.4510000000000001}]},{"osd":5,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.169},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.492,"5min":2.492,"15min":2.492},"last":1.1419999999999999}]},{"osd":6,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.206},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":2.4390000000000001,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":1.244}]},{"osd":7,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.3169999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8752,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363088,"statfs":{"total":96636764160,"available":96627802112,"internally_reserved":0,"allocated":499712,"data_stored":221787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.62}]},{"osd":2,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.9159999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.2070000000000001}]},{"osd":5,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.2549999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.097},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":3.6309999999999998,"5min":3.6309999999999998,"15min":3.6309999999999998},"last":1.4610000000000001}]},{"osd":6,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.4019999999999999}]},{"osd":7,"last update":"Thu Mar 30 08:11:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.304},{"interface":"front","average":{"1min":1.45,"5min":1.45,"15min":1.45},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":1.5209999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9840,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362000,"statfs":{"total":96636764160,"available":96626688000,"internally_reserved":0,"allocated":1089536,"data_stored":810780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.88100000000000001}]},{"osd":4,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.698,"5min":2.698,"15min":2.698},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.1830000000000001}]},{"osd":5,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.228}]},{"osd":6,"last update":"Thu Mar 30 08:11:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.5329999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.123},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.3680000000000001}]},{"osd":7,"last update":"Thu Mar 30 08:11:44 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.802,"5min":2.802,"15min":2.802},"last":1.3},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.3440000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-30T08:12:26.645 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-30T08:12:26.646 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-03-30T08:12:26.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.851+0000 7ff2b4f84700 1 Processor -- start 2023-03-30T08:12:26.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.851+0000 7ff2b4f84700 1 -- start start 2023-03-30T08:12:26.855 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2b4f84700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff2b00cfd90 0x7ff2b00cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:26.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2b4f84700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b00b1ec0 con 0x7ff2b00b85b0 2023-03-30T08:12:26.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2b4f84700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b00cf0d0 con 0x7ff2b00b2100 2023-03-30T08:12:26.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2af7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff2b00b85b0 0x7ff2b00cf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59308/0 (socket says 172.21.15.87:59308) 2023-03-30T08:12:26.856 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2af7fe700 1 -- 172.21.15.87:0/115901567 learned_addr learned my addr 172.21.15.87:0/115901567 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:26.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2b4f84700 1 -- 172.21.15.87:0/115901567 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b0160b30 con 0x7ff2b00cfd90 2023-03-30T08:12:26.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2aeffd700 1 --2- 172.21.15.87:0/115901567 >> v2:172.21.15.87:3300/0 conn(0x7ff2b00cfd90 0x7ff2b00cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:26.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2ae7fc700 1 -- 172.21.15.87:0/115901567 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615013085 0 0) 0x7ff2b00b1ec0 con 0x7ff2b00b85b0 2023-03-30T08:12:26.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2ae7fc700 1 -- 172.21.15.87:0/115901567 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2980035d0 con 0x7ff2b00b85b0 2023-03-30T08:12:26.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2ae7fc700 1 -- 172.21.15.87:0/115901567 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955669321 0 0) 0x7ff2b00cf0d0 con 0x7ff2b00b2100 2023-03-30T08:12:26.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2ae7fc700 1 -- 172.21.15.87:0/115901567 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2b00b1ec0 con 0x7ff2b00b2100 2023-03-30T08:12:26.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2aeffd700 1 -- 172.21.15.87:0/115901567 >> v1:172.21.15.115:6789/0 conn(0x7ff2b00b2100 legacy=0x7ff2b00d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:26.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2aeffd700 1 -- 172.21.15.87:0/115901567 >> v1:172.21.15.87:6789/0 conn(0x7ff2b00b85b0 legacy=0x7ff2b00cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:26.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2ae7fc700 1 -- 172.21.15.87:0/115901567 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1922451465 0 0) 0x7ff2980035d0 con 0x7ff2b00b85b0 2023-03-30T08:12:26.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2aeffd700 1 -- 172.21.15.87:0/115901567 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b0160e10 con 0x7ff2b00cfd90 2023-03-30T08:12:26.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2aeffd700 1 --2- 172.21.15.87:0/115901567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b00cfd90 0x7ff2b00cd680 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009850 tx=0x7ff2a4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba50873d107d97b server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:26.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2ae7fc700 1 -- 172.21.15.87:0/115901567 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0001670 con 0x7ff2b00cfd90 2023-03-30T08:12:26.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2ae7fc700 1 -- 172.21.15.87:0/115901567 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a4004030 con 0x7ff2b00cfd90 2023-03-30T08:12:26.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.855+0000 7ff2ae7fc700 1 -- 172.21.15.87:0/115901567 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40043c0 con 0x7ff2b00cfd90 2023-03-30T08:12:26.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.859+0000 7ff2b4f84700 1 -- 172.21.15.87:0/115901567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b00cfd90 msgr2=0x7ff2b00cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:26.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.859+0000 7ff2b4f84700 1 --2- 172.21.15.87:0/115901567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b00cfd90 0x7ff2b00cd680 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009850 tx=0x7ff2a4009b60 comp rx=0 tx=0).stop 2023-03-30T08:12:26.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.859+0000 7ff2b4f84700 1 -- 172.21.15.87:0/115901567 shutdown_connections 2023-03-30T08:12:26.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.859+0000 7ff2b4f84700 1 --2- 172.21.15.87:0/115901567 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b00cfd90 0x7ff2b00cd680 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:26.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.859+0000 7ff2b4f84700 1 -- 172.21.15.87:0/115901567 >> 172.21.15.87:0/115901567 conn(0x7ff2b00b4760 msgr2=0x7ff2b00b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:26.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.859+0000 7ff2b4f84700 1 -- 172.21.15.87:0/115901567 shutdown_connections 2023-03-30T08:12:26.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.859+0000 7ff2b4f84700 1 -- 172.21.15.87:0/115901567 wait complete. 2023-03-30T08:12:26.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.859+0000 7ff2b4f84700 1 Processor -- start 2023-03-30T08:12:26.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.859+0000 7ff2b4f84700 1 -- start start 2023-03-30T08:12:26.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2b4f84700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b00b2100 0x7ff2b00b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:26.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2b4f84700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2b00b85b0 0x7ff2b00b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:26.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2b4f84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2b00cfd90 0x7ff2b00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:26.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2b4f84700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b00cd370 con 0x7ff2b00b2100 2023-03-30T08:12:26.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2b4f84700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b00b7a90 con 0x7ff2b00b85b0 2023-03-30T08:12:26.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2b4f84700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b00caaa0 con 0x7ff2b00cfd90 2023-03-30T08:12:26.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2af7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b00b2100 0x7ff2b00b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:26.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2af7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b00b2100 0x7ff2b00b7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39754/0 (socket says 172.21.15.87:39754) 2023-03-30T08:12:26.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2af7fe700 1 -- 172.21.15.87:0/3728799020 learned_addr learned my addr 172.21.15.87:0/3728799020 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:26.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2aeffd700 1 --2- 172.21.15.87:0/3728799020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2b00b85b0 0x7ff2b00b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:26.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2affff700 1 --2- 172.21.15.87:0/3728799020 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2b00cfd90 0x7ff2b00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:26.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2af7fe700 1 -- 172.21.15.87:0/3728799020 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2b00cfd90 msgr2=0x7ff2b00b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:26.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2af7fe700 1 --2- 172.21.15.87:0/3728799020 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2b00cfd90 0x7ff2b00b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:26.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2af7fe700 1 -- 172.21.15.87:0/3728799020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2b00b85b0 msgr2=0x7ff2b00b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:26.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2af7fe700 1 --2- 172.21.15.87:0/3728799020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2b00b85b0 0x7ff2b00b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:26.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2af7fe700 1 -- 172.21.15.87:0/3728799020 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a40094b0 con 0x7ff2b00b2100 2023-03-30T08:12:26.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2affff700 1 --2- 172.21.15.87:0/3728799020 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2b00cfd90 0x7ff2b00b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:26.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2af7fe700 1 --2- 172.21.15.87:0/3728799020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b00b2100 0x7ff2b00b7550 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000c750 tx=0x7ff2a000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:26.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff297fff700 1 -- 172.21.15.87:0/3728799020 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0004ca0 con 0x7ff2b00b2100 2023-03-30T08:12:26.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff297fff700 1 -- 172.21.15.87:0/3728799020 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a0004e20 con 0x7ff2b00b2100 2023-03-30T08:12:26.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff297fff700 1 -- 172.21.15.87:0/3728799020 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0007310 con 0x7ff2b00b2100 2023-03-30T08:12:26.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2b4f84700 1 -- 172.21.15.87:0/3728799020 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b00d26b0 con 0x7ff2b00b2100 2023-03-30T08:12:26.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.863+0000 7ff2b4f84700 1 -- 172.21.15.87:0/3728799020 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b00cf3b0 con 0x7ff2b00b2100 2023-03-30T08:12:26.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.867+0000 7ff2b4f84700 1 -- 172.21.15.87:0/3728799020 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b00d2840 con 0x7ff2b00b2100 2023-03-30T08:12:26.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.867+0000 7ff297fff700 1 -- 172.21.15.87:0/3728799020 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ff2a0007470 con 0x7ff2b00b2100 2023-03-30T08:12:26.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.871+0000 7ff297fff700 1 --2- 172.21.15.87:0/3728799020 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff29c0653f0 0x7ff29c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:26.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.871+0000 7ff297fff700 1 -- 172.21.15.87:0/3728799020 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff2a0082760 con 0x7ff2b00b2100 2023-03-30T08:12:26.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.871+0000 7ff2aeffd700 1 --2- 172.21.15.87:0/3728799020 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff29c0653f0 0x7ff29c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:26.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.871+0000 7ff2aeffd700 1 --2- 172.21.15.87:0/3728799020 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff29c0653f0 0x7ff29c0678a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40090b0 tx=0x7ff2a4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:26.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:26.875+0000 7ff297fff700 1 -- 172.21.15.87:0/3728799020 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7ff2a0050200 con 0x7ff2b00b2100 2023-03-30T08:12:27.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.107+0000 7ff2b4f84700 1 -- 172.21.15.87:0/3728799020 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff2b0072cf0 con 0x7ff2b00b2100 2023-03-30T08:12:27.118 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.115+0000 7ff297fff700 1 -- 172.21.15.87:0/3728799020 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff2a0007720 con 0x7ff2b00b2100 2023-03-30T08:12:27.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.119+0000 7ff2b4f84700 1 -- 172.21.15.87:0/3728799020 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff29c0653f0 msgr2=0x7ff29c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:27.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.119+0000 7ff2b4f84700 1 --2- 172.21.15.87:0/3728799020 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff29c0653f0 0x7ff29c0678a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40090b0 tx=0x7ff2a4008030 comp rx=0 tx=0).stop 2023-03-30T08:12:27.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.119+0000 7ff2b4f84700 1 -- 172.21.15.87:0/3728799020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b00b2100 msgr2=0x7ff2b00b7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:27.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.119+0000 7ff2b4f84700 1 --2- 172.21.15.87:0/3728799020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b00b2100 0x7ff2b00b7550 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000c750 tx=0x7ff2a000ca60 comp rx=0 tx=0).stop 2023-03-30T08:12:27.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.123+0000 7ff2b4f84700 1 -- 172.21.15.87:0/3728799020 shutdown_connections 2023-03-30T08:12:27.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.123+0000 7ff2b4f84700 1 --2- 172.21.15.87:0/3728799020 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff29c0653f0 0x7ff29c0678a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:27.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.123+0000 7ff2b4f84700 1 --2- 172.21.15.87:0/3728799020 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff2b00cfd90 0x7ff2b00b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:27.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.123+0000 7ff2b4f84700 1 --2- 172.21.15.87:0/3728799020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2b00b85b0 0x7ff2b00b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:27.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.123+0000 7ff2b4f84700 1 --2- 172.21.15.87:0/3728799020 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2b00b2100 0x7ff2b00b7550 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:27.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.123+0000 7ff2b4f84700 1 -- 172.21.15.87:0/3728799020 >> 172.21.15.87:0/3728799020 conn(0x7ff2b00b4760 msgr2=0x7ff2b00d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:27.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.123+0000 7ff2b4f84700 1 -- 172.21.15.87:0/3728799020 shutdown_connections 2023-03-30T08:12:27.125 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.123+0000 7ff2b4f84700 1 -- 172.21.15.87:0/3728799020 wait complete. 2023-03-30T08:12:27.125 INFO:teuthology.orchestra.run.smithi087.stderr:updated caps for client.0 2023-03-30T08:12:27.145 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T08:12:27.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.295+0000 7f53e8c74700 1 Processor -- start 2023-03-30T08:12:27.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.295+0000 7f53e8c74700 1 -- start start 2023-03-30T08:12:27.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.299+0000 7f53e8c74700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53e415a9e0 0x7f53e40ad740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:27.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.299+0000 7f53e8c74700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e415e5d0 con 0x7f53e4070ae0 2023-03-30T08:12:27.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.299+0000 7f53e8c74700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e415e8b0 con 0x7f53e40adc80 2023-03-30T08:12:27.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.299+0000 7f53e8c74700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e415eb90 con 0x7f53e415a9e0 2023-03-30T08:12:27.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.299+0000 7f53e2d9d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f53e4070ae0 0x7f53e40ccca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59318/0 (socket says 172.21.15.87:59318) 2023-03-30T08:12:27.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.299+0000 7f53e2d9d700 1 -- 172.21.15.87:0/2369546604 learned_addr learned my addr 172.21.15.87:0/2369546604 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:27.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.299+0000 7f53e259c700 1 --2- 172.21.15.87:0/2369546604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53e415a9e0 0x7f53e40ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:27.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.299+0000 7f53e1d9b700 1 -- 172.21.15.87:0/2369546604 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322806070 0 0) 0x7f53e415e5d0 con 0x7f53e4070ae0 2023-03-30T08:12:27.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.299+0000 7f53e1d9b700 1 -- 172.21.15.87:0/2369546604 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53d00035d0 con 0x7f53e4070ae0 2023-03-30T08:12:27.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.299+0000 7f53e1d9b700 1 -- 172.21.15.87:0/2369546604 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437523474 0 0) 0x7f53e415e8b0 con 0x7f53e40adc80 2023-03-30T08:12:27.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.299+0000 7f53e1d9b700 1 -- 172.21.15.87:0/2369546604 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53e415e5d0 con 0x7f53e40adc80 2023-03-30T08:12:27.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.299+0000 7f53e259c700 1 -- 172.21.15.87:0/2369546604 >> v1:172.21.15.115:6789/0 conn(0x7f53e40adc80 legacy=0x7f53e40703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:27.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.299+0000 7f53e259c700 1 -- 172.21.15.87:0/2369546604 >> v1:172.21.15.87:6789/0 conn(0x7f53e4070ae0 legacy=0x7f53e40ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:27.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.299+0000 7f53e259c700 1 -- 172.21.15.87:0/2369546604 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e415ee70 con 0x7f53e415a9e0 2023-03-30T08:12:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.299+0000 7f53e259c700 1 --2- 172.21.15.87:0/2369546604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53e415a9e0 0x7f53e40ad740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009880 tx=0x7f53d4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e0addf61eba61d server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.303+0000 7f53e1d9b700 1 -- 172.21.15.87:0/2369546604 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4011830 con 0x7f53e415a9e0 2023-03-30T08:12:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.303+0000 7f53e1d9b700 1 -- 172.21.15.87:0/2369546604 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d4011990 con 0x7f53e415a9e0 2023-03-30T08:12:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.303+0000 7f53e1d9b700 1 -- 172.21.15.87:0/2369546604 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4011d20 con 0x7f53e415a9e0 2023-03-30T08:12:27.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.303+0000 7f53e8c74700 1 -- 172.21.15.87:0/2369546604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53e415a9e0 msgr2=0x7f53e40ad740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:27.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.303+0000 7f53e8c74700 1 --2- 172.21.15.87:0/2369546604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53e415a9e0 0x7f53e40ad740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009880 tx=0x7f53d4009b90 comp rx=0 tx=0).stop 2023-03-30T08:12:27.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.303+0000 7f53e8c74700 1 -- 172.21.15.87:0/2369546604 shutdown_connections 2023-03-30T08:12:27.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.303+0000 7f53e8c74700 1 --2- 172.21.15.87:0/2369546604 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53e415a9e0 0x7f53e40ad740 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:27.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.303+0000 7f53e8c74700 1 -- 172.21.15.87:0/2369546604 >> 172.21.15.87:0/2369546604 conn(0x7f53e40ce840 msgr2=0x7f53e40cec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.303+0000 7f53e8c74700 1 -- 172.21.15.87:0/2369546604 shutdown_connections 2023-03-30T08:12:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.303+0000 7f53e8c74700 1 -- 172.21.15.87:0/2369546604 wait complete. 2023-03-30T08:12:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.307+0000 7f53e8c74700 1 Processor -- start 2023-03-30T08:12:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.307+0000 7f53e8c74700 1 -- start start 2023-03-30T08:12:27.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.307+0000 7f53e8c74700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53e4070ae0 0x7f53e40ac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:27.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.307+0000 7f53e8c74700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53e40adc80 0x7f53e40c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:27.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.307+0000 7f53e8c74700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53e415a9e0 0x7f53e406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:27.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.307+0000 7f53e8c74700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e40abc50 con 0x7f53e4070ae0 2023-03-30T08:12:27.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.307+0000 7f53e8c74700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e406c0b0 con 0x7f53e415a9e0 2023-03-30T08:12:27.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.307+0000 7f53e8c74700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e406c390 con 0x7f53e40adc80 2023-03-30T08:12:27.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.307+0000 7f53e259c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53e4070ae0 0x7f53e40ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.307+0000 7f53e259c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53e4070ae0 0x7f53e40ac800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39758/0 (socket says 172.21.15.87:39758) 2023-03-30T08:12:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.307+0000 7f53e259c700 1 -- 172.21.15.87:0/302706653 learned_addr learned my addr 172.21.15.87:0/302706653 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.307+0000 7f53e2d9d700 1 --2- 172.21.15.87:0/302706653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53e415a9e0 0x7f53e406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.307+0000 7f53dbfff700 1 --2- 172.21.15.87:0/302706653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53e40adc80 0x7f53e40c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.311+0000 7f53e259c700 1 -- 172.21.15.87:0/302706653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53e40adc80 msgr2=0x7f53e40c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.311+0000 7f53e259c700 1 --2- 172.21.15.87:0/302706653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53e40adc80 0x7f53e40c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.311+0000 7f53e259c700 1 -- 172.21.15.87:0/302706653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53e415a9e0 msgr2=0x7f53e406d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:27.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.311+0000 7f53e259c700 1 --2- 172.21.15.87:0/302706653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53e415a9e0 0x7f53e406d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:27.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.311+0000 7f53e259c700 1 -- 172.21.15.87:0/302706653 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d40094b0 con 0x7f53e4070ae0 2023-03-30T08:12:27.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.311+0000 7f53e259c700 1 --2- 172.21.15.87:0/302706653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53e4070ae0 0x7f53e40ac800 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f53d4013040 tx=0x7f53d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:27.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.311+0000 7f53daffd700 1 -- 172.21.15.87:0/302706653 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d401a8c0 con 0x7f53e4070ae0 2023-03-30T08:12:27.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.311+0000 7f53daffd700 1 -- 172.21.15.87:0/302706653 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d401e070 con 0x7f53e4070ae0 2023-03-30T08:12:27.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.311+0000 7f53e8c74700 1 -- 172.21.15.87:0/302706653 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e40c9ad0 con 0x7f53e4070ae0 2023-03-30T08:12:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.311+0000 7f53daffd700 1 -- 172.21.15.87:0/302706653 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d401ac60 con 0x7f53e4070ae0 2023-03-30T08:12:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.311+0000 7f53e8c74700 1 -- 172.21.15.87:0/302706653 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e415f150 con 0x7f53e4070ae0 2023-03-30T08:12:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.311+0000 7f53e8c74700 1 -- 172.21.15.87:0/302706653 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e415adb0 con 0x7f53e4070ae0 2023-03-30T08:12:27.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.315+0000 7f53daffd700 1 -- 172.21.15.87:0/302706653 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f53d402d450 con 0x7f53e4070ae0 2023-03-30T08:12:27.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.315+0000 7f53daffd700 1 --2- 172.21.15.87:0/302706653 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f53c40653f0 0x7f53c40678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:27.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.315+0000 7f53daffd700 1 -- 172.21.15.87:0/302706653 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f53d40838d0 con 0x7f53e4070ae0 2023-03-30T08:12:27.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.315+0000 7f53dbfff700 1 --2- 172.21.15.87:0/302706653 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f53c40653f0 0x7f53c40678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:27.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.315+0000 7f53dbfff700 1 --2- 172.21.15.87:0/302706653 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f53c40653f0 0x7f53c40678a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f53e4157bb0 tx=0x7f53cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:27.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.323+0000 7f53daffd700 1 -- 172.21.15.87:0/302706653 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f53d40513a0 con 0x7f53e4070ae0 2023-03-30T08:12:27.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.527+0000 7f53e8c74700 1 -- 172.21.15.87:0/302706653 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53e40733a0 con 0x7f53e4070ae0 2023-03-30T08:12:27.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.527+0000 7f53daffd700 1 -- 172.21.15.87:0/302706653 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f53d4020090 con 0x7f53e4070ae0 2023-03-30T08:12:27.531 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:27.531 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4958,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/474261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":474261391},{"type":"v1","addr":"172.21.15.115:6833","nonce":474261391}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/2626542689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2626542689},{"type":"v1","addr":"172.21.15.87:6836","nonce":2626542689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3981806958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3981806958},{"type":"v1","addr":"172.21.15.87:6837","nonce":3981806958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-30T08:12:16.963002+0000","modified":"2023-03-30T08:12:20.012842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6835/450554084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":450554084},{"type":"v1","addr":"172.21.15.115:6835","nonce":450554084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-30T08:12:27.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.535+0000 7f53e8c74700 1 -- 172.21.15.87:0/302706653 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f53c40653f0 msgr2=0x7f53c40678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:27.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.535+0000 7f53e8c74700 1 --2- 172.21.15.87:0/302706653 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f53c40653f0 0x7f53c40678a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f53e4157bb0 tx=0x7f53cc009040 comp rx=0 tx=0).stop 2023-03-30T08:12:27.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.535+0000 7f53e8c74700 1 -- 172.21.15.87:0/302706653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53e4070ae0 msgr2=0x7f53e40ac800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:27.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.535+0000 7f53e8c74700 1 --2- 172.21.15.87:0/302706653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53e4070ae0 0x7f53e40ac800 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f53d4013040 tx=0x7f53d4004770 comp rx=0 tx=0).stop 2023-03-30T08:12:27.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.535+0000 7f53e8c74700 1 -- 172.21.15.87:0/302706653 shutdown_connections 2023-03-30T08:12:27.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.535+0000 7f53e8c74700 1 --2- 172.21.15.87:0/302706653 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f53c40653f0 0x7f53c40678a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:27.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.535+0000 7f53e8c74700 1 --2- 172.21.15.87:0/302706653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53e415a9e0 0x7f53e406d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:27.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.535+0000 7f53e8c74700 1 --2- 172.21.15.87:0/302706653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f53e40adc80 0x7f53e40c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:27.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.535+0000 7f53e8c74700 1 --2- 172.21.15.87:0/302706653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53e4070ae0 0x7f53e40ac800 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:27.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.535+0000 7f53e8c74700 1 -- 172.21.15.87:0/302706653 >> 172.21.15.87:0/302706653 conn(0x7f53e40ce840 msgr2=0x7f53e40b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:27.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.535+0000 7f53e8c74700 1 -- 172.21.15.87:0/302706653 shutdown_connections 2023-03-30T08:12:27.537 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:27.535+0000 7f53e8c74700 1 -- 172.21.15.87:0/302706653 wait complete. 2023-03-30T08:12:27.537 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 17 2023-03-30T08:12:27.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-30T08:12:16.963002+0000', 'modified': '2023-03-30T08:12:20.012842+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5346}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5346': {'gid': 5346, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.115:6835/450554084', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 450554084}, {'type': 'v1', 'addr': '172.21.15.115:6835', 'nonce': 450554084}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-30T08:12:27.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-30T08:12:27.958 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-03-30T08:12:28.123 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.123+0000 7f4193534700 1 Processor -- start 2023-03-30T08:12:28.124 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.123+0000 7f4193534700 1 -- start start 2023-03-30T08:12:28.126 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.123+0000 7f4193534700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4184038980 0x7f4184038dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.123+0000 7f4193534700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4184008ac0 0x7f4184008f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.123+0000 7f4193534700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4184054650 con 0x7f41840e2aa0 2023-03-30T08:12:28.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.123+0000 7f4193534700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4184039310 con 0x7f4184008ac0 2023-03-30T08:12:28.127 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.123+0000 7f4193534700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41840e7190 con 0x7f4184038980 2023-03-30T08:12:28.128 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4192d33700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4184008ac0 0x7f4184008f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4192d33700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4184008ac0 0x7f4184008f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39764/0 (socket says 172.21.15.87:39764) 2023-03-30T08:12:28.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4192d33700 1 -- 172.21.15.87:0/539937927 learned_addr learned my addr 172.21.15.87:0/539937927 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:28.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4192532700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f41840e2aa0 0x7f41840e6620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:39120/0 (socket says 172.21.15.87:39120) 2023-03-30T08:12:28.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4191d31700 1 --2- 172.21.15.87:0/539937927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4184038980 0x7f4184038dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4192d33700 1 -- 172.21.15.87:0/539937927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4184038980 msgr2=0x7f4184038dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:28.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4192d33700 1 --2- 172.21.15.87:0/539937927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4184038980 0x7f4184038dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.129 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4192d33700 1 -- 172.21.15.87:0/539937927 >> v1:172.21.15.115:6789/0 conn(0x7f41840e2aa0 legacy=0x7f41840e6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4192d33700 1 -- 172.21.15.87:0/539937927 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4184007fe0 con 0x7f4184008ac0 2023-03-30T08:12:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4191530700 1 -- 172.21.15.87:0/539937927 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878312634 0 0) 0x7f4184054650 con 0x7f41840e2aa0 2023-03-30T08:12:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4192d33700 1 --2- 172.21.15.87:0/539937927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4184008ac0 0x7f4184008f40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f418c068010 tx=0x7f418c04e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccd3a3e9824e8a9 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4191530700 1 -- 172.21.15.87:0/539937927 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c08d070 con 0x7f4184008ac0 2023-03-30T08:12:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4191530700 1 -- 172.21.15.87:0/539937927 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c067770 con 0x7f4184008ac0 2023-03-30T08:12:28.130 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4191530700 1 -- 172.21.15.87:0/539937927 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c072400 con 0x7f4184008ac0 2023-03-30T08:12:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4193534700 1 -- 172.21.15.87:0/539937927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4184008ac0 msgr2=0x7f4184008f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4193534700 1 --2- 172.21.15.87:0/539937927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4184008ac0 0x7f4184008f40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f418c068010 tx=0x7f418c04e9e0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4193534700 1 -- 172.21.15.87:0/539937927 shutdown_connections 2023-03-30T08:12:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4193534700 1 --2- 172.21.15.87:0/539937927 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4184008ac0 0x7f4184008f40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.131 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4193534700 1 --2- 172.21.15.87:0/539937927 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4184038980 0x7f4184038dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4193534700 1 -- 172.21.15.87:0/539937927 >> 172.21.15.87:0/539937927 conn(0x7f4184057b90 msgr2=0x7f4184053980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.127+0000 7f4193534700 1 -- 172.21.15.87:0/539937927 shutdown_connections 2023-03-30T08:12:28.132 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.131+0000 7f4193534700 1 -- 172.21.15.87:0/539937927 wait complete. 2023-03-30T08:12:28.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.131+0000 7f4193534700 1 Processor -- start 2023-03-30T08:12:28.134 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.131+0000 7f4193534700 1 -- start start 2023-03-30T08:12:28.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4193534700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4184008ac0 0x7f418404b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4193534700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4184038980 0x7f41840e03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.136 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4193534700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41840e2aa0 0x7f4184052370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4193534700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41840e1ad0 con 0x7f4184038980 2023-03-30T08:12:28.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4193534700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41840e0c40 con 0x7f41840e2aa0 2023-03-30T08:12:28.137 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4193534700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418404be30 con 0x7f4184008ac0 2023-03-30T08:12:28.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4191d31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4184038980 0x7f41840e03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4191d31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4184038980 0x7f41840e03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39772/0 (socket says 172.21.15.87:39772) 2023-03-30T08:12:28.138 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4191d31700 1 -- 172.21.15.87:0/3163853616 learned_addr learned my addr 172.21.15.87:0/3163853616 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:28.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4192532700 1 --2- 172.21.15.87:0/3163853616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4184008ac0 0x7f418404b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4192d33700 1 --2- 172.21.15.87:0/3163853616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41840e2aa0 0x7f4184052370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4191d31700 1 -- 172.21.15.87:0/3163853616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4184008ac0 msgr2=0x7f418404b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:28.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4191d31700 1 --2- 172.21.15.87:0/3163853616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4184008ac0 0x7f418404b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4191d31700 1 -- 172.21.15.87:0/3163853616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41840e2aa0 msgr2=0x7f4184052370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:28.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4191d31700 1 --2- 172.21.15.87:0/3163853616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41840e2aa0 0x7f4184052370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.139 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4191d31700 1 -- 172.21.15.87:0/3163853616 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41840085a0 con 0x7f4184038980 2023-03-30T08:12:28.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4191d31700 1 --2- 172.21.15.87:0/3163853616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4184038980 0x7f41840e03d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f417c00ea00 tx=0x7f417c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:28.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4182ffd700 1 -- 172.21.15.87:0/3163853616 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c009720 con 0x7f4184038980 2023-03-30T08:12:28.140 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4182ffd700 1 -- 172.21.15.87:0/3163853616 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c00eea0 con 0x7f4184038980 2023-03-30T08:12:28.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4182ffd700 1 -- 172.21.15.87:0/3163853616 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c00c9f0 con 0x7f4184038980 2023-03-30T08:12:28.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.135+0000 7f4193534700 1 -- 172.21.15.87:0/3163853616 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41840082c0 con 0x7f4184038980 2023-03-30T08:12:28.141 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.139+0000 7f4193534700 1 -- 172.21.15.87:0/3163853616 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41840e7470 con 0x7f4184038980 2023-03-30T08:12:28.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.139+0000 7f4182ffd700 1 -- 172.21.15.87:0/3163853616 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f417c00cb50 con 0x7f4184038980 2023-03-30T08:12:28.143 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4197a1d740 1 Processor -- start 2023-03-30T08:12:28.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4197a1d740 1 -- start start 2023-03-30T08:12:28.144 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4182ffd700 1 --2- 172.21.15.87:0/3163853616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f41700653f0 0x7f41700678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4182ffd700 1 -- 172.21.15.87:0/3163853616 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f417c082cf0 con 0x7f4184038980 2023-03-30T08:12:28.145 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4197a1d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228bae0 0x253b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4192d33700 1 --2- 172.21.15.87:0/3163853616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f41700653f0 0x7f41700678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4197a1d740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x228b710 0x253bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4197a1d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x22d6790 0x250bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4197a1d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x2418bc0 con 0x22d6790 2023-03-30T08:12:28.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4197a1d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x246ba00 con 0x228bae0 2023-03-30T08:12:28.146 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4197a1d740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x2464c60 con 0x228b710 2023-03-30T08:12:28.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4192d33700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x22d6790 0x250bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.148 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4192d33700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x22d6790 0x250bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39788/0 (socket says 172.21.15.87:39788) 2023-03-30T08:12:28.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4192d33700 1 -- 172.21.15.87:0/1231367666 learned_addr learned my addr 172.21.15.87:0/1231367666 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:28.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4191d31700 1 --2- 172.21.15.87:0/1231367666 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x228b710 0x253bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4192532700 1 --2- 172.21.15.87:0/1231367666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228bae0 0x253b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4192d33700 1 -- 172.21.15.87:0/1231367666 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x228b710 msgr2=0x253bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:28.149 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4192d33700 1 --2- 172.21.15.87:0/1231367666 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x228b710 0x253bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4192d33700 1 -- 172.21.15.87:0/1231367666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228bae0 msgr2=0x253b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:28.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4192d33700 1 --2- 172.21.15.87:0/1231367666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228bae0 0x253b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4192d33700 1 -- 172.21.15.87:0/1231367666 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x248b9b0 con 0x22d6790 2023-03-30T08:12:28.150 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4192d33700 1 --2- 172.21.15.87:0/3163853616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f41700653f0 0x7f41700678a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f418c04ea60 tx=0x7f418c06d030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:28.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.143+0000 7f4192d33700 1 --2- 172.21.15.87:0/1231367666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x22d6790 0x250bf50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f418c04f720 tx=0x7f418c0a2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c9759d8f6d570a server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:28.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f416ffff700 1 -- 172.21.15.87:0/1231367666 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c098030 con 0x22d6790 2023-03-30T08:12:28.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f416ffff700 1 -- 172.21.15.87:0/1231367666 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c06f070 con 0x22d6790 2023-03-30T08:12:28.151 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f416ffff700 1 -- 172.21.15.87:0/1231367666 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c067050 con 0x22d6790 2023-03-30T08:12:28.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 -- 172.21.15.87:0/1231367666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x22d6790 msgr2=0x250bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:28.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 --2- 172.21.15.87:0/1231367666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x22d6790 0x250bf50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f418c04f720 tx=0x7f418c0a2000 comp rx=0 tx=0).stop 2023-03-30T08:12:28.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 -- 172.21.15.87:0/1231367666 shutdown_connections 2023-03-30T08:12:28.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 --2- 172.21.15.87:0/1231367666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x22d6790 0x250bf50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.152 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 --2- 172.21.15.87:0/1231367666 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x228b710 0x253bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 --2- 172.21.15.87:0/1231367666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228bae0 0x253b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 -- 172.21.15.87:0/1231367666 >> 172.21.15.87:0/1231367666 conn(0x228beb0 msgr2=0x2525d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:28.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 -- 172.21.15.87:0/1231367666 shutdown_connections 2023-03-30T08:12:28.153 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 -- 172.21.15.87:0/1231367666 wait complete. 2023-03-30T08:12:28.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 -- start start 2023-03-30T08:12:28.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 Processor -- start 2023-03-30T08:12:28.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228b710 0x253e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228bae0 0x24fca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x22d6790 0x24fcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x2310b20 con 0x228bae0 2023-03-30T08:12:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x253d200 con 0x228b710 2023-03-30T08:12:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x253d4a0 con 0x22d6790 2023-03-30T08:12:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.147+0000 7f4197a1d740 10 client.0 _ll_register_callbacks cb 0x24b6c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-30T08:12:28.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4191d31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228bae0 0x24fca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4191d31700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228bae0 0x24fca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39790/0 (socket says 172.21.15.87:39790) 2023-03-30T08:12:28.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4191d31700 1 -- 172.21.15.87:0/494886440 learned_addr learned my addr 172.21.15.87:0/494886440 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:28.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4192532700 1 --2- 172.21.15.87:0/494886440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228b710 0x253e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4192d33700 1 --2- 172.21.15.87:0/494886440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x22d6790 0x24fcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4191d31700 1 -- 172.21.15.87:0/494886440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x22d6790 msgr2=0x24fcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:28.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4191d31700 1 --2- 172.21.15.87:0/494886440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x22d6790 0x24fcf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4191d31700 1 -- 172.21.15.87:0/494886440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228b710 msgr2=0x253e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:28.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4191d31700 1 --2- 172.21.15.87:0/494886440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228b710 0x253e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.161 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4191d31700 1 -- 172.21.15.87:0/494886440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c09b040 con 0x228bae0 2023-03-30T08:12:28.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4192d33700 1 --2- 172.21.15.87:0/494886440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x22d6790 0x24fcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:28.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4192532700 1 --2- 172.21.15.87:0/494886440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228b710 0x253e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:28.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4191d31700 1 --2- 172.21.15.87:0/494886440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228bae0 0x24fca50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f417c00c430 tx=0x7f417c0529b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41797f7f195e2178 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:28.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f416d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2023-03-30T08:12:28.162 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f416d7fa700 1 -- 172.21.15.87:0/494886440 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c050440 con 0x228bae0 2023-03-30T08:12:28.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f416d7fa700 1 -- 172.21.15.87:0/494886440 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f417c0505a0 con 0x228bae0 2023-03-30T08:12:28.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4197a1d740 1 -- 172.21.15.87:0/494886440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x245dc40 con 0x228bae0 2023-03-30T08:12:28.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f416d7fa700 1 -- 172.21.15.87:0/494886440 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f417c0533b0 con 0x228bae0 2023-03-30T08:12:28.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4197a1d740 10 client.5550 fetch_fsmap learned FSMap version 17 2023-03-30T08:12:28.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4197a1d740 1 -- 172.21.15.87:0/494886440 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x22d79e0 con 0x228bae0 2023-03-30T08:12:28.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f416d7fa700 1 -- 172.21.15.87:0/494886440 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x245dc40 con 0x228bae0 2023-03-30T08:12:28.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f416d7fa700 1 -- 172.21.15.87:0/494886440 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f417c053510 con 0x228bae0 2023-03-30T08:12:28.163 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4197a1d740 10 client.5550 fetch_fsmap finished waiting for FSMap version 17 2023-03-30T08:12:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4197a1d740 10 client.5550 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-30T08:12:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4197a1d740 20 client.5550 populate_metadata read hostname 'smithi087' 2023-03-30T08:12:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4197a1d740 1 --2- 172.21.15.87:0/494886440 >> [v2:172.21.15.115:6834/450554084,v1:172.21.15.115:6835/450554084] conn(0x24fdb50 0x2540060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4197a1d740 4 client.5550 mds_command: new command op to 5346 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-30T08:12:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4197a1d740 1 -- 172.21.15.87:0/494886440 --> [v2:172.21.15.115:6834/450554084,v1:172.21.15.115:6835/450554084] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x245d960 con 0x24fdb50 2023-03-30T08:12:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4192532700 1 --2- 172.21.15.87:0/494886440 >> [v2:172.21.15.115:6834/450554084,v1:172.21.15.115:6835/450554084] conn(0x24fdb50 0x2540060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.164 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f4192532700 1 --2- 172.21.15.87:0/494886440 >> [v2:172.21.15.115:6834/450554084,v1:172.21.15.115:6835/450554084] conn(0x24fdb50 0x2540060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be5cecbb14033128 server_cookie=696f536ef1e19f7b in_seq=0 out_seq=0 2023-03-30T08:12:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.151+0000 7f416d7fa700 10 client.5550 ms_handle_connect on v2:172.21.15.115:6834/450554084 2023-03-30T08:12:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.155+0000 7f416d7fa700 1 -- 172.21.15.87:0/494886440 <== mds.0 v2:172.21.15.115:6834/450554084 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x245d960 con 0x24fdb50 2023-03-30T08:12:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.155+0000 7f416d7fa700 10 client.5550 handle_command_reply: tid=0 2023-03-30T08:12:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.155+0000 7f4197a1d740 1 client.5550 shutdown 2023-03-30T08:12:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.155+0000 7f4197a1d740 1 -- 172.21.15.87:0/494886440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228bae0 msgr2=0x24fca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.155+0000 7f4197a1d740 1 --2- 172.21.15.87:0/494886440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228bae0 0x24fca50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f417c00c430 tx=0x7f417c0529b0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.165 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.155+0000 7f4197a1d740 1 -- 172.21.15.87:0/494886440 shutdown_connections 2023-03-30T08:12:28.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.155+0000 7f4197a1d740 1 --2- 172.21.15.87:0/494886440 >> [v2:172.21.15.115:6834/450554084,v1:172.21.15.115:6835/450554084] conn(0x24fdb50 0x2540060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.155+0000 7f4197a1d740 1 --2- 172.21.15.87:0/494886440 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x22d6790 0x24fcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.155+0000 7f4197a1d740 1 --2- 172.21.15.87:0/494886440 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228bae0 0x24fca50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.155+0000 7f416d7fa700 0 client.5550 ms_handle_reset on v2:172.21.15.115:6834/450554084 2023-03-30T08:12:28.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.155+0000 7f4197a1d740 1 --2- 172.21.15.87:0/494886440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228b710 0x253e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.155+0000 7f4197a1d740 1 -- 172.21.15.87:0/494886440 >> 172.21.15.87:0/494886440 conn(0x228beb0 msgr2=0x25263b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:28.166 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.155+0000 7f4197a1d740 1 -- 172.21.15.87:0/494886440 shutdown_connections 2023-03-30T08:12:28.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.155+0000 7f4197a1d740 1 -- 172.21.15.87:0/494886440 wait complete. 2023-03-30T08:12:28.167 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.155+0000 7f4197a1d740 20 client.5550 trim_cache size 0 max 16384 2023-03-30T08:12:28.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.175+0000 7f4197a1d740 1 Processor -- start 2023-03-30T08:12:28.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.175+0000 7f4197a1d740 1 -- start start 2023-03-30T08:12:28.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4197a1d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228b710 0x25534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4197a1d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228bae0 0x250ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4197a1d740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x22d6790 0x250f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4197a1d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x253a630 con 0x228b710 2023-03-30T08:12:28.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4197a1d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x2468dd0 con 0x228bae0 2023-03-30T08:12:28.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4197a1d740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x24398c0 con 0x22d6790 2023-03-30T08:12:28.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4192532700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228b710 0x25534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4192532700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228b710 0x25534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39796/0 (socket says 172.21.15.87:39796) 2023-03-30T08:12:28.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4192532700 1 -- 172.21.15.87:0/1171600839 learned_addr learned my addr 172.21.15.87:0/1171600839 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:28.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4192d33700 1 --2- 172.21.15.87:0/1171600839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x22d6790 0x250f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4191d31700 1 --2- 172.21.15.87:0/1171600839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228bae0 0x250ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4192532700 1 -- 172.21.15.87:0/1171600839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x22d6790 msgr2=0x250f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:28.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4192532700 1 --2- 172.21.15.87:0/1171600839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x22d6790 0x250f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4192532700 1 -- 172.21.15.87:0/1171600839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228bae0 msgr2=0x250ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:28.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4192532700 1 --2- 172.21.15.87:0/1171600839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228bae0 0x250ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4192532700 1 -- 172.21.15.87:0/1171600839 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4184052c10 con 0x228b710 2023-03-30T08:12:28.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4192532700 1 --2- 172.21.15.87:0/1171600839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228b710 0x25534d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4188007fd0 tx=0x7f4188006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c285231e5ed1e5 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:28.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4180ff9700 1 -- 172.21.15.87:0/1171600839 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418801a3b0 con 0x228b710 2023-03-30T08:12:28.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4180ff9700 1 -- 172.21.15.87:0/1171600839 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418801a510 con 0x228b710 2023-03-30T08:12:28.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4180ff9700 1 -- 172.21.15.87:0/1171600839 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41880074a0 con 0x228b710 2023-03-30T08:12:28.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4197a1d740 1 -- 172.21.15.87:0/1171600839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228b710 msgr2=0x25534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:28.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4197a1d740 1 --2- 172.21.15.87:0/1171600839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228b710 0x25534d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4188007fd0 tx=0x7f4188006040 comp rx=0 tx=0).stop 2023-03-30T08:12:28.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4197a1d740 1 -- 172.21.15.87:0/1171600839 shutdown_connections 2023-03-30T08:12:28.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4197a1d740 1 --2- 172.21.15.87:0/1171600839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x22d6790 0x250f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4197a1d740 1 --2- 172.21.15.87:0/1171600839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x228bae0 0x250ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4197a1d740 1 --2- 172.21.15.87:0/1171600839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228b710 0x25534d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4197a1d740 1 -- 172.21.15.87:0/1171600839 >> 172.21.15.87:0/1171600839 conn(0x228beb0 msgr2=0x25263b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:28.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4197a1d740 1 -- 172.21.15.87:0/1171600839 shutdown_connections 2023-03-30T08:12:28.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.179+0000 7f4197a1d740 1 -- 172.21.15.87:0/1171600839 wait complete. 2023-03-30T08:12:28.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4197a1d740 1 -- start start 2023-03-30T08:12:28.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4197a1d740 1 Processor -- start 2023-03-30T08:12:28.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4197a1d740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228bae0 0x253c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4197a1d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x22d6790 0x25a6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4197a1d740 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x24fb760 0x25a69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4197a1d740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x253c720 con 0x228bae0 2023-03-30T08:12:28.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4197a1d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x250f980 con 0x22d6790 2023-03-30T08:12:28.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4197a1d740 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x24fcfd0 con 0x24fb760 2023-03-30T08:12:28.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4197a1d740 10 client.0 _ll_register_callbacks cb 0x2405b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-30T08:12:28.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4192532700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228bae0 0x253c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4192532700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228bae0 0x253c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39808/0 (socket says 172.21.15.87:39808) 2023-03-30T08:12:28.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4192532700 1 -- 172.21.15.87:0/316386614 learned_addr learned my addr 172.21.15.87:0/316386614 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:28.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4191d31700 1 --2- 172.21.15.87:0/316386614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x22d6790 0x25a6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4192532700 1 -- 172.21.15.87:0/316386614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x24fb760 msgr2=0x25a69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:28.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4192d33700 1 --2- 172.21.15.87:0/316386614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x24fb760 0x25a69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4192532700 1 --2- 172.21.15.87:0/316386614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x24fb760 0x25a69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4192532700 1 -- 172.21.15.87:0/316386614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x22d6790 msgr2=0x25a6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:28.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4192532700 1 --2- 172.21.15.87:0/316386614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x22d6790 0x25a6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4192532700 1 -- 172.21.15.87:0/316386614 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4188004d30 con 0x228bae0 2023-03-30T08:12:28.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4191d31700 1 --2- 172.21.15.87:0/316386614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x22d6790 0x25a6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:12:28.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4192d33700 1 --2- 172.21.15.87:0/316386614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x24fb760 0x25a69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T08:12:28.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f4192532700 1 --2- 172.21.15.87:0/316386614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228bae0 0x253c1e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4188020000 tx=0x7f4188009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db52248b6e756448 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:28.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f416d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2023-03-30T08:12:28.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.183+0000 7f416d7fa700 1 -- 172.21.15.87:0/316386614 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418801a3b0 con 0x228bae0 2023-03-30T08:12:28.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 1 -- 172.21.15.87:0/316386614 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f418c06f070 con 0x228bae0 2023-03-30T08:12:28.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f416d7fa700 1 -- 172.21.15.87:0/316386614 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4188001370 con 0x228bae0 2023-03-30T08:12:28.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f416d7fa700 1 -- 172.21.15.87:0/316386614 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4188001570 con 0x228bae0 2023-03-30T08:12:28.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 10 client.5556 fetch_fsmap learned FSMap version 17 2023-03-30T08:12:28.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 1 -- 172.21.15.87:0/316386614 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x2410e40 con 0x228bae0 2023-03-30T08:12:28.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f416d7fa700 1 -- 172.21.15.87:0/316386614 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c06f070 con 0x228bae0 2023-03-30T08:12:28.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f416d7fa700 1 -- 172.21.15.87:0/316386614 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f41880016d0 con 0x228bae0 2023-03-30T08:12:28.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 10 client.5556 fetch_fsmap finished waiting for FSMap version 17 2023-03-30T08:12:28.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 10 client.5556 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-30T08:12:28.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 20 client.5556 populate_metadata read hostname 'smithi087' 2023-03-30T08:12:28.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 1 --2- 172.21.15.87:0/316386614 >> [v2:172.21.15.115:6834/450554084,v1:172.21.15.115:6835/450554084] conn(0x24fa2b0 0x24fa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 4 client.5556 mds_command: new command op to 5346 tid=0[{"prefix": "status"}] 2023-03-30T08:12:28.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 1 -- 172.21.15.87:0/316386614 --> [v2:172.21.15.115:6834/450554084,v1:172.21.15.115:6835/450554084] -- command(tid 0: {"prefix": "status"}) v1 -- 0x2308260 con 0x24fa2b0 2023-03-30T08:12:28.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4191d31700 1 --2- 172.21.15.87:0/316386614 >> [v2:172.21.15.115:6834/450554084,v1:172.21.15.115:6835/450554084] conn(0x24fa2b0 0x24fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4191d31700 1 --2- 172.21.15.87:0/316386614 >> [v2:172.21.15.115:6834/450554084,v1:172.21.15.115:6835/450554084] conn(0x24fa2b0 0x24fa680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5857d415faebf193 server_cookie=b13b474f90a30e77 in_seq=0 out_seq=0 2023-03-30T08:12:28.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f416d7fa700 10 client.5556 ms_handle_connect on v2:172.21.15.115:6834/450554084 2023-03-30T08:12:28.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f416d7fa700 1 -- 172.21.15.87:0/316386614 <== mds.0 v2:172.21.15.115:6834/450554084 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x2308260 con 0x24fa2b0 2023-03-30T08:12:28.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f416d7fa700 10 client.5556 handle_command_reply: tid=0 2023-03-30T08:12:28.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 1 client.5556 shutdown 2023-03-30T08:12:28.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 1 -- 172.21.15.87:0/316386614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228bae0 msgr2=0x253c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:28.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 1 --2- 172.21.15.87:0/316386614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228bae0 0x253c1e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4188020000 tx=0x7f4188009040 comp rx=0 tx=0).stop 2023-03-30T08:12:28.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 1 -- 172.21.15.87:0/316386614 shutdown_connections 2023-03-30T08:12:28.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 1 --2- 172.21.15.87:0/316386614 >> [v2:172.21.15.115:6834/450554084,v1:172.21.15.115:6835/450554084] conn(0x24fa2b0 0x24fa680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.194 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 1 --2- 172.21.15.87:0/316386614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x24fb760 0x25a69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 1 --2- 172.21.15.87:0/316386614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x22d6790 0x25a6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f416d7fa700 0 client.5556 ms_handle_reset on v2:172.21.15.115:6834/450554084 2023-03-30T08:12:28.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.187+0000 7f4197a1d740 1 --2- 172.21.15.87:0/316386614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x228bae0 0x253c1e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4197a1d740 1 -- 172.21.15.87:0/316386614 >> 172.21.15.87:0/316386614 conn(0x228beb0 msgr2=0x25263b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:28.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4197a1d740 1 -- 172.21.15.87:0/316386614 shutdown_connections 2023-03-30T08:12:28.195 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4197a1d740 1 -- 172.21.15.87:0/316386614 wait complete. 2023-03-30T08:12:28.196 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4197a1d740 20 client.5556 trim_cache size 0 max 16384 2023-03-30T08:12:28.196 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-03-30T08:12:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "936aee23-1888-4f7e-bc67-7a45e372f20a", 2023-03-30T08:12:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2023-03-30T08:12:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 5346, 2023-03-30T08:12:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2023-03-30T08:12:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2023-03-30T08:12:28.197 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2023-03-30T08:12:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 11.221122906, 2023-03-30T08:12:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 17, 2023-03-30T08:12:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 43, 2023-03-30T08:12:28.198 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 43, 2023-03-30T08:12:28.199 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 19.543270623000002 2023-03-30T08:12:28.199 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-03-30T08:12:28.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4193534700 1 -- 172.21.15.87:0/3163853616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f41700653f0 msgr2=0x7f41700678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:28.200 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4193534700 1 --2- 172.21.15.87:0/3163853616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f41700653f0 0x7f41700678a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f418c04ea60 tx=0x7f418c06d030 comp rx=0 tx=0).stop 2023-03-30T08:12:28.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4193534700 1 -- 172.21.15.87:0/3163853616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4184038980 msgr2=0x7f41840e03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:28.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4193534700 1 --2- 172.21.15.87:0/3163853616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4184038980 0x7f41840e03d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f417c00ea00 tx=0x7f417c00ed10 comp rx=0 tx=0).stop 2023-03-30T08:12:28.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4193534700 1 -- 172.21.15.87:0/3163853616 shutdown_connections 2023-03-30T08:12:28.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4193534700 1 --2- 172.21.15.87:0/3163853616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f41700653f0 0x7f41700678a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4193534700 1 --2- 172.21.15.87:0/3163853616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41840e2aa0 0x7f4184052370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.201 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4193534700 1 --2- 172.21.15.87:0/3163853616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4184038980 0x7f41840e03d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4193534700 1 --2- 172.21.15.87:0/3163853616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4184008ac0 0x7f418404b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4193534700 1 -- 172.21.15.87:0/3163853616 >> 172.21.15.87:0/3163853616 conn(0x7f4184057b90 msgr2=0x7f4184051510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:28.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4193534700 1 -- 172.21.15.87:0/3163853616 shutdown_connections 2023-03-30T08:12:28.202 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.191+0000 7f4193534700 1 -- 172.21.15.87:0/3163853616 wait complete. 2023-03-30T08:12:28.212 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-30T08:12:28.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.375+0000 7f905804a700 1 Processor -- start 2023-03-30T08:12:28.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.375+0000 7f905804a700 1 -- start start 2023-03-30T08:12:28.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f905804a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90500c1dc0 0x7f90500cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.381 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f905804a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f90500cca70 0x7f9050070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f905804a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f905006bd80 0x7f9050070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f905804a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9050164520 con 0x7f90500cca70 2023-03-30T08:12:28.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f905804a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9050164800 con 0x7f905006bd80 2023-03-30T08:12:28.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f905804a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9050164ae0 con 0x7f90500c1dc0 2023-03-30T08:12:28.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f90555e5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f90500cca70 0x7f9050070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f9055de6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90500c1dc0 0x7f90500cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f90555e5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f90500cca70 0x7f9050070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:39822/0 (socket says 172.21.15.87:39822) 2023-03-30T08:12:28.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f90555e5700 1 -- 172.21.15.87:0/196888432 learned_addr learned my addr 172.21.15.87:0/196888432 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:28.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f9055de6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90500c1dc0 0x7f90500cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:38228/0 (socket says 172.21.15.87:38228) 2023-03-30T08:12:28.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f90565e7700 1 --2- 172.21.15.87:0/196888432 >> v2:172.21.15.115:3300/0 conn(0x7f905006bd80 0x7f9050070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f90555e5700 1 -- 172.21.15.87:0/196888432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90500c1dc0 msgr2=0x7f90500cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:28.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f90555e5700 1 --2- 172.21.15.87:0/196888432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90500c1dc0 0x7f90500cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f90555e5700 1 -- 172.21.15.87:0/196888432 >> v2:172.21.15.115:3300/0 conn(0x7f905006bd80 msgr2=0x7f9050070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:28.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f90555e5700 1 --2- 172.21.15.87:0/196888432 >> v2:172.21.15.115:3300/0 conn(0x7f905006bd80 0x7f9050070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.379+0000 7f90555e5700 1 -- 172.21.15.87:0/196888432 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9050164dc0 con 0x7f90500cca70 2023-03-30T08:12:28.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.383+0000 7f90555e5700 1 --2- 172.21.15.87:0/196888432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90500cca70 0x7f9050070420 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9050071490 tx=0x7f9040009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26be221a7e935fa server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:28.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.383+0000 7f9054de4700 1 -- 172.21.15.87:0/196888432 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040011830 con 0x7f90500cca70 2023-03-30T08:12:28.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.383+0000 7f9054de4700 1 -- 172.21.15.87:0/196888432 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9040011990 con 0x7f90500cca70 2023-03-30T08:12:28.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.383+0000 7f9054de4700 1 -- 172.21.15.87:0/196888432 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040011d20 con 0x7f90500cca70 2023-03-30T08:12:28.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.383+0000 7f905804a700 1 -- 172.21.15.87:0/196888432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90500cca70 msgr2=0x7f9050070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:28.385 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.383+0000 7f905804a700 1 --2- 172.21.15.87:0/196888432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90500cca70 0x7f9050070420 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9050071490 tx=0x7f9040009bf0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.383+0000 7f905804a700 1 -- 172.21.15.87:0/196888432 shutdown_connections 2023-03-30T08:12:28.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.383+0000 7f905804a700 1 --2- 172.21.15.87:0/196888432 >> v2:172.21.15.115:3300/0 conn(0x7f905006bd80 0x7f9050070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.383+0000 7f905804a700 1 --2- 172.21.15.87:0/196888432 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90500cca70 0x7f9050070420 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.386 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.383+0000 7f905804a700 1 --2- 172.21.15.87:0/196888432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90500c1dc0 0x7f90500cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.383+0000 7f905804a700 1 -- 172.21.15.87:0/196888432 >> 172.21.15.87:0/196888432 conn(0x7f90500ce960 msgr2=0x7f90500ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:28.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.383+0000 7f905804a700 1 -- 172.21.15.87:0/196888432 shutdown_connections 2023-03-30T08:12:28.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.383+0000 7f905804a700 1 -- 172.21.15.87:0/196888432 wait complete. 2023-03-30T08:12:28.387 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f905804a700 1 Processor -- start 2023-03-30T08:12:28.388 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f905804a700 1 -- start start 2023-03-30T08:12:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f905804a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f905006bd80 0x7f90501f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f905804a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90500c1dc0 0x7f90500c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f905804a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90500cca70 0x7f905015fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.389 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f905804a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90500c48a0 con 0x7f90500cca70 2023-03-30T08:12:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f905804a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9050163e80 con 0x7f90500c1dc0 2023-03-30T08:12:28.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f905804a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90501f5f90 con 0x7f905006bd80 2023-03-30T08:12:28.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f90565e7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90500cca70 0x7f905015fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f9055de6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f905006bd80 0x7f90501f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f9055de6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f905006bd80 0x7f90501f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:38240/0 (socket says 172.21.15.87:38240) 2023-03-30T08:12:28.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f9055de6700 1 -- 172.21.15.87:0/1163467280 learned_addr learned my addr 172.21.15.87:0/1163467280 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:28.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f90555e5700 1 --2- 172.21.15.87:0/1163467280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90500c1dc0 0x7f90500c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.391 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f9055de6700 1 -- 172.21.15.87:0/1163467280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90500c1dc0 msgr2=0x7f90500c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:28.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f9055de6700 1 --2- 172.21.15.87:0/1163467280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90500c1dc0 0x7f90500c3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f9055de6700 1 -- 172.21.15.87:0/1163467280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90500cca70 msgr2=0x7f905015fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:28.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f9055de6700 1 --2- 172.21.15.87:0/1163467280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90500cca70 0x7f905015fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.387+0000 7f9055de6700 1 -- 172.21.15.87:0/1163467280 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9040009570 con 0x7f905006bd80 2023-03-30T08:12:28.392 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.391+0000 7f9055de6700 1 --2- 172.21.15.87:0/1163467280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f905006bd80 0x7f90501f5a50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f904c00e840 tx=0x7f904c00eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:28.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.391+0000 7f90467fc700 1 -- 172.21.15.87:0/1163467280 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c0095a0 con 0x7f905006bd80 2023-03-30T08:12:28.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.391+0000 7f90467fc700 1 -- 172.21.15.87:0/1163467280 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c013680 con 0x7f905006bd80 2023-03-30T08:12:28.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.391+0000 7f90467fc700 1 -- 172.21.15.87:0/1163467280 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c0139f0 con 0x7f905006bd80 2023-03-30T08:12:28.393 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.391+0000 7f905804a700 1 -- 172.21.15.87:0/1163467280 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90500ce540 con 0x7f905006bd80 2023-03-30T08:12:28.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.391+0000 7f905804a700 1 -- 172.21.15.87:0/1163467280 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90501650a0 con 0x7f905006bd80 2023-03-30T08:12:28.394 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.391+0000 7f905804a700 1 -- 172.21.15.87:0/1163467280 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90500c4390 con 0x7f905006bd80 2023-03-30T08:12:28.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.395+0000 7f90467fc700 1 -- 172.21.15.87:0/1163467280 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f904c013b50 con 0x7f905006bd80 2023-03-30T08:12:28.398 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.395+0000 7f90467fc700 1 --2- 172.21.15.87:0/1163467280 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9034065440 0x7f90340678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:28.399 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.395+0000 7f90467fc700 1 -- 172.21.15.87:0/1163467280 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f904c082f70 con 0x7f905006bd80 2023-03-30T08:12:28.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.395+0000 7f90555e5700 1 --2- 172.21.15.87:0/1163467280 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9034065440 0x7f90340678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:28.400 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.399+0000 7f90555e5700 1 --2- 172.21.15.87:0/1163467280 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9034065440 0x7f90340678f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9040000c00 tx=0x7f9040008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:28.403 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.399+0000 7f90467fc700 1 -- 172.21.15.87:0/1163467280 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f904c0544c0 con 0x7f905006bd80 2023-03-30T08:12:28.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.607+0000 7f905804a700 1 -- 172.21.15.87:0/1163467280 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f90500c2190 con 0x7f905006bd80 2023-03-30T08:12:28.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.607+0000 7f90467fc700 1 -- 172.21.15.87:0/1163467280 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f904c017060 con 0x7f905006bd80 2023-03-30T08:12:28.611 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-30T08:12:28.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.611+0000 7f905804a700 1 -- 172.21.15.87:0/1163467280 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9034065440 msgr2=0x7f90340678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:28.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.611+0000 7f905804a700 1 --2- 172.21.15.87:0/1163467280 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9034065440 0x7f90340678f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9040000c00 tx=0x7f9040008030 comp rx=0 tx=0).stop 2023-03-30T08:12:28.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.611+0000 7f905804a700 1 -- 172.21.15.87:0/1163467280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f905006bd80 msgr2=0x7f90501f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:28.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.611+0000 7f905804a700 1 --2- 172.21.15.87:0/1163467280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f905006bd80 0x7f90501f5a50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f904c00e840 tx=0x7f904c00eb50 comp rx=0 tx=0).stop 2023-03-30T08:12:28.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.611+0000 7f905804a700 1 -- 172.21.15.87:0/1163467280 shutdown_connections 2023-03-30T08:12:28.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.611+0000 7f905804a700 1 --2- 172.21.15.87:0/1163467280 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9034065440 0x7f90340678f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.611+0000 7f905804a700 1 --2- 172.21.15.87:0/1163467280 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90500cca70 0x7f905015fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.611+0000 7f905804a700 1 --2- 172.21.15.87:0/1163467280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90500c1dc0 0x7f90500c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.611+0000 7f905804a700 1 --2- 172.21.15.87:0/1163467280 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f905006bd80 0x7f90501f5a50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:28.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.611+0000 7f905804a700 1 -- 172.21.15.87:0/1163467280 >> 172.21.15.87:0/1163467280 conn(0x7f90500ce960 msgr2=0x7f90500ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:28.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.611+0000 7f905804a700 1 -- 172.21.15.87:0/1163467280 shutdown_connections 2023-03-30T08:12:28.616 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:28.611+0000 7f905804a700 1 -- 172.21.15.87:0/1163467280 wait complete. 2023-03-30T08:12:28.632 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-03-30T08:12:28.633 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-30T08:12:28.633 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2023-03-30T08:12:28.633 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-30T08:12:28.634 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-30T08:12:28.634 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-03-30T08:12:28.634 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-03-30T08:12:28.634 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-30T08:12:28.635 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-30T08:12:28.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:12:28.635 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2023-03-30T08:12:28.650 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-30T08:12:28.650 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-30T08:12:28.650 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2023-03-30T08:12:28.651 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:12:28.651 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2023-03-30T08:12:28.651 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:12:28.651 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:12:28.652 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2023-03-30T08:12:28.652 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2023-03-30T08:12:28.652 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:12:28.652 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2023-03-30T08:12:28.652 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2023-03-30T08:12:28.652 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-03-30T08:12:28.653 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:12:28.653 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-30T08:12:28.653 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:12:28.653 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-03-30T08:12:28.653 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42397sec preferred_lft 42397sec 2023-03-30T08:12:28.653 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2023-03-30T08:12:28.653 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:12:28.653 INFO:teuthology.orchestra.run.smithi087.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-03-30T08:12:28.654 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 02:42:18:c5:86:06 brd ff:ff:ff:ff:ff:ff 2023-03-30T08:12:28.654 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-03-30T08:12:28.654 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:12:28.654 INFO:teuthology.orchestra.run.smithi087.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-30T08:12:28.654 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether b6:9e:c4:a9:cd:0f brd ff:ff:ff:ff:ff:ff 2023-03-30T08:12:28.654 INFO:teuthology.orchestra.run.smithi087.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-03-30T08:12:28.655 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:12:28.655 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::887:93ff:fe81:2f74/64 scope link 2023-03-30T08:12:28.655 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:12:28.655 INFO:teuthology.orchestra.run.smithi087.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-30T08:12:28.655 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether ba:c6:29:ff:a6:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-30T08:12:28.655 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::b8c6:29ff:feff:a614/64 scope link 2023-03-30T08:12:28.655 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:12:28.655 INFO:teuthology.orchestra.run.smithi087.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-30T08:12:28.656 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether b6:9e:c4:a9:cd:0f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-03-30T08:12:28.656 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::b49e:c4ff:fea9:cd0f/64 scope link 2023-03-30T08:12:28.656 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2023-03-30T08:12:28.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:12:28.657 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-30T08:12:28.730 INFO:teuthology.orchestra.run.smithi087.stdout:1 2023-03-30T08:12:28.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:12:28.732 DEBUG:teuthology.orchestra.run.smithi087:> route 2023-03-30T08:12:28.796 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2023-03-30T08:12:28.797 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-30T08:12:28.797 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-03-30T08:12:28.797 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-30T08:12:28.797 INFO:teuthology.orchestra.run.smithi087.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-03-30T08:12:28.797 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-03-30T08:12:28.798 INFO:teuthology.orchestra.run.smithi087.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-03-30T08:12:28.798 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-30T08:12:28.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:12:28.798 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec bash -c ' 2023-03-30T08:12:28.799 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2023-03-30T08:12:28.799 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-30T08:12:28.799 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-30T08:12:28.800 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-30T08:12:28.800 DEBUG:teuthology.orchestra.run.smithi087:> ') 2023-03-30T08:12:28.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:12:28.931 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2023-03-30T08:12:28.947 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-03-30T08:12:28.947 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-03-30T08:12:28.948 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-30T08:12:28.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:12:28.949 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2023-03-30T08:12:29.023 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-30T08:12:29.023 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-03-30T08:12:29.083 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-03-30T08:12:29.084 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-30T08:12:29.085 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-03-30T08:12:29.139 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-03-30T08:12:29.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:12:29.140 DEBUG:teuthology.orchestra.run.smithi087:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-30T08:12:29.264 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-30T08:12:29.264 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-30T08:12:29.264 INFO:teuthology.orchestra.run.smithi087.stdout:invalid new device string format 2023-03-30T08:12:29.290 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-30T08:12:29.290 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-30T08:12:29.290 INFO:teuthology.orchestra.run.smithi087.stdout:invalid new device string format 2023-03-30T08:12:29.291 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: resolved to: "172.21.15.87:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-03-30T08:12:29.291 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-30T08:12:29.307 INFO:teuthology.orchestra.run.smithi087.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-30T08:12:29.308 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-30T08:12:29.308 INFO:teuthology.orchestra.run.smithi087.stdout:invalid new device string format 2023-03-30T08:12:29.308 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: resolved to: "172.21.15.87:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-03-30T08:12:29.308 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-30T08:12:29.308 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: resolved to: "172.21.15.87:6789,172.21.15.115:6789,172.21.15.115:6790" 2023-03-30T08:12:29.308 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.87:6789,172.21.15.115:6789,172.21.15.115:6790:/ 2023-03-30T08:12:29.308 INFO:teuthology.orchestra.run.smithi087.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=936aee23-1888-4f7e-bc67-7a45e372f20a" will pass to kernel 2023-03-30T08:12:29.314 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-30T08:12:29.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:12:29.315 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-03-30T08:12:29.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:12:29.342 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-30T08:12:29.422 INFO:teuthology.orchestra.run.smithi087.stdout:client5437 2023-03-30T08:12:29.422 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:12:29.423 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T08:12:29.482 DEBUG:teuthology.orchestra.run.smithi087:> mktemp -d --suffix=xfstests-dev 2023-03-30T08:12:29.537 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.dmK5MK8Zk9xfstests-dev 2023-03-30T08:12:29.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:12:29.538 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.dmK5MK8Zk9xfstests-dev) 2023-03-30T08:12:29.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:12:29.617 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.dmK5MK8Zk9xfstests-dev) 2023-03-30T08:12:29.691 INFO:teuthology.orchestra.run.smithi087.stderr:Cloning into '/tmp/tmp.dmK5MK8Zk9xfstests-dev'... 2023-03-30T08:12:30.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:12:30.577 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-03-30T08:12:30.656 DEBUG:teuthology.orchestra.run.smithi087:> mktemp -d --suffix=test 2023-03-30T08:12:30.713 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.3MaCcqrm21test 2023-03-30T08:12:30.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:12:30.714 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-03-30T08:12:30.776 DEBUG:teuthology.orchestra.run.smithi087:> mktemp -d --suffix=scratch 2023-03-30T08:12:30.833 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:12:30.834 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "20.04". 2023-03-30T08:12:30.834 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 2023-03-30T08:12:30.996 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2023-03-30T08:12:31.192 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2023-03-30T08:12:31.192 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2023-03-30T08:12:31.367 INFO:teuthology.orchestra.run.smithi087.stdout:attr is already the newest version (1:2.4.48-5). 2023-03-30T08:12:31.368 INFO:teuthology.orchestra.run.smithi087.stdout:automake is already the newest version (1:1.16.1-4ubuntu6). 2023-03-30T08:12:31.368 INFO:teuthology.orchestra.run.smithi087.stdout:gawk is already the newest version (1:5.0.1+dfsg-1). 2023-03-30T08:12:31.368 INFO:teuthology.orchestra.run.smithi087.stdout:gcc is already the newest version (4:9.3.0-1ubuntu2). 2023-03-30T08:12:31.368 INFO:teuthology.orchestra.run.smithi087.stdout:gcc set to manually installed. 2023-03-30T08:12:31.368 INFO:teuthology.orchestra.run.smithi087.stdout:libacl1-dev is already the newest version (2.2.53-6). 2023-03-30T08:12:31.368 INFO:teuthology.orchestra.run.smithi087.stdout:libaio-dev is already the newest version (0.3.112-5). 2023-03-30T08:12:31.368 INFO:teuthology.orchestra.run.smithi087.stdout:libattr1-dev is already the newest version (1:2.4.48-5). 2023-03-30T08:12:31.369 INFO:teuthology.orchestra.run.smithi087.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-03-30T08:12:31.369 INFO:teuthology.orchestra.run.smithi087.stdout:make is already the newest version (4.2.1-1.2). 2023-03-30T08:12:31.369 INFO:teuthology.orchestra.run.smithi087.stdout:make set to manually installed. 2023-03-30T08:12:31.369 INFO:teuthology.orchestra.run.smithi087.stdout:quota is already the newest version (4.05-1). 2023-03-30T08:12:31.369 INFO:teuthology.orchestra.run.smithi087.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-03-30T08:12:31.369 INFO:teuthology.orchestra.run.smithi087.stdout:xfsprogs is already the newest version (5.3.0-1ubuntu2). 2023-03-30T08:12:31.369 INFO:teuthology.orchestra.run.smithi087.stdout:dbench is already the newest version (4.0-2build1). 2023-03-30T08:12:31.370 INFO:teuthology.orchestra.run.smithi087.stdout:python2 is already the newest version (2.7.17-2ubuntu4). 2023-03-30T08:12:31.370 INFO:teuthology.orchestra.run.smithi087.stdout:python2 set to manually installed. 2023-03-30T08:12:31.370 INFO:teuthology.orchestra.run.smithi087.stdout:e2fsprogs is already the newest version (1.45.5-2ubuntu1.1). 2023-03-30T08:12:31.370 INFO:teuthology.orchestra.run.smithi087.stdout:libuuid1 is already the newest version (2.34-0.1ubuntu9.3). 2023-03-30T08:12:31.370 INFO:teuthology.orchestra.run.smithi087.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-03-30T08:12:31.370 INFO:teuthology.orchestra.run.smithi087.stdout:uuid-runtime is already the newest version (2.34-0.1ubuntu9.3). 2023-03-30T08:12:31.370 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2023-03-30T08:12:31.371 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-03-30T08:12:31.371 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2023-03-30T08:12:31.371 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2023-03-30T08:12:31.371 INFO:teuthology.orchestra.run.smithi087.stdout: libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 libsqlite3-0 2023-03-30T08:12:31.371 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2023-03-30T08:12:31.372 INFO:teuthology.orchestra.run.smithi087.stdout: gnuplot gfio python-scipy sqlite3-doc 2023-03-30T08:12:31.425 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2023-03-30T08:12:31.426 INFO:teuthology.orchestra.run.smithi087.stdout: fio libgdbm-dev libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 sqlite3 2023-03-30T08:12:31.428 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2023-03-30T08:12:31.428 INFO:teuthology.orchestra.run.smithi087.stdout: libsqlite3-0 2023-03-30T08:12:31.640 INFO:teuthology.orchestra.run.smithi087.stdout:1 upgraded, 7 newly installed, 0 to remove and 156 not upgraded. 2023-03-30T08:12:31.641 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 2,428 kB of archives. 2023-03-30T08:12:31.641 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 7,043 kB of additional disk space will be used. 2023-03-30T08:12:31.641 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libsqlite3-0 amd64 3.31.1-4ubuntu0.5 [549 kB] 2023-03-30T08:12:32.192 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libglusterfs0 amd64 7.2-2build1 [286 kB] 2023-03-30T08:12:32.223 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfxdr0 amd64 7.2-2build1 [24.2 kB] 2023-03-30T08:12:32.224 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfrpc0 amd64 7.2-2build1 [46.1 kB] 2023-03-30T08:12:32.230 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfapi0 amd64 7.2-2build1 [72.6 kB] 2023-03-30T08:12:32.238 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 fio amd64 3.16-1 [507 kB] 2023-03-30T08:12:32.314 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libgdbm-dev amd64 1.18.1-5 [83.4 kB] 2023-03-30T08:12:32.322 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 sqlite3 amd64 3.31.1-4ubuntu0.5 [860 kB] 2023-03-30T08:12:32.689 INFO:teuthology.orchestra.run.smithi087.stderr:debconf: unable to initialize frontend: Dialog 2023-03-30T08:12:32.689 INFO:teuthology.orchestra.run.smithi087.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-03-30T08:12:32.690 INFO:teuthology.orchestra.run.smithi087.stderr:debconf: falling back to frontend: Readline 2023-03-30T08:12:32.716 INFO:teuthology.orchestra.run.smithi087.stderr:debconf: unable to initialize frontend: Readline 2023-03-30T08:12:32.716 INFO:teuthology.orchestra.run.smithi087.stderr:debconf: (This frontend requires a controlling tty.) 2023-03-30T08:12:32.716 INFO:teuthology.orchestra.run.smithi087.stderr:debconf: falling back to frontend: Teletype 2023-03-30T08:12:32.732 INFO:teuthology.orchestra.run.smithi087.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-03-30T08:12:32.807 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 2,428 kB in 1s (2,566 kB/s) 2023-03-30T08:12:33.077 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 121317 files and directories currently installed.) 2023-03-30T08:12:33.080 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../0-libsqlite3-0_3.31.1-4ubuntu0.5_amd64.deb ... 2023-03-30T08:12:33.263 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) over (3.31.1-4ubuntu0.3) ... 2023-03-30T08:12:33.700 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libglusterfs0:amd64. 2023-03-30T08:12:33.720 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../1-libglusterfs0_7.2-2build1_amd64.deb ... 2023-03-30T08:12:33.758 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libglusterfs0:amd64 (7.2-2build1) ... 2023-03-30T08:12:34.137 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libgfxdr0:amd64. 2023-03-30T08:12:34.156 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../2-libgfxdr0_7.2-2build1_amd64.deb ... 2023-03-30T08:12:34.195 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libgfxdr0:amd64 (7.2-2build1) ... 2023-03-30T08:12:34.557 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libgfrpc0:amd64. 2023-03-30T08:12:34.576 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../3-libgfrpc0_7.2-2build1_amd64.deb ... 2023-03-30T08:12:34.615 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libgfrpc0:amd64 (7.2-2build1) ... 2023-03-30T08:12:34.968 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libgfapi0:amd64. 2023-03-30T08:12:34.986 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../4-libgfapi0_7.2-2build1_amd64.deb ... 2023-03-30T08:12:35.026 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libgfapi0:amd64 (7.2-2build1) ... 2023-03-30T08:12:35.413 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package fio. 2023-03-30T08:12:35.430 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../5-fio_3.16-1_amd64.deb ... 2023-03-30T08:12:35.471 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking fio (3.16-1) ... 2023-03-30T08:12:35.917 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-03-30T08:12:35.935 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../6-libgdbm-dev_1.18.1-5_amd64.deb ... 2023-03-30T08:12:35.975 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libgdbm-dev:amd64 (1.18.1-5) ... 2023-03-30T08:12:36.295 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package sqlite3. 2023-03-30T08:12:36.308 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../7-sqlite3_3.31.1-4ubuntu0.5_amd64.deb ... 2023-03-30T08:12:36.345 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking sqlite3 (3.31.1-4ubuntu0.5) ... 2023-03-30T08:12:36.718 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) ... 2023-03-30T08:12:36.841 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libglusterfs0:amd64 (7.2-2build1) ... 2023-03-30T08:12:36.967 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libgdbm-dev:amd64 (1.18.1-5) ... 2023-03-30T08:12:37.102 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up sqlite3 (3.31.1-4ubuntu0.5) ... 2023-03-30T08:12:37.228 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libgfxdr0:amd64 (7.2-2build1) ... 2023-03-30T08:12:37.355 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libgfrpc0:amd64 (7.2-2build1) ... 2023-03-30T08:12:37.480 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libgfapi0:amd64 (7.2-2build1) ... 2023-03-30T08:12:37.632 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up fio (3.16-1) ... 2023-03-30T08:12:37.918 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-03-30T08:12:38.069 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-03-30T08:12:38.595 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-03-30T08:12:41.406 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-03-30T08:12:42.274 DEBUG:teuthology.orchestra.run.smithi087:> sudo useradd -m fsgqa 2023-03-30T08:12:42.302 INFO:teuthology.orchestra.run.smithi087.stderr:useradd: user 'fsgqa' already exists 2023-03-30T08:12:42.304 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-03-30T08:12:42.305 DEBUG:teuthology.orchestra.run.smithi087:> sudo groupadd fsgqa 2023-03-30T08:12:42.380 INFO:teuthology.orchestra.run.smithi087.stderr:groupadd: group 'fsgqa' already exists 2023-03-30T08:12:42.382 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-03-30T08:12:42.382 DEBUG:teuthology.orchestra.run.smithi087:> sudo useradd fsgqa2 2023-03-30T08:12:42.827 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:12:42.832 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:12:42.840 DEBUG:teuthology.orchestra.run.smithi087:> sudo useradd 123456-fsgqa 2023-03-30T08:12:43.346 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-03-30T08:12:43.511 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.506+0000 7f7521620700 1 Processor -- start 2023-03-30T08:12:43.511 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.510+0000 7f7521620700 1 -- start start 2023-03-30T08:12:43.514 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.510+0000 7f7521620700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f751c0d27e0 0x7f751c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:43.514 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.510+0000 7f7521620700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f751c06a3e0 0x7f751c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:43.514 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.510+0000 7f7521620700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751c160ef0 con 0x7f751c0b8380 2023-03-30T08:12:43.514 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.510+0000 7f7521620700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751c0cd6a0 con 0x7f751c0d27e0 2023-03-30T08:12:43.514 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.510+0000 7f7521620700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0cd3a0 con 0x7f751c06a3e0 2023-03-30T08:12:43.515 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.510+0000 7f751bfff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f751c0b8380 0x7f751c069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41330/0 (socket says 172.21.15.87:41330) 2023-03-30T08:12:43.516 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.510+0000 7f751bfff700 1 -- 172.21.15.87:0/4232853695 learned_addr learned my addr 172.21.15.87:0/4232853695 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T08:12:43.516 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f7520e1f700 1 --2- 172.21.15.87:0/4232853695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f751c06a3e0 0x7f751c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:43.516 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.510+0000 7f751b7fe700 1 --2- 172.21.15.87:0/4232853695 >> v2:172.21.15.87:3300/0 conn(0x7f751c0d27e0 0x7f751c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:43.516 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 -- 172.21.15.87:0/4232853695 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675890704 0 0) 0x7f751c160ef0 con 0x7f751c0b8380 2023-03-30T08:12:43.516 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 -- 172.21.15.87:0/4232853695 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75040035d0 con 0x7f751c0b8380 2023-03-30T08:12:43.516 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 -- 172.21.15.87:0/4232853695 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1476685582 0 0) 0x7f75040035d0 con 0x7f751c0b8380 2023-03-30T08:12:43.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 -- 172.21.15.87:0/4232853695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f751c06a3e0 msgr2=0x7f751c0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:43.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 --2- 172.21.15.87:0/4232853695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f751c06a3e0 0x7f751c0d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 -- 172.21.15.87:0/4232853695 >> v2:172.21.15.87:3300/0 conn(0x7f751c0d27e0 msgr2=0x7f751c0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:43.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 --2- 172.21.15.87:0/4232853695 >> v2:172.21.15.87:3300/0 conn(0x7f751c0d27e0 0x7f751c0d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 -- 172.21.15.87:0/4232853695 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c0cef00 con 0x7f751c0b8380 2023-03-30T08:12:43.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 -- 172.21.15.87:0/4232853695 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f750c0019f0 con 0x7f751c0b8380 2023-03-30T08:12:43.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 -- 172.21.15.87:0/4232853695 >> v1:172.21.15.87:6789/0 conn(0x7f751c0b8380 legacy=0x7f751c069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:43.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 --2- 172.21.15.87:0/4232853695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7504003a20 0x7f7504003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:43.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 --2- 172.21.15.87:0/4232853695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7504004450 0x7f7504004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:43.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 --2- 172.21.15.87:0/4232853695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7504004f30 0x7f750400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:43.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 -- 172.21.15.87:0/4232853695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0cd6a0 con 0x7f7504004f30 2023-03-30T08:12:43.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 -- 172.21.15.87:0/4232853695 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0cd3a0 con 0x7f7504003a20 2023-03-30T08:12:43.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 -- 172.21.15.87:0/4232853695 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750400bf70 con 0x7f7504004450 2023-03-30T08:12:43.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f7520e1f700 1 --2- 172.21.15.87:0/4232853695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f751c06a3e0 0x7f751c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T08:12:43.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f7520e1f700 1 --2- 172.21.15.87:0/4232853695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7504004f30 0x7f750400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:43.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751b7fe700 1 --2- 172.21.15.87:0/4232853695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7504004450 0x7f7504004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:43.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751bfff700 1 --2- 172.21.15.87:0/4232853695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7504003a20 0x7f7504003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:43.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f7520e1f700 1 -- 172.21.15.87:0/4232853695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7504004450 msgr2=0x7f7504004910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:43.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f7520e1f700 1 --2- 172.21.15.87:0/4232853695 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7504004450 0x7f7504004910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f7520e1f700 1 -- 172.21.15.87:0/4232853695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7504003a20 msgr2=0x7f7504003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:43.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f7520e1f700 1 --2- 172.21.15.87:0/4232853695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7504003a20 0x7f7504003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f7520e1f700 1 -- 172.21.15.87:0/4232853695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75040035d0 con 0x7f7504004f30 2023-03-30T08:12:43.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f7520e1f700 1 --2- 172.21.15.87:0/4232853695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7504004f30 0x7f750400ba30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f751c06a7b0 tx=0x7f75040058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ba85b286574fc3 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:43.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 -- 172.21.15.87:0/4232853695 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514004030 con 0x7f7504004f30 2023-03-30T08:12:43.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 -- 172.21.15.87:0/4232853695 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7514004190 con 0x7f7504004f30 2023-03-30T08:12:43.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.514+0000 7f751affd700 1 -- 172.21.15.87:0/4232853695 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514004540 con 0x7f7504004f30 2023-03-30T08:12:43.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.518+0000 7f7521620700 1 -- 172.21.15.87:0/4232853695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7504004f30 msgr2=0x7f750400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:43.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.518+0000 7f7521620700 1 --2- 172.21.15.87:0/4232853695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7504004f30 0x7f750400ba30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f751c06a7b0 tx=0x7f75040058a0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.518+0000 7f7520e1f700 1 -- 172.21.15.87:0/4232853695 reap_dead start 2023-03-30T08:12:43.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.518+0000 7f7521620700 1 -- 172.21.15.87:0/4232853695 shutdown_connections 2023-03-30T08:12:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.518+0000 7f7521620700 1 -- 172.21.15.87:0/4232853695 >> 172.21.15.87:0/4232853695 conn(0x7f751c0b53f0 msgr2=0x7f751c0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.518+0000 7f7521620700 1 -- 172.21.15.87:0/4232853695 shutdown_connections 2023-03-30T08:12:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.518+0000 7f7521620700 1 -- 172.21.15.87:0/4232853695 wait complete. 2023-03-30T08:12:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.518+0000 7f7521620700 1 Processor -- start 2023-03-30T08:12:43.523 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f7521620700 1 -- start start 2023-03-30T08:12:43.525 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f7521620700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7504004f30 0x7f751c0a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:43.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f7521620700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f751c14d660 0x7f751c14c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:43.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f7521620700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f751c14eee0 0x7f751c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:43.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f7521620700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c14de40 con 0x7f751c14d660 2023-03-30T08:12:43.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f7521620700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c14e120 con 0x7f7504004f30 2023-03-30T08:12:43.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f7521620700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c14e400 con 0x7f751c14eee0 2023-03-30T08:12:43.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f751b7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f751c14d660 0x7f751c14c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:43.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f751b7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f751c14d660 0x7f751c14c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37972/0 (socket says 172.21.15.87:37972) 2023-03-30T08:12:43.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f751b7fe700 1 -- 172.21.15.87:0/3705858109 learned_addr learned my addr 172.21.15.87:0/3705858109 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:43.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f751bfff700 1 --2- 172.21.15.87:0/3705858109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7504004f30 0x7f751c0a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:43.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f7520e1f700 1 --2- 172.21.15.87:0/3705858109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f751c14eee0 0x7f751c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:43.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f751b7fe700 1 -- 172.21.15.87:0/3705858109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f751c14eee0 msgr2=0x7f751c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:43.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f751b7fe700 1 --2- 172.21.15.87:0/3705858109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f751c14eee0 0x7f751c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f751b7fe700 1 -- 172.21.15.87:0/3705858109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7504004f30 msgr2=0x7f751c0a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:43.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f751b7fe700 1 --2- 172.21.15.87:0/3705858109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7504004f30 0x7f751c0a9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.522+0000 7f751b7fe700 1 -- 172.21.15.87:0/3705858109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c0cf480 con 0x7f751c14d660 2023-03-30T08:12:43.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.526+0000 7f751b7fe700 1 --2- 172.21.15.87:0/3705858109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f751c14d660 0x7f751c14c070 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7510011a70 tx=0x7f7510011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:43.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.526+0000 7f7518ff9700 1 -- 172.21.15.87:0/3705858109 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751000f940 con 0x7f751c14d660 2023-03-30T08:12:43.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.526+0000 7f7518ff9700 1 -- 172.21.15.87:0/3705858109 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751000faa0 con 0x7f751c14d660 2023-03-30T08:12:43.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.526+0000 7f7521620700 1 -- 172.21.15.87:0/3705858109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751c0cf1a0 con 0x7f751c14d660 2023-03-30T08:12:43.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.526+0000 7f7518ff9700 1 -- 172.21.15.87:0/3705858109 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751000fe30 con 0x7f751c14d660 2023-03-30T08:12:43.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.526+0000 7f7521620700 1 -- 172.21.15.87:0/3705858109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751c0b8750 con 0x7f751c14d660 2023-03-30T08:12:43.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.526+0000 7f7521620700 1 -- 172.21.15.87:0/3705858109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751c072cf0 con 0x7f751c14d660 2023-03-30T08:12:43.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.526+0000 7f7518ff9700 1 -- 172.21.15.87:0/3705858109 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f7510014440 con 0x7f751c14d660 2023-03-30T08:12:43.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.530+0000 7f7518ff9700 1 --2- 172.21.15.87:0/3705858109 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75080653f0 0x7f75080678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:43.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.530+0000 7f7518ff9700 1 -- 172.21.15.87:0/3705858109 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f7510083160 con 0x7f751c14d660 2023-03-30T08:12:43.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.530+0000 7f751bfff700 1 --2- 172.21.15.87:0/3705858109 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75080653f0 0x7f75080678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:43.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.530+0000 7f751bfff700 1 --2- 172.21.15.87:0/3705858109 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75080653f0 0x7f75080678a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f750c002230 tx=0x7f750c006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:43.537 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.534+0000 7f7518ff9700 1 -- 172.21.15.87:0/3705858109 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f7510050ad0 con 0x7f751c14d660 2023-03-30T08:12:43.762 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.758+0000 7f7521620700 1 -- 172.21.15.87:0/3705858109 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f751c0733a0 con 0x7f751c14d660 2023-03-30T08:12:43.762 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.758+0000 7f7518ff9700 1 -- 172.21.15.87:0/3705858109 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f75100540f0 con 0x7f751c14d660 2023-03-30T08:12:43.763 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:12:43.763 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":1,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","modified":"2023-03-30T08:09:44.290819Z","created":"2023-03-30T08:09:44.290819Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:3300","nonce":0},{"type":"v1","addr":"172.21.15.87:6789","nonce":0}]},"addr":"172.21.15.87:6789/0","public_addr":"172.21.15.87:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3301","nonce":0},{"type":"v1","addr":"172.21.15.115:6790","nonce":0}]},"addr":"172.21.15.115:6790/0","public_addr":"172.21.15.115:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-03-30T08:12:43.765 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.762+0000 7f7521620700 1 -- 172.21.15.87:0/3705858109 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75080653f0 msgr2=0x7f75080678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:43.765 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.762+0000 7f7521620700 1 --2- 172.21.15.87:0/3705858109 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75080653f0 0x7f75080678a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f750c002230 tx=0x7f750c006040 comp rx=0 tx=0).stop 2023-03-30T08:12:43.765 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.762+0000 7f7521620700 1 -- 172.21.15.87:0/3705858109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f751c14d660 msgr2=0x7f751c14c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:43.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.762+0000 7f7521620700 1 --2- 172.21.15.87:0/3705858109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f751c14d660 0x7f751c14c070 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7510011a70 tx=0x7f7510011d80 comp rx=0 tx=0).stop 2023-03-30T08:12:43.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.762+0000 7f7521620700 1 -- 172.21.15.87:0/3705858109 shutdown_connections 2023-03-30T08:12:43.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.762+0000 7f7521620700 1 --2- 172.21.15.87:0/3705858109 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75080653f0 0x7f75080678a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.762+0000 7f7521620700 1 --2- 172.21.15.87:0/3705858109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f751c14eee0 0x7f751c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.762+0000 7f7521620700 1 --2- 172.21.15.87:0/3705858109 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f751c14d660 0x7f751c14c070 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.762+0000 7f7521620700 1 --2- 172.21.15.87:0/3705858109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7504004f30 0x7f751c0a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.766 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.762+0000 7f7521620700 1 -- 172.21.15.87:0/3705858109 >> 172.21.15.87:0/3705858109 conn(0x7f751c0b53f0 msgr2=0x7f751c0d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:43.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.762+0000 7f7521620700 1 -- 172.21.15.87:0/3705858109 shutdown_connections 2023-03-30T08:12:43.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.762+0000 7f7521620700 1 -- 172.21.15.87:0/3705858109 wait complete. 2023-03-30T08:12:43.768 INFO:teuthology.orchestra.run.smithi087.stderr:dumped monmap epoch 1 2023-03-30T08:12:43.786 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-03-30T08:12:43.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.938+0000 7eff81e98700 1 Processor -- start 2023-03-30T08:12:43.940 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.938+0000 7eff81e98700 1 -- start start 2023-03-30T08:12:43.942 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.938+0000 7eff81e98700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff7c159050 0x7eff7c069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.938+0000 7eff81e98700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7eff7c0ca4b0 0x7eff7c0ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.938+0000 7eff81e98700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7c0afca0 con 0x7eff7c15cba0 2023-03-30T08:12:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.938+0000 7eff81e98700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7c0afb10 con 0x7eff7c0ca4b0 2023-03-30T08:12:43.943 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.938+0000 7eff81e98700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c0cae70 con 0x7eff7c159050 2023-03-30T08:12:43.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff80e96700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff7c159050 0x7eff7c069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:43.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff80e96700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff7c159050 0x7eff7c069cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:37302/0 (socket says 172.21.15.87:37302) 2023-03-30T08:12:43.944 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff80e96700 1 -- 172.21.15.87:0/1533061323 learned_addr learned my addr 172.21.15.87:0/1533061323 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:43.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff81697700 1 --2- 172.21.15.87:0/1533061323 >> v2:172.21.15.115:3300/0 conn(0x7eff7c0ca4b0 0x7eff7c0ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:43.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff80e96700 1 -- 172.21.15.87:0/1533061323 >> v2:172.21.15.115:3300/0 conn(0x7eff7c0ca4b0 msgr2=0x7eff7c0ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T08:12:43.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff80e96700 1 --2- 172.21.15.87:0/1533061323 >> v2:172.21.15.115:3300/0 conn(0x7eff7c0ca4b0 0x7eff7c0ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff80e96700 1 -- 172.21.15.87:0/1533061323 >> v1:172.21.15.115:6789/0 conn(0x7eff7c15cba0 legacy=0x7eff7c0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:43.945 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff80e96700 1 -- 172.21.15.87:0/1533061323 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7c15d110 con 0x7eff7c159050 2023-03-30T08:12:43.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff80e96700 1 --2- 172.21.15.87:0/1533061323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff7c159050 0x7eff7c069cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7eff70009910 tx=0x7eff70009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeb8c7a58f99bde server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:43.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff7b7fe700 1 -- 172.21.15.87:0/1533061323 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70011830 con 0x7eff7c159050 2023-03-30T08:12:43.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff7b7fe700 1 -- 172.21.15.87:0/1533061323 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff70011990 con 0x7eff7c159050 2023-03-30T08:12:43.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff7b7fe700 1 -- 172.21.15.87:0/1533061323 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70011d40 con 0x7eff7c159050 2023-03-30T08:12:43.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff81e98700 1 -- 172.21.15.87:0/1533061323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff7c159050 msgr2=0x7eff7c069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:43.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff81e98700 1 --2- 172.21.15.87:0/1533061323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff7c159050 0x7eff7c069cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7eff70009910 tx=0x7eff70009c20 comp rx=0 tx=0).stop 2023-03-30T08:12:43.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff81e98700 1 -- 172.21.15.87:0/1533061323 shutdown_connections 2023-03-30T08:12:43.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff81e98700 1 --2- 172.21.15.87:0/1533061323 >> v2:172.21.15.115:3300/0 conn(0x7eff7c0ca4b0 0x7eff7c0ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff81e98700 1 --2- 172.21.15.87:0/1533061323 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff7c159050 0x7eff7c069cd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff81e98700 1 -- 172.21.15.87:0/1533061323 >> 172.21.15.87:0/1533061323 conn(0x7eff7c0cf410 msgr2=0x7eff7c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:43.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff81e98700 1 -- 172.21.15.87:0/1533061323 shutdown_connections 2023-03-30T08:12:43.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.942+0000 7eff81e98700 1 -- 172.21.15.87:0/1533061323 wait complete. 2023-03-30T08:12:43.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.946+0000 7eff81e98700 1 Processor -- start 2023-03-30T08:12:43.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.946+0000 7eff81e98700 1 -- start start 2023-03-30T08:12:43.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81e98700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff7c0ca4b0 0x7eff7c15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:43.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81e98700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff7c159050 0x7eff7c159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:43.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81e98700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff7c15cba0 0x7eff7c0c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:43.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81e98700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c15b0e0 con 0x7eff7c15cba0 2023-03-30T08:12:43.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81e98700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c15a730 con 0x7eff7c0ca4b0 2023-03-30T08:12:43.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81e98700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c0c52e0 con 0x7eff7c159050 2023-03-30T08:12:43.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81697700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff7c15cba0 0x7eff7c0c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:43.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81697700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff7c15cba0 0x7eff7c0c4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:37980/0 (socket says 172.21.15.87:37980) 2023-03-30T08:12:43.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81697700 1 -- 172.21.15.87:0/1237120396 learned_addr learned my addr 172.21.15.87:0/1237120396 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T08:12:43.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff7bfff700 1 --2- 172.21.15.87:0/1237120396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff7c159050 0x7eff7c159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:43.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff80e96700 1 --2- 172.21.15.87:0/1237120396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff7c0ca4b0 0x7eff7c15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:43.954 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81697700 1 -- 172.21.15.87:0/1237120396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff7c159050 msgr2=0x7eff7c159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81697700 1 --2- 172.21.15.87:0/1237120396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff7c159050 0x7eff7c159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81697700 1 -- 172.21.15.87:0/1237120396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff7c0ca4b0 msgr2=0x7eff7c15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81697700 1 --2- 172.21.15.87:0/1237120396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff7c0ca4b0 0x7eff7c15b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81697700 1 -- 172.21.15.87:0/1237120396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff70009570 con 0x7eff7c15cba0 2023-03-30T08:12:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff80e96700 1 --2- 172.21.15.87:0/1237120396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff7c0ca4b0 0x7eff7c15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T08:12:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81697700 1 --2- 172.21.15.87:0/1237120396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff7c15cba0 0x7eff7c0c4da0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7eff7400efc0 tx=0x7eff7400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff797fa700 1 -- 172.21.15.87:0/1237120396 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff74009ea0 con 0x7eff7c15cba0 2023-03-30T08:12:43.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff797fa700 1 -- 172.21.15.87:0/1237120396 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7400f040 con 0x7eff7c15cba0 2023-03-30T08:12:43.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff797fa700 1 -- 172.21.15.87:0/1237120396 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff74014480 con 0x7eff7c15cba0 2023-03-30T08:12:43.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81e98700 1 -- 172.21.15.87:0/1237120396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff7c15d6d0 con 0x7eff7c15cba0 2023-03-30T08:12:43.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.950+0000 7eff81e98700 1 -- 172.21.15.87:0/1237120396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7c15d3f0 con 0x7eff7c15cba0 2023-03-30T08:12:43.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.954+0000 7eff81e98700 1 -- 172.21.15.87:0/1237120396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff7c15d9b0 con 0x7eff7c15cba0 2023-03-30T08:12:43.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.954+0000 7eff797fa700 1 -- 172.21.15.87:0/1237120396 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7eff740145e0 con 0x7eff7c15cba0 2023-03-30T08:12:43.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.954+0000 7eff797fa700 1 --2- 172.21.15.87:0/1237120396 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7eff68065420 0x7eff680678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T08:12:43.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.954+0000 7eff797fa700 1 -- 172.21.15.87:0/1237120396 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7eff740834d0 con 0x7eff7c15cba0 2023-03-30T08:12:43.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.954+0000 7eff80e96700 1 --2- 172.21.15.87:0/1237120396 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7eff68065420 0x7eff680678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T08:12:43.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.958+0000 7eff80e96700 1 --2- 172.21.15.87:0/1237120396 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7eff68065420 0x7eff680678d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7eff70000c00 tx=0x7eff70008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T08:12:43.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:43.962+0000 7eff797fa700 1 -- 172.21.15.87:0/1237120396 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7eff74050fc0 con 0x7eff7c15cba0 2023-03-30T08:12:44.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:44.182+0000 7eff81e98700 1 -- 172.21.15.87:0/1237120396 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7eff7c0c2d30 con 0x7eff7c15cba0 2023-03-30T08:12:44.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:44.182+0000 7eff797fa700 1 -- 172.21.15.87:0/1237120396 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7eff740545e0 con 0x7eff7c15cba0 2023-03-30T08:12:44.186 INFO:teuthology.orchestra.run.smithi087.stdout:[client.admin] 2023-03-30T08:12:44.186 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 2023-03-30T08:12:44.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:44.186+0000 7eff81e98700 1 -- 172.21.15.87:0/1237120396 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7eff68065420 msgr2=0x7eff680678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:44.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:44.186+0000 7eff81e98700 1 --2- 172.21.15.87:0/1237120396 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7eff68065420 0x7eff680678d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7eff70000c00 tx=0x7eff70008030 comp rx=0 tx=0).stop 2023-03-30T08:12:44.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:44.186+0000 7eff81e98700 1 -- 172.21.15.87:0/1237120396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff7c15cba0 msgr2=0x7eff7c0c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T08:12:44.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:44.186+0000 7eff81e98700 1 --2- 172.21.15.87:0/1237120396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff7c15cba0 0x7eff7c0c4da0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7eff7400efc0 tx=0x7eff7400c3a0 comp rx=0 tx=0).stop 2023-03-30T08:12:44.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:44.186+0000 7eff81e98700 1 -- 172.21.15.87:0/1237120396 shutdown_connections 2023-03-30T08:12:44.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:44.186+0000 7eff81e98700 1 --2- 172.21.15.87:0/1237120396 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7eff68065420 0x7eff680678d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:44.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:44.186+0000 7eff81e98700 1 --2- 172.21.15.87:0/1237120396 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff7c15cba0 0x7eff7c0c4da0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:44.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:44.186+0000 7eff81e98700 1 --2- 172.21.15.87:0/1237120396 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff7c159050 0x7eff7c159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:44.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:44.186+0000 7eff81e98700 1 --2- 172.21.15.87:0/1237120396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff7c0ca4b0 0x7eff7c15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T08:12:44.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:44.186+0000 7eff81e98700 1 -- 172.21.15.87:0/1237120396 >> 172.21.15.87:0/1237120396 conn(0x7eff7c0cf410 msgr2=0x7eff7c153bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T08:12:44.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:44.186+0000 7eff81e98700 1 -- 172.21.15.87:0/1237120396 shutdown_connections 2023-03-30T08:12:44.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T08:12:44.186+0000 7eff81e98700 1 -- 172.21.15.87:0/1237120396 wait complete. 2023-03-30T08:12:44.210 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:12:44.210 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/tmp/tmp.dmK5MK8Zk9xfstests-dev/local.config 2023-03-30T08:12:44.238 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.87:6789:/test export TEST_DIR=/tmp/tmp.3MaCcqrm21test export SCRATCH_DEV=172.21.15.87:6789:/scratch export SCRATCH_MNT=/tmp/tmp.T6S6cZMyVfscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ==" 2023-03-30T08:12:44.239 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T08:12:44.239 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/tmp/tmp.dmK5MK8Zk9xfstests-dev/ceph.exclude 2023-03-30T08:12:44.316 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo make) 2023-03-30T08:12:44.418 INFO:teuthology.orchestra.run.smithi087.stdout:libtoolize -cfi 2023-03-30T08:12:44.999 INFO:teuthology.orchestra.run.smithi087.stdout:libtoolize: putting auxiliary files in '.'. 2023-03-30T08:12:44.999 INFO:teuthology.orchestra.run.smithi087.stdout:libtoolize: copying file './config.guess' 2023-03-30T08:12:45.021 INFO:teuthology.orchestra.run.smithi087.stdout:libtoolize: copying file './config.sub' 2023-03-30T08:12:45.050 INFO:teuthology.orchestra.run.smithi087.stdout:libtoolize: copying file './install-sh' 2023-03-30T08:12:45.073 INFO:teuthology.orchestra.run.smithi087.stdout:libtoolize: copying file './ltmain.sh' 2023-03-30T08:12:45.168 INFO:teuthology.orchestra.run.smithi087.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-03-30T08:12:45.168 INFO:teuthology.orchestra.run.smithi087.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-03-30T08:12:45.200 INFO:teuthology.orchestra.run.smithi087.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-03-30T08:12:45.218 INFO:teuthology.orchestra.run.smithi087.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-03-30T08:12:45.243 INFO:teuthology.orchestra.run.smithi087.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-03-30T08:12:45.266 INFO:teuthology.orchestra.run.smithi087.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-03-30T08:12:45.286 INFO:teuthology.orchestra.run.smithi087.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-03-30T08:12:45.291 INFO:teuthology.orchestra.run.smithi087.stdout:cp include/install-sh . 2023-03-30T08:12:45.295 INFO:teuthology.orchestra.run.smithi087.stdout:aclocal -I m4 2023-03-30T08:12:46.810 INFO:teuthology.orchestra.run.smithi087.stdout:autoheader 2023-03-30T08:12:47.235 INFO:teuthology.orchestra.run.smithi087.stdout:autoconf 2023-03-30T08:12:47.544 INFO:teuthology.orchestra.run.smithi087.stdout:./configure \ 2023-03-30T08:12:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: --libexecdir=/usr/lib \ 2023-03-30T08:12:47.545 INFO:teuthology.orchestra.run.smithi087.stdout: --exec_prefix=/var/lib 2023-03-30T08:12:48.750 INFO:teuthology.orchestra.run.smithi087.stdout:checking build system type... x86_64-pc-linux-gnu 2023-03-30T08:12:48.751 INFO:teuthology.orchestra.run.smithi087.stdout:checking host system type... x86_64-pc-linux-gnu 2023-03-30T08:12:48.809 INFO:teuthology.orchestra.run.smithi087.stdout:checking how to print strings... printf 2023-03-30T08:12:48.811 INFO:teuthology.orchestra.run.smithi087.stdout:checking for gcc... gcc 2023-03-30T08:12:49.096 INFO:teuthology.orchestra.run.smithi087.stdout:checking whether the C compiler works... yes 2023-03-30T08:12:49.097 INFO:teuthology.orchestra.run.smithi087.stdout:checking for C compiler default output file name... a.out 2023-03-30T08:12:49.168 INFO:teuthology.orchestra.run.smithi087.stdout:checking for suffix of executables... 2023-03-30T08:12:49.307 INFO:teuthology.orchestra.run.smithi087.stdout:checking whether we are cross compiling... no 2023-03-30T08:12:49.360 INFO:teuthology.orchestra.run.smithi087.stdout:checking for suffix of object files... o 2023-03-30T08:12:49.415 INFO:teuthology.orchestra.run.smithi087.stdout:checking whether we are using the GNU C compiler... yes 2023-03-30T08:12:49.471 INFO:teuthology.orchestra.run.smithi087.stdout:checking whether gcc accepts -g... yes 2023-03-30T08:12:49.594 INFO:teuthology.orchestra.run.smithi087.stdout:checking for gcc option to accept ISO C89... none needed 2023-03-30T08:12:49.607 INFO:teuthology.orchestra.run.smithi087.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-03-30T08:12:49.617 INFO:teuthology.orchestra.run.smithi087.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-03-30T08:12:49.623 INFO:teuthology.orchestra.run.smithi087.stdout:checking for egrep... /usr/bin/grep -E 2023-03-30T08:12:49.628 INFO:teuthology.orchestra.run.smithi087.stdout:checking for fgrep... /usr/bin/grep -F 2023-03-30T08:12:49.642 INFO:teuthology.orchestra.run.smithi087.stdout:checking for ld used by gcc... /usr/bin/ld 2023-03-30T08:12:49.651 INFO:teuthology.orchestra.run.smithi087.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-03-30T08:12:49.664 INFO:teuthology.orchestra.run.smithi087.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-03-30T08:12:49.733 INFO:teuthology.orchestra.run.smithi087.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-03-30T08:12:49.733 INFO:teuthology.orchestra.run.smithi087.stdout:checking whether ln -s works... yes 2023-03-30T08:12:49.758 INFO:teuthology.orchestra.run.smithi087.stdout:checking the maximum length of command line arguments... 1572864 2023-03-30T08:12:49.768 INFO:teuthology.orchestra.run.smithi087.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-03-30T08:12:49.768 INFO:teuthology.orchestra.run.smithi087.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-03-30T08:12:49.769 INFO:teuthology.orchestra.run.smithi087.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-03-30T08:12:49.770 INFO:teuthology.orchestra.run.smithi087.stdout:checking for objdump... objdump 2023-03-30T08:12:49.771 INFO:teuthology.orchestra.run.smithi087.stdout:checking how to recognize dependent libraries... pass_all 2023-03-30T08:12:49.772 INFO:teuthology.orchestra.run.smithi087.stdout:checking for dlltool... no 2023-03-30T08:12:49.773 INFO:teuthology.orchestra.run.smithi087.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-03-30T08:12:49.775 INFO:teuthology.orchestra.run.smithi087.stdout:checking for ar... ar 2023-03-30T08:12:49.848 INFO:teuthology.orchestra.run.smithi087.stdout:checking for archiver @FILE support... @ 2023-03-30T08:12:49.849 INFO:teuthology.orchestra.run.smithi087.stdout:checking for strip... strip 2023-03-30T08:12:49.850 INFO:teuthology.orchestra.run.smithi087.stdout:checking for ranlib... ranlib 2023-03-30T08:12:49.851 INFO:teuthology.orchestra.run.smithi087.stdout:checking for gawk... gawk 2023-03-30T08:12:50.046 INFO:teuthology.orchestra.run.smithi087.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-03-30T08:12:50.051 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sysroot... no 2023-03-30T08:12:50.061 INFO:teuthology.orchestra.run.smithi087.stdout:checking for a working dd... /usr/bin/dd 2023-03-30T08:12:50.073 INFO:teuthology.orchestra.run.smithi087.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-03-30T08:12:50.116 INFO:teuthology.orchestra.run.smithi087.stdout:checking for mt... mt 2023-03-30T08:12:50.138 INFO:teuthology.orchestra.run.smithi087.stdout:checking if mt is a manifest tool... no 2023-03-30T08:12:50.228 INFO:teuthology.orchestra.run.smithi087.stdout:checking how to run the C preprocessor... gcc -E 2023-03-30T08:12:50.541 INFO:teuthology.orchestra.run.smithi087.stdout:checking for ANSI C header files... yes 2023-03-30T08:12:50.607 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/types.h... yes 2023-03-30T08:12:50.684 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/stat.h... yes 2023-03-30T08:12:50.767 INFO:teuthology.orchestra.run.smithi087.stdout:checking for stdlib.h... yes 2023-03-30T08:12:50.861 INFO:teuthology.orchestra.run.smithi087.stdout:checking for string.h... yes 2023-03-30T08:12:50.956 INFO:teuthology.orchestra.run.smithi087.stdout:checking for memory.h... yes 2023-03-30T08:12:51.045 INFO:teuthology.orchestra.run.smithi087.stdout:checking for strings.h... yes 2023-03-30T08:12:51.138 INFO:teuthology.orchestra.run.smithi087.stdout:checking for inttypes.h... yes 2023-03-30T08:12:51.227 INFO:teuthology.orchestra.run.smithi087.stdout:checking for stdint.h... yes 2023-03-30T08:12:51.322 INFO:teuthology.orchestra.run.smithi087.stdout:checking for unistd.h... yes 2023-03-30T08:12:51.410 INFO:teuthology.orchestra.run.smithi087.stdout:checking for dlfcn.h... yes 2023-03-30T08:12:51.424 INFO:teuthology.orchestra.run.smithi087.stdout:checking for objdir... .libs 2023-03-30T08:12:51.638 INFO:teuthology.orchestra.run.smithi087.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-03-30T08:12:51.638 INFO:teuthology.orchestra.run.smithi087.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-03-30T08:12:51.701 INFO:teuthology.orchestra.run.smithi087.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-03-30T08:12:51.904 INFO:teuthology.orchestra.run.smithi087.stdout:checking if gcc static flag -static works... yes 2023-03-30T08:12:51.991 INFO:teuthology.orchestra.run.smithi087.stdout:checking if gcc supports -c -o file.o... yes 2023-03-30T08:12:51.992 INFO:teuthology.orchestra.run.smithi087.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-03-30T08:12:52.022 INFO:teuthology.orchestra.run.smithi087.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-03-30T08:12:52.096 INFO:teuthology.orchestra.run.smithi087.stdout:checking whether -lc should be explicitly linked in... no 2023-03-30T08:12:52.246 INFO:teuthology.orchestra.run.smithi087.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-03-30T08:12:52.247 INFO:teuthology.orchestra.run.smithi087.stdout:checking how to hardcode library paths into programs... immediate 2023-03-30T08:12:52.260 INFO:teuthology.orchestra.run.smithi087.stdout:checking whether stripping libraries is possible... yes 2023-03-30T08:12:52.261 INFO:teuthology.orchestra.run.smithi087.stdout:checking if libtool supports shared libraries... yes 2023-03-30T08:12:52.261 INFO:teuthology.orchestra.run.smithi087.stdout:checking whether to build shared libraries... yes 2023-03-30T08:12:52.261 INFO:teuthology.orchestra.run.smithi087.stdout:checking whether to build static libraries... yes 2023-03-30T08:12:52.297 INFO:teuthology.orchestra.run.smithi087.stdout:checking for gcc... (cached) gcc 2023-03-30T08:12:52.364 INFO:teuthology.orchestra.run.smithi087.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-03-30T08:12:52.365 INFO:teuthology.orchestra.run.smithi087.stdout:checking whether gcc accepts -g... (cached) yes 2023-03-30T08:12:52.365 INFO:teuthology.orchestra.run.smithi087.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-03-30T08:12:52.366 INFO:teuthology.orchestra.run.smithi087.stdout:checking for gmake... no 2023-03-30T08:12:52.367 INFO:teuthology.orchestra.run.smithi087.stdout:checking for make... /usr/bin/make 2023-03-30T08:12:52.368 INFO:teuthology.orchestra.run.smithi087.stderr:./configure: line 8824: test: $(SHELL): binary operator expected 2023-03-30T08:12:52.369 INFO:teuthology.orchestra.run.smithi087.stdout:checking for tar... /bin/tar 2023-03-30T08:12:52.370 INFO:teuthology.orchestra.run.smithi087.stdout:checking for gzip... /bin/gzip 2023-03-30T08:12:52.397 INFO:teuthology.orchestra.run.smithi087.stdout:checking whether gcc -MM is supported... yes 2023-03-30T08:12:52.399 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sort... /bin/sort 2023-03-30T08:12:52.399 INFO:teuthology.orchestra.run.smithi087.stdout:checking whether ln -s works... yes 2023-03-30T08:12:52.400 INFO:teuthology.orchestra.run.smithi087.stdout:checking for rpm... no 2023-03-30T08:12:52.483 INFO:teuthology.orchestra.run.smithi087.stdout:checking assert.h usability... yes 2023-03-30T08:12:52.508 INFO:teuthology.orchestra.run.smithi087.stdout:checking assert.h presence... yes 2023-03-30T08:12:52.508 INFO:teuthology.orchestra.run.smithi087.stdout:checking for assert.h... yes 2023-03-30T08:12:52.609 INFO:teuthology.orchestra.run.smithi087.stdout:checking bstring.h usability... no 2023-03-30T08:12:52.650 INFO:teuthology.orchestra.run.smithi087.stdout:checking bstring.h presence... no 2023-03-30T08:12:52.650 INFO:teuthology.orchestra.run.smithi087.stdout:checking for bstring.h... no 2023-03-30T08:12:52.734 INFO:teuthology.orchestra.run.smithi087.stdout:checking libgen.h usability... yes 2023-03-30T08:12:52.759 INFO:teuthology.orchestra.run.smithi087.stdout:checking libgen.h presence... yes 2023-03-30T08:12:52.759 INFO:teuthology.orchestra.run.smithi087.stdout:checking for libgen.h... yes 2023-03-30T08:12:52.855 INFO:teuthology.orchestra.run.smithi087.stdout:checking dirent.h usability... yes 2023-03-30T08:12:52.884 INFO:teuthology.orchestra.run.smithi087.stdout:checking dirent.h presence... yes 2023-03-30T08:12:52.885 INFO:teuthology.orchestra.run.smithi087.stdout:checking for dirent.h... yes 2023-03-30T08:12:53.006 INFO:teuthology.orchestra.run.smithi087.stdout:checking errno.h usability... yes 2023-03-30T08:12:53.036 INFO:teuthology.orchestra.run.smithi087.stdout:checking errno.h presence... yes 2023-03-30T08:12:53.036 INFO:teuthology.orchestra.run.smithi087.stdout:checking for errno.h... yes 2023-03-30T08:12:53.141 INFO:teuthology.orchestra.run.smithi087.stdout:checking malloc.h usability... yes 2023-03-30T08:12:53.182 INFO:teuthology.orchestra.run.smithi087.stdout:checking malloc.h presence... yes 2023-03-30T08:12:53.182 INFO:teuthology.orchestra.run.smithi087.stdout:checking for malloc.h... yes 2023-03-30T08:12:53.269 INFO:teuthology.orchestra.run.smithi087.stdout:checking uuid.h usability... no 2023-03-30T08:12:53.310 INFO:teuthology.orchestra.run.smithi087.stdout:checking uuid.h presence... no 2023-03-30T08:12:53.310 INFO:teuthology.orchestra.run.smithi087.stdout:checking for uuid.h... no 2023-03-30T08:12:53.406 INFO:teuthology.orchestra.run.smithi087.stdout:checking uuid/uuid.h usability... yes 2023-03-30T08:12:53.441 INFO:teuthology.orchestra.run.smithi087.stdout:checking uuid/uuid.h presence... yes 2023-03-30T08:12:53.442 INFO:teuthology.orchestra.run.smithi087.stdout:checking for uuid/uuid.h... yes 2023-03-30T08:12:53.550 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/uuid.h usability... no 2023-03-30T08:12:53.597 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/uuid.h presence... no 2023-03-30T08:12:53.597 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/uuid.h... no 2023-03-30T08:12:53.682 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/file.h usability... yes 2023-03-30T08:12:53.712 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/file.h presence... yes 2023-03-30T08:12:53.712 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/file.h... yes 2023-03-30T08:12:53.814 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/fcntl.h usability... yes 2023-03-30T08:12:53.841 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/fcntl.h presence... yes 2023-03-30T08:12:53.842 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/fcntl.h... yes 2023-03-30T08:12:53.943 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/syssgi.h usability... no 2023-03-30T08:12:53.984 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/syssgi.h presence... no 2023-03-30T08:12:53.985 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/syssgi.h... no 2023-03-30T08:12:54.104 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/param.h usability... yes 2023-03-30T08:12:54.141 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/param.h presence... yes 2023-03-30T08:12:54.141 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/param.h... yes 2023-03-30T08:12:54.163 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/stat.h... (cached) yes 2023-03-30T08:12:54.257 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/statvfs.h usability... yes 2023-03-30T08:12:54.285 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/statvfs.h presence... yes 2023-03-30T08:12:54.286 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/statvfs.h... yes 2023-03-30T08:12:54.382 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/time.h usability... yes 2023-03-30T08:12:54.414 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/time.h presence... yes 2023-03-30T08:12:54.414 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/time.h... yes 2023-03-30T08:12:54.526 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/ioctl.h usability... yes 2023-03-30T08:12:54.554 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/ioctl.h presence... yes 2023-03-30T08:12:54.554 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/ioctl.h... yes 2023-03-30T08:12:54.659 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/wait.h usability... yes 2023-03-30T08:12:54.689 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/wait.h presence... yes 2023-03-30T08:12:54.690 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/wait.h... yes 2023-03-30T08:12:54.715 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/types.h... (cached) yes 2023-03-30T08:12:54.739 INFO:teuthology.orchestra.run.smithi087.stdout:checking for strings.h... (cached) yes 2023-03-30T08:12:54.838 INFO:teuthology.orchestra.run.smithi087.stdout:checking err.h usability... yes 2023-03-30T08:12:54.864 INFO:teuthology.orchestra.run.smithi087.stdout:checking err.h presence... yes 2023-03-30T08:12:54.865 INFO:teuthology.orchestra.run.smithi087.stdout:checking for err.h... yes 2023-03-30T08:12:54.963 INFO:teuthology.orchestra.run.smithi087.stdout:checking linux/falloc.h usability... yes 2023-03-30T08:12:54.991 INFO:teuthology.orchestra.run.smithi087.stdout:checking linux/falloc.h presence... yes 2023-03-30T08:12:54.992 INFO:teuthology.orchestra.run.smithi087.stdout:checking for linux/falloc.h... yes 2023-03-30T08:12:55.090 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-03-30T08:12:55.133 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-03-30T08:12:55.133 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/fs/xfs_fsops.h... no 2023-03-30T08:12:55.213 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/fs/xfs_itable.h usability... no 2023-03-30T08:12:55.258 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/fs/xfs_itable.h presence... no 2023-03-30T08:12:55.259 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/fs/xfs_itable.h... no 2023-03-30T08:12:55.341 INFO:teuthology.orchestra.run.smithi087.stdout:checking xfs/platform_defs.h usability... no 2023-03-30T08:12:55.380 INFO:teuthology.orchestra.run.smithi087.stdout:checking xfs/platform_defs.h presence... no 2023-03-30T08:12:55.381 INFO:teuthology.orchestra.run.smithi087.stdout:checking for xfs/platform_defs.h... no 2023-03-30T08:12:55.461 INFO:teuthology.orchestra.run.smithi087.stdout:checking btrfs/ioctl.h usability... no 2023-03-30T08:12:55.505 INFO:teuthology.orchestra.run.smithi087.stdout:checking btrfs/ioctl.h presence... no 2023-03-30T08:12:55.505 INFO:teuthology.orchestra.run.smithi087.stdout:checking for btrfs/ioctl.h... no 2023-03-30T08:12:55.585 INFO:teuthology.orchestra.run.smithi087.stdout:checking cifs/ioctl.h usability... no 2023-03-30T08:12:55.624 INFO:teuthology.orchestra.run.smithi087.stdout:checking cifs/ioctl.h presence... no 2023-03-30T08:12:55.625 INFO:teuthology.orchestra.run.smithi087.stdout:checking for cifs/ioctl.h... no 2023-03-30T08:12:55.710 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/mman.h usability... yes 2023-03-30T08:12:55.740 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/mman.h presence... yes 2023-03-30T08:12:55.740 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/mman.h... yes 2023-03-30T08:12:55.802 INFO:teuthology.orchestra.run.smithi087.stdout:checking for xfs/xfs_log_format.h... no 2023-03-30T08:12:55.905 INFO:teuthology.orchestra.run.smithi087.stdout:checking for uuid_compare... no 2023-03-30T08:12:55.989 INFO:teuthology.orchestra.run.smithi087.stdout:checking for uuid_compare in -luuid... yes 2023-03-30T08:12:56.134 INFO:teuthology.orchestra.run.smithi087.stdout:checking for xfs/xfs.h... yes 2023-03-30T08:12:56.192 INFO:teuthology.orchestra.run.smithi087.stdout:checking for xfs/libxfs.h... no 2023-03-30T08:12:56.251 INFO:teuthology.orchestra.run.smithi087.stdout:checking whether xlog_assign_lsn is declared... no 2023-03-30T08:12:56.330 INFO:teuthology.orchestra.run.smithi087.stdout:checking for xfs/xqm.h... yes 2023-03-30T08:12:56.454 INFO:teuthology.orchestra.run.smithi087.stdout:checking xfsctl from xfs/xfs.h... ok 2023-03-30T08:12:56.527 INFO:teuthology.orchestra.run.smithi087.stdout:checking xfs/handle.h usability... yes 2023-03-30T08:12:56.553 INFO:teuthology.orchestra.run.smithi087.stdout:checking xfs/handle.h presence... yes 2023-03-30T08:12:56.554 INFO:teuthology.orchestra.run.smithi087.stdout:checking for xfs/handle.h... yes 2023-03-30T08:12:56.641 INFO:teuthology.orchestra.run.smithi087.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-03-30T08:12:56.723 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/acl.h usability... yes 2023-03-30T08:12:56.750 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/acl.h presence... yes 2023-03-30T08:12:56.750 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/acl.h... yes 2023-03-30T08:12:56.829 INFO:teuthology.orchestra.run.smithi087.stdout:checking acl/libacl.h usability... yes 2023-03-30T08:12:56.860 INFO:teuthology.orchestra.run.smithi087.stdout:checking acl/libacl.h presence... yes 2023-03-30T08:12:56.860 INFO:teuthology.orchestra.run.smithi087.stdout:checking for acl/libacl.h... yes 2023-03-30T08:12:56.954 INFO:teuthology.orchestra.run.smithi087.stdout:checking for acl_init in -lacl... yes 2023-03-30T08:12:57.031 INFO:teuthology.orchestra.run.smithi087.stdout:checking gdbm-ndbm.h usability... no 2023-03-30T08:12:57.075 INFO:teuthology.orchestra.run.smithi087.stdout:checking gdbm-ndbm.h presence... no 2023-03-30T08:12:57.075 INFO:teuthology.orchestra.run.smithi087.stdout:checking for gdbm-ndbm.h... no 2023-03-30T08:12:57.148 INFO:teuthology.orchestra.run.smithi087.stdout:checking gdbm/ndbm.h usability... no 2023-03-30T08:12:57.187 INFO:teuthology.orchestra.run.smithi087.stdout:checking gdbm/ndbm.h presence... no 2023-03-30T08:12:57.188 INFO:teuthology.orchestra.run.smithi087.stdout:checking for gdbm/ndbm.h... no 2023-03-30T08:12:57.260 INFO:teuthology.orchestra.run.smithi087.stdout:checking ndbm.h usability... no 2023-03-30T08:12:57.299 INFO:teuthology.orchestra.run.smithi087.stdout:checking ndbm.h presence... no 2023-03-30T08:12:57.299 INFO:teuthology.orchestra.run.smithi087.stdout:checking for ndbm.h... no 2023-03-30T08:12:57.378 INFO:teuthology.orchestra.run.smithi087.stdout:checking libaio.h usability... yes 2023-03-30T08:12:57.415 INFO:teuthology.orchestra.run.smithi087.stdout:checking libaio.h presence... yes 2023-03-30T08:12:57.415 INFO:teuthology.orchestra.run.smithi087.stdout:checking for libaio.h... yes 2023-03-30T08:12:57.493 INFO:teuthology.orchestra.run.smithi087.stdout:checking liburing.h usability... no 2023-03-30T08:12:57.541 INFO:teuthology.orchestra.run.smithi087.stdout:checking liburing.h presence... no 2023-03-30T08:12:57.541 INFO:teuthology.orchestra.run.smithi087.stdout:checking for liburing.h... no 2023-03-30T08:12:57.609 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/capability.h usability... no 2023-03-30T08:12:57.651 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/capability.h presence... no 2023-03-30T08:12:57.651 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/capability.h... no 2023-03-30T08:12:57.726 INFO:teuthology.orchestra.run.smithi087.stdout:checking linux/fiemap.h usability... yes 2023-03-30T08:12:57.755 INFO:teuthology.orchestra.run.smithi087.stdout:checking linux/fiemap.h presence... yes 2023-03-30T08:12:57.755 INFO:teuthology.orchestra.run.smithi087.stdout:checking for linux/fiemap.h... yes 2023-03-30T08:12:57.850 INFO:teuthology.orchestra.run.smithi087.stdout:checking for fallocate... yes 2023-03-30T08:12:57.946 INFO:teuthology.orchestra.run.smithi087.stdout:checking for open_by_handle_at... yes 2023-03-30T08:12:58.026 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/prctl.h usability... yes 2023-03-30T08:12:58.054 INFO:teuthology.orchestra.run.smithi087.stdout:checking sys/prctl.h presence... yes 2023-03-30T08:12:58.054 INFO:teuthology.orchestra.run.smithi087.stdout:checking for sys/prctl.h... yes 2023-03-30T08:12:58.131 INFO:teuthology.orchestra.run.smithi087.stdout:checking linux/fs.h usability... yes 2023-03-30T08:12:58.161 INFO:teuthology.orchestra.run.smithi087.stdout:checking linux/fs.h presence... yes 2023-03-30T08:12:58.162 INFO:teuthology.orchestra.run.smithi087.stdout:checking for linux/fs.h... yes 2023-03-30T08:12:58.235 INFO:teuthology.orchestra.run.smithi087.stdout:checking btrfsutil.h usability... no 2023-03-30T08:12:58.277 INFO:teuthology.orchestra.run.smithi087.stdout:checking btrfsutil.h presence... no 2023-03-30T08:12:58.277 INFO:teuthology.orchestra.run.smithi087.stdout:checking for btrfsutil.h... no 2023-03-30T08:12:58.376 INFO:teuthology.orchestra.run.smithi087.stdout:checking for copy_file_range... yes 2023-03-30T08:12:58.472 INFO:teuthology.orchestra.run.smithi087.stdout:checking for SEEK_DATA... yes 2023-03-30T08:12:58.579 INFO:teuthology.orchestra.run.smithi087.stdout:checking for BMV_OF_SHARED... yes 2023-03-30T08:12:58.669 INFO:teuthology.orchestra.run.smithi087.stdout:checking for nftw... yes 2023-03-30T08:12:58.764 INFO:teuthology.orchestra.run.smithi087.stdout:checking for RLIMIT_NOFILE... yes 2023-03-30T08:12:58.828 INFO:teuthology.orchestra.run.smithi087.stdout:checking for FIEXCHANGE_RANGE... no 2023-03-30T08:12:58.914 INFO:teuthology.orchestra.run.smithi087.stdout:checking for renameat2... yes 2023-03-30T08:12:59.009 INFO:teuthology.orchestra.run.smithi087.stdout:checking for reallocarray... yes 2023-03-30T08:12:59.063 INFO:teuthology.orchestra.run.smithi087.stdout:checking for struct mount_attr... no 2023-03-30T08:12:59.170 INFO:teuthology.orchestra.run.smithi087.stdout:checking for struct btrfs_qgroup_limit... yes 2023-03-30T08:12:59.291 INFO:teuthology.orchestra.run.smithi087.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-03-30T08:12:59.405 INFO:teuthology.orchestra.run.smithi087.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-03-30T08:12:59.521 INFO:teuthology.orchestra.run.smithi087.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-03-30T08:12:59.637 INFO:teuthology.orchestra.run.smithi087.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-03-30T08:12:59.744 INFO:teuthology.orchestra.run.smithi087.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-03-30T08:12:59.859 INFO:teuthology.orchestra.run.smithi087.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-03-30T08:12:59.947 INFO:teuthology.orchestra.run.smithi087.stdout:checking linux/btrfs.h usability... yes 2023-03-30T08:12:59.975 INFO:teuthology.orchestra.run.smithi087.stdout:checking linux/btrfs.h presence... yes 2023-03-30T08:12:59.976 INFO:teuthology.orchestra.run.smithi087.stdout:checking for linux/btrfs.h... yes 2023-03-30T08:13:00.076 INFO:teuthology.orchestra.run.smithi087.stdout:checking linux/btrfs_tree.h usability... yes 2023-03-30T08:13:00.103 INFO:teuthology.orchestra.run.smithi087.stdout:checking linux/btrfs_tree.h presence... yes 2023-03-30T08:13:00.103 INFO:teuthology.orchestra.run.smithi087.stdout:checking for linux/btrfs_tree.h... yes 2023-03-30T08:13:00.230 INFO:teuthology.orchestra.run.smithi087.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-03-30T08:13:00.276 INFO:teuthology.orchestra.run.smithi087.stdout:configure: creating ./config.status 2023-03-30T08:13:01.909 INFO:teuthology.orchestra.run.smithi087.stdout:config.status: creating include/builddefs 2023-03-30T08:13:01.963 INFO:teuthology.orchestra.run.smithi087.stdout:config.status: creating include/config.h 2023-03-30T08:13:02.003 INFO:teuthology.orchestra.run.smithi087.stdout:config.status: executing libtool commands 2023-03-30T08:13:02.149 INFO:teuthology.orchestra.run.smithi087.stdout:Building include 2023-03-30T08:13:02.161 INFO:teuthology.orchestra.run.smithi087.stdout:Building lib 2023-03-30T08:13:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: [LTDEP] 2023-03-30T08:13:02.463 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] dataascii.lo 2023-03-30T08:13:02.741 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] databin.lo 2023-03-30T08:13:03.043 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] datapid.lo 2023-03-30T08:13:03.288 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] file_lock.lo 2023-03-30T08:13:03.587 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] forker.lo 2023-03-30T08:13:03.863 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] pattern.lo 2023-03-30T08:13:04.120 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] open_flags.lo 2023-03-30T08:13:04.425 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] random_range.lo 2023-03-30T08:13:04.816 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] string_to_tokens.lo 2023-03-30T08:13:05.064 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] str_to_bytes.lo 2023-03-30T08:13:05.345 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] tlibio.lo 2023-03-30T08:13:05.751 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] write_log.lo 2023-03-30T08:13:05.906 INFO:teuthology.orchestra.run.smithi087.stderr:write_log.c: In function 'wlog_record_write': 2023-03-30T08:13:05.907 INFO:teuthology.orchestra.run.smithi087.stderr:write_log.c:205:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:05.907 INFO:teuthology.orchestra.run.smithi087.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-03-30T08:13:05.907 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:05.907 INFO:teuthology.orchestra.run.smithi087.stderr:write_log.c:209:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:05.907 INFO:teuthology.orchestra.run.smithi087.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-03-30T08:13:05.907 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:06.140 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] random.lo 2023-03-30T08:13:06.382 INFO:teuthology.orchestra.run.smithi087.stdout: [LD] 2023-03-30T08:13:06.590 INFO:teuthology.orchestra.run.smithi087.stdout:Building ltp 2023-03-30T08:13:06.601 INFO:teuthology.orchestra.run.smithi087.stdout: [DEP] 2023-03-30T08:13:06.874 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] doio 2023-03-30T08:13:07.819 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] fsstress 2023-03-30T08:13:09.511 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] fsx 2023-03-30T08:13:10.692 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] growfiles 2023-03-30T08:13:11.455 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] iogen 2023-03-30T08:13:11.754 INFO:teuthology.orchestra.run.smithi087.stderr:iogen.c: In function 'main': 2023-03-30T08:13:11.755 INFO:teuthology.orchestra.run.smithi087.stderr:iogen.c:280:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:11.755 INFO:teuthology.orchestra.run.smithi087.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-03-30T08:13:11.755 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:11.758 INFO:teuthology.orchestra.run.smithi087.stderr:iogen.c: In function 'parse_cmdline': 2023-03-30T08:13:11.758 INFO:teuthology.orchestra.run.smithi087.stderr:iogen.c:1535:10: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:11.758 INFO:teuthology.orchestra.run.smithi087.stderr: 1535 | getcwd(fptr->f_path, 2023-03-30T08:13:11.758 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:11.758 INFO:teuthology.orchestra.run.smithi087.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-03-30T08:13:11.758 INFO:teuthology.orchestra.run.smithi087.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:12.048 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-stress 2023-03-30T08:13:12.352 INFO:teuthology.orchestra.run.smithi087.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-03-30T08:13:12.352 INFO:teuthology.orchestra.run.smithi087.stderr:aio-stress.c:1013:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:12.352 INFO:teuthology.orchestra.run.smithi087.stderr: 1013 | ftruncate(fd, total_ram); 2023-03-30T08:13:12.352 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:12.740 INFO:teuthology.orchestra.run.smithi087.stdout:Building src 2023-03-30T08:13:12.756 INFO:teuthology.orchestra.run.smithi087.stdout: [DEP] 2023-03-30T08:13:12.897 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:13:12.903 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:13:16.035 INFO:teuthology.orchestra.run.smithi087.stdout: [DEP] 2023-03-30T08:13:16.103 INFO:teuthology.orchestra.run.smithi087.stdout: [DEP] 2023-03-30T08:13:16.131 INFO:teuthology.orchestra.run.smithi087.stdout: [DEP] 2023-03-30T08:13:16.579 INFO:teuthology.orchestra.run.smithi087.stdout: [DEP] 2023-03-30T08:13:16.645 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] dirstress 2023-03-30T08:13:17.124 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] fill 2023-03-30T08:13:17.473 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] fill2 2023-03-30T08:13:17.933 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] getpagesize 2023-03-30T08:13:18.252 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] holes 2023-03-30T08:13:18.660 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] lstat64 2023-03-30T08:13:19.038 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] nametest 2023-03-30T08:13:19.333 INFO:teuthology.orchestra.run.smithi087.stderr:nametest.c: In function 'main': 2023-03-30T08:13:19.333 INFO:teuthology.orchestra.run.smithi087.stderr:nametest.c:236:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:19.334 INFO:teuthology.orchestra.run.smithi087.stderr: 236 | write(1, "\n", 1); 2023-03-30T08:13:19.334 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~ 2023-03-30T08:13:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:nametest.c:238:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:19.334 INFO:teuthology.orchestra.run.smithi087.stderr: 238 | write(1, ".", 1); 2023-03-30T08:13:19.334 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~ 2023-03-30T08:13:19.334 INFO:teuthology.orchestra.run.smithi087.stderr:nametest.c:288:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:19.334 INFO:teuthology.orchestra.run.smithi087.stderr: 288 | write(1, ".", 1); 2023-03-30T08:13:19.335 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~ 2023-03-30T08:13:19.501 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] permname 2023-03-30T08:13:19.906 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] randholes 2023-03-30T08:13:20.377 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] runas 2023-03-30T08:13:20.764 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] truncfile 2023-03-30T08:13:21.163 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] usemem 2023-03-30T08:13:21.517 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] mmapcat 2023-03-30T08:13:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:mmapcat.c: In function 'main': 2023-03-30T08:13:21.798 INFO:teuthology.orchestra.run.smithi087.stderr:mmapcat.c:29:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:21.798 INFO:teuthology.orchestra.run.smithi087.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-03-30T08:13:21.798 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:21.874 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] append_reader 2023-03-30T08:13:22.232 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] append_writer 2023-03-30T08:13:22.575 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] dirperf 2023-03-30T08:13:23.014 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] metaperf 2023-03-30T08:13:23.299 INFO:teuthology.orchestra.run.smithi087.stderr:metaperf.c: In function 'crfiles': 2023-03-30T08:13:23.299 INFO:teuthology.orchestra.run.smithi087.stderr:metaperf.c:166:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:23.299 INFO:teuthology.orchestra.run.smithi087.stderr: 166 | write(fd, buf, fsize); 2023-03-30T08:13:23.299 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:23.300 INFO:teuthology.orchestra.run.smithi087.stderr:metaperf.c: In function 't_linkun': 2023-03-30T08:13:23.300 INFO:teuthology.orchestra.run.smithi087.stderr:metaperf.c:454:4: warning: ignoring return value of 'link', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:23.300 INFO:teuthology.orchestra.run.smithi087.stderr: 454 | link("a", *fnp); 2023-03-30T08:13:23.300 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~ 2023-03-30T08:13:23.300 INFO:teuthology.orchestra.run.smithi087.stderr:metaperf.c: In function 't_chown': 2023-03-30T08:13:23.301 INFO:teuthology.orchestra.run.smithi087.stderr:metaperf.c:404:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:23.301 INFO:teuthology.orchestra.run.smithi087.stderr: 404 | chown(*fnp, 2, -1); 2023-03-30T08:13:23.301 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:23.301 INFO:teuthology.orchestra.run.smithi087.stderr:metaperf.c:406:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:23.301 INFO:teuthology.orchestra.run.smithi087.stderr: 406 | chown(*fnp, 1, -1); 2023-03-30T08:13:23.301 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:23.301 INFO:teuthology.orchestra.run.smithi087.stderr:metaperf.c: In function 'i_chown': 2023-03-30T08:13:23.302 INFO:teuthology.orchestra.run.smithi087.stderr:metaperf.c:291:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:23.302 INFO:teuthology.orchestra.run.smithi087.stderr: 291 | chown(*fnp, 1, -1); 2023-03-30T08:13:23.302 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:23.302 INFO:teuthology.orchestra.run.smithi087.stderr:metaperf.c: In function 'main': 2023-03-30T08:13:23.302 INFO:teuthology.orchestra.run.smithi087.stderr:metaperf.c:152:2: warning: ignoring return value of 'chdir', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:23.302 INFO:teuthology.orchestra.run.smithi087.stderr: 152 | chdir(".."); 2023-03-30T08:13:23.302 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~ 2023-03-30T08:13:23.479 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] devzero 2023-03-30T08:13:23.855 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] feature 2023-03-30T08:13:24.301 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] alloc 2023-03-30T08:13:24.605 INFO:teuthology.orchestra.run.smithi087.stderr:alloc.c: In function 'main': 2023-03-30T08:13:24.605 INFO:teuthology.orchestra.run.smithi087.stderr:alloc.c:247:3: warning: ignoring return value of 'mkstemp', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:24.605 INFO:teuthology.orchestra.run.smithi087.stderr: 247 | mkstemp(tmpfile); 2023-03-30T08:13:24.605 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~ 2023-03-30T08:13:24.736 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] fault 2023-03-30T08:13:25.094 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] fstest 2023-03-30T08:13:25.559 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_access_root 2023-03-30T08:13:25.833 INFO:teuthology.orchestra.run.smithi087.stderr:t_access_root.c: In function 'main': 2023-03-30T08:13:25.834 INFO:teuthology.orchestra.run.smithi087.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:25.834 INFO:teuthology.orchestra.run.smithi087.stderr: 55 | system(cmd); 2023-03-30T08:13:25.834 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~ 2023-03-30T08:13:25.913 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] godown 2023-03-30T08:13:26.286 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] resvtest 2023-03-30T08:13:26.690 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] writemod 2023-03-30T08:13:27.036 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] writev_on_pagefault 2023-03-30T08:13:27.390 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] makeextents 2023-03-30T08:13:27.782 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] itrash 2023-03-30T08:13:28.131 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] rename 2023-03-30T08:13:28.467 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] multi_open_unlink 2023-03-30T08:13:28.842 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] unwritten_sync 2023-03-30T08:13:29.227 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] genhashnames 2023-03-30T08:13:29.619 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_holes 2023-03-30T08:13:29.970 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_mmap_writev 2023-03-30T08:13:30.315 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_truncate_cmtime 2023-03-30T08:13:30.672 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] dirhash_collide 2023-03-30T08:13:31.063 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_rename_overwrite 2023-03-30T08:13:31.388 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] holetest 2023-03-30T08:13:31.684 INFO:teuthology.orchestra.run.smithi087.stderr:holetest.c: In function 'pt_write_marker': 2023-03-30T08:13:31.685 INFO:teuthology.orchestra.run.smithi087.stderr:holetest.c:140:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:31.685 INFO:teuthology.orchestra.run.smithi087.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-03-30T08:13:31.685 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:31.836 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_truncate_self 2023-03-30T08:13:32.166 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] af_unix 2023-03-30T08:13:32.520 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_mmap_stale_pmd 2023-03-30T08:13:32.807 INFO:teuthology.orchestra.run.smithi087.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-03-30T08:13:32.808 INFO:teuthology.orchestra.run.smithi087.stderr:t_mmap_stale_pmd.c:42:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:32.808 INFO:teuthology.orchestra.run.smithi087.stderr: 42 | ftruncate(fd, 0); 2023-03-30T08:13:32.808 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~ 2023-03-30T08:13:32.808 INFO:teuthology.orchestra.run.smithi087.stderr:t_mmap_stale_pmd.c:43:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:32.808 INFO:teuthology.orchestra.run.smithi087.stderr: 43 | ftruncate(fd, MiB(4)); 2023-03-30T08:13:32.808 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:32.808 INFO:teuthology.orchestra.run.smithi087.stderr:t_mmap_stale_pmd.c:55:2: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:32.809 INFO:teuthology.orchestra.run.smithi087.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-03-30T08:13:32.809 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:32.883 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_mmap_cow_race 2023-03-30T08:13:33.156 INFO:teuthology.orchestra.run.smithi087.stderr:t_mmap_cow_race.c: In function 'main': 2023-03-30T08:13:33.156 INFO:teuthology.orchestra.run.smithi087.stderr:t_mmap_cow_race.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:33.156 INFO:teuthology.orchestra.run.smithi087.stderr: 61 | ftruncate(fd, 0); 2023-03-30T08:13:33.156 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~ 2023-03-30T08:13:33.157 INFO:teuthology.orchestra.run.smithi087.stderr:t_mmap_cow_race.c:62:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:33.157 INFO:teuthology.orchestra.run.smithi087.stderr: 62 | ftruncate(fd, MiB(2)); 2023-03-30T08:13:33.157 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:33.238 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_mmap_fallocate 2023-03-30T08:13:33.599 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] fsync-err 2023-03-30T08:13:33.998 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_mmap_write_ro 2023-03-30T08:13:34.348 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_ext4_dax_journal_corruption 2023-03-30T08:13:34.636 INFO:teuthology.orchestra.run.smithi087.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-03-30T08:13:34.636 INFO:teuthology.orchestra.run.smithi087.stderr:t_ext4_dax_journal_corruption.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:34.637 INFO:teuthology.orchestra.run.smithi087.stderr: 61 | ftruncate(fd, 0); 2023-03-30T08:13:34.637 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~ 2023-03-30T08:13:34.716 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_ext4_dax_inline_corruption 2023-03-30T08:13:35.080 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_ofd_locks 2023-03-30T08:13:35.483 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_mmap_collision 2023-03-30T08:13:35.886 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] mmap-write-concurrent 2023-03-30T08:13:36.252 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_get_file_time 2023-03-30T08:13:36.598 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_create_short_dirs 2023-03-30T08:13:36.971 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_create_long_dirs 2023-03-30T08:13:37.330 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_enospc 2023-03-30T08:13:37.733 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_mmap_writev_overlap 2023-03-30T08:13:38.091 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] checkpoint_journal 2023-03-30T08:13:38.439 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] mmap-rw-fault 2023-03-30T08:13:38.824 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] allocstale 2023-03-30T08:13:39.196 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_mmap_cow_memory_failure 2023-03-30T08:13:39.571 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] fake-dump-rootino 2023-03-30T08:13:39.911 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] dio-buf-fault 2023-03-30T08:13:40.266 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] xfsctl 2023-03-30T08:13:40.676 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] bstat 2023-03-30T08:13:41.105 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_mtab 2023-03-30T08:13:41.390 INFO:teuthology.orchestra.run.smithi087.stderr:t_mtab.c: In function 'update_mtab': 2023-03-30T08:13:41.390 INFO:teuthology.orchestra.run.smithi087.stderr:t_mtab.c:256:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:41.390 INFO:teuthology.orchestra.run.smithi087.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-03-30T08:13:41.390 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:41.496 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] getdevicesize 2023-03-30T08:13:41.834 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] preallo_rw_pattern_reader 2023-03-30T08:13:42.122 INFO:teuthology.orchestra.run.smithi087.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-03-30T08:13:42.122 INFO:teuthology.orchestra.run.smithi087.stderr:iopat.c: In function 'main': 2023-03-30T08:13:42.122 INFO:teuthology.orchestra.run.smithi087.stderr:iopat.c:38:4: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:42.122 INFO:teuthology.orchestra.run.smithi087.stderr: 38 | read(fd, &x, 1048576); 2023-03-30T08:13:42.123 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:42.191 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] preallo_rw_pattern_writer 2023-03-30T08:13:42.481 INFO:teuthology.orchestra.run.smithi087.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-03-30T08:13:42.482 INFO:teuthology.orchestra.run.smithi087.stderr:iopat.c: In function 'main': 2023-03-30T08:13:42.482 INFO:teuthology.orchestra.run.smithi087.stderr:iopat.c:34:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:42.482 INFO:teuthology.orchestra.run.smithi087.stderr: 34 | write(fd, &x, 1048576); 2023-03-30T08:13:42.482 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:42.553 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] ftrunc 2023-03-30T08:13:42.901 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] trunc 2023-03-30T08:13:43.008 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:13:43.014 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:13:43.261 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] fs_perms 2023-03-30T08:13:43.546 INFO:teuthology.orchestra.run.smithi087.stderr:fs_perms.c: In function 'main': 2023-03-30T08:13:43.547 INFO:teuthology.orchestra.run.smithi087.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:43.547 INFO:teuthology.orchestra.run.smithi087.stderr: 54 | system("rm -f test.file"); 2023-03-30T08:13:43.547 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:43.548 INFO:teuthology.orchestra.run.smithi087.stderr:fs_perms.c: In function 'testsetup': 2023-03-30T08:13:43.548 INFO:teuthology.orchestra.run.smithi087.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:43.548 INFO:teuthology.orchestra.run.smithi087.stderr: 67 | system("cp testx.file test.file"); 2023-03-30T08:13:43.548 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:43.549 INFO:teuthology.orchestra.run.smithi087.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:43.549 INFO:teuthology.orchestra.run.smithi087.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-03-30T08:13:43.549 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:43.549 INFO:teuthology.orchestra.run.smithi087.stderr:fs_perms.c: In function 'testfperm': 2023-03-30T08:13:43.550 INFO:teuthology.orchestra.run.smithi087.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:43.550 INFO:teuthology.orchestra.run.smithi087.stderr: 123 | seteuid(0); 2023-03-30T08:13:43.550 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~ 2023-03-30T08:13:43.550 INFO:teuthology.orchestra.run.smithi087.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:43.551 INFO:teuthology.orchestra.run.smithi087.stderr: 124 | setegid(0); 2023-03-30T08:13:43.551 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~ 2023-03-30T08:13:43.628 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] testx 2023-03-30T08:13:43.950 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] looptest 2023-03-30T08:13:44.366 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] locktest 2023-03-30T08:13:44.906 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] unwritten_mmap 2023-03-30T08:13:45.273 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] bulkstat_unlink_test 2023-03-30T08:13:45.561 INFO:teuthology.orchestra.run.smithi087.stderr:bulkstat_unlink_test.c: In function 'main': 2023-03-30T08:13:45.562 INFO:teuthology.orchestra.run.smithi087.stderr:bulkstat_unlink_test.c:106:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:45.562 INFO:teuthology.orchestra.run.smithi087.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-03-30T08:13:45.562 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:45.562 INFO:teuthology.orchestra.run.smithi087.stderr:bulkstat_unlink_test.c:178:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:45.562 INFO:teuthology.orchestra.run.smithi087.stderr: 178 | system(fname); 2023-03-30T08:13:45.562 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~ 2023-03-30T08:13:45.686 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] deduperace 2023-03-30T08:13:46.096 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] bulkstat_unlink_test_modified 2023-03-30T08:13:46.390 INFO:teuthology.orchestra.run.smithi087.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-03-30T08:13:46.390 INFO:teuthology.orchestra.run.smithi087.stderr:bulkstat_unlink_test_modified.c:83:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:46.390 INFO:teuthology.orchestra.run.smithi087.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-03-30T08:13:46.390 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:46.390 INFO:teuthology.orchestra.run.smithi087.stderr:bulkstat_unlink_test_modified.c:139:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:46.391 INFO:teuthology.orchestra.run.smithi087.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-03-30T08:13:46.391 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:46.391 INFO:teuthology.orchestra.run.smithi087.stderr:bulkstat_unlink_test_modified.c:185:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:46.391 INFO:teuthology.orchestra.run.smithi087.stderr: 185 | system(fname); 2023-03-30T08:13:46.391 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~ 2023-03-30T08:13:46.512 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_dir_offset 2023-03-30T08:13:46.863 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_futimens 2023-03-30T08:13:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_immutable 2023-03-30T08:13:47.506 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c: In function 'create_test_area': 2023-03-30T08:13:47.507 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.507 INFO:teuthology.orchestra.run.smithi087.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-03-30T08:13:47.507 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.507 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.507 INFO:teuthology.orchestra.run.smithi087.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-03-30T08:13:47.507 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.508 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c: In function 'remove_test_area': 2023-03-30T08:13:47.508 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.508 INFO:teuthology.orchestra.run.smithi087.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-03-30T08:13:47.509 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.509 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.509 INFO:teuthology.orchestra.run.smithi087.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-03-30T08:13:47.509 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.509 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.509 INFO:teuthology.orchestra.run.smithi087.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-03-30T08:13:47.509 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.510 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.510 INFO:teuthology.orchestra.run.smithi087.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-03-30T08:13:47.510 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.510 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.510 INFO:teuthology.orchestra.run.smithi087.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-03-30T08:13:47.510 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.510 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.511 INFO:teuthology.orchestra.run.smithi087.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-03-30T08:13:47.511 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.511 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c: In function 'check_test_area': 2023-03-30T08:13:47.511 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.511 INFO:teuthology.orchestra.run.smithi087.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-03-30T08:13:47.511 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.511 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.511 INFO:teuthology.orchestra.run.smithi087.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-03-30T08:13:47.512 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.512 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.512 INFO:teuthology.orchestra.run.smithi087.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-03-30T08:13:47.513 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.513 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.513 INFO:teuthology.orchestra.run.smithi087.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-03-30T08:13:47.513 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.513 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.513 INFO:teuthology.orchestra.run.smithi087.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-03-30T08:13:47.513 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.514 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.514 INFO:teuthology.orchestra.run.smithi087.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-03-30T08:13:47.514 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.514 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.514 INFO:teuthology.orchestra.run.smithi087.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-03-30T08:13:47.514 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.514 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.514 INFO:teuthology.orchestra.run.smithi087.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-03-30T08:13:47.515 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.515 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.515 INFO:teuthology.orchestra.run.smithi087.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-03-30T08:13:47.515 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.515 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c: In function 'test_immutable': 2023-03-30T08:13:47.515 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.515 INFO:teuthology.orchestra.run.smithi087.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-03-30T08:13:47.516 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.516 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.516 INFO:teuthology.orchestra.run.smithi087.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-03-30T08:13:47.516 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.516 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:408:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.516 INFO:teuthology.orchestra.run.smithi087.stderr: 408 | chown(path, 0, 0); 2023-03-30T08:13:47.516 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.517 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.517 INFO:teuthology.orchestra.run.smithi087.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-03-30T08:13:47.517 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.517 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.517 INFO:teuthology.orchestra.run.smithi087.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-03-30T08:13:47.517 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.517 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:553:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.518 INFO:teuthology.orchestra.run.smithi087.stderr: 553 | chown(path, 0, 0); 2023-03-30T08:13:47.518 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.518 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.518 INFO:teuthology.orchestra.run.smithi087.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-03-30T08:13:47.518 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.518 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.518 INFO:teuthology.orchestra.run.smithi087.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-03-30T08:13:47.519 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.519 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.519 INFO:teuthology.orchestra.run.smithi087.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-03-30T08:13:47.519 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.519 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.519 INFO:teuthology.orchestra.run.smithi087.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-03-30T08:13:47.519 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.520 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.520 INFO:teuthology.orchestra.run.smithi087.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-03-30T08:13:47.520 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.520 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.520 INFO:teuthology.orchestra.run.smithi087.stderr: 653 | chown(path, 0, 0); 2023-03-30T08:13:47.520 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.520 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.520 INFO:teuthology.orchestra.run.smithi087.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-03-30T08:13:47.521 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.521 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.521 INFO:teuthology.orchestra.run.smithi087.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-03-30T08:13:47.521 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.521 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:705:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.521 INFO:teuthology.orchestra.run.smithi087.stderr: 705 | chown(path, 0, 0); 2023-03-30T08:13:47.521 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.522 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.522 INFO:teuthology.orchestra.run.smithi087.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-03-30T08:13:47.522 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.523 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c: In function 'test_append': 2023-03-30T08:13:47.523 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.524 INFO:teuthology.orchestra.run.smithi087.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-03-30T08:13:47.524 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.524 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.524 INFO:teuthology.orchestra.run.smithi087.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-03-30T08:13:47.524 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.524 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1051:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.525 INFO:teuthology.orchestra.run.smithi087.stderr: 1051 | chown(path, 0, 0); 2023-03-30T08:13:47.525 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.525 INFO:teuthology.orchestra.run.smithi087.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-03-30T08:13:47.525 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.525 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.526 INFO:teuthology.orchestra.run.smithi087.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-03-30T08:13:47.526 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.526 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1516:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.526 INFO:teuthology.orchestra.run.smithi087.stderr: 1516 | chown(path, 0, 0); 2023-03-30T08:13:47.526 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.526 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.526 INFO:teuthology.orchestra.run.smithi087.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-03-30T08:13:47.526 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.527 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.527 INFO:teuthology.orchestra.run.smithi087.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-03-30T08:13:47.527 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.527 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.527 INFO:teuthology.orchestra.run.smithi087.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-03-30T08:13:47.527 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.527 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.528 INFO:teuthology.orchestra.run.smithi087.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-03-30T08:13:47.528 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.528 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1573:4: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.528 INFO:teuthology.orchestra.run.smithi087.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-03-30T08:13:47.528 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.528 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.528 INFO:teuthology.orchestra.run.smithi087.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-03-30T08:13:47.529 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.529 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.529 INFO:teuthology.orchestra.run.smithi087.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-03-30T08:13:47.529 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.529 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.529 INFO:teuthology.orchestra.run.smithi087.stderr: 1618 | chown(path, 0, 0); 2023-03-30T08:13:47.529 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.529 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.530 INFO:teuthology.orchestra.run.smithi087.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-03-30T08:13:47.530 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.530 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.530 INFO:teuthology.orchestra.run.smithi087.stderr: 1644 | chown(path, 0, 0); 2023-03-30T08:13:47.530 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.530 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.530 INFO:teuthology.orchestra.run.smithi087.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-03-30T08:13:47.530 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.531 INFO:teuthology.orchestra.run.smithi087.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-03-30T08:13:47.531 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1692:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.531 INFO:teuthology.orchestra.run.smithi087.stderr: 1692 | chown(path, 0, 0); 2023-03-30T08:13:47.531 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~ 2023-03-30T08:13:47.531 INFO:teuthology.orchestra.run.smithi087.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:47.532 INFO:teuthology.orchestra.run.smithi087.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-03-30T08:13:47.532 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:48.152 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] stale_handle 2023-03-30T08:13:48.441 INFO:teuthology.orchestra.run.smithi087.stderr:stale_handle.c: In function 'main': 2023-03-30T08:13:48.442 INFO:teuthology.orchestra.run.smithi087.stderr:stale_handle.c:102:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:48.442 INFO:teuthology.orchestra.run.smithi087.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-03-30T08:13:48.442 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:48.524 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] pwrite_mmap_blocked 2023-03-30T08:13:48.876 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_dir_offset2 2023-03-30T08:13:49.280 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] seek_sanity_test 2023-03-30T08:13:49.584 INFO:teuthology.orchestra.run.smithi087.stderr:seek_sanity_test.c: In function 'test18': 2023-03-30T08:13:49.584 INFO:teuthology.orchestra.run.smithi087.stderr:seek_sanity_test.c:460:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:49.585 INFO:teuthology.orchestra.run.smithi087.stderr: 460 | ftruncate(fd, 0); 2023-03-30T08:13:49.585 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~ 2023-03-30T08:13:49.589 INFO:teuthology.orchestra.run.smithi087.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-03-30T08:13:49.589 INFO:teuthology.orchestra.run.smithi087.stderr:seek_sanity_test.c:1207:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:49.589 INFO:teuthology.orchestra.run.smithi087.stderr: 1207 | ftruncate(fd, 0); 2023-03-30T08:13:49.589 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~ 2023-03-30T08:13:49.589 INFO:teuthology.orchestra.run.smithi087.stderr:seek_sanity_test.c:1256:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:49.589 INFO:teuthology.orchestra.run.smithi087.stderr: 1256 | ftruncate(fd, 0); 2023-03-30T08:13:49.589 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~ 2023-03-30T08:13:49.590 INFO:teuthology.orchestra.run.smithi087.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-03-30T08:13:49.590 INFO:teuthology.orchestra.run.smithi087.stderr:seek_sanity_test.c:88:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:49.590 INFO:teuthology.orchestra.run.smithi087.stderr: 88 | ftruncate(fd, 0); 2023-03-30T08:13:49.590 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~ 2023-03-30T08:13:49.590 INFO:teuthology.orchestra.run.smithi087.stderr:seek_sanity_test.c:89:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:49.591 INFO:teuthology.orchestra.run.smithi087.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-03-30T08:13:49.591 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:49.591 INFO:teuthology.orchestra.run.smithi087.stderr:seek_sanity_test.c:98:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:49.591 INFO:teuthology.orchestra.run.smithi087.stderr: 98 | ftruncate(fd, 0); 2023-03-30T08:13:49.591 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~ 2023-03-30T08:13:49.591 INFO:teuthology.orchestra.run.smithi087.stderr:seek_sanity_test.c:99:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:49.591 INFO:teuthology.orchestra.run.smithi087.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-03-30T08:13:49.592 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:49.959 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] seek_copy_test 2023-03-30T08:13:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_readdir_1 2023-03-30T08:13:50.624 INFO:teuthology.orchestra.run.smithi087.stderr:t_readdir_1.c: In function 'main': 2023-03-30T08:13:50.624 INFO:teuthology.orchestra.run.smithi087.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:50.624 INFO:teuthology.orchestra.run.smithi087.stderr: 30 | read(fd, buf, 100); 2023-03-30T08:13:50.625 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:50.690 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_readdir_2 2023-03-30T08:13:51.040 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] fsync-tester 2023-03-30T08:13:51.327 INFO:teuthology.orchestra.run.smithi087.stderr:fsync-tester.c: In function 'main': 2023-03-30T08:13:51.327 INFO:teuthology.orchestra.run.smithi087.stderr:fsync-tester.c:391:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:51.327 INFO:teuthology.orchestra.run.smithi087.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-03-30T08:13:51.327 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:51.328 INFO:teuthology.orchestra.run.smithi087.stderr:fsync-tester.c:541:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:51.328 INFO:teuthology.orchestra.run.smithi087.stderr: 541 | system("reboot -fn"); 2023-03-30T08:13:51.328 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:51.328 INFO:teuthology.orchestra.run.smithi087.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-03-30T08:13:51.328 INFO:teuthology.orchestra.run.smithi087.stderr:fsync-tester.c:90:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:51.329 INFO:teuthology.orchestra.run.smithi087.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-03-30T08:13:51.329 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:51.520 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] nsexec 2023-03-30T08:13:51.915 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] cloner 2023-03-30T08:13:52.299 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] renameat2 2023-03-30T08:13:52.691 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_getcwd 2023-03-30T08:13:52.978 INFO:teuthology.orchestra.run.smithi087.stderr:t_getcwd.c: In function 'test_getcwd': 2023-03-30T08:13:52.979 INFO:teuthology.orchestra.run.smithi087.stderr:t_getcwd.c:21:3: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:52.979 INFO:teuthology.orchestra.run.smithi087.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-03-30T08:13:52.979 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:53.061 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] e4compact 2023-03-30T08:13:53.483 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] test-nextquota 2023-03-30T08:13:53.857 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] punch-alternating 2023-03-30T08:13:54.244 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] attr-list-by-handle-cursor-test 2023-03-30T08:13:54.615 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] listxattr 2023-03-30T08:13:54.963 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] dio-interleaved 2023-03-30T08:13:55.327 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_dir_type 2023-03-30T08:13:55.683 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] dio-invalidate-cache 2023-03-30T08:13:55.975 INFO:teuthology.orchestra.run.smithi087.stderr:dio-invalidate-cache.c: In function 'main': 2023-03-30T08:13:55.975 INFO:teuthology.orchestra.run.smithi087.stderr:dio-invalidate-cache.c:286:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:13:55.975 INFO:teuthology.orchestra.run.smithi087.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-03-30T08:13:55.976 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:13:56.113 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] stat_test 2023-03-30T08:13:56.640 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_encrypted_d_revalidate 2023-03-30T08:13:57.009 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] attr_replace_test 2023-03-30T08:13:57.374 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] swapon 2023-03-30T08:13:57.742 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] mkswap 2023-03-30T08:13:58.092 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_attr_corruption 2023-03-30T08:13:58.444 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_open_tmpfiles 2023-03-30T08:13:58.829 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] fscrypt-crypt-util 2023-03-30T08:13:59.748 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] bulkstat_null_ocount 2023-03-30T08:14:00.107 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] splice-test 2023-03-30T08:14:00.496 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] chprojid_fail 2023-03-30T08:14:00.863 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] detached_mounts_propagation 2023-03-30T08:14:01.258 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] ext4_resize 2023-03-30T08:14:01.612 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_readdir_3 2023-03-30T08:14:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] splice2pipe 2023-03-30T08:14:02.311 INFO:teuthology.orchestra.run.smithi087.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-03-30T08:14:02.311 INFO:teuthology.orchestra.run.smithi087.stderr:splice2pipe.c:56:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:14:02.312 INFO:teuthology.orchestra.run.smithi087.stderr: 56 | write(p[1], buffer, n); 2023-03-30T08:14:02.312 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:14:02.312 INFO:teuthology.orchestra.run.smithi087.stderr:splice2pipe.c:64:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:14:02.312 INFO:teuthology.orchestra.run.smithi087.stderr: 64 | read(p[0], buffer, n); 2023-03-30T08:14:02.312 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:14:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] uuid_ioctl 2023-03-30T08:14:02.764 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] fiemap-tester 2023-03-30T08:14:03.258 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_stripealign 2023-03-30T08:14:03.623 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] open_by_handle 2023-03-30T08:14:04.109 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] t_mmap_dio 2023-03-30T08:14:04.471 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] xfsfind 2023-03-30T08:14:04.884 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] fssum 2023-03-30T08:14:05.608 INFO:teuthology.orchestra.run.smithi087.stdout:Building log-writes 2023-03-30T08:14:05.628 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] replay-log 2023-03-30T08:14:06.196 INFO:teuthology.orchestra.run.smithi087.stdout:Building perf 2023-03-30T08:14:06.208 INFO:teuthology.orchestra.run.smithi087.stdout:Building aio-dio-regress 2023-03-30T08:14:06.223 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-dio-append-write-fallocate-race 2023-03-30T08:14:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-dio-fcntl-race 2023-03-30T08:14:06.988 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-dio-subblock-eof-read 2023-03-30T08:14:07.340 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-dio-append-write-read-race 2023-03-30T08:14:07.740 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-dio-invalidate-readahead 2023-03-30T08:14:08.116 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-dio-hole-filling-race 2023-03-30T08:14:08.468 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-03-30T08:14:08.806 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-last-ref-held-by-io 2023-03-30T08:14:09.193 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-dio-cycle-write 2023-03-30T08:14:09.479 INFO:teuthology.orchestra.run.smithi087.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-03-30T08:14:09.479 INFO:teuthology.orchestra.run.smithi087.stderr:aio-dio-cycle-write.c:83:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:14:09.480 INFO:teuthology.orchestra.run.smithi087.stderr: 83 | ftruncate(fd, buf_size); 2023-03-30T08:14:09.480 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:14:09.601 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-dio-extend-stat 2023-03-30T08:14:09.984 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-03-30T08:14:10.314 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aiocp 2023-03-30T08:14:10.763 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-dio-invalidate-failure 2023-03-30T08:14:11.140 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aiodio_sparse2 2023-03-30T08:14:11.423 INFO:teuthology.orchestra.run.smithi087.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-03-30T08:14:11.424 INFO:teuthology.orchestra.run.smithi087.stderr:aiodio_sparse2.c:111:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:14:11.424 INFO:teuthology.orchestra.run.smithi087.stderr: 111 | ftruncate(fd, filesize); 2023-03-30T08:14:11.424 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-03-30T08:14:11.424 INFO:teuthology.orchestra.run.smithi087.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-03-30T08:14:11.425 INFO:teuthology.orchestra.run.smithi087.stderr:aiodio_sparse2.c:274:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-03-30T08:14:11.425 INFO:teuthology.orchestra.run.smithi087.stderr: 274 | ftruncate(fd, size); 2023-03-30T08:14:11.425 INFO:teuthology.orchestra.run.smithi087.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-03-30T08:14:11.584 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-dio-cow-race 2023-03-30T08:14:11.945 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-dio-write-verify 2023-03-30T08:14:12.355 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] aio-dio-eof-race 2023-03-30T08:14:12.751 INFO:teuthology.orchestra.run.smithi087.stdout:Building vfs 2023-03-30T08:14:12.766 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] vfstest 2023-03-30T08:14:13.161 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:14:13.167 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:14:15.307 INFO:teuthology.orchestra.run.smithi087.stdout: [CC] mount-idmapped 2023-03-30T08:14:15.951 INFO:teuthology.orchestra.run.smithi087.stdout:Building m4 2023-03-30T08:14:15.963 INFO:teuthology.orchestra.run.smithi087.stdout:Building common 2023-03-30T08:14:15.974 INFO:teuthology.orchestra.run.smithi087.stdout:Building tests 2023-03-30T08:14:15.991 INFO:teuthology.orchestra.run.smithi087.stdout:Building perf 2023-03-30T08:14:16.006 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/perf/group.list 2023-03-30T08:14:16.053 INFO:teuthology.orchestra.run.smithi087.stdout:Building ext4 2023-03-30T08:14:16.069 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/ext4/group.list 2023-03-30T08:14:16.232 INFO:teuthology.orchestra.run.smithi087.stdout:Building ocfs2 2023-03-30T08:14:16.247 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/ocfs2/group.list 2023-03-30T08:14:16.303 INFO:teuthology.orchestra.run.smithi087.stdout:Building overlay 2023-03-30T08:14:16.319 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/overlay/group.list 2023-03-30T08:14:16.484 INFO:teuthology.orchestra.run.smithi087.stdout:Building cifs 2023-03-30T08:14:16.502 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/cifs/group.list 2023-03-30T08:14:16.556 INFO:teuthology.orchestra.run.smithi087.stdout:Building generic 2023-03-30T08:14:16.572 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/generic/group.list 2023-03-30T08:14:16.956 INFO:teuthology.orchestra.run.smithi087.stdout:Building shared 2023-03-30T08:14:16.970 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/shared/group.list 2023-03-30T08:14:17.040 INFO:teuthology.orchestra.run.smithi087.stdout:Building xfs 2023-03-30T08:14:17.058 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/xfs/group.list 2023-03-30T08:14:17.433 INFO:teuthology.orchestra.run.smithi087.stdout:Building f2fs 2023-03-30T08:14:17.448 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/f2fs/group.list 2023-03-30T08:14:17.523 INFO:teuthology.orchestra.run.smithi087.stdout:Building udf 2023-03-30T08:14:17.538 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/udf/group.list 2023-03-30T08:14:17.585 INFO:teuthology.orchestra.run.smithi087.stdout:Building ceph 2023-03-30T08:14:17.601 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/ceph/group.list 2023-03-30T08:14:17.667 INFO:teuthology.orchestra.run.smithi087.stdout:Building nfs 2023-03-30T08:14:17.682 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/nfs/group.list 2023-03-30T08:14:17.740 INFO:teuthology.orchestra.run.smithi087.stdout:Building btrfs 2023-03-30T08:14:17.757 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/btrfs/group.list 2023-03-30T08:14:17.990 INFO:teuthology.orchestra.run.smithi087.stdout:Building tmpfs 2023-03-30T08:14:18.004 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/tmpfs/group.list 2023-03-30T08:14:18.063 INFO:teuthology.orchestra.run.smithi087.stdout:Building selftest 2023-03-30T08:14:18.078 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/selftest/group.list 2023-03-30T08:14:18.139 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo make install) 2023-03-30T08:14:18.215 INFO:teuthology.orchestra.run.smithi087.stdout:Building include 2023-03-30T08:14:18.229 INFO:teuthology.orchestra.run.smithi087.stdout:Building lib 2023-03-30T08:14:18.240 INFO:teuthology.orchestra.run.smithi087.stdout:Building ltp 2023-03-30T08:14:18.253 INFO:teuthology.orchestra.run.smithi087.stdout:Building src 2023-03-30T08:14:18.358 INFO:teuthology.orchestra.run.smithi087.stdout:Building log-writes 2023-03-30T08:14:18.370 INFO:teuthology.orchestra.run.smithi087.stdout:Building perf 2023-03-30T08:14:18.383 INFO:teuthology.orchestra.run.smithi087.stdout:Building aio-dio-regress 2023-03-30T08:14:18.401 INFO:teuthology.orchestra.run.smithi087.stdout:Building vfs 2023-03-30T08:14:18.414 INFO:teuthology.orchestra.run.smithi087.stdout:Building m4 2023-03-30T08:14:18.424 INFO:teuthology.orchestra.run.smithi087.stdout:Building common 2023-03-30T08:14:18.433 INFO:teuthology.orchestra.run.smithi087.stdout:Building tests 2023-03-30T08:14:18.448 INFO:teuthology.orchestra.run.smithi087.stdout:Building perf 2023-03-30T08:14:18.464 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/perf/group.list 2023-03-30T08:14:18.515 INFO:teuthology.orchestra.run.smithi087.stdout:Building ext4 2023-03-30T08:14:18.532 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/ext4/group.list 2023-03-30T08:14:18.691 INFO:teuthology.orchestra.run.smithi087.stdout:Building ocfs2 2023-03-30T08:14:18.708 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/ocfs2/group.list 2023-03-30T08:14:18.765 INFO:teuthology.orchestra.run.smithi087.stdout:Building overlay 2023-03-30T08:14:18.780 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/overlay/group.list 2023-03-30T08:14:18.936 INFO:teuthology.orchestra.run.smithi087.stdout:Building cifs 2023-03-30T08:14:18.953 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/cifs/group.list 2023-03-30T08:14:19.005 INFO:teuthology.orchestra.run.smithi087.stdout:Building generic 2023-03-30T08:14:19.026 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/generic/group.list 2023-03-30T08:14:19.407 INFO:teuthology.orchestra.run.smithi087.stdout:Building shared 2023-03-30T08:14:19.423 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/shared/group.list 2023-03-30T08:14:19.497 INFO:teuthology.orchestra.run.smithi087.stdout:Building xfs 2023-03-30T08:14:19.515 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/xfs/group.list 2023-03-30T08:14:19.897 INFO:teuthology.orchestra.run.smithi087.stdout:Building f2fs 2023-03-30T08:14:19.911 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/f2fs/group.list 2023-03-30T08:14:19.984 INFO:teuthology.orchestra.run.smithi087.stdout:Building udf 2023-03-30T08:14:19.999 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/udf/group.list 2023-03-30T08:14:20.053 INFO:teuthology.orchestra.run.smithi087.stdout:Building ceph 2023-03-30T08:14:20.069 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/ceph/group.list 2023-03-30T08:14:20.127 INFO:teuthology.orchestra.run.smithi087.stdout:Building nfs 2023-03-30T08:14:20.144 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/nfs/group.list 2023-03-30T08:14:20.204 INFO:teuthology.orchestra.run.smithi087.stdout:Building btrfs 2023-03-30T08:14:20.220 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/btrfs/group.list 2023-03-30T08:14:20.445 INFO:teuthology.orchestra.run.smithi087.stdout:Building tmpfs 2023-03-30T08:14:20.464 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/tmpfs/group.list 2023-03-30T08:14:20.518 INFO:teuthology.orchestra.run.smithi087.stdout:Building selftest 2023-03-30T08:14:20.533 INFO:teuthology.orchestra.run.smithi087.stdout: [GROUP] /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/selftest/group.list 2023-03-30T08:14:20.584 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C include install 2023-03-30T08:14:20.592 INFO:teuthology.orchestra.run.smithi087.stdout:make[1]: Nothing to be done for 'install'. 2023-03-30T08:14:20.593 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C lib install 2023-03-30T08:14:20.600 INFO:teuthology.orchestra.run.smithi087.stdout:make[1]: Nothing to be done for 'install'. 2023-03-30T08:14:20.601 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C ltp install 2023-03-30T08:14:20.609 INFO:teuthology.orchestra.run.smithi087.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-03-30T08:14:20.649 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-03-30T08:14:20.957 INFO:teuthology.orchestra.run.smithi087.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-03-30T08:14:20.997 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C src install 2023-03-30T08:14:21.053 INFO:teuthology.orchestra.run.smithi087.stdout:Building log-writes 2023-03-30T08:14:21.064 INFO:teuthology.orchestra.run.smithi087.stdout:Building perf 2023-03-30T08:14:21.076 INFO:teuthology.orchestra.run.smithi087.stdout:Building aio-dio-regress 2023-03-30T08:14:21.091 INFO:teuthology.orchestra.run.smithi087.stdout:Building vfs 2023-03-30T08:14:21.100 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make -C log-writes install 2023-03-30T08:14:21.109 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-03-30T08:14:21.148 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-03-30T08:14:21.189 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make -C perf install 2023-03-30T08:14:21.199 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-03-30T08:14:21.240 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-03-30T08:14:21.328 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make -C aio-dio-regress install 2023-03-30T08:14:21.335 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-03-30T08:14:21.377 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aiocp aio-dio-append-write-fallocate-race aio-dio-invalidate-failure aiodio_sparse2 aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-03-30T08:14:21.593 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make -C vfs install 2023-03-30T08:14:21.599 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-03-30T08:14:21.639 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-03-30T08:14:21.693 INFO:teuthology.orchestra.run.smithi087.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-03-30T08:14:21.733 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-03-30T08:14:27.033 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-03-30T08:14:27.415 INFO:teuthology.orchestra.run.smithi087.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-03-30T08:14:27.513 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C m4 install 2023-03-30T08:14:27.521 INFO:teuthology.orchestra.run.smithi087.stdout:make[1]: Nothing to be done for 'install'. 2023-03-30T08:14:27.521 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C common install 2023-03-30T08:14:27.529 INFO:teuthology.orchestra.run.smithi087.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-03-30T08:14:27.569 INFO:teuthology.orchestra.run.smithi087.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-03-30T08:14:28.110 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C tests install 2023-03-30T08:14:28.116 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/btrfs/ install 2023-03-30T08:14:28.128 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-03-30T08:14:28.166 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 290 291 299 /var/lib/xfstests/tests/btrfs 2023-03-30T08:14:31.420 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-03-30T08:14:31.460 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 016.out 064.out 186.out 240.out 279.out 180.out 282.out 267.out 280.out 140.out 265.out 206.out 121.out 040.out 106.out 199.out 233.out 234.out 248.out 009.out 033.out 082.out 252.out 270.out 148.out 088.out 137.out 002.out 125.out 110.out 165.out 152.out 143.out 264.out 015.out 192.out 075.out 178.out 284.out 052.out 228.out 276.out 046.out 273.out 074.out 251.out 176.out 209.out 020.out 195.out 215.out 115.out 179.out 250.out 191.out 266.out 111.out 051.out 177.out 219.out 119.out 244.out 128.out 232.out 221.out 087.out 212.out 112.out 012.out 107.out 162.out 147.out 196.out 145.out 004.out 187.out 024.out 220.out 238.out 120.out 202.out 102.out 171.out 261.out 156.out 092.out 072.out 068.out 048.out 062.out 084.out 129.out 066.out 229.out 254.out 047.out 011.out 029.out 035.out 134.out 170.out 260.out 034.out 065.out 286.out 161.out 246.out 056.out 216.out 116.out 043.out 274.out 099.out 010.out 001.out 138.out 237.out 097.out 153.out 160.out 175.out 091.out 081.out 071.out 061.out 239.out 067.out 200.out 100.out 025.out 258.out 269.out 208.out 039.out 222.out 275.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 108.out 006.out 167.out 217.out 133.out 117.out 017.out 236.out 159.out 211.out 158.out 085.out 277.out 146.out 188.out 189.out 204.out 104.out 225.out 242.out 268.out 135.out 257.out 124.out 142.out 172.out 103.out 058.out 262.out 042.out 096.out 193.out 283.out 083.out 247.out 053.out 109.out 157.out 164.out 154.out 094.out 241.out 089.out 141.out 214.out 114.out 014.out 278.out 041.out 223.out 028.out 086.out 123.out 144.out 032.out 182.out 205.out 136.out 005.out 036.out 198.out 008.out 190.out 173.out 050.out 038.out 105.out 263.out 291.out 185.out 095.out 285.out 155.out 201.out 019.out 063.out 299.out 151.out 231.out 227.out 069.out 131.out 213.out 113.out 013.out 031.out 057.out 272.out 078.out 184.out 259.out 210.out 132.out 037.out 093.out 197.out 235.out 127.out 230.out 027.out 130.out 023.out 044.out 073.out 030.out 203.out 003.out 101.out 055.out 166.out 245.out 243.out 194.out 249.out 122.out 076.out 022.out 174.out 045.out 281.out 090.out 224.out 181.out 271.out 149.out 183.out 077.out 218.out 118.out 018.out 256.out 168.out 007.out 079.out 054.out 059.out 150.out 049.out 226.out 163.out 126.out 026.out 021.out 253.out 255.out 139.out /var/lib/xfstests/tests/btrfs 2023-03-30T08:14:34.671 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/ceph/ install 2023-03-30T08:14:34.678 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-03-30T08:14:34.716 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-03-30T08:14:34.796 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-03-30T08:14:34.832 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-03-30T08:14:34.911 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/cifs/ install 2023-03-30T08:14:34.919 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-03-30T08:14:34.959 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-03-30T08:14:34.998 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-03-30T08:14:35.037 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-03-30T08:14:35.074 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/ext4/ install 2023-03-30T08:14:35.080 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-03-30T08:14:35.117 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-03-30T08:14:35.887 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-03-30T08:14:35.925 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 049.out 032.out 039.out 045.out 054.out 056.out 308.out 008.out 040.out 307.out 005.out 021.out 012.out 009.out 033.out 015.out 050.out 026.out 034.out 046.out 018.out 010.out 047.out 303.out 302.out 020.out 002.out 028.out 024.out 013.out 031.out 027.out 306.out 048.out 038.out 044.out 052.out 025.out 029.out 011.out 042.out 304.out 055.out 030.out 003.out 017.out 043.out 053.out 035.out 016.out 058.out 022.out 006.out 004.out 057.out 014.out 036.out 271.out 051.out 041.out 037.out 305.out 019.out 301.out 007.out 023.out 059.out /var/lib/xfstests/tests/ext4 2023-03-30T08:14:36.751 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/f2fs/ install 2023-03-30T08:14:36.759 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-03-30T08:14:36.799 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-03-30T08:14:36.851 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-03-30T08:14:36.892 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-03-30T08:14:36.942 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/generic/ install 2023-03-30T08:14:36.950 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-03-30T08:14:36.986 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-03-30T08:14:43.324 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:14:43.330 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:14:45.102 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-03-30T08:14:45.138 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 035.out.default 050.out.nojournal 050.out.xfsquota 050.out.default 050.cfg 035.cfg 047.out 021.out 233.out 518.out 055.out 295.out 683.out 337.out 385.out 082.out 270.out 237.out 502.out 088.out 597.out 097.out 202.out 137.out 034.out 110.out 389.out 593.out 571.out 040.out 646.out 592.out 282.out 472.out 468.out 628.out 428.out 507.out 328.out 566.out 127.out 557.out 273.out 182.out 420.out 609.out 576.out 087.out 506.out 057.out 195.out 711.out 007.out 466.out 311.out 532.out 591.out 719.out 111.out 432.out 519.out 623.out 131.out 319.out 177.out 219.out 119.out 423.out 661.out 232.out 645.out 134.out 260.out 095.out 611.out 638.out 465.out 716.out 161.out 416.out 026.out 216.out 116.out 043.out 358.out 338.out 238.out 439.out 138.out 263.out 497.out 160.out 647.out 433.out 481.out 061.out 555.out 686.out 333.out 258.out 322.out 039.out 222.out 098.out 330.out 690.out 480.out 706.out 606.out 406.out 306.out 206.out 106.out 006.out 167.out 003.out 217.out 120.out 191.out 117.out 355.out 357.out 542.out 485.out 074.out 033.out 188.out 367.out 489.out 279.out 624.out 524.out 174.out 163.out 324.out 224.out 257.out 124.out 672.out 668.out 058.out 262.out 366.out 648.out 042.out 537.out 377.out 193.out 083.out 399.out 365.out 509.out 568.out 309.out 209.out 441.out 255.out 356.out 474.out 341.out 094.out 241.out 089.out 691.out 616.out 614.out 514.out 312.out 141.out 314.out 214.out 381.out 056.out 671.out 041.out 016.out 340.out 649.out 572.out 586.out 240.out 549.out 673.out 633.out 321.out 140.out 708.out 608.out 449.out 185.out 408.out 308.out 208.out 380.out 670.out 604.out 404.out 104.out 663.out 599.out 476.out 192.out 199.out 278.out 639.out 443.out 540.out 186.out 539.out 133.out 164.out 376.out 589.out 154.out 339.out 652.out 239.out 440.out 498.out 139.out 180.out 267.out 317.out 552.out 017.out 169.out 565.out 315.out 580.out 452.out 679.out 336.out 020.out 252.out 585.out 678.out 448.out 352.out 348.out 651.out 184.out 435.out 409.out 248.out 009.out 482.out 625.out 283.out 488.out 496.out 325.out 551.out 225.out 636.out 125.out 544.out 693.out 296.out 650.out 152.out 563.out 143.out 024.out 015.out 392.out 682.out 595.out 578.out 642.out 550.out 052.out 062.out 655.out 276.out 451.out 450.out 463.out 004.out 157.out 069.out 644.out 316.out 344.out 487.out 715.out 615.out 395.out 151.out 415.out 674.out 215.out 115.out 384.out 351.out 250.out 266.out 051.out 536.out 228.out 577.out 244.out 128.out 662.out 579.out 144.out 405.out 205.out 136.out 598.out 363.out 712.out 176.out 198.out 723.out 108.out 390.out 680.out 705.out 605.out 505.out 305.out 105.out 005.out 523.out 084.out 703.out 619.out 727.out 685.out 562.out 419.out 570.out 388.out 527.out 158.out 044.out 019.out 695.out 086.out 574.out 332.out 060.out 142.out 584.out 045.out 372.out 478.out 612.out 462.out 173.out 687.out 350.out 132.out 037.out 293.out 197.out 492.out 499.out 246.out 032.out 112.out 660.out 414.out 063.out 101.out 561.out 343.out 323.out 702.out 362.out 387.out 594.out 438.out 721.out 289.out 699.out 284.out 477.out 621.out 290.out 548.out 299.out 456.out 707.out 461.out 391.out 445.out 632.out 256.out 493.out 107.out 658.out 251.out 526.out 479.out 713.out 426.out 221.out 326.out 226.out 413.out 126.out 121.out 313.out 447.out 460.out 694.out 347.out 275.out 038.out 090.out 361.out 528.out 564.out 294.out 656.out 066.out 455.out 558.out 162.out 147.out 288.out 396.out 547.out 531.out 698.out 148.out 301.out 360.out 374.out 261.out 375.out 076.out 657.out 692.out 304.out 634.out 724.out 129.out 726.out 458.out 534.out 626.out 529.out 603.out 434.out 329.out 587.out 165.out 229.out 590.out 371.out 234.out 183.out 486.out 223.out 123.out 179.out 669.out 023.out 459.out 688.out 277.out 516.out 146.out 398.out 696.out 247.out 427.out 190.out 280.out 484.out 491.out 187.out 046.out 227.out 583.out 285.out 631.out 654.out 359.out 501.out 171.out 155.out 431.out 099.out 331.out 231.out 613.out 513.out 028.out 213.out 113.out 013.out 031.out 630.out 675.out 667.out 272.out 530.out 627.out 573.out 430.out 310.out 454.out 259.out 210.out 327.out 397.out 067.out 093.out 287.out 230.out 027.out 292.out 130.out 370.out 403.out 030.out 203.out 103.out 354.out 025.out 386.out 560.out 722.out 291.out 622.out 243.out 522.out 543.out 422.out 394.out 159.out 249.out 122.out 689.out 166.out 022.out 424.out 637.out 684.out 490.out 353.out 181.out 676.out 271.out 149.out 618.out 064.out 018.out 418.out 077.out 218.out 118.out 575.out 172.out 079.out 469.out 054.out 059.out 049.out 442.out 569.out 521.out 378.out 253.out 421.out 475.out 512.out 494.out 412.out 212.out 538.out 379.out 342.out 012.out 554.out 471.out 070.out 596.out 720.out 620.out 196.out 520.out 242.out 457.out 320.out 220.out 629.out 602.out 153.out 402.out 302.out 102.out 002.out 717.out 617.out 517.out 429.out 417.out 156.out 092.out 664.out 072.out 068.out 473.out 369.out 511.out 411.out 029.out 211.out 011.out 659.out 194.out 170.out 053.out 065.out 286.out 245.out 437.out 545.out 714.out 559.out 710.out 036.out 610.out 510.out 274.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 495.out 281.out 048.out 665.out 114.out 014.out 346.out 581.out 297.out 145.out 168.out 641.out 436.out 091.out 081.out 071.out 075.out 653.out 700.out 600.out 500.out 400.out 300.out 200.out 100.out 464.out 541.out 269.out 546.out 382.out 677.out 553.out 178.out 175.out 298.out 446.out 444.out 080.out 709.out 607.out 508.out 407.out 307.out 207.out 109.out 008.out 643.out 150.out 349.out 453.out 666.out 236.out 078.out 364.out 567.out 725.out 582.out 383.out 085.out 704.out 588.out 635.out 334.out 504.out 525.out 189.out 204.out 535.out 425.out 345.out 318.out 467.out 368.out 681.out 254.out 335.out 718.out 073.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 515.out 373.out 265.out 697.out 640.out 483.out 096.out 393.out /var/lib/xfstests/tests/generic 2023-03-30T08:14:53.340 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/nfs/ install 2023-03-30T08:14:53.350 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-03-30T08:14:53.392 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-03-30T08:14:53.432 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-03-30T08:14:53.473 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-03-30T08:14:53.511 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/ocfs2/ install 2023-03-30T08:14:53.520 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-03-30T08:14:53.560 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-03-30T08:14:53.599 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-03-30T08:14:53.635 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-03-30T08:14:53.673 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/overlay/ install 2023-03-30T08:14:53.680 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-03-30T08:14:53.715 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-03-30T08:14:54.802 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-03-30T08:14:54.843 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 050.out 044.out 019.out 103.out 003.out 074.out 018.out 024.out 078.out 069.out 020.out 102.out 002.out 060.out 113.out 013.out 031.out 015.out 117.out 045.out 072.out 106.out 048.out 062.out 038.out 052.out 076.out 037.out 029.out 111.out 112.out 042.out 035.out 073.out 068.out 030.out 034.out 017.out 055.out 053.out 109.out 116.out 043.out 056.out 010.out 001.out 009.out 065.out 022.out 004.out 115.out 066.out 114.out 014.out 071.out 007.out 061.out 051.out 011.out 041.out 067.out 058.out 100.out 064.out 104.out 028.out 027.out 023.out 059.out 049.out 032.out 039.out 077.out 105.out 005.out 025.out 026.out 036.out 070.out 108.out 008.out 040.out 107.out 006.out 075.out 063.out 021.out 016.out 047.out 110.out 046.out 012.out 101.out 054.out 033.out 057.out /var/lib/xfstests/tests/overlay 2023-03-30T08:14:55.933 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/perf/ install 2023-03-30T08:14:55.938 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-03-30T08:14:55.976 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-03-30T08:14:56.013 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-03-30T08:14:56.052 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-03-30T08:14:56.089 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/selftest/ install 2023-03-30T08:14:56.099 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-03-30T08:14:56.137 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-03-30T08:14:56.232 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-03-30T08:14:56.268 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 006.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-03-30T08:14:56.355 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/shared/ install 2023-03-30T08:14:56.362 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-03-30T08:14:56.404 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-03-30T08:14:56.460 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-03-30T08:14:56.496 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-03-30T08:14:56.555 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/tmpfs/ install 2023-03-30T08:14:56.564 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-03-30T08:14:56.600 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-03-30T08:14:56.637 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-03-30T08:14:56.676 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-03-30T08:14:56.717 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/udf/ install 2023-03-30T08:14:56.725 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-03-30T08:14:56.765 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-03-30T08:14:56.800 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-03-30T08:14:56.839 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-03-30T08:14:56.879 INFO:teuthology.orchestra.run.smithi087.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.dmK5MK8Zk9xfstests-dev/tests/xfs/ install 2023-03-30T08:14:56.889 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-03-30T08:14:56.931 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-03-30T08:15:04.571 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-03-30T08:15:04.612 INFO:teuthology.orchestra.run.smithi087.stdout:../../install-sh -o root -g root -m 644 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 096.out.internal 216.out.64mblog 071.out.32 216.cfg 033.cfg 508.out 221.out 057.out 308.out 208.out 737.out 108.out 404.out 457.out 021.out 455.out 233.out 194.out 443.out 295.out 337.out 237.out 759.out 502.out 088.out 366.out 202.out 137.out 002.out 389.out 593.out 571.out 775.out 040.out 765.out 592.out 282.out 728.out 528.out 428.out 407.out 328.out 566.out 261.out 557.out 273.out 468.out 074.out 427.out 059.out 595.out 789.out 195.out 346.out 732.out 784.out 532.out 191.out 111.out 432.out 519.out 419.out 131.out 319.out 177.out 219.out 119.out 423.out 232.out 329.out 467.out 229.out 103.out 234.out 183.out 733.out 134.out 260.out 157.out 718.out 034.out 465.out 716.out 161.out 416.out 116.out 043.out 155.out 358.out 338.out 238.out 065.out 439.out 138.out 189.out 097.out 160.out 175.out 373.out 481.out 345.out 025.out 772.out 768.out 258.out 379.out 322.out 039.out 498.out 742.out 290.out 480.out 060.out 506.out 406.out 306.out 206.out 006.out 167.out 003.out 217.out 117.out 355.out 017.out 542.out 783.out 485.out 442.out 188.out 099.out 342.out 279.out 524.out 174.out 771.out 324.out 224.out 313.out 257.out 124.out 758.out 058.out 741.out 384.out 262.out 042.out 497.out 377.out 193.out 799.out 473.out 770.out 365.out 409.out 309.out 209.out 441.out 109.out 255.out 740.out 558.out 474.out 341.out 094.out 555.out 712.out 241.out 089.out 540.out 256.out 714.out 514.out 414.out 314.out 214.out 114.out 381.out 147.out 275.out 041.out 721.out 340.out 793.out 156.out 572.out 568.out 586.out 240.out 180.out 549.out 267.out 280.out 543.out 140.out 708.out 449.out 185.out 334.out 504.out 525.out 204.out 535.out 104.out 425.out 399.out 254.out 335.out 531.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 110.out 318.out 515.out 433.out 036.out 169.out 483.out 393.out 333.out 476.out 087.out 192.out 199.out 739.out 278.out 591.out 752.out 736.out 236.out 539.out 749.out 164.out 376.out 154.out 587.out 339.out 239.out 440.out 458.out 456.out 489.out 139.out 774.out 790.out 317.out 552.out 781.out 064.out 444.out 580.out 452.out 020.out 252.out 724.out 352.out 794.out 348.out 709.out 394.out 356.out 184.out 435.out 509.out 466.out 248.out 785.out 009.out 283.out 750.out 045.out 297.out 488.out 496.out 325.out 551.out 225.out 125.out 186.out 544.out 296.out 152.out 563.out 143.out 436.out 392.out 545.out 075.out 472.out 463.out 550.out 052.out 062.out 276.out 266.out 450.out 744.out 004.out 764.out 069.out 316.out 487.out 762.out 715.out 395.out 151.out 415.out 315.out 344.out 215.out 115.out 015.out 351.out 250.out 464.out 051.out 536.out 228.out 244.out 128.out 385.out 336.out 086.out 579.out 144.out 505.out 205.out 136.out 537.out 176.out 198.out 723.out 390.out 178.out 050.out 405.out 305.out 105.out 005.out 523.out 761.out 437.out 719.out 727.out 363.out 095.out 562.out 382.out 271.out 570.out 388.out 590.out 527.out 158.out 044.out 019.out 577.out 777.out 760.out 574.out 332.out 372.out 478.out 462.out 220.out 350.out 132.out 293.out 492.out 263.out 212.out 499.out 246.out 112.out 063.out 101.out 561.out 343.out 362.out 387.out 798.out 594.out 438.out 265.out 289.out 106.out 477.out 281.out 548.out 299.out 364.out 461.out 391.out 451.out 493.out 786.out 007.out 448.out 251.out 380.out 526.out 479.out 713.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 026.out 347.out 035.out 361.out 564.out 294.out 788.out 066.out 795.out 076.out 747.out 585.out 162.out 796.out 288.out 197.out 396.out 576.out 547.out 298.out 148.out 301.out 360.out 374.out 734.out 447.out 292.out 304.out 482.out 129.out 726.out 729.out 048.out 534.out 073.out 529.out 434.out 368.out 486.out 223.out 123.out 179.out 023.out 032.out 748.out 277.out 516.out 424.out 398.out 168.out 751.out 190.out 173.out 484.out 491.out 754.out 016.out 046.out 227.out 731.out 782.out 583.out 285.out 127.out 501.out 171.out 581.out 027.out 431.out 068.out 331.out 791.out 743.out 047.out 231.out 024.out 513.out 371.out 213.out 730.out 113.out 013.out 031.out 367.out 182.out 323.out 272.out 530.out 573.out 430.out 454.out 259.out 210.out 327.out 330.out 067.out 093.out 287.out 230.out 769.out 061.out 130.out 370.out 403.out 030.out 203.out 354.out 165.out 386.out 560.out 055.out 722.out 291.out 245.out 243.out 522.out 787.out 745.out 422.out 222.out 159.out 249.out 122.out 166.out 022.out 038.out 578.out 490.out 565.out 353.out 375.out 181.out 500.out 149.out 518.out 018.out 418.out 077.out 218.out 118.out 575.out 780.out 172.out 792.out 079.out 469.out 054.out 049.out 247.out 738.out 163.out 776.out 521.out 270.out 378.out 253.out 421.out 321.out 475.out 512.out 494.out 412.out 312.out 121.out 538.out 012.out 028.out 554.out 397.out 773.out 720.out 196.out 520.out 242.out 420.out 098.out 320.out 120.out 153.out 402.out 302.out 102.out 717.out 460.out 517.out 429.out 417.out 142.out 092.out 357.out 072.out 778.out 084.out 056.out 369.out 711.out 511.out 411.out 029.out 311.out 211.out 011.out 767.out 187.out 170.out 053.out 133.out 286.out 756.out 755.out 766.out 559.out 710.out 510.out 274.out 410.out 310.out 401.out 201.out 010.out 001.out 141.out 495.out 584.out 589.out 753.out 014.out 459.out 145.out 797.out 757.out 091.out 081.out 083.out 800.out 037.out 400.out 300.out 200.out 100.out 359.out 471.out 541.out 445.out 779.out 269.out 546.out 553.out 763.out 446.out 090.out 080.out 070.out 507.out 408.out 307.out 207.out 107.out 008.out 746.out 284.out 349.out 453.out 078.out 567.out 725.out 582.out 735.out 383.out 085.out 588.out 146.out /var/lib/xfstests/tests/xfs 2023-03-30T08:15:12.405 INFO:teuthology.orchestra.run.smithi087.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-03-30T08:15:12.446 INFO:teuthology.orchestra.run.smithi087.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-03-30T08:15:12.485 INFO:teuthology.orchestra.run.smithi087.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-03-30T08:15:12.522 INFO:teuthology.orchestra.run.smithi087.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-03-30T08:15:12.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T08:15:12.565 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec ls tests/generic) 2023-03-30T08:15:12.582 INFO:teuthology.orchestra.run.smithi087.stdout:001 2023-03-30T08:15:12.583 INFO:teuthology.orchestra.run.smithi087.stdout:001.out 2023-03-30T08:15:12.583 INFO:teuthology.orchestra.run.smithi087.stdout:002 2023-03-30T08:15:12.583 INFO:teuthology.orchestra.run.smithi087.stdout:002.out 2023-03-30T08:15:12.583 INFO:teuthology.orchestra.run.smithi087.stdout:003 2023-03-30T08:15:12.583 INFO:teuthology.orchestra.run.smithi087.stdout:003.out 2023-03-30T08:15:12.583 INFO:teuthology.orchestra.run.smithi087.stdout:004 2023-03-30T08:15:12.583 INFO:teuthology.orchestra.run.smithi087.stdout:004.out 2023-03-30T08:15:12.584 INFO:teuthology.orchestra.run.smithi087.stdout:005 2023-03-30T08:15:12.584 INFO:teuthology.orchestra.run.smithi087.stdout:005.out 2023-03-30T08:15:12.584 INFO:teuthology.orchestra.run.smithi087.stdout:006 2023-03-30T08:15:12.584 INFO:teuthology.orchestra.run.smithi087.stdout:006.out 2023-03-30T08:15:12.584 INFO:teuthology.orchestra.run.smithi087.stdout:007 2023-03-30T08:15:12.584 INFO:teuthology.orchestra.run.smithi087.stdout:007.out 2023-03-30T08:15:12.584 INFO:teuthology.orchestra.run.smithi087.stdout:008 2023-03-30T08:15:12.584 INFO:teuthology.orchestra.run.smithi087.stdout:008.out 2023-03-30T08:15:12.585 INFO:teuthology.orchestra.run.smithi087.stdout:009 2023-03-30T08:15:12.585 INFO:teuthology.orchestra.run.smithi087.stdout:009.out 2023-03-30T08:15:12.585 INFO:teuthology.orchestra.run.smithi087.stdout:010 2023-03-30T08:15:12.585 INFO:teuthology.orchestra.run.smithi087.stdout:010.out 2023-03-30T08:15:12.585 INFO:teuthology.orchestra.run.smithi087.stdout:011 2023-03-30T08:15:12.585 INFO:teuthology.orchestra.run.smithi087.stdout:011.out 2023-03-30T08:15:12.585 INFO:teuthology.orchestra.run.smithi087.stdout:012 2023-03-30T08:15:12.586 INFO:teuthology.orchestra.run.smithi087.stdout:012.out 2023-03-30T08:15:12.586 INFO:teuthology.orchestra.run.smithi087.stdout:013 2023-03-30T08:15:12.586 INFO:teuthology.orchestra.run.smithi087.stdout:013.out 2023-03-30T08:15:12.586 INFO:teuthology.orchestra.run.smithi087.stdout:014 2023-03-30T08:15:12.586 INFO:teuthology.orchestra.run.smithi087.stdout:014.out 2023-03-30T08:15:12.586 INFO:teuthology.orchestra.run.smithi087.stdout:015 2023-03-30T08:15:12.586 INFO:teuthology.orchestra.run.smithi087.stdout:015.out 2023-03-30T08:15:12.586 INFO:teuthology.orchestra.run.smithi087.stdout:016 2023-03-30T08:15:12.587 INFO:teuthology.orchestra.run.smithi087.stdout:016.out 2023-03-30T08:15:12.587 INFO:teuthology.orchestra.run.smithi087.stdout:017 2023-03-30T08:15:12.587 INFO:teuthology.orchestra.run.smithi087.stdout:017.out 2023-03-30T08:15:12.587 INFO:teuthology.orchestra.run.smithi087.stdout:018 2023-03-30T08:15:12.587 INFO:teuthology.orchestra.run.smithi087.stdout:018.out 2023-03-30T08:15:12.587 INFO:teuthology.orchestra.run.smithi087.stdout:019 2023-03-30T08:15:12.587 INFO:teuthology.orchestra.run.smithi087.stdout:019.out 2023-03-30T08:15:12.587 INFO:teuthology.orchestra.run.smithi087.stdout:020 2023-03-30T08:15:12.588 INFO:teuthology.orchestra.run.smithi087.stdout:020.out 2023-03-30T08:15:12.588 INFO:teuthology.orchestra.run.smithi087.stdout:021 2023-03-30T08:15:12.588 INFO:teuthology.orchestra.run.smithi087.stdout:021.out 2023-03-30T08:15:12.588 INFO:teuthology.orchestra.run.smithi087.stdout:022 2023-03-30T08:15:12.588 INFO:teuthology.orchestra.run.smithi087.stdout:022.out 2023-03-30T08:15:12.588 INFO:teuthology.orchestra.run.smithi087.stdout:023 2023-03-30T08:15:12.588 INFO:teuthology.orchestra.run.smithi087.stdout:023.out 2023-03-30T08:15:12.589 INFO:teuthology.orchestra.run.smithi087.stdout:024 2023-03-30T08:15:12.589 INFO:teuthology.orchestra.run.smithi087.stdout:024.out 2023-03-30T08:15:12.589 INFO:teuthology.orchestra.run.smithi087.stdout:025 2023-03-30T08:15:12.589 INFO:teuthology.orchestra.run.smithi087.stdout:025.out 2023-03-30T08:15:12.589 INFO:teuthology.orchestra.run.smithi087.stdout:026 2023-03-30T08:15:12.589 INFO:teuthology.orchestra.run.smithi087.stdout:026.out 2023-03-30T08:15:12.589 INFO:teuthology.orchestra.run.smithi087.stdout:027 2023-03-30T08:15:12.590 INFO:teuthology.orchestra.run.smithi087.stdout:027.out 2023-03-30T08:15:12.590 INFO:teuthology.orchestra.run.smithi087.stdout:028 2023-03-30T08:15:12.590 INFO:teuthology.orchestra.run.smithi087.stdout:028.out 2023-03-30T08:15:12.590 INFO:teuthology.orchestra.run.smithi087.stdout:029 2023-03-30T08:15:12.590 INFO:teuthology.orchestra.run.smithi087.stdout:029.out 2023-03-30T08:15:12.590 INFO:teuthology.orchestra.run.smithi087.stdout:030 2023-03-30T08:15:12.590 INFO:teuthology.orchestra.run.smithi087.stdout:030.out 2023-03-30T08:15:12.590 INFO:teuthology.orchestra.run.smithi087.stdout:031 2023-03-30T08:15:12.591 INFO:teuthology.orchestra.run.smithi087.stdout:031.out 2023-03-30T08:15:12.591 INFO:teuthology.orchestra.run.smithi087.stdout:032 2023-03-30T08:15:12.591 INFO:teuthology.orchestra.run.smithi087.stdout:032.out 2023-03-30T08:15:12.591 INFO:teuthology.orchestra.run.smithi087.stdout:033 2023-03-30T08:15:12.591 INFO:teuthology.orchestra.run.smithi087.stdout:033.out 2023-03-30T08:15:12.591 INFO:teuthology.orchestra.run.smithi087.stdout:034 2023-03-30T08:15:12.591 INFO:teuthology.orchestra.run.smithi087.stdout:034.out 2023-03-30T08:15:12.591 INFO:teuthology.orchestra.run.smithi087.stdout:035 2023-03-30T08:15:12.592 INFO:teuthology.orchestra.run.smithi087.stdout:035.cfg 2023-03-30T08:15:12.592 INFO:teuthology.orchestra.run.smithi087.stdout:035.out.default 2023-03-30T08:15:12.592 INFO:teuthology.orchestra.run.smithi087.stdout:035.out.nfs 2023-03-30T08:15:12.592 INFO:teuthology.orchestra.run.smithi087.stdout:036 2023-03-30T08:15:12.592 INFO:teuthology.orchestra.run.smithi087.stdout:036.out 2023-03-30T08:15:12.592 INFO:teuthology.orchestra.run.smithi087.stdout:037 2023-03-30T08:15:12.592 INFO:teuthology.orchestra.run.smithi087.stdout:037.out 2023-03-30T08:15:12.592 INFO:teuthology.orchestra.run.smithi087.stdout:038 2023-03-30T08:15:12.593 INFO:teuthology.orchestra.run.smithi087.stdout:038.out 2023-03-30T08:15:12.593 INFO:teuthology.orchestra.run.smithi087.stdout:039 2023-03-30T08:15:12.593 INFO:teuthology.orchestra.run.smithi087.stdout:039.out 2023-03-30T08:15:12.593 INFO:teuthology.orchestra.run.smithi087.stdout:040 2023-03-30T08:15:12.593 INFO:teuthology.orchestra.run.smithi087.stdout:040.out 2023-03-30T08:15:12.593 INFO:teuthology.orchestra.run.smithi087.stdout:041 2023-03-30T08:15:12.593 INFO:teuthology.orchestra.run.smithi087.stdout:041.out 2023-03-30T08:15:12.593 INFO:teuthology.orchestra.run.smithi087.stdout:042 2023-03-30T08:15:12.594 INFO:teuthology.orchestra.run.smithi087.stdout:042.out 2023-03-30T08:15:12.594 INFO:teuthology.orchestra.run.smithi087.stdout:043 2023-03-30T08:15:12.594 INFO:teuthology.orchestra.run.smithi087.stdout:043.out 2023-03-30T08:15:12.594 INFO:teuthology.orchestra.run.smithi087.stdout:044 2023-03-30T08:15:12.594 INFO:teuthology.orchestra.run.smithi087.stdout:044.out 2023-03-30T08:15:12.594 INFO:teuthology.orchestra.run.smithi087.stdout:045 2023-03-30T08:15:12.594 INFO:teuthology.orchestra.run.smithi087.stdout:045.out 2023-03-30T08:15:12.594 INFO:teuthology.orchestra.run.smithi087.stdout:046 2023-03-30T08:15:12.595 INFO:teuthology.orchestra.run.smithi087.stdout:046.out 2023-03-30T08:15:12.595 INFO:teuthology.orchestra.run.smithi087.stdout:047 2023-03-30T08:15:12.595 INFO:teuthology.orchestra.run.smithi087.stdout:047.out 2023-03-30T08:15:12.595 INFO:teuthology.orchestra.run.smithi087.stdout:048 2023-03-30T08:15:12.595 INFO:teuthology.orchestra.run.smithi087.stdout:048.out 2023-03-30T08:15:12.595 INFO:teuthology.orchestra.run.smithi087.stdout:049 2023-03-30T08:15:12.595 INFO:teuthology.orchestra.run.smithi087.stdout:049.out 2023-03-30T08:15:12.595 INFO:teuthology.orchestra.run.smithi087.stdout:050 2023-03-30T08:15:12.596 INFO:teuthology.orchestra.run.smithi087.stdout:050.cfg 2023-03-30T08:15:12.596 INFO:teuthology.orchestra.run.smithi087.stdout:050.out.default 2023-03-30T08:15:12.596 INFO:teuthology.orchestra.run.smithi087.stdout:050.out.nojournal 2023-03-30T08:15:12.596 INFO:teuthology.orchestra.run.smithi087.stdout:050.out.xfsquota 2023-03-30T08:15:12.596 INFO:teuthology.orchestra.run.smithi087.stdout:051 2023-03-30T08:15:12.596 INFO:teuthology.orchestra.run.smithi087.stdout:051.out 2023-03-30T08:15:12.597 INFO:teuthology.orchestra.run.smithi087.stdout:052 2023-03-30T08:15:12.597 INFO:teuthology.orchestra.run.smithi087.stdout:052.out 2023-03-30T08:15:12.597 INFO:teuthology.orchestra.run.smithi087.stdout:053 2023-03-30T08:15:12.597 INFO:teuthology.orchestra.run.smithi087.stdout:053.out 2023-03-30T08:15:12.597 INFO:teuthology.orchestra.run.smithi087.stdout:054 2023-03-30T08:15:12.598 INFO:teuthology.orchestra.run.smithi087.stdout:054.out 2023-03-30T08:15:12.598 INFO:teuthology.orchestra.run.smithi087.stdout:055 2023-03-30T08:15:12.598 INFO:teuthology.orchestra.run.smithi087.stdout:055.out 2023-03-30T08:15:12.598 INFO:teuthology.orchestra.run.smithi087.stdout:056 2023-03-30T08:15:12.598 INFO:teuthology.orchestra.run.smithi087.stdout:056.out 2023-03-30T08:15:12.598 INFO:teuthology.orchestra.run.smithi087.stdout:057 2023-03-30T08:15:12.599 INFO:teuthology.orchestra.run.smithi087.stdout:057.out 2023-03-30T08:15:12.599 INFO:teuthology.orchestra.run.smithi087.stdout:058 2023-03-30T08:15:12.599 INFO:teuthology.orchestra.run.smithi087.stdout:058.out 2023-03-30T08:15:12.599 INFO:teuthology.orchestra.run.smithi087.stdout:059 2023-03-30T08:15:12.599 INFO:teuthology.orchestra.run.smithi087.stdout:059.out 2023-03-30T08:15:12.600 INFO:teuthology.orchestra.run.smithi087.stdout:060 2023-03-30T08:15:12.600 INFO:teuthology.orchestra.run.smithi087.stdout:060.out 2023-03-30T08:15:12.600 INFO:teuthology.orchestra.run.smithi087.stdout:061 2023-03-30T08:15:12.600 INFO:teuthology.orchestra.run.smithi087.stdout:061.out 2023-03-30T08:15:12.601 INFO:teuthology.orchestra.run.smithi087.stdout:062 2023-03-30T08:15:12.601 INFO:teuthology.orchestra.run.smithi087.stdout:062.out 2023-03-30T08:15:12.601 INFO:teuthology.orchestra.run.smithi087.stdout:063 2023-03-30T08:15:12.602 INFO:teuthology.orchestra.run.smithi087.stdout:063.out 2023-03-30T08:15:12.602 INFO:teuthology.orchestra.run.smithi087.stdout:064 2023-03-30T08:15:12.602 INFO:teuthology.orchestra.run.smithi087.stdout:064.out 2023-03-30T08:15:12.602 INFO:teuthology.orchestra.run.smithi087.stdout:065 2023-03-30T08:15:12.602 INFO:teuthology.orchestra.run.smithi087.stdout:065.out 2023-03-30T08:15:12.602 INFO:teuthology.orchestra.run.smithi087.stdout:066 2023-03-30T08:15:12.603 INFO:teuthology.orchestra.run.smithi087.stdout:066.out 2023-03-30T08:15:12.603 INFO:teuthology.orchestra.run.smithi087.stdout:067 2023-03-30T08:15:12.603 INFO:teuthology.orchestra.run.smithi087.stdout:067.out 2023-03-30T08:15:12.603 INFO:teuthology.orchestra.run.smithi087.stdout:068 2023-03-30T08:15:12.604 INFO:teuthology.orchestra.run.smithi087.stdout:068.out 2023-03-30T08:15:12.604 INFO:teuthology.orchestra.run.smithi087.stdout:069 2023-03-30T08:15:12.604 INFO:teuthology.orchestra.run.smithi087.stdout:069.out 2023-03-30T08:15:12.604 INFO:teuthology.orchestra.run.smithi087.stdout:070 2023-03-30T08:15:12.604 INFO:teuthology.orchestra.run.smithi087.stdout:070.out 2023-03-30T08:15:12.604 INFO:teuthology.orchestra.run.smithi087.stdout:071 2023-03-30T08:15:12.604 INFO:teuthology.orchestra.run.smithi087.stdout:071.out 2023-03-30T08:15:12.605 INFO:teuthology.orchestra.run.smithi087.stdout:072 2023-03-30T08:15:12.605 INFO:teuthology.orchestra.run.smithi087.stdout:072.out 2023-03-30T08:15:12.605 INFO:teuthology.orchestra.run.smithi087.stdout:073 2023-03-30T08:15:12.605 INFO:teuthology.orchestra.run.smithi087.stdout:073.out 2023-03-30T08:15:12.606 INFO:teuthology.orchestra.run.smithi087.stdout:074 2023-03-30T08:15:12.606 INFO:teuthology.orchestra.run.smithi087.stdout:074.out 2023-03-30T08:15:12.606 INFO:teuthology.orchestra.run.smithi087.stdout:075 2023-03-30T08:15:12.606 INFO:teuthology.orchestra.run.smithi087.stdout:075.out 2023-03-30T08:15:12.606 INFO:teuthology.orchestra.run.smithi087.stdout:076 2023-03-30T08:15:12.606 INFO:teuthology.orchestra.run.smithi087.stdout:076.out 2023-03-30T08:15:12.606 INFO:teuthology.orchestra.run.smithi087.stdout:077 2023-03-30T08:15:12.607 INFO:teuthology.orchestra.run.smithi087.stdout:077.out 2023-03-30T08:15:12.607 INFO:teuthology.orchestra.run.smithi087.stdout:078 2023-03-30T08:15:12.607 INFO:teuthology.orchestra.run.smithi087.stdout:078.out 2023-03-30T08:15:12.607 INFO:teuthology.orchestra.run.smithi087.stdout:079 2023-03-30T08:15:12.607 INFO:teuthology.orchestra.run.smithi087.stdout:079.out 2023-03-30T08:15:12.607 INFO:teuthology.orchestra.run.smithi087.stdout:080 2023-03-30T08:15:12.607 INFO:teuthology.orchestra.run.smithi087.stdout:080.out 2023-03-30T08:15:12.607 INFO:teuthology.orchestra.run.smithi087.stdout:081 2023-03-30T08:15:12.608 INFO:teuthology.orchestra.run.smithi087.stdout:081.out 2023-03-30T08:15:12.608 INFO:teuthology.orchestra.run.smithi087.stdout:082 2023-03-30T08:15:12.608 INFO:teuthology.orchestra.run.smithi087.stdout:082.out 2023-03-30T08:15:12.608 INFO:teuthology.orchestra.run.smithi087.stdout:083 2023-03-30T08:15:12.608 INFO:teuthology.orchestra.run.smithi087.stdout:083.out 2023-03-30T08:15:12.608 INFO:teuthology.orchestra.run.smithi087.stdout:084 2023-03-30T08:15:12.608 INFO:teuthology.orchestra.run.smithi087.stdout:084.out 2023-03-30T08:15:12.608 INFO:teuthology.orchestra.run.smithi087.stdout:085 2023-03-30T08:15:12.609 INFO:teuthology.orchestra.run.smithi087.stdout:085.out 2023-03-30T08:15:12.609 INFO:teuthology.orchestra.run.smithi087.stdout:086 2023-03-30T08:15:12.609 INFO:teuthology.orchestra.run.smithi087.stdout:086.out 2023-03-30T08:15:12.609 INFO:teuthology.orchestra.run.smithi087.stdout:087 2023-03-30T08:15:12.609 INFO:teuthology.orchestra.run.smithi087.stdout:087.out 2023-03-30T08:15:12.609 INFO:teuthology.orchestra.run.smithi087.stdout:088 2023-03-30T08:15:12.610 INFO:teuthology.orchestra.run.smithi087.stdout:088.out 2023-03-30T08:15:12.610 INFO:teuthology.orchestra.run.smithi087.stdout:089 2023-03-30T08:15:12.610 INFO:teuthology.orchestra.run.smithi087.stdout:089.out 2023-03-30T08:15:12.610 INFO:teuthology.orchestra.run.smithi087.stdout:090 2023-03-30T08:15:12.610 INFO:teuthology.orchestra.run.smithi087.stdout:090.out 2023-03-30T08:15:12.610 INFO:teuthology.orchestra.run.smithi087.stdout:091 2023-03-30T08:15:12.610 INFO:teuthology.orchestra.run.smithi087.stdout:091.out 2023-03-30T08:15:12.610 INFO:teuthology.orchestra.run.smithi087.stdout:092 2023-03-30T08:15:12.611 INFO:teuthology.orchestra.run.smithi087.stdout:092.out 2023-03-30T08:15:12.611 INFO:teuthology.orchestra.run.smithi087.stdout:093 2023-03-30T08:15:12.611 INFO:teuthology.orchestra.run.smithi087.stdout:093.out 2023-03-30T08:15:12.611 INFO:teuthology.orchestra.run.smithi087.stdout:094 2023-03-30T08:15:12.611 INFO:teuthology.orchestra.run.smithi087.stdout:094.out 2023-03-30T08:15:12.611 INFO:teuthology.orchestra.run.smithi087.stdout:095 2023-03-30T08:15:12.612 INFO:teuthology.orchestra.run.smithi087.stdout:095.out 2023-03-30T08:15:12.612 INFO:teuthology.orchestra.run.smithi087.stdout:096 2023-03-30T08:15:12.612 INFO:teuthology.orchestra.run.smithi087.stdout:096.out 2023-03-30T08:15:12.612 INFO:teuthology.orchestra.run.smithi087.stdout:097 2023-03-30T08:15:12.612 INFO:teuthology.orchestra.run.smithi087.stdout:097.out 2023-03-30T08:15:12.612 INFO:teuthology.orchestra.run.smithi087.stdout:098 2023-03-30T08:15:12.613 INFO:teuthology.orchestra.run.smithi087.stdout:098.out 2023-03-30T08:15:12.613 INFO:teuthology.orchestra.run.smithi087.stdout:099 2023-03-30T08:15:12.613 INFO:teuthology.orchestra.run.smithi087.stdout:099.out 2023-03-30T08:15:12.613 INFO:teuthology.orchestra.run.smithi087.stdout:100 2023-03-30T08:15:12.613 INFO:teuthology.orchestra.run.smithi087.stdout:100.out 2023-03-30T08:15:12.613 INFO:teuthology.orchestra.run.smithi087.stdout:101 2023-03-30T08:15:12.614 INFO:teuthology.orchestra.run.smithi087.stdout:101.out 2023-03-30T08:15:12.614 INFO:teuthology.orchestra.run.smithi087.stdout:102 2023-03-30T08:15:12.614 INFO:teuthology.orchestra.run.smithi087.stdout:102.out 2023-03-30T08:15:12.614 INFO:teuthology.orchestra.run.smithi087.stdout:103 2023-03-30T08:15:12.614 INFO:teuthology.orchestra.run.smithi087.stdout:103.out 2023-03-30T08:15:12.615 INFO:teuthology.orchestra.run.smithi087.stdout:104 2023-03-30T08:15:12.615 INFO:teuthology.orchestra.run.smithi087.stdout:104.out 2023-03-30T08:15:12.615 INFO:teuthology.orchestra.run.smithi087.stdout:105 2023-03-30T08:15:12.615 INFO:teuthology.orchestra.run.smithi087.stdout:105.out 2023-03-30T08:15:12.615 INFO:teuthology.orchestra.run.smithi087.stdout:106 2023-03-30T08:15:12.615 INFO:teuthology.orchestra.run.smithi087.stdout:106.out 2023-03-30T08:15:12.615 INFO:teuthology.orchestra.run.smithi087.stdout:107 2023-03-30T08:15:12.615 INFO:teuthology.orchestra.run.smithi087.stdout:107.out 2023-03-30T08:15:12.616 INFO:teuthology.orchestra.run.smithi087.stdout:108 2023-03-30T08:15:12.616 INFO:teuthology.orchestra.run.smithi087.stdout:108.out 2023-03-30T08:15:12.616 INFO:teuthology.orchestra.run.smithi087.stdout:109 2023-03-30T08:15:12.616 INFO:teuthology.orchestra.run.smithi087.stdout:109.out 2023-03-30T08:15:12.616 INFO:teuthology.orchestra.run.smithi087.stdout:110 2023-03-30T08:15:12.616 INFO:teuthology.orchestra.run.smithi087.stdout:110.out 2023-03-30T08:15:12.616 INFO:teuthology.orchestra.run.smithi087.stdout:111 2023-03-30T08:15:12.617 INFO:teuthology.orchestra.run.smithi087.stdout:111.out 2023-03-30T08:15:12.617 INFO:teuthology.orchestra.run.smithi087.stdout:112 2023-03-30T08:15:12.617 INFO:teuthology.orchestra.run.smithi087.stdout:112.out 2023-03-30T08:15:12.617 INFO:teuthology.orchestra.run.smithi087.stdout:113 2023-03-30T08:15:12.617 INFO:teuthology.orchestra.run.smithi087.stdout:113.out 2023-03-30T08:15:12.617 INFO:teuthology.orchestra.run.smithi087.stdout:114 2023-03-30T08:15:12.617 INFO:teuthology.orchestra.run.smithi087.stdout:114.out 2023-03-30T08:15:12.617 INFO:teuthology.orchestra.run.smithi087.stdout:115 2023-03-30T08:15:12.618 INFO:teuthology.orchestra.run.smithi087.stdout:115.out 2023-03-30T08:15:12.618 INFO:teuthology.orchestra.run.smithi087.stdout:116 2023-03-30T08:15:12.618 INFO:teuthology.orchestra.run.smithi087.stdout:116.out 2023-03-30T08:15:12.618 INFO:teuthology.orchestra.run.smithi087.stdout:117 2023-03-30T08:15:12.618 INFO:teuthology.orchestra.run.smithi087.stdout:117.out 2023-03-30T08:15:12.618 INFO:teuthology.orchestra.run.smithi087.stdout:118 2023-03-30T08:15:12.618 INFO:teuthology.orchestra.run.smithi087.stdout:118.out 2023-03-30T08:15:12.618 INFO:teuthology.orchestra.run.smithi087.stdout:119 2023-03-30T08:15:12.619 INFO:teuthology.orchestra.run.smithi087.stdout:119.out 2023-03-30T08:15:12.619 INFO:teuthology.orchestra.run.smithi087.stdout:120 2023-03-30T08:15:12.619 INFO:teuthology.orchestra.run.smithi087.stdout:120.out 2023-03-30T08:15:12.619 INFO:teuthology.orchestra.run.smithi087.stdout:121 2023-03-30T08:15:12.619 INFO:teuthology.orchestra.run.smithi087.stdout:121.out 2023-03-30T08:15:12.619 INFO:teuthology.orchestra.run.smithi087.stdout:122 2023-03-30T08:15:12.620 INFO:teuthology.orchestra.run.smithi087.stdout:122.out 2023-03-30T08:15:12.620 INFO:teuthology.orchestra.run.smithi087.stdout:123 2023-03-30T08:15:12.620 INFO:teuthology.orchestra.run.smithi087.stdout:123.out 2023-03-30T08:15:12.620 INFO:teuthology.orchestra.run.smithi087.stdout:124 2023-03-30T08:15:12.620 INFO:teuthology.orchestra.run.smithi087.stdout:124.out 2023-03-30T08:15:12.620 INFO:teuthology.orchestra.run.smithi087.stdout:125 2023-03-30T08:15:12.620 INFO:teuthology.orchestra.run.smithi087.stdout:125.out 2023-03-30T08:15:12.620 INFO:teuthology.orchestra.run.smithi087.stdout:126 2023-03-30T08:15:12.621 INFO:teuthology.orchestra.run.smithi087.stdout:126.out 2023-03-30T08:15:12.621 INFO:teuthology.orchestra.run.smithi087.stdout:127 2023-03-30T08:15:12.621 INFO:teuthology.orchestra.run.smithi087.stdout:127.out 2023-03-30T08:15:12.621 INFO:teuthology.orchestra.run.smithi087.stdout:128 2023-03-30T08:15:12.621 INFO:teuthology.orchestra.run.smithi087.stdout:128.out 2023-03-30T08:15:12.621 INFO:teuthology.orchestra.run.smithi087.stdout:129 2023-03-30T08:15:12.621 INFO:teuthology.orchestra.run.smithi087.stdout:129.out 2023-03-30T08:15:12.622 INFO:teuthology.orchestra.run.smithi087.stdout:130 2023-03-30T08:15:12.622 INFO:teuthology.orchestra.run.smithi087.stdout:130.out 2023-03-30T08:15:12.622 INFO:teuthology.orchestra.run.smithi087.stdout:131 2023-03-30T08:15:12.622 INFO:teuthology.orchestra.run.smithi087.stdout:131.out 2023-03-30T08:15:12.622 INFO:teuthology.orchestra.run.smithi087.stdout:132 2023-03-30T08:15:12.622 INFO:teuthology.orchestra.run.smithi087.stdout:132.out 2023-03-30T08:15:12.622 INFO:teuthology.orchestra.run.smithi087.stdout:133 2023-03-30T08:15:12.622 INFO:teuthology.orchestra.run.smithi087.stdout:133.out 2023-03-30T08:15:12.623 INFO:teuthology.orchestra.run.smithi087.stdout:134 2023-03-30T08:15:12.623 INFO:teuthology.orchestra.run.smithi087.stdout:134.out 2023-03-30T08:15:12.623 INFO:teuthology.orchestra.run.smithi087.stdout:135 2023-03-30T08:15:12.623 INFO:teuthology.orchestra.run.smithi087.stdout:135.out 2023-03-30T08:15:12.623 INFO:teuthology.orchestra.run.smithi087.stdout:136 2023-03-30T08:15:12.623 INFO:teuthology.orchestra.run.smithi087.stdout:136.out 2023-03-30T08:15:12.623 INFO:teuthology.orchestra.run.smithi087.stdout:137 2023-03-30T08:15:12.623 INFO:teuthology.orchestra.run.smithi087.stdout:137.out 2023-03-30T08:15:12.624 INFO:teuthology.orchestra.run.smithi087.stdout:138 2023-03-30T08:15:12.624 INFO:teuthology.orchestra.run.smithi087.stdout:138.out 2023-03-30T08:15:12.624 INFO:teuthology.orchestra.run.smithi087.stdout:139 2023-03-30T08:15:12.624 INFO:teuthology.orchestra.run.smithi087.stdout:139.out 2023-03-30T08:15:12.624 INFO:teuthology.orchestra.run.smithi087.stdout:140 2023-03-30T08:15:12.624 INFO:teuthology.orchestra.run.smithi087.stdout:140.out 2023-03-30T08:15:12.624 INFO:teuthology.orchestra.run.smithi087.stdout:141 2023-03-30T08:15:12.624 INFO:teuthology.orchestra.run.smithi087.stdout:141.out 2023-03-30T08:15:12.625 INFO:teuthology.orchestra.run.smithi087.stdout:142 2023-03-30T08:15:12.625 INFO:teuthology.orchestra.run.smithi087.stdout:142.out 2023-03-30T08:15:12.625 INFO:teuthology.orchestra.run.smithi087.stdout:143 2023-03-30T08:15:12.625 INFO:teuthology.orchestra.run.smithi087.stdout:143.out 2023-03-30T08:15:12.625 INFO:teuthology.orchestra.run.smithi087.stdout:144 2023-03-30T08:15:12.625 INFO:teuthology.orchestra.run.smithi087.stdout:144.out 2023-03-30T08:15:12.625 INFO:teuthology.orchestra.run.smithi087.stdout:145 2023-03-30T08:15:12.625 INFO:teuthology.orchestra.run.smithi087.stdout:145.out 2023-03-30T08:15:12.626 INFO:teuthology.orchestra.run.smithi087.stdout:146 2023-03-30T08:15:12.626 INFO:teuthology.orchestra.run.smithi087.stdout:146.out 2023-03-30T08:15:12.626 INFO:teuthology.orchestra.run.smithi087.stdout:147 2023-03-30T08:15:12.626 INFO:teuthology.orchestra.run.smithi087.stdout:147.out 2023-03-30T08:15:12.626 INFO:teuthology.orchestra.run.smithi087.stdout:148 2023-03-30T08:15:12.626 INFO:teuthology.orchestra.run.smithi087.stdout:148.out 2023-03-30T08:15:12.626 INFO:teuthology.orchestra.run.smithi087.stdout:149 2023-03-30T08:15:12.627 INFO:teuthology.orchestra.run.smithi087.stdout:149.out 2023-03-30T08:15:12.627 INFO:teuthology.orchestra.run.smithi087.stdout:150 2023-03-30T08:15:12.627 INFO:teuthology.orchestra.run.smithi087.stdout:150.out 2023-03-30T08:15:12.627 INFO:teuthology.orchestra.run.smithi087.stdout:151 2023-03-30T08:15:12.627 INFO:teuthology.orchestra.run.smithi087.stdout:151.out 2023-03-30T08:15:12.627 INFO:teuthology.orchestra.run.smithi087.stdout:152 2023-03-30T08:15:12.627 INFO:teuthology.orchestra.run.smithi087.stdout:152.out 2023-03-30T08:15:12.627 INFO:teuthology.orchestra.run.smithi087.stdout:153 2023-03-30T08:15:12.628 INFO:teuthology.orchestra.run.smithi087.stdout:153.out 2023-03-30T08:15:12.628 INFO:teuthology.orchestra.run.smithi087.stdout:154 2023-03-30T08:15:12.628 INFO:teuthology.orchestra.run.smithi087.stdout:154.out 2023-03-30T08:15:12.628 INFO:teuthology.orchestra.run.smithi087.stdout:155 2023-03-30T08:15:12.628 INFO:teuthology.orchestra.run.smithi087.stdout:155.out 2023-03-30T08:15:12.628 INFO:teuthology.orchestra.run.smithi087.stdout:156 2023-03-30T08:15:12.628 INFO:teuthology.orchestra.run.smithi087.stdout:156.out 2023-03-30T08:15:12.628 INFO:teuthology.orchestra.run.smithi087.stdout:157 2023-03-30T08:15:12.629 INFO:teuthology.orchestra.run.smithi087.stdout:157.out 2023-03-30T08:15:12.629 INFO:teuthology.orchestra.run.smithi087.stdout:158 2023-03-30T08:15:12.629 INFO:teuthology.orchestra.run.smithi087.stdout:158.out 2023-03-30T08:15:12.629 INFO:teuthology.orchestra.run.smithi087.stdout:159 2023-03-30T08:15:12.629 INFO:teuthology.orchestra.run.smithi087.stdout:159.out 2023-03-30T08:15:12.629 INFO:teuthology.orchestra.run.smithi087.stdout:160 2023-03-30T08:15:12.629 INFO:teuthology.orchestra.run.smithi087.stdout:160.out 2023-03-30T08:15:12.630 INFO:teuthology.orchestra.run.smithi087.stdout:161 2023-03-30T08:15:12.630 INFO:teuthology.orchestra.run.smithi087.stdout:161.out 2023-03-30T08:15:12.630 INFO:teuthology.orchestra.run.smithi087.stdout:162 2023-03-30T08:15:12.630 INFO:teuthology.orchestra.run.smithi087.stdout:162.out 2023-03-30T08:15:12.630 INFO:teuthology.orchestra.run.smithi087.stdout:163 2023-03-30T08:15:12.630 INFO:teuthology.orchestra.run.smithi087.stdout:163.out 2023-03-30T08:15:12.630 INFO:teuthology.orchestra.run.smithi087.stdout:164 2023-03-30T08:15:12.631 INFO:teuthology.orchestra.run.smithi087.stdout:164.out 2023-03-30T08:15:12.631 INFO:teuthology.orchestra.run.smithi087.stdout:165 2023-03-30T08:15:12.631 INFO:teuthology.orchestra.run.smithi087.stdout:165.out 2023-03-30T08:15:12.631 INFO:teuthology.orchestra.run.smithi087.stdout:166 2023-03-30T08:15:12.631 INFO:teuthology.orchestra.run.smithi087.stdout:166.out 2023-03-30T08:15:12.631 INFO:teuthology.orchestra.run.smithi087.stdout:167 2023-03-30T08:15:12.631 INFO:teuthology.orchestra.run.smithi087.stdout:167.out 2023-03-30T08:15:12.631 INFO:teuthology.orchestra.run.smithi087.stdout:168 2023-03-30T08:15:12.632 INFO:teuthology.orchestra.run.smithi087.stdout:168.out 2023-03-30T08:15:12.632 INFO:teuthology.orchestra.run.smithi087.stdout:169 2023-03-30T08:15:12.632 INFO:teuthology.orchestra.run.smithi087.stdout:169.out 2023-03-30T08:15:12.632 INFO:teuthology.orchestra.run.smithi087.stdout:170 2023-03-30T08:15:12.632 INFO:teuthology.orchestra.run.smithi087.stdout:170.out 2023-03-30T08:15:12.632 INFO:teuthology.orchestra.run.smithi087.stdout:171 2023-03-30T08:15:12.632 INFO:teuthology.orchestra.run.smithi087.stdout:171.out 2023-03-30T08:15:12.632 INFO:teuthology.orchestra.run.smithi087.stdout:172 2023-03-30T08:15:12.633 INFO:teuthology.orchestra.run.smithi087.stdout:172.out 2023-03-30T08:15:12.633 INFO:teuthology.orchestra.run.smithi087.stdout:173 2023-03-30T08:15:12.633 INFO:teuthology.orchestra.run.smithi087.stdout:173.out 2023-03-30T08:15:12.633 INFO:teuthology.orchestra.run.smithi087.stdout:174 2023-03-30T08:15:12.633 INFO:teuthology.orchestra.run.smithi087.stdout:174.out 2023-03-30T08:15:12.633 INFO:teuthology.orchestra.run.smithi087.stdout:175 2023-03-30T08:15:12.633 INFO:teuthology.orchestra.run.smithi087.stdout:175.out 2023-03-30T08:15:12.634 INFO:teuthology.orchestra.run.smithi087.stdout:176 2023-03-30T08:15:12.634 INFO:teuthology.orchestra.run.smithi087.stdout:176.out 2023-03-30T08:15:12.634 INFO:teuthology.orchestra.run.smithi087.stdout:177 2023-03-30T08:15:12.634 INFO:teuthology.orchestra.run.smithi087.stdout:177.out 2023-03-30T08:15:12.634 INFO:teuthology.orchestra.run.smithi087.stdout:178 2023-03-30T08:15:12.634 INFO:teuthology.orchestra.run.smithi087.stdout:178.out 2023-03-30T08:15:12.634 INFO:teuthology.orchestra.run.smithi087.stdout:179 2023-03-30T08:15:12.634 INFO:teuthology.orchestra.run.smithi087.stdout:179.out 2023-03-30T08:15:12.635 INFO:teuthology.orchestra.run.smithi087.stdout:180 2023-03-30T08:15:12.635 INFO:teuthology.orchestra.run.smithi087.stdout:180.out 2023-03-30T08:15:12.635 INFO:teuthology.orchestra.run.smithi087.stdout:181 2023-03-30T08:15:12.635 INFO:teuthology.orchestra.run.smithi087.stdout:181.out 2023-03-30T08:15:12.635 INFO:teuthology.orchestra.run.smithi087.stdout:182 2023-03-30T08:15:12.635 INFO:teuthology.orchestra.run.smithi087.stdout:182.out 2023-03-30T08:15:12.636 INFO:teuthology.orchestra.run.smithi087.stdout:183 2023-03-30T08:15:12.636 INFO:teuthology.orchestra.run.smithi087.stdout:183.out 2023-03-30T08:15:12.636 INFO:teuthology.orchestra.run.smithi087.stdout:184 2023-03-30T08:15:12.636 INFO:teuthology.orchestra.run.smithi087.stdout:184.out 2023-03-30T08:15:12.636 INFO:teuthology.orchestra.run.smithi087.stdout:185 2023-03-30T08:15:12.636 INFO:teuthology.orchestra.run.smithi087.stdout:185.out 2023-03-30T08:15:12.636 INFO:teuthology.orchestra.run.smithi087.stdout:186 2023-03-30T08:15:12.636 INFO:teuthology.orchestra.run.smithi087.stdout:186.out 2023-03-30T08:15:12.637 INFO:teuthology.orchestra.run.smithi087.stdout:187 2023-03-30T08:15:12.637 INFO:teuthology.orchestra.run.smithi087.stdout:187.out 2023-03-30T08:15:12.637 INFO:teuthology.orchestra.run.smithi087.stdout:188 2023-03-30T08:15:12.637 INFO:teuthology.orchestra.run.smithi087.stdout:188.out 2023-03-30T08:15:12.637 INFO:teuthology.orchestra.run.smithi087.stdout:189 2023-03-30T08:15:12.637 INFO:teuthology.orchestra.run.smithi087.stdout:189.out 2023-03-30T08:15:12.638 INFO:teuthology.orchestra.run.smithi087.stdout:190 2023-03-30T08:15:12.638 INFO:teuthology.orchestra.run.smithi087.stdout:190.out 2023-03-30T08:15:12.638 INFO:teuthology.orchestra.run.smithi087.stdout:191 2023-03-30T08:15:12.638 INFO:teuthology.orchestra.run.smithi087.stdout:191.out 2023-03-30T08:15:12.638 INFO:teuthology.orchestra.run.smithi087.stdout:192 2023-03-30T08:15:12.638 INFO:teuthology.orchestra.run.smithi087.stdout:192.out 2023-03-30T08:15:12.638 INFO:teuthology.orchestra.run.smithi087.stdout:193 2023-03-30T08:15:12.638 INFO:teuthology.orchestra.run.smithi087.stdout:193.out 2023-03-30T08:15:12.639 INFO:teuthology.orchestra.run.smithi087.stdout:194 2023-03-30T08:15:12.639 INFO:teuthology.orchestra.run.smithi087.stdout:194.out 2023-03-30T08:15:12.639 INFO:teuthology.orchestra.run.smithi087.stdout:195 2023-03-30T08:15:12.639 INFO:teuthology.orchestra.run.smithi087.stdout:195.out 2023-03-30T08:15:12.639 INFO:teuthology.orchestra.run.smithi087.stdout:196 2023-03-30T08:15:12.639 INFO:teuthology.orchestra.run.smithi087.stdout:196.out 2023-03-30T08:15:12.639 INFO:teuthology.orchestra.run.smithi087.stdout:197 2023-03-30T08:15:12.640 INFO:teuthology.orchestra.run.smithi087.stdout:197.out 2023-03-30T08:15:12.640 INFO:teuthology.orchestra.run.smithi087.stdout:198 2023-03-30T08:15:12.640 INFO:teuthology.orchestra.run.smithi087.stdout:198.out 2023-03-30T08:15:12.640 INFO:teuthology.orchestra.run.smithi087.stdout:199 2023-03-30T08:15:12.641 INFO:teuthology.orchestra.run.smithi087.stdout:199.out 2023-03-30T08:15:12.641 INFO:teuthology.orchestra.run.smithi087.stdout:200 2023-03-30T08:15:12.641 INFO:teuthology.orchestra.run.smithi087.stdout:200.out 2023-03-30T08:15:12.641 INFO:teuthology.orchestra.run.smithi087.stdout:201 2023-03-30T08:15:12.641 INFO:teuthology.orchestra.run.smithi087.stdout:201.out 2023-03-30T08:15:12.641 INFO:teuthology.orchestra.run.smithi087.stdout:202 2023-03-30T08:15:12.641 INFO:teuthology.orchestra.run.smithi087.stdout:202.out 2023-03-30T08:15:12.641 INFO:teuthology.orchestra.run.smithi087.stdout:203 2023-03-30T08:15:12.642 INFO:teuthology.orchestra.run.smithi087.stdout:203.out 2023-03-30T08:15:12.642 INFO:teuthology.orchestra.run.smithi087.stdout:204 2023-03-30T08:15:12.642 INFO:teuthology.orchestra.run.smithi087.stdout:204.out 2023-03-30T08:15:12.642 INFO:teuthology.orchestra.run.smithi087.stdout:205 2023-03-30T08:15:12.642 INFO:teuthology.orchestra.run.smithi087.stdout:205.out 2023-03-30T08:15:12.642 INFO:teuthology.orchestra.run.smithi087.stdout:206 2023-03-30T08:15:12.642 INFO:teuthology.orchestra.run.smithi087.stdout:206.out 2023-03-30T08:15:12.643 INFO:teuthology.orchestra.run.smithi087.stdout:207 2023-03-30T08:15:12.643 INFO:teuthology.orchestra.run.smithi087.stdout:207.out 2023-03-30T08:15:12.643 INFO:teuthology.orchestra.run.smithi087.stdout:208 2023-03-30T08:15:12.643 INFO:teuthology.orchestra.run.smithi087.stdout:208.out 2023-03-30T08:15:12.643 INFO:teuthology.orchestra.run.smithi087.stdout:209 2023-03-30T08:15:12.643 INFO:teuthology.orchestra.run.smithi087.stdout:209.out 2023-03-30T08:15:12.643 INFO:teuthology.orchestra.run.smithi087.stdout:210 2023-03-30T08:15:12.643 INFO:teuthology.orchestra.run.smithi087.stdout:210.out 2023-03-30T08:15:12.644 INFO:teuthology.orchestra.run.smithi087.stdout:211 2023-03-30T08:15:12.644 INFO:teuthology.orchestra.run.smithi087.stdout:211.out 2023-03-30T08:15:12.644 INFO:teuthology.orchestra.run.smithi087.stdout:212 2023-03-30T08:15:12.644 INFO:teuthology.orchestra.run.smithi087.stdout:212.out 2023-03-30T08:15:12.644 INFO:teuthology.orchestra.run.smithi087.stdout:213 2023-03-30T08:15:12.644 INFO:teuthology.orchestra.run.smithi087.stdout:213.out 2023-03-30T08:15:12.644 INFO:teuthology.orchestra.run.smithi087.stdout:214 2023-03-30T08:15:12.644 INFO:teuthology.orchestra.run.smithi087.stdout:214.out 2023-03-30T08:15:12.645 INFO:teuthology.orchestra.run.smithi087.stdout:215 2023-03-30T08:15:12.645 INFO:teuthology.orchestra.run.smithi087.stdout:215.out 2023-03-30T08:15:12.645 INFO:teuthology.orchestra.run.smithi087.stdout:216 2023-03-30T08:15:12.645 INFO:teuthology.orchestra.run.smithi087.stdout:216.out 2023-03-30T08:15:12.645 INFO:teuthology.orchestra.run.smithi087.stdout:217 2023-03-30T08:15:12.645 INFO:teuthology.orchestra.run.smithi087.stdout:217.out 2023-03-30T08:15:12.645 INFO:teuthology.orchestra.run.smithi087.stdout:218 2023-03-30T08:15:12.645 INFO:teuthology.orchestra.run.smithi087.stdout:218.out 2023-03-30T08:15:12.646 INFO:teuthology.orchestra.run.smithi087.stdout:219 2023-03-30T08:15:12.646 INFO:teuthology.orchestra.run.smithi087.stdout:219.out 2023-03-30T08:15:12.646 INFO:teuthology.orchestra.run.smithi087.stdout:220 2023-03-30T08:15:12.646 INFO:teuthology.orchestra.run.smithi087.stdout:220.out 2023-03-30T08:15:12.646 INFO:teuthology.orchestra.run.smithi087.stdout:221 2023-03-30T08:15:12.646 INFO:teuthology.orchestra.run.smithi087.stdout:221.out 2023-03-30T08:15:12.646 INFO:teuthology.orchestra.run.smithi087.stdout:222 2023-03-30T08:15:12.646 INFO:teuthology.orchestra.run.smithi087.stdout:222.out 2023-03-30T08:15:12.647 INFO:teuthology.orchestra.run.smithi087.stdout:223 2023-03-30T08:15:12.647 INFO:teuthology.orchestra.run.smithi087.stdout:223.out 2023-03-30T08:15:12.647 INFO:teuthology.orchestra.run.smithi087.stdout:224 2023-03-30T08:15:12.647 INFO:teuthology.orchestra.run.smithi087.stdout:224.out 2023-03-30T08:15:12.647 INFO:teuthology.orchestra.run.smithi087.stdout:225 2023-03-30T08:15:12.647 INFO:teuthology.orchestra.run.smithi087.stdout:225.out 2023-03-30T08:15:12.647 INFO:teuthology.orchestra.run.smithi087.stdout:226 2023-03-30T08:15:12.648 INFO:teuthology.orchestra.run.smithi087.stdout:226.out 2023-03-30T08:15:12.648 INFO:teuthology.orchestra.run.smithi087.stdout:227 2023-03-30T08:15:12.648 INFO:teuthology.orchestra.run.smithi087.stdout:227.out 2023-03-30T08:15:12.648 INFO:teuthology.orchestra.run.smithi087.stdout:228 2023-03-30T08:15:12.648 INFO:teuthology.orchestra.run.smithi087.stdout:228.out 2023-03-30T08:15:12.648 INFO:teuthology.orchestra.run.smithi087.stdout:229 2023-03-30T08:15:12.648 INFO:teuthology.orchestra.run.smithi087.stdout:229.out 2023-03-30T08:15:12.648 INFO:teuthology.orchestra.run.smithi087.stdout:230 2023-03-30T08:15:12.649 INFO:teuthology.orchestra.run.smithi087.stdout:230.out 2023-03-30T08:15:12.649 INFO:teuthology.orchestra.run.smithi087.stdout:231 2023-03-30T08:15:12.649 INFO:teuthology.orchestra.run.smithi087.stdout:231.out 2023-03-30T08:15:12.649 INFO:teuthology.orchestra.run.smithi087.stdout:232 2023-03-30T08:15:12.649 INFO:teuthology.orchestra.run.smithi087.stdout:232.out 2023-03-30T08:15:12.649 INFO:teuthology.orchestra.run.smithi087.stdout:233 2023-03-30T08:15:12.649 INFO:teuthology.orchestra.run.smithi087.stdout:233.out 2023-03-30T08:15:12.650 INFO:teuthology.orchestra.run.smithi087.stdout:234 2023-03-30T08:15:12.650 INFO:teuthology.orchestra.run.smithi087.stdout:234.out 2023-03-30T08:15:12.650 INFO:teuthology.orchestra.run.smithi087.stdout:235 2023-03-30T08:15:12.650 INFO:teuthology.orchestra.run.smithi087.stdout:235.out 2023-03-30T08:15:12.650 INFO:teuthology.orchestra.run.smithi087.stdout:236 2023-03-30T08:15:12.650 INFO:teuthology.orchestra.run.smithi087.stdout:236.out 2023-03-30T08:15:12.650 INFO:teuthology.orchestra.run.smithi087.stdout:237 2023-03-30T08:15:12.650 INFO:teuthology.orchestra.run.smithi087.stdout:237.out 2023-03-30T08:15:12.651 INFO:teuthology.orchestra.run.smithi087.stdout:238 2023-03-30T08:15:12.651 INFO:teuthology.orchestra.run.smithi087.stdout:238.out 2023-03-30T08:15:12.651 INFO:teuthology.orchestra.run.smithi087.stdout:239 2023-03-30T08:15:12.651 INFO:teuthology.orchestra.run.smithi087.stdout:239.out 2023-03-30T08:15:12.651 INFO:teuthology.orchestra.run.smithi087.stdout:240 2023-03-30T08:15:12.651 INFO:teuthology.orchestra.run.smithi087.stdout:240.out 2023-03-30T08:15:12.651 INFO:teuthology.orchestra.run.smithi087.stdout:241 2023-03-30T08:15:12.652 INFO:teuthology.orchestra.run.smithi087.stdout:241.out 2023-03-30T08:15:12.652 INFO:teuthology.orchestra.run.smithi087.stdout:242 2023-03-30T08:15:12.652 INFO:teuthology.orchestra.run.smithi087.stdout:242.out 2023-03-30T08:15:12.652 INFO:teuthology.orchestra.run.smithi087.stdout:243 2023-03-30T08:15:12.652 INFO:teuthology.orchestra.run.smithi087.stdout:243.out 2023-03-30T08:15:12.652 INFO:teuthology.orchestra.run.smithi087.stdout:244 2023-03-30T08:15:12.652 INFO:teuthology.orchestra.run.smithi087.stdout:244.out 2023-03-30T08:15:12.652 INFO:teuthology.orchestra.run.smithi087.stdout:245 2023-03-30T08:15:12.653 INFO:teuthology.orchestra.run.smithi087.stdout:245.out 2023-03-30T08:15:12.653 INFO:teuthology.orchestra.run.smithi087.stdout:246 2023-03-30T08:15:12.653 INFO:teuthology.orchestra.run.smithi087.stdout:246.out 2023-03-30T08:15:12.653 INFO:teuthology.orchestra.run.smithi087.stdout:247 2023-03-30T08:15:12.653 INFO:teuthology.orchestra.run.smithi087.stdout:247.out 2023-03-30T08:15:12.653 INFO:teuthology.orchestra.run.smithi087.stdout:248 2023-03-30T08:15:12.653 INFO:teuthology.orchestra.run.smithi087.stdout:248.out 2023-03-30T08:15:12.654 INFO:teuthology.orchestra.run.smithi087.stdout:249 2023-03-30T08:15:12.654 INFO:teuthology.orchestra.run.smithi087.stdout:249.out 2023-03-30T08:15:12.654 INFO:teuthology.orchestra.run.smithi087.stdout:250 2023-03-30T08:15:12.654 INFO:teuthology.orchestra.run.smithi087.stdout:250.out 2023-03-30T08:15:12.654 INFO:teuthology.orchestra.run.smithi087.stdout:251 2023-03-30T08:15:12.654 INFO:teuthology.orchestra.run.smithi087.stdout:251.out 2023-03-30T08:15:12.654 INFO:teuthology.orchestra.run.smithi087.stdout:252 2023-03-30T08:15:12.654 INFO:teuthology.orchestra.run.smithi087.stdout:252.out 2023-03-30T08:15:12.655 INFO:teuthology.orchestra.run.smithi087.stdout:253 2023-03-30T08:15:12.655 INFO:teuthology.orchestra.run.smithi087.stdout:253.out 2023-03-30T08:15:12.655 INFO:teuthology.orchestra.run.smithi087.stdout:254 2023-03-30T08:15:12.655 INFO:teuthology.orchestra.run.smithi087.stdout:254.out 2023-03-30T08:15:12.655 INFO:teuthology.orchestra.run.smithi087.stdout:255 2023-03-30T08:15:12.655 INFO:teuthology.orchestra.run.smithi087.stdout:255.out 2023-03-30T08:15:12.655 INFO:teuthology.orchestra.run.smithi087.stdout:256 2023-03-30T08:15:12.656 INFO:teuthology.orchestra.run.smithi087.stdout:256.out 2023-03-30T08:15:12.656 INFO:teuthology.orchestra.run.smithi087.stdout:257 2023-03-30T08:15:12.656 INFO:teuthology.orchestra.run.smithi087.stdout:257.out 2023-03-30T08:15:12.656 INFO:teuthology.orchestra.run.smithi087.stdout:258 2023-03-30T08:15:12.656 INFO:teuthology.orchestra.run.smithi087.stdout:258.out 2023-03-30T08:15:12.657 INFO:teuthology.orchestra.run.smithi087.stdout:259 2023-03-30T08:15:12.657 INFO:teuthology.orchestra.run.smithi087.stdout:259.out 2023-03-30T08:15:12.657 INFO:teuthology.orchestra.run.smithi087.stdout:260 2023-03-30T08:15:12.657 INFO:teuthology.orchestra.run.smithi087.stdout:260.out 2023-03-30T08:15:12.657 INFO:teuthology.orchestra.run.smithi087.stdout:261 2023-03-30T08:15:12.657 INFO:teuthology.orchestra.run.smithi087.stdout:261.out 2023-03-30T08:15:12.658 INFO:teuthology.orchestra.run.smithi087.stdout:262 2023-03-30T08:15:12.658 INFO:teuthology.orchestra.run.smithi087.stdout:262.out 2023-03-30T08:15:12.658 INFO:teuthology.orchestra.run.smithi087.stdout:263 2023-03-30T08:15:12.658 INFO:teuthology.orchestra.run.smithi087.stdout:263.out 2023-03-30T08:15:12.659 INFO:teuthology.orchestra.run.smithi087.stdout:264 2023-03-30T08:15:12.659 INFO:teuthology.orchestra.run.smithi087.stdout:264.out 2023-03-30T08:15:12.659 INFO:teuthology.orchestra.run.smithi087.stdout:265 2023-03-30T08:15:12.659 INFO:teuthology.orchestra.run.smithi087.stdout:265.out 2023-03-30T08:15:12.660 INFO:teuthology.orchestra.run.smithi087.stdout:266 2023-03-30T08:15:12.660 INFO:teuthology.orchestra.run.smithi087.stdout:266.out 2023-03-30T08:15:12.660 INFO:teuthology.orchestra.run.smithi087.stdout:267 2023-03-30T08:15:12.660 INFO:teuthology.orchestra.run.smithi087.stdout:267.out 2023-03-30T08:15:12.660 INFO:teuthology.orchestra.run.smithi087.stdout:268 2023-03-30T08:15:12.661 INFO:teuthology.orchestra.run.smithi087.stdout:268.out 2023-03-30T08:15:12.661 INFO:teuthology.orchestra.run.smithi087.stdout:269 2023-03-30T08:15:12.661 INFO:teuthology.orchestra.run.smithi087.stdout:269.out 2023-03-30T08:15:12.661 INFO:teuthology.orchestra.run.smithi087.stdout:270 2023-03-30T08:15:12.662 INFO:teuthology.orchestra.run.smithi087.stdout:270.out 2023-03-30T08:15:12.662 INFO:teuthology.orchestra.run.smithi087.stdout:271 2023-03-30T08:15:12.662 INFO:teuthology.orchestra.run.smithi087.stdout:271.out 2023-03-30T08:15:12.662 INFO:teuthology.orchestra.run.smithi087.stdout:272 2023-03-30T08:15:12.662 INFO:teuthology.orchestra.run.smithi087.stdout:272.out 2023-03-30T08:15:12.663 INFO:teuthology.orchestra.run.smithi087.stdout:273 2023-03-30T08:15:12.663 INFO:teuthology.orchestra.run.smithi087.stdout:273.out 2023-03-30T08:15:12.663 INFO:teuthology.orchestra.run.smithi087.stdout:274 2023-03-30T08:15:12.663 INFO:teuthology.orchestra.run.smithi087.stdout:274.out 2023-03-30T08:15:12.663 INFO:teuthology.orchestra.run.smithi087.stdout:275 2023-03-30T08:15:12.664 INFO:teuthology.orchestra.run.smithi087.stdout:275.out 2023-03-30T08:15:12.664 INFO:teuthology.orchestra.run.smithi087.stdout:276 2023-03-30T08:15:12.664 INFO:teuthology.orchestra.run.smithi087.stdout:276.out 2023-03-30T08:15:12.664 INFO:teuthology.orchestra.run.smithi087.stdout:277 2023-03-30T08:15:12.664 INFO:teuthology.orchestra.run.smithi087.stdout:277.out 2023-03-30T08:15:12.664 INFO:teuthology.orchestra.run.smithi087.stdout:278 2023-03-30T08:15:12.664 INFO:teuthology.orchestra.run.smithi087.stdout:278.out 2023-03-30T08:15:12.665 INFO:teuthology.orchestra.run.smithi087.stdout:279 2023-03-30T08:15:12.665 INFO:teuthology.orchestra.run.smithi087.stdout:279.out 2023-03-30T08:15:12.665 INFO:teuthology.orchestra.run.smithi087.stdout:280 2023-03-30T08:15:12.665 INFO:teuthology.orchestra.run.smithi087.stdout:280.out 2023-03-30T08:15:12.665 INFO:teuthology.orchestra.run.smithi087.stdout:281 2023-03-30T08:15:12.666 INFO:teuthology.orchestra.run.smithi087.stdout:281.out 2023-03-30T08:15:12.666 INFO:teuthology.orchestra.run.smithi087.stdout:282 2023-03-30T08:15:12.666 INFO:teuthology.orchestra.run.smithi087.stdout:282.out 2023-03-30T08:15:12.666 INFO:teuthology.orchestra.run.smithi087.stdout:283 2023-03-30T08:15:12.667 INFO:teuthology.orchestra.run.smithi087.stdout:283.out 2023-03-30T08:15:12.667 INFO:teuthology.orchestra.run.smithi087.stdout:284 2023-03-30T08:15:12.667 INFO:teuthology.orchestra.run.smithi087.stdout:284.out 2023-03-30T08:15:12.667 INFO:teuthology.orchestra.run.smithi087.stdout:285 2023-03-30T08:15:12.668 INFO:teuthology.orchestra.run.smithi087.stdout:285.out 2023-03-30T08:15:12.668 INFO:teuthology.orchestra.run.smithi087.stdout:286 2023-03-30T08:15:12.668 INFO:teuthology.orchestra.run.smithi087.stdout:286.out 2023-03-30T08:15:12.668 INFO:teuthology.orchestra.run.smithi087.stdout:287 2023-03-30T08:15:12.668 INFO:teuthology.orchestra.run.smithi087.stdout:287.out 2023-03-30T08:15:12.668 INFO:teuthology.orchestra.run.smithi087.stdout:288 2023-03-30T08:15:12.669 INFO:teuthology.orchestra.run.smithi087.stdout:288.out 2023-03-30T08:15:12.669 INFO:teuthology.orchestra.run.smithi087.stdout:289 2023-03-30T08:15:12.669 INFO:teuthology.orchestra.run.smithi087.stdout:289.out 2023-03-30T08:15:12.669 INFO:teuthology.orchestra.run.smithi087.stdout:290 2023-03-30T08:15:12.670 INFO:teuthology.orchestra.run.smithi087.stdout:290.out 2023-03-30T08:15:12.670 INFO:teuthology.orchestra.run.smithi087.stdout:291 2023-03-30T08:15:12.670 INFO:teuthology.orchestra.run.smithi087.stdout:291.out 2023-03-30T08:15:12.670 INFO:teuthology.orchestra.run.smithi087.stdout:292 2023-03-30T08:15:12.670 INFO:teuthology.orchestra.run.smithi087.stdout:292.out 2023-03-30T08:15:12.670 INFO:teuthology.orchestra.run.smithi087.stdout:293 2023-03-30T08:15:12.670 INFO:teuthology.orchestra.run.smithi087.stdout:293.out 2023-03-30T08:15:12.670 INFO:teuthology.orchestra.run.smithi087.stdout:294 2023-03-30T08:15:12.671 INFO:teuthology.orchestra.run.smithi087.stdout:294.out 2023-03-30T08:15:12.671 INFO:teuthology.orchestra.run.smithi087.stdout:295 2023-03-30T08:15:12.671 INFO:teuthology.orchestra.run.smithi087.stdout:295.out 2023-03-30T08:15:12.671 INFO:teuthology.orchestra.run.smithi087.stdout:296 2023-03-30T08:15:12.671 INFO:teuthology.orchestra.run.smithi087.stdout:296.out 2023-03-30T08:15:12.671 INFO:teuthology.orchestra.run.smithi087.stdout:297 2023-03-30T08:15:12.671 INFO:teuthology.orchestra.run.smithi087.stdout:297.out 2023-03-30T08:15:12.672 INFO:teuthology.orchestra.run.smithi087.stdout:298 2023-03-30T08:15:12.672 INFO:teuthology.orchestra.run.smithi087.stdout:298.out 2023-03-30T08:15:12.672 INFO:teuthology.orchestra.run.smithi087.stdout:299 2023-03-30T08:15:12.672 INFO:teuthology.orchestra.run.smithi087.stdout:299.out 2023-03-30T08:15:12.672 INFO:teuthology.orchestra.run.smithi087.stdout:300 2023-03-30T08:15:12.672 INFO:teuthology.orchestra.run.smithi087.stdout:300.out 2023-03-30T08:15:12.672 INFO:teuthology.orchestra.run.smithi087.stdout:301 2023-03-30T08:15:12.673 INFO:teuthology.orchestra.run.smithi087.stdout:301.out 2023-03-30T08:15:12.673 INFO:teuthology.orchestra.run.smithi087.stdout:302 2023-03-30T08:15:12.673 INFO:teuthology.orchestra.run.smithi087.stdout:302.out 2023-03-30T08:15:12.673 INFO:teuthology.orchestra.run.smithi087.stdout:303 2023-03-30T08:15:12.673 INFO:teuthology.orchestra.run.smithi087.stdout:303.out 2023-03-30T08:15:12.673 INFO:teuthology.orchestra.run.smithi087.stdout:304 2023-03-30T08:15:12.673 INFO:teuthology.orchestra.run.smithi087.stdout:304.out 2023-03-30T08:15:12.674 INFO:teuthology.orchestra.run.smithi087.stdout:305 2023-03-30T08:15:12.674 INFO:teuthology.orchestra.run.smithi087.stdout:305.out 2023-03-30T08:15:12.674 INFO:teuthology.orchestra.run.smithi087.stdout:306 2023-03-30T08:15:12.674 INFO:teuthology.orchestra.run.smithi087.stdout:306.out 2023-03-30T08:15:12.674 INFO:teuthology.orchestra.run.smithi087.stdout:307 2023-03-30T08:15:12.674 INFO:teuthology.orchestra.run.smithi087.stdout:307.out 2023-03-30T08:15:12.674 INFO:teuthology.orchestra.run.smithi087.stdout:308 2023-03-30T08:15:12.674 INFO:teuthology.orchestra.run.smithi087.stdout:308.out 2023-03-30T08:15:12.675 INFO:teuthology.orchestra.run.smithi087.stdout:309 2023-03-30T08:15:12.675 INFO:teuthology.orchestra.run.smithi087.stdout:309.out 2023-03-30T08:15:12.675 INFO:teuthology.orchestra.run.smithi087.stdout:310 2023-03-30T08:15:12.675 INFO:teuthology.orchestra.run.smithi087.stdout:310.out 2023-03-30T08:15:12.675 INFO:teuthology.orchestra.run.smithi087.stdout:311 2023-03-30T08:15:12.675 INFO:teuthology.orchestra.run.smithi087.stdout:311.out 2023-03-30T08:15:12.675 INFO:teuthology.orchestra.run.smithi087.stdout:312 2023-03-30T08:15:12.675 INFO:teuthology.orchestra.run.smithi087.stdout:312.out 2023-03-30T08:15:12.676 INFO:teuthology.orchestra.run.smithi087.stdout:313 2023-03-30T08:15:12.676 INFO:teuthology.orchestra.run.smithi087.stdout:313.out 2023-03-30T08:15:12.676 INFO:teuthology.orchestra.run.smithi087.stdout:314 2023-03-30T08:15:12.676 INFO:teuthology.orchestra.run.smithi087.stdout:314.out 2023-03-30T08:15:12.676 INFO:teuthology.orchestra.run.smithi087.stdout:315 2023-03-30T08:15:12.676 INFO:teuthology.orchestra.run.smithi087.stdout:315.out 2023-03-30T08:15:12.676 INFO:teuthology.orchestra.run.smithi087.stdout:316 2023-03-30T08:15:12.677 INFO:teuthology.orchestra.run.smithi087.stdout:316.out 2023-03-30T08:15:12.677 INFO:teuthology.orchestra.run.smithi087.stdout:317 2023-03-30T08:15:12.677 INFO:teuthology.orchestra.run.smithi087.stdout:317.out 2023-03-30T08:15:12.677 INFO:teuthology.orchestra.run.smithi087.stdout:318 2023-03-30T08:15:12.677 INFO:teuthology.orchestra.run.smithi087.stdout:318.out 2023-03-30T08:15:12.678 INFO:teuthology.orchestra.run.smithi087.stdout:319 2023-03-30T08:15:12.678 INFO:teuthology.orchestra.run.smithi087.stdout:319.out 2023-03-30T08:15:12.678 INFO:teuthology.orchestra.run.smithi087.stdout:320 2023-03-30T08:15:12.678 INFO:teuthology.orchestra.run.smithi087.stdout:320.out 2023-03-30T08:15:12.678 INFO:teuthology.orchestra.run.smithi087.stdout:321 2023-03-30T08:15:12.678 INFO:teuthology.orchestra.run.smithi087.stdout:321.out 2023-03-30T08:15:12.679 INFO:teuthology.orchestra.run.smithi087.stdout:322 2023-03-30T08:15:12.679 INFO:teuthology.orchestra.run.smithi087.stdout:322.out 2023-03-30T08:15:12.679 INFO:teuthology.orchestra.run.smithi087.stdout:323 2023-03-30T08:15:12.679 INFO:teuthology.orchestra.run.smithi087.stdout:323.out 2023-03-30T08:15:12.679 INFO:teuthology.orchestra.run.smithi087.stdout:324 2023-03-30T08:15:12.679 INFO:teuthology.orchestra.run.smithi087.stdout:324.out 2023-03-30T08:15:12.680 INFO:teuthology.orchestra.run.smithi087.stdout:325 2023-03-30T08:15:12.680 INFO:teuthology.orchestra.run.smithi087.stdout:325.out 2023-03-30T08:15:12.680 INFO:teuthology.orchestra.run.smithi087.stdout:326 2023-03-30T08:15:12.680 INFO:teuthology.orchestra.run.smithi087.stdout:326.out 2023-03-30T08:15:12.680 INFO:teuthology.orchestra.run.smithi087.stdout:327 2023-03-30T08:15:12.680 INFO:teuthology.orchestra.run.smithi087.stdout:327.out 2023-03-30T08:15:12.680 INFO:teuthology.orchestra.run.smithi087.stdout:328 2023-03-30T08:15:12.680 INFO:teuthology.orchestra.run.smithi087.stdout:328.out 2023-03-30T08:15:12.681 INFO:teuthology.orchestra.run.smithi087.stdout:329 2023-03-30T08:15:12.681 INFO:teuthology.orchestra.run.smithi087.stdout:329.out 2023-03-30T08:15:12.681 INFO:teuthology.orchestra.run.smithi087.stdout:330 2023-03-30T08:15:12.681 INFO:teuthology.orchestra.run.smithi087.stdout:330.out 2023-03-30T08:15:12.681 INFO:teuthology.orchestra.run.smithi087.stdout:331 2023-03-30T08:15:12.681 INFO:teuthology.orchestra.run.smithi087.stdout:331.out 2023-03-30T08:15:12.682 INFO:teuthology.orchestra.run.smithi087.stdout:332 2023-03-30T08:15:12.682 INFO:teuthology.orchestra.run.smithi087.stdout:332.out 2023-03-30T08:15:12.682 INFO:teuthology.orchestra.run.smithi087.stdout:333 2023-03-30T08:15:12.682 INFO:teuthology.orchestra.run.smithi087.stdout:333.out 2023-03-30T08:15:12.682 INFO:teuthology.orchestra.run.smithi087.stdout:334 2023-03-30T08:15:12.682 INFO:teuthology.orchestra.run.smithi087.stdout:334.out 2023-03-30T08:15:12.682 INFO:teuthology.orchestra.run.smithi087.stdout:335 2023-03-30T08:15:12.682 INFO:teuthology.orchestra.run.smithi087.stdout:335.out 2023-03-30T08:15:12.683 INFO:teuthology.orchestra.run.smithi087.stdout:336 2023-03-30T08:15:12.683 INFO:teuthology.orchestra.run.smithi087.stdout:336.out 2023-03-30T08:15:12.683 INFO:teuthology.orchestra.run.smithi087.stdout:337 2023-03-30T08:15:12.683 INFO:teuthology.orchestra.run.smithi087.stdout:337.out 2023-03-30T08:15:12.683 INFO:teuthology.orchestra.run.smithi087.stdout:338 2023-03-30T08:15:12.683 INFO:teuthology.orchestra.run.smithi087.stdout:338.out 2023-03-30T08:15:12.683 INFO:teuthology.orchestra.run.smithi087.stdout:339 2023-03-30T08:15:12.683 INFO:teuthology.orchestra.run.smithi087.stdout:339.out 2023-03-30T08:15:12.684 INFO:teuthology.orchestra.run.smithi087.stdout:340 2023-03-30T08:15:12.684 INFO:teuthology.orchestra.run.smithi087.stdout:340.out 2023-03-30T08:15:12.684 INFO:teuthology.orchestra.run.smithi087.stdout:341 2023-03-30T08:15:12.684 INFO:teuthology.orchestra.run.smithi087.stdout:341.out 2023-03-30T08:15:12.684 INFO:teuthology.orchestra.run.smithi087.stdout:342 2023-03-30T08:15:12.684 INFO:teuthology.orchestra.run.smithi087.stdout:342.out 2023-03-30T08:15:12.684 INFO:teuthology.orchestra.run.smithi087.stdout:343 2023-03-30T08:15:12.684 INFO:teuthology.orchestra.run.smithi087.stdout:343.out 2023-03-30T08:15:12.685 INFO:teuthology.orchestra.run.smithi087.stdout:344 2023-03-30T08:15:12.685 INFO:teuthology.orchestra.run.smithi087.stdout:344.out 2023-03-30T08:15:12.685 INFO:teuthology.orchestra.run.smithi087.stdout:345 2023-03-30T08:15:12.685 INFO:teuthology.orchestra.run.smithi087.stdout:345.out 2023-03-30T08:15:12.685 INFO:teuthology.orchestra.run.smithi087.stdout:346 2023-03-30T08:15:12.685 INFO:teuthology.orchestra.run.smithi087.stdout:346.out 2023-03-30T08:15:12.685 INFO:teuthology.orchestra.run.smithi087.stdout:347 2023-03-30T08:15:12.686 INFO:teuthology.orchestra.run.smithi087.stdout:347.out 2023-03-30T08:15:12.686 INFO:teuthology.orchestra.run.smithi087.stdout:348 2023-03-30T08:15:12.686 INFO:teuthology.orchestra.run.smithi087.stdout:348.out 2023-03-30T08:15:12.686 INFO:teuthology.orchestra.run.smithi087.stdout:349 2023-03-30T08:15:12.686 INFO:teuthology.orchestra.run.smithi087.stdout:349.out 2023-03-30T08:15:12.686 INFO:teuthology.orchestra.run.smithi087.stdout:350 2023-03-30T08:15:12.686 INFO:teuthology.orchestra.run.smithi087.stdout:350.out 2023-03-30T08:15:12.686 INFO:teuthology.orchestra.run.smithi087.stdout:351 2023-03-30T08:15:12.687 INFO:teuthology.orchestra.run.smithi087.stdout:351.out 2023-03-30T08:15:12.687 INFO:teuthology.orchestra.run.smithi087.stdout:352 2023-03-30T08:15:12.687 INFO:teuthology.orchestra.run.smithi087.stdout:352.out 2023-03-30T08:15:12.687 INFO:teuthology.orchestra.run.smithi087.stdout:353 2023-03-30T08:15:12.687 INFO:teuthology.orchestra.run.smithi087.stdout:353.out 2023-03-30T08:15:12.687 INFO:teuthology.orchestra.run.smithi087.stdout:354 2023-03-30T08:15:12.687 INFO:teuthology.orchestra.run.smithi087.stdout:354.out 2023-03-30T08:15:12.687 INFO:teuthology.orchestra.run.smithi087.stdout:355 2023-03-30T08:15:12.688 INFO:teuthology.orchestra.run.smithi087.stdout:355.out 2023-03-30T08:15:12.688 INFO:teuthology.orchestra.run.smithi087.stdout:356 2023-03-30T08:15:12.688 INFO:teuthology.orchestra.run.smithi087.stdout:356.out 2023-03-30T08:15:12.688 INFO:teuthology.orchestra.run.smithi087.stdout:357 2023-03-30T08:15:12.688 INFO:teuthology.orchestra.run.smithi087.stdout:357.out 2023-03-30T08:15:12.688 INFO:teuthology.orchestra.run.smithi087.stdout:358 2023-03-30T08:15:12.688 INFO:teuthology.orchestra.run.smithi087.stdout:358.out 2023-03-30T08:15:12.688 INFO:teuthology.orchestra.run.smithi087.stdout:359 2023-03-30T08:15:12.689 INFO:teuthology.orchestra.run.smithi087.stdout:359.out 2023-03-30T08:15:12.689 INFO:teuthology.orchestra.run.smithi087.stdout:360 2023-03-30T08:15:12.689 INFO:teuthology.orchestra.run.smithi087.stdout:360.out 2023-03-30T08:15:12.689 INFO:teuthology.orchestra.run.smithi087.stdout:361 2023-03-30T08:15:12.689 INFO:teuthology.orchestra.run.smithi087.stdout:361.out 2023-03-30T08:15:12.689 INFO:teuthology.orchestra.run.smithi087.stdout:362 2023-03-30T08:15:12.689 INFO:teuthology.orchestra.run.smithi087.stdout:362.out 2023-03-30T08:15:12.690 INFO:teuthology.orchestra.run.smithi087.stdout:363 2023-03-30T08:15:12.690 INFO:teuthology.orchestra.run.smithi087.stdout:363.out 2023-03-30T08:15:12.690 INFO:teuthology.orchestra.run.smithi087.stdout:364 2023-03-30T08:15:12.690 INFO:teuthology.orchestra.run.smithi087.stdout:364.out 2023-03-30T08:15:12.690 INFO:teuthology.orchestra.run.smithi087.stdout:365 2023-03-30T08:15:12.690 INFO:teuthology.orchestra.run.smithi087.stdout:365.out 2023-03-30T08:15:12.690 INFO:teuthology.orchestra.run.smithi087.stdout:366 2023-03-30T08:15:12.690 INFO:teuthology.orchestra.run.smithi087.stdout:366.out 2023-03-30T08:15:12.691 INFO:teuthology.orchestra.run.smithi087.stdout:367 2023-03-30T08:15:12.691 INFO:teuthology.orchestra.run.smithi087.stdout:367.out 2023-03-30T08:15:12.691 INFO:teuthology.orchestra.run.smithi087.stdout:368 2023-03-30T08:15:12.691 INFO:teuthology.orchestra.run.smithi087.stdout:368.out 2023-03-30T08:15:12.691 INFO:teuthology.orchestra.run.smithi087.stdout:369 2023-03-30T08:15:12.691 INFO:teuthology.orchestra.run.smithi087.stdout:369.out 2023-03-30T08:15:12.691 INFO:teuthology.orchestra.run.smithi087.stdout:370 2023-03-30T08:15:12.691 INFO:teuthology.orchestra.run.smithi087.stdout:370.out 2023-03-30T08:15:12.692 INFO:teuthology.orchestra.run.smithi087.stdout:371 2023-03-30T08:15:12.692 INFO:teuthology.orchestra.run.smithi087.stdout:371.out 2023-03-30T08:15:12.692 INFO:teuthology.orchestra.run.smithi087.stdout:372 2023-03-30T08:15:12.692 INFO:teuthology.orchestra.run.smithi087.stdout:372.out 2023-03-30T08:15:12.692 INFO:teuthology.orchestra.run.smithi087.stdout:373 2023-03-30T08:15:12.692 INFO:teuthology.orchestra.run.smithi087.stdout:373.out 2023-03-30T08:15:12.692 INFO:teuthology.orchestra.run.smithi087.stdout:374 2023-03-30T08:15:12.693 INFO:teuthology.orchestra.run.smithi087.stdout:374.out 2023-03-30T08:15:12.693 INFO:teuthology.orchestra.run.smithi087.stdout:375 2023-03-30T08:15:12.693 INFO:teuthology.orchestra.run.smithi087.stdout:375.out 2023-03-30T08:15:12.693 INFO:teuthology.orchestra.run.smithi087.stdout:376 2023-03-30T08:15:12.693 INFO:teuthology.orchestra.run.smithi087.stdout:376.out 2023-03-30T08:15:12.693 INFO:teuthology.orchestra.run.smithi087.stdout:377 2023-03-30T08:15:12.693 INFO:teuthology.orchestra.run.smithi087.stdout:377.out 2023-03-30T08:15:12.694 INFO:teuthology.orchestra.run.smithi087.stdout:378 2023-03-30T08:15:12.694 INFO:teuthology.orchestra.run.smithi087.stdout:378.out 2023-03-30T08:15:12.694 INFO:teuthology.orchestra.run.smithi087.stdout:379 2023-03-30T08:15:12.694 INFO:teuthology.orchestra.run.smithi087.stdout:379.out 2023-03-30T08:15:12.694 INFO:teuthology.orchestra.run.smithi087.stdout:380 2023-03-30T08:15:12.694 INFO:teuthology.orchestra.run.smithi087.stdout:380.out 2023-03-30T08:15:12.694 INFO:teuthology.orchestra.run.smithi087.stdout:381 2023-03-30T08:15:12.694 INFO:teuthology.orchestra.run.smithi087.stdout:381.out 2023-03-30T08:15:12.695 INFO:teuthology.orchestra.run.smithi087.stdout:382 2023-03-30T08:15:12.695 INFO:teuthology.orchestra.run.smithi087.stdout:382.out 2023-03-30T08:15:12.695 INFO:teuthology.orchestra.run.smithi087.stdout:383 2023-03-30T08:15:12.695 INFO:teuthology.orchestra.run.smithi087.stdout:383.out 2023-03-30T08:15:12.695 INFO:teuthology.orchestra.run.smithi087.stdout:384 2023-03-30T08:15:12.695 INFO:teuthology.orchestra.run.smithi087.stdout:384.out 2023-03-30T08:15:12.695 INFO:teuthology.orchestra.run.smithi087.stdout:385 2023-03-30T08:15:12.695 INFO:teuthology.orchestra.run.smithi087.stdout:385.out 2023-03-30T08:15:12.696 INFO:teuthology.orchestra.run.smithi087.stdout:386 2023-03-30T08:15:12.696 INFO:teuthology.orchestra.run.smithi087.stdout:386.out 2023-03-30T08:15:12.696 INFO:teuthology.orchestra.run.smithi087.stdout:387 2023-03-30T08:15:12.696 INFO:teuthology.orchestra.run.smithi087.stdout:387.out 2023-03-30T08:15:12.696 INFO:teuthology.orchestra.run.smithi087.stdout:388 2023-03-30T08:15:12.696 INFO:teuthology.orchestra.run.smithi087.stdout:388.out 2023-03-30T08:15:12.696 INFO:teuthology.orchestra.run.smithi087.stdout:389 2023-03-30T08:15:12.696 INFO:teuthology.orchestra.run.smithi087.stdout:389.out 2023-03-30T08:15:12.697 INFO:teuthology.orchestra.run.smithi087.stdout:390 2023-03-30T08:15:12.697 INFO:teuthology.orchestra.run.smithi087.stdout:390.out 2023-03-30T08:15:12.697 INFO:teuthology.orchestra.run.smithi087.stdout:391 2023-03-30T08:15:12.697 INFO:teuthology.orchestra.run.smithi087.stdout:391.out 2023-03-30T08:15:12.697 INFO:teuthology.orchestra.run.smithi087.stdout:392 2023-03-30T08:15:12.697 INFO:teuthology.orchestra.run.smithi087.stdout:392.out 2023-03-30T08:15:12.698 INFO:teuthology.orchestra.run.smithi087.stdout:393 2023-03-30T08:15:12.698 INFO:teuthology.orchestra.run.smithi087.stdout:393.out 2023-03-30T08:15:12.698 INFO:teuthology.orchestra.run.smithi087.stdout:394 2023-03-30T08:15:12.698 INFO:teuthology.orchestra.run.smithi087.stdout:394.out 2023-03-30T08:15:12.698 INFO:teuthology.orchestra.run.smithi087.stdout:395 2023-03-30T08:15:12.698 INFO:teuthology.orchestra.run.smithi087.stdout:395.out 2023-03-30T08:15:12.698 INFO:teuthology.orchestra.run.smithi087.stdout:396 2023-03-30T08:15:12.698 INFO:teuthology.orchestra.run.smithi087.stdout:396.out 2023-03-30T08:15:12.699 INFO:teuthology.orchestra.run.smithi087.stdout:397 2023-03-30T08:15:12.699 INFO:teuthology.orchestra.run.smithi087.stdout:397.out 2023-03-30T08:15:12.699 INFO:teuthology.orchestra.run.smithi087.stdout:398 2023-03-30T08:15:12.699 INFO:teuthology.orchestra.run.smithi087.stdout:398.out 2023-03-30T08:15:12.699 INFO:teuthology.orchestra.run.smithi087.stdout:399 2023-03-30T08:15:12.699 INFO:teuthology.orchestra.run.smithi087.stdout:399.out 2023-03-30T08:15:12.699 INFO:teuthology.orchestra.run.smithi087.stdout:400 2023-03-30T08:15:12.700 INFO:teuthology.orchestra.run.smithi087.stdout:400.out 2023-03-30T08:15:12.700 INFO:teuthology.orchestra.run.smithi087.stdout:401 2023-03-30T08:15:12.700 INFO:teuthology.orchestra.run.smithi087.stdout:401.out 2023-03-30T08:15:12.700 INFO:teuthology.orchestra.run.smithi087.stdout:402 2023-03-30T08:15:12.700 INFO:teuthology.orchestra.run.smithi087.stdout:402.out 2023-03-30T08:15:12.700 INFO:teuthology.orchestra.run.smithi087.stdout:403 2023-03-30T08:15:12.700 INFO:teuthology.orchestra.run.smithi087.stdout:403.out 2023-03-30T08:15:12.700 INFO:teuthology.orchestra.run.smithi087.stdout:404 2023-03-30T08:15:12.701 INFO:teuthology.orchestra.run.smithi087.stdout:404.out 2023-03-30T08:15:12.701 INFO:teuthology.orchestra.run.smithi087.stdout:405 2023-03-30T08:15:12.701 INFO:teuthology.orchestra.run.smithi087.stdout:405.out 2023-03-30T08:15:12.701 INFO:teuthology.orchestra.run.smithi087.stdout:406 2023-03-30T08:15:12.701 INFO:teuthology.orchestra.run.smithi087.stdout:406.out 2023-03-30T08:15:12.701 INFO:teuthology.orchestra.run.smithi087.stdout:407 2023-03-30T08:15:12.701 INFO:teuthology.orchestra.run.smithi087.stdout:407.out 2023-03-30T08:15:12.702 INFO:teuthology.orchestra.run.smithi087.stdout:408 2023-03-30T08:15:12.702 INFO:teuthology.orchestra.run.smithi087.stdout:408.out 2023-03-30T08:15:12.702 INFO:teuthology.orchestra.run.smithi087.stdout:409 2023-03-30T08:15:12.702 INFO:teuthology.orchestra.run.smithi087.stdout:409.out 2023-03-30T08:15:12.702 INFO:teuthology.orchestra.run.smithi087.stdout:410 2023-03-30T08:15:12.702 INFO:teuthology.orchestra.run.smithi087.stdout:410.out 2023-03-30T08:15:12.702 INFO:teuthology.orchestra.run.smithi087.stdout:411 2023-03-30T08:15:12.703 INFO:teuthology.orchestra.run.smithi087.stdout:411.out 2023-03-30T08:15:12.703 INFO:teuthology.orchestra.run.smithi087.stdout:412 2023-03-30T08:15:12.703 INFO:teuthology.orchestra.run.smithi087.stdout:412.out 2023-03-30T08:15:12.703 INFO:teuthology.orchestra.run.smithi087.stdout:413 2023-03-30T08:15:12.703 INFO:teuthology.orchestra.run.smithi087.stdout:413.out 2023-03-30T08:15:12.703 INFO:teuthology.orchestra.run.smithi087.stdout:414 2023-03-30T08:15:12.703 INFO:teuthology.orchestra.run.smithi087.stdout:414.out 2023-03-30T08:15:12.703 INFO:teuthology.orchestra.run.smithi087.stdout:415 2023-03-30T08:15:12.704 INFO:teuthology.orchestra.run.smithi087.stdout:415.out 2023-03-30T08:15:12.704 INFO:teuthology.orchestra.run.smithi087.stdout:416 2023-03-30T08:15:12.704 INFO:teuthology.orchestra.run.smithi087.stdout:416.out 2023-03-30T08:15:12.704 INFO:teuthology.orchestra.run.smithi087.stdout:417 2023-03-30T08:15:12.704 INFO:teuthology.orchestra.run.smithi087.stdout:417.out 2023-03-30T08:15:12.704 INFO:teuthology.orchestra.run.smithi087.stdout:418 2023-03-30T08:15:12.704 INFO:teuthology.orchestra.run.smithi087.stdout:418.out 2023-03-30T08:15:12.704 INFO:teuthology.orchestra.run.smithi087.stdout:419 2023-03-30T08:15:12.705 INFO:teuthology.orchestra.run.smithi087.stdout:419.out 2023-03-30T08:15:12.705 INFO:teuthology.orchestra.run.smithi087.stdout:420 2023-03-30T08:15:12.705 INFO:teuthology.orchestra.run.smithi087.stdout:420.out 2023-03-30T08:15:12.705 INFO:teuthology.orchestra.run.smithi087.stdout:421 2023-03-30T08:15:12.705 INFO:teuthology.orchestra.run.smithi087.stdout:421.out 2023-03-30T08:15:12.705 INFO:teuthology.orchestra.run.smithi087.stdout:422 2023-03-30T08:15:12.705 INFO:teuthology.orchestra.run.smithi087.stdout:422.out 2023-03-30T08:15:12.705 INFO:teuthology.orchestra.run.smithi087.stdout:423 2023-03-30T08:15:12.706 INFO:teuthology.orchestra.run.smithi087.stdout:423.out 2023-03-30T08:15:12.706 INFO:teuthology.orchestra.run.smithi087.stdout:424 2023-03-30T08:15:12.706 INFO:teuthology.orchestra.run.smithi087.stdout:424.out 2023-03-30T08:15:12.706 INFO:teuthology.orchestra.run.smithi087.stdout:425 2023-03-30T08:15:12.706 INFO:teuthology.orchestra.run.smithi087.stdout:425.out 2023-03-30T08:15:12.706 INFO:teuthology.orchestra.run.smithi087.stdout:426 2023-03-30T08:15:12.706 INFO:teuthology.orchestra.run.smithi087.stdout:426.out 2023-03-30T08:15:12.707 INFO:teuthology.orchestra.run.smithi087.stdout:427 2023-03-30T08:15:12.707 INFO:teuthology.orchestra.run.smithi087.stdout:427.out 2023-03-30T08:15:12.707 INFO:teuthology.orchestra.run.smithi087.stdout:428 2023-03-30T08:15:12.707 INFO:teuthology.orchestra.run.smithi087.stdout:428.out 2023-03-30T08:15:12.707 INFO:teuthology.orchestra.run.smithi087.stdout:429 2023-03-30T08:15:12.707 INFO:teuthology.orchestra.run.smithi087.stdout:429.out 2023-03-30T08:15:12.707 INFO:teuthology.orchestra.run.smithi087.stdout:430 2023-03-30T08:15:12.707 INFO:teuthology.orchestra.run.smithi087.stdout:430.out 2023-03-30T08:15:12.708 INFO:teuthology.orchestra.run.smithi087.stdout:431 2023-03-30T08:15:12.708 INFO:teuthology.orchestra.run.smithi087.stdout:431.out 2023-03-30T08:15:12.708 INFO:teuthology.orchestra.run.smithi087.stdout:432 2023-03-30T08:15:12.708 INFO:teuthology.orchestra.run.smithi087.stdout:432.out 2023-03-30T08:15:12.708 INFO:teuthology.orchestra.run.smithi087.stdout:433 2023-03-30T08:15:12.708 INFO:teuthology.orchestra.run.smithi087.stdout:433.out 2023-03-30T08:15:12.708 INFO:teuthology.orchestra.run.smithi087.stdout:434 2023-03-30T08:15:12.708 INFO:teuthology.orchestra.run.smithi087.stdout:434.out 2023-03-30T08:15:12.709 INFO:teuthology.orchestra.run.smithi087.stdout:435 2023-03-30T08:15:12.709 INFO:teuthology.orchestra.run.smithi087.stdout:435.out 2023-03-30T08:15:12.709 INFO:teuthology.orchestra.run.smithi087.stdout:436 2023-03-30T08:15:12.709 INFO:teuthology.orchestra.run.smithi087.stdout:436.out 2023-03-30T08:15:12.709 INFO:teuthology.orchestra.run.smithi087.stdout:437 2023-03-30T08:15:12.709 INFO:teuthology.orchestra.run.smithi087.stdout:437.out 2023-03-30T08:15:12.709 INFO:teuthology.orchestra.run.smithi087.stdout:438 2023-03-30T08:15:12.709 INFO:teuthology.orchestra.run.smithi087.stdout:438.out 2023-03-30T08:15:12.710 INFO:teuthology.orchestra.run.smithi087.stdout:439 2023-03-30T08:15:12.710 INFO:teuthology.orchestra.run.smithi087.stdout:439.out 2023-03-30T08:15:12.710 INFO:teuthology.orchestra.run.smithi087.stdout:440 2023-03-30T08:15:12.710 INFO:teuthology.orchestra.run.smithi087.stdout:440.out 2023-03-30T08:15:12.710 INFO:teuthology.orchestra.run.smithi087.stdout:441 2023-03-30T08:15:12.710 INFO:teuthology.orchestra.run.smithi087.stdout:441.out 2023-03-30T08:15:12.710 INFO:teuthology.orchestra.run.smithi087.stdout:442 2023-03-30T08:15:12.710 INFO:teuthology.orchestra.run.smithi087.stdout:442.out 2023-03-30T08:15:12.711 INFO:teuthology.orchestra.run.smithi087.stdout:443 2023-03-30T08:15:12.711 INFO:teuthology.orchestra.run.smithi087.stdout:443.out 2023-03-30T08:15:12.711 INFO:teuthology.orchestra.run.smithi087.stdout:444 2023-03-30T08:15:12.711 INFO:teuthology.orchestra.run.smithi087.stdout:444.out 2023-03-30T08:15:12.711 INFO:teuthology.orchestra.run.smithi087.stdout:445 2023-03-30T08:15:12.711 INFO:teuthology.orchestra.run.smithi087.stdout:445.out 2023-03-30T08:15:12.711 INFO:teuthology.orchestra.run.smithi087.stdout:446 2023-03-30T08:15:12.711 INFO:teuthology.orchestra.run.smithi087.stdout:446.out 2023-03-30T08:15:12.712 INFO:teuthology.orchestra.run.smithi087.stdout:447 2023-03-30T08:15:12.712 INFO:teuthology.orchestra.run.smithi087.stdout:447.out 2023-03-30T08:15:12.712 INFO:teuthology.orchestra.run.smithi087.stdout:448 2023-03-30T08:15:12.712 INFO:teuthology.orchestra.run.smithi087.stdout:448.out 2023-03-30T08:15:12.712 INFO:teuthology.orchestra.run.smithi087.stdout:449 2023-03-30T08:15:12.712 INFO:teuthology.orchestra.run.smithi087.stdout:449.out 2023-03-30T08:15:12.713 INFO:teuthology.orchestra.run.smithi087.stdout:450 2023-03-30T08:15:12.713 INFO:teuthology.orchestra.run.smithi087.stdout:450.out 2023-03-30T08:15:12.713 INFO:teuthology.orchestra.run.smithi087.stdout:451 2023-03-30T08:15:12.713 INFO:teuthology.orchestra.run.smithi087.stdout:451.out 2023-03-30T08:15:12.714 INFO:teuthology.orchestra.run.smithi087.stdout:452 2023-03-30T08:15:12.714 INFO:teuthology.orchestra.run.smithi087.stdout:452.out 2023-03-30T08:15:12.714 INFO:teuthology.orchestra.run.smithi087.stdout:453 2023-03-30T08:15:12.714 INFO:teuthology.orchestra.run.smithi087.stdout:453.out 2023-03-30T08:15:12.714 INFO:teuthology.orchestra.run.smithi087.stdout:454 2023-03-30T08:15:12.714 INFO:teuthology.orchestra.run.smithi087.stdout:454.out 2023-03-30T08:15:12.714 INFO:teuthology.orchestra.run.smithi087.stdout:455 2023-03-30T08:15:12.714 INFO:teuthology.orchestra.run.smithi087.stdout:455.out 2023-03-30T08:15:12.715 INFO:teuthology.orchestra.run.smithi087.stdout:456 2023-03-30T08:15:12.715 INFO:teuthology.orchestra.run.smithi087.stdout:456.out 2023-03-30T08:15:12.715 INFO:teuthology.orchestra.run.smithi087.stdout:457 2023-03-30T08:15:12.715 INFO:teuthology.orchestra.run.smithi087.stdout:457.out 2023-03-30T08:15:12.715 INFO:teuthology.orchestra.run.smithi087.stdout:458 2023-03-30T08:15:12.715 INFO:teuthology.orchestra.run.smithi087.stdout:458.out 2023-03-30T08:15:12.715 INFO:teuthology.orchestra.run.smithi087.stdout:459 2023-03-30T08:15:12.715 INFO:teuthology.orchestra.run.smithi087.stdout:459.out 2023-03-30T08:15:12.716 INFO:teuthology.orchestra.run.smithi087.stdout:460 2023-03-30T08:15:12.716 INFO:teuthology.orchestra.run.smithi087.stdout:460.out 2023-03-30T08:15:12.716 INFO:teuthology.orchestra.run.smithi087.stdout:461 2023-03-30T08:15:12.716 INFO:teuthology.orchestra.run.smithi087.stdout:461.out 2023-03-30T08:15:12.716 INFO:teuthology.orchestra.run.smithi087.stdout:462 2023-03-30T08:15:12.716 INFO:teuthology.orchestra.run.smithi087.stdout:462.out 2023-03-30T08:15:12.716 INFO:teuthology.orchestra.run.smithi087.stdout:463 2023-03-30T08:15:12.717 INFO:teuthology.orchestra.run.smithi087.stdout:463.out 2023-03-30T08:15:12.717 INFO:teuthology.orchestra.run.smithi087.stdout:464 2023-03-30T08:15:12.717 INFO:teuthology.orchestra.run.smithi087.stdout:464.out 2023-03-30T08:15:12.717 INFO:teuthology.orchestra.run.smithi087.stdout:465 2023-03-30T08:15:12.717 INFO:teuthology.orchestra.run.smithi087.stdout:465.out 2023-03-30T08:15:12.717 INFO:teuthology.orchestra.run.smithi087.stdout:466 2023-03-30T08:15:12.717 INFO:teuthology.orchestra.run.smithi087.stdout:466.out 2023-03-30T08:15:12.717 INFO:teuthology.orchestra.run.smithi087.stdout:467 2023-03-30T08:15:12.718 INFO:teuthology.orchestra.run.smithi087.stdout:467.out 2023-03-30T08:15:12.718 INFO:teuthology.orchestra.run.smithi087.stdout:468 2023-03-30T08:15:12.718 INFO:teuthology.orchestra.run.smithi087.stdout:468.out 2023-03-30T08:15:12.718 INFO:teuthology.orchestra.run.smithi087.stdout:469 2023-03-30T08:15:12.718 INFO:teuthology.orchestra.run.smithi087.stdout:469.out 2023-03-30T08:15:12.718 INFO:teuthology.orchestra.run.smithi087.stdout:470 2023-03-30T08:15:12.718 INFO:teuthology.orchestra.run.smithi087.stdout:470.out 2023-03-30T08:15:12.718 INFO:teuthology.orchestra.run.smithi087.stdout:471 2023-03-30T08:15:12.719 INFO:teuthology.orchestra.run.smithi087.stdout:471.out 2023-03-30T08:15:12.719 INFO:teuthology.orchestra.run.smithi087.stdout:472 2023-03-30T08:15:12.719 INFO:teuthology.orchestra.run.smithi087.stdout:472.out 2023-03-30T08:15:12.719 INFO:teuthology.orchestra.run.smithi087.stdout:473 2023-03-30T08:15:12.719 INFO:teuthology.orchestra.run.smithi087.stdout:473.out 2023-03-30T08:15:12.719 INFO:teuthology.orchestra.run.smithi087.stdout:474 2023-03-30T08:15:12.719 INFO:teuthology.orchestra.run.smithi087.stdout:474.out 2023-03-30T08:15:12.719 INFO:teuthology.orchestra.run.smithi087.stdout:475 2023-03-30T08:15:12.720 INFO:teuthology.orchestra.run.smithi087.stdout:475.out 2023-03-30T08:15:12.720 INFO:teuthology.orchestra.run.smithi087.stdout:476 2023-03-30T08:15:12.720 INFO:teuthology.orchestra.run.smithi087.stdout:476.out 2023-03-30T08:15:12.720 INFO:teuthology.orchestra.run.smithi087.stdout:477 2023-03-30T08:15:12.720 INFO:teuthology.orchestra.run.smithi087.stdout:477.out 2023-03-30T08:15:12.720 INFO:teuthology.orchestra.run.smithi087.stdout:478 2023-03-30T08:15:12.720 INFO:teuthology.orchestra.run.smithi087.stdout:478.out 2023-03-30T08:15:12.720 INFO:teuthology.orchestra.run.smithi087.stdout:479 2023-03-30T08:15:12.721 INFO:teuthology.orchestra.run.smithi087.stdout:479.out 2023-03-30T08:15:12.721 INFO:teuthology.orchestra.run.smithi087.stdout:480 2023-03-30T08:15:12.721 INFO:teuthology.orchestra.run.smithi087.stdout:480.out 2023-03-30T08:15:12.721 INFO:teuthology.orchestra.run.smithi087.stdout:481 2023-03-30T08:15:12.721 INFO:teuthology.orchestra.run.smithi087.stdout:481.out 2023-03-30T08:15:12.721 INFO:teuthology.orchestra.run.smithi087.stdout:482 2023-03-30T08:15:12.721 INFO:teuthology.orchestra.run.smithi087.stdout:482.out 2023-03-30T08:15:12.722 INFO:teuthology.orchestra.run.smithi087.stdout:483 2023-03-30T08:15:12.722 INFO:teuthology.orchestra.run.smithi087.stdout:483.out 2023-03-30T08:15:12.722 INFO:teuthology.orchestra.run.smithi087.stdout:484 2023-03-30T08:15:12.722 INFO:teuthology.orchestra.run.smithi087.stdout:484.out 2023-03-30T08:15:12.722 INFO:teuthology.orchestra.run.smithi087.stdout:485 2023-03-30T08:15:12.722 INFO:teuthology.orchestra.run.smithi087.stdout:485.out 2023-03-30T08:15:12.722 INFO:teuthology.orchestra.run.smithi087.stdout:486 2023-03-30T08:15:12.723 INFO:teuthology.orchestra.run.smithi087.stdout:486.out 2023-03-30T08:15:12.723 INFO:teuthology.orchestra.run.smithi087.stdout:487 2023-03-30T08:15:12.723 INFO:teuthology.orchestra.run.smithi087.stdout:487.out 2023-03-30T08:15:12.723 INFO:teuthology.orchestra.run.smithi087.stdout:488 2023-03-30T08:15:12.723 INFO:teuthology.orchestra.run.smithi087.stdout:488.out 2023-03-30T08:15:12.723 INFO:teuthology.orchestra.run.smithi087.stdout:489 2023-03-30T08:15:12.723 INFO:teuthology.orchestra.run.smithi087.stdout:489.out 2023-03-30T08:15:12.723 INFO:teuthology.orchestra.run.smithi087.stdout:490 2023-03-30T08:15:12.724 INFO:teuthology.orchestra.run.smithi087.stdout:490.out 2023-03-30T08:15:12.724 INFO:teuthology.orchestra.run.smithi087.stdout:491 2023-03-30T08:15:12.724 INFO:teuthology.orchestra.run.smithi087.stdout:491.out 2023-03-30T08:15:12.724 INFO:teuthology.orchestra.run.smithi087.stdout:492 2023-03-30T08:15:12.724 INFO:teuthology.orchestra.run.smithi087.stdout:492.out 2023-03-30T08:15:12.724 INFO:teuthology.orchestra.run.smithi087.stdout:493 2023-03-30T08:15:12.724 INFO:teuthology.orchestra.run.smithi087.stdout:493.out 2023-03-30T08:15:12.724 INFO:teuthology.orchestra.run.smithi087.stdout:494 2023-03-30T08:15:12.725 INFO:teuthology.orchestra.run.smithi087.stdout:494.out 2023-03-30T08:15:12.725 INFO:teuthology.orchestra.run.smithi087.stdout:495 2023-03-30T08:15:12.725 INFO:teuthology.orchestra.run.smithi087.stdout:495.out 2023-03-30T08:15:12.725 INFO:teuthology.orchestra.run.smithi087.stdout:496 2023-03-30T08:15:12.725 INFO:teuthology.orchestra.run.smithi087.stdout:496.out 2023-03-30T08:15:12.725 INFO:teuthology.orchestra.run.smithi087.stdout:497 2023-03-30T08:15:12.725 INFO:teuthology.orchestra.run.smithi087.stdout:497.out 2023-03-30T08:15:12.726 INFO:teuthology.orchestra.run.smithi087.stdout:498 2023-03-30T08:15:12.726 INFO:teuthology.orchestra.run.smithi087.stdout:498.out 2023-03-30T08:15:12.726 INFO:teuthology.orchestra.run.smithi087.stdout:499 2023-03-30T08:15:12.726 INFO:teuthology.orchestra.run.smithi087.stdout:499.out 2023-03-30T08:15:12.726 INFO:teuthology.orchestra.run.smithi087.stdout:500 2023-03-30T08:15:12.726 INFO:teuthology.orchestra.run.smithi087.stdout:500.out 2023-03-30T08:15:12.726 INFO:teuthology.orchestra.run.smithi087.stdout:501 2023-03-30T08:15:12.726 INFO:teuthology.orchestra.run.smithi087.stdout:501.out 2023-03-30T08:15:12.727 INFO:teuthology.orchestra.run.smithi087.stdout:502 2023-03-30T08:15:12.727 INFO:teuthology.orchestra.run.smithi087.stdout:502.out 2023-03-30T08:15:12.727 INFO:teuthology.orchestra.run.smithi087.stdout:503 2023-03-30T08:15:12.727 INFO:teuthology.orchestra.run.smithi087.stdout:503.out 2023-03-30T08:15:12.727 INFO:teuthology.orchestra.run.smithi087.stdout:504 2023-03-30T08:15:12.727 INFO:teuthology.orchestra.run.smithi087.stdout:504.out 2023-03-30T08:15:12.727 INFO:teuthology.orchestra.run.smithi087.stdout:505 2023-03-30T08:15:12.727 INFO:teuthology.orchestra.run.smithi087.stdout:505.out 2023-03-30T08:15:12.728 INFO:teuthology.orchestra.run.smithi087.stdout:506 2023-03-30T08:15:12.728 INFO:teuthology.orchestra.run.smithi087.stdout:506.out 2023-03-30T08:15:12.728 INFO:teuthology.orchestra.run.smithi087.stdout:507 2023-03-30T08:15:12.728 INFO:teuthology.orchestra.run.smithi087.stdout:507.out 2023-03-30T08:15:12.728 INFO:teuthology.orchestra.run.smithi087.stdout:508 2023-03-30T08:15:12.728 INFO:teuthology.orchestra.run.smithi087.stdout:508.out 2023-03-30T08:15:12.728 INFO:teuthology.orchestra.run.smithi087.stdout:509 2023-03-30T08:15:12.728 INFO:teuthology.orchestra.run.smithi087.stdout:509.out 2023-03-30T08:15:12.729 INFO:teuthology.orchestra.run.smithi087.stdout:510 2023-03-30T08:15:12.729 INFO:teuthology.orchestra.run.smithi087.stdout:510.out 2023-03-30T08:15:12.729 INFO:teuthology.orchestra.run.smithi087.stdout:511 2023-03-30T08:15:12.729 INFO:teuthology.orchestra.run.smithi087.stdout:511.out 2023-03-30T08:15:12.729 INFO:teuthology.orchestra.run.smithi087.stdout:512 2023-03-30T08:15:12.729 INFO:teuthology.orchestra.run.smithi087.stdout:512.out 2023-03-30T08:15:12.729 INFO:teuthology.orchestra.run.smithi087.stdout:513 2023-03-30T08:15:12.729 INFO:teuthology.orchestra.run.smithi087.stdout:513.out 2023-03-30T08:15:12.730 INFO:teuthology.orchestra.run.smithi087.stdout:514 2023-03-30T08:15:12.730 INFO:teuthology.orchestra.run.smithi087.stdout:514.out 2023-03-30T08:15:12.730 INFO:teuthology.orchestra.run.smithi087.stdout:515 2023-03-30T08:15:12.730 INFO:teuthology.orchestra.run.smithi087.stdout:515.out 2023-03-30T08:15:12.730 INFO:teuthology.orchestra.run.smithi087.stdout:516 2023-03-30T08:15:12.730 INFO:teuthology.orchestra.run.smithi087.stdout:516.out 2023-03-30T08:15:12.730 INFO:teuthology.orchestra.run.smithi087.stdout:517 2023-03-30T08:15:12.730 INFO:teuthology.orchestra.run.smithi087.stdout:517.out 2023-03-30T08:15:12.731 INFO:teuthology.orchestra.run.smithi087.stdout:518 2023-03-30T08:15:12.731 INFO:teuthology.orchestra.run.smithi087.stdout:518.out 2023-03-30T08:15:12.731 INFO:teuthology.orchestra.run.smithi087.stdout:519 2023-03-30T08:15:12.731 INFO:teuthology.orchestra.run.smithi087.stdout:519.out 2023-03-30T08:15:12.731 INFO:teuthology.orchestra.run.smithi087.stdout:520 2023-03-30T08:15:12.731 INFO:teuthology.orchestra.run.smithi087.stdout:520.out 2023-03-30T08:15:12.731 INFO:teuthology.orchestra.run.smithi087.stdout:521 2023-03-30T08:15:12.731 INFO:teuthology.orchestra.run.smithi087.stdout:521.out 2023-03-30T08:15:12.732 INFO:teuthology.orchestra.run.smithi087.stdout:522 2023-03-30T08:15:12.732 INFO:teuthology.orchestra.run.smithi087.stdout:522.out 2023-03-30T08:15:12.732 INFO:teuthology.orchestra.run.smithi087.stdout:523 2023-03-30T08:15:12.732 INFO:teuthology.orchestra.run.smithi087.stdout:523.out 2023-03-30T08:15:12.732 INFO:teuthology.orchestra.run.smithi087.stdout:524 2023-03-30T08:15:12.732 INFO:teuthology.orchestra.run.smithi087.stdout:524.out 2023-03-30T08:15:12.732 INFO:teuthology.orchestra.run.smithi087.stdout:525 2023-03-30T08:15:12.733 INFO:teuthology.orchestra.run.smithi087.stdout:525.out 2023-03-30T08:15:12.733 INFO:teuthology.orchestra.run.smithi087.stdout:526 2023-03-30T08:15:12.733 INFO:teuthology.orchestra.run.smithi087.stdout:526.out 2023-03-30T08:15:12.733 INFO:teuthology.orchestra.run.smithi087.stdout:527 2023-03-30T08:15:12.733 INFO:teuthology.orchestra.run.smithi087.stdout:527.out 2023-03-30T08:15:12.733 INFO:teuthology.orchestra.run.smithi087.stdout:528 2023-03-30T08:15:12.733 INFO:teuthology.orchestra.run.smithi087.stdout:528.out 2023-03-30T08:15:12.734 INFO:teuthology.orchestra.run.smithi087.stdout:529 2023-03-30T08:15:12.734 INFO:teuthology.orchestra.run.smithi087.stdout:529.out 2023-03-30T08:15:12.734 INFO:teuthology.orchestra.run.smithi087.stdout:530 2023-03-30T08:15:12.734 INFO:teuthology.orchestra.run.smithi087.stdout:530.out 2023-03-30T08:15:12.734 INFO:teuthology.orchestra.run.smithi087.stdout:531 2023-03-30T08:15:12.734 INFO:teuthology.orchestra.run.smithi087.stdout:531.out 2023-03-30T08:15:12.734 INFO:teuthology.orchestra.run.smithi087.stdout:532 2023-03-30T08:15:12.734 INFO:teuthology.orchestra.run.smithi087.stdout:532.out 2023-03-30T08:15:12.735 INFO:teuthology.orchestra.run.smithi087.stdout:533 2023-03-30T08:15:12.735 INFO:teuthology.orchestra.run.smithi087.stdout:533.out 2023-03-30T08:15:12.735 INFO:teuthology.orchestra.run.smithi087.stdout:534 2023-03-30T08:15:12.735 INFO:teuthology.orchestra.run.smithi087.stdout:534.out 2023-03-30T08:15:12.735 INFO:teuthology.orchestra.run.smithi087.stdout:535 2023-03-30T08:15:12.735 INFO:teuthology.orchestra.run.smithi087.stdout:535.out 2023-03-30T08:15:12.735 INFO:teuthology.orchestra.run.smithi087.stdout:536 2023-03-30T08:15:12.735 INFO:teuthology.orchestra.run.smithi087.stdout:536.out 2023-03-30T08:15:12.736 INFO:teuthology.orchestra.run.smithi087.stdout:537 2023-03-30T08:15:12.736 INFO:teuthology.orchestra.run.smithi087.stdout:537.out 2023-03-30T08:15:12.736 INFO:teuthology.orchestra.run.smithi087.stdout:538 2023-03-30T08:15:12.736 INFO:teuthology.orchestra.run.smithi087.stdout:538.out 2023-03-30T08:15:12.736 INFO:teuthology.orchestra.run.smithi087.stdout:539 2023-03-30T08:15:12.736 INFO:teuthology.orchestra.run.smithi087.stdout:539.out 2023-03-30T08:15:12.736 INFO:teuthology.orchestra.run.smithi087.stdout:540 2023-03-30T08:15:12.736 INFO:teuthology.orchestra.run.smithi087.stdout:540.out 2023-03-30T08:15:12.737 INFO:teuthology.orchestra.run.smithi087.stdout:541 2023-03-30T08:15:12.737 INFO:teuthology.orchestra.run.smithi087.stdout:541.out 2023-03-30T08:15:12.737 INFO:teuthology.orchestra.run.smithi087.stdout:542 2023-03-30T08:15:12.737 INFO:teuthology.orchestra.run.smithi087.stdout:542.out 2023-03-30T08:15:12.737 INFO:teuthology.orchestra.run.smithi087.stdout:543 2023-03-30T08:15:12.737 INFO:teuthology.orchestra.run.smithi087.stdout:543.out 2023-03-30T08:15:12.737 INFO:teuthology.orchestra.run.smithi087.stdout:544 2023-03-30T08:15:12.738 INFO:teuthology.orchestra.run.smithi087.stdout:544.out 2023-03-30T08:15:12.738 INFO:teuthology.orchestra.run.smithi087.stdout:545 2023-03-30T08:15:12.738 INFO:teuthology.orchestra.run.smithi087.stdout:545.out 2023-03-30T08:15:12.738 INFO:teuthology.orchestra.run.smithi087.stdout:546 2023-03-30T08:15:12.738 INFO:teuthology.orchestra.run.smithi087.stdout:546.out 2023-03-30T08:15:12.738 INFO:teuthology.orchestra.run.smithi087.stdout:547 2023-03-30T08:15:12.738 INFO:teuthology.orchestra.run.smithi087.stdout:547.out 2023-03-30T08:15:12.738 INFO:teuthology.orchestra.run.smithi087.stdout:548 2023-03-30T08:15:12.738 INFO:teuthology.orchestra.run.smithi087.stdout:548.out 2023-03-30T08:15:12.739 INFO:teuthology.orchestra.run.smithi087.stdout:549 2023-03-30T08:15:12.739 INFO:teuthology.orchestra.run.smithi087.stdout:549.out 2023-03-30T08:15:12.739 INFO:teuthology.orchestra.run.smithi087.stdout:550 2023-03-30T08:15:12.739 INFO:teuthology.orchestra.run.smithi087.stdout:550.out 2023-03-30T08:15:12.739 INFO:teuthology.orchestra.run.smithi087.stdout:551 2023-03-30T08:15:12.739 INFO:teuthology.orchestra.run.smithi087.stdout:551.out 2023-03-30T08:15:12.739 INFO:teuthology.orchestra.run.smithi087.stdout:552 2023-03-30T08:15:12.739 INFO:teuthology.orchestra.run.smithi087.stdout:552.out 2023-03-30T08:15:12.740 INFO:teuthology.orchestra.run.smithi087.stdout:553 2023-03-30T08:15:12.740 INFO:teuthology.orchestra.run.smithi087.stdout:553.out 2023-03-30T08:15:12.740 INFO:teuthology.orchestra.run.smithi087.stdout:554 2023-03-30T08:15:12.740 INFO:teuthology.orchestra.run.smithi087.stdout:554.out 2023-03-30T08:15:12.740 INFO:teuthology.orchestra.run.smithi087.stdout:555 2023-03-30T08:15:12.740 INFO:teuthology.orchestra.run.smithi087.stdout:555.out 2023-03-30T08:15:12.740 INFO:teuthology.orchestra.run.smithi087.stdout:556 2023-03-30T08:15:12.740 INFO:teuthology.orchestra.run.smithi087.stdout:556.out 2023-03-30T08:15:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:557 2023-03-30T08:15:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:557.out 2023-03-30T08:15:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:558 2023-03-30T08:15:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:558.out 2023-03-30T08:15:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:559 2023-03-30T08:15:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:559.out 2023-03-30T08:15:12.741 INFO:teuthology.orchestra.run.smithi087.stdout:560 2023-03-30T08:15:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:560.out 2023-03-30T08:15:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:561 2023-03-30T08:15:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:561.out 2023-03-30T08:15:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:562 2023-03-30T08:15:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:562.out 2023-03-30T08:15:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:563 2023-03-30T08:15:12.742 INFO:teuthology.orchestra.run.smithi087.stdout:563.out 2023-03-30T08:15:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:564 2023-03-30T08:15:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:564.out 2023-03-30T08:15:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:565 2023-03-30T08:15:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:565.out 2023-03-30T08:15:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:566 2023-03-30T08:15:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:566.out 2023-03-30T08:15:12.743 INFO:teuthology.orchestra.run.smithi087.stdout:567 2023-03-30T08:15:12.744 INFO:teuthology.orchestra.run.smithi087.stdout:567.out 2023-03-30T08:15:12.744 INFO:teuthology.orchestra.run.smithi087.stdout:568 2023-03-30T08:15:12.744 INFO:teuthology.orchestra.run.smithi087.stdout:568.out 2023-03-30T08:15:12.744 INFO:teuthology.orchestra.run.smithi087.stdout:569 2023-03-30T08:15:12.744 INFO:teuthology.orchestra.run.smithi087.stdout:569.out 2023-03-30T08:15:12.744 INFO:teuthology.orchestra.run.smithi087.stdout:570 2023-03-30T08:15:12.744 INFO:teuthology.orchestra.run.smithi087.stdout:570.out 2023-03-30T08:15:12.744 INFO:teuthology.orchestra.run.smithi087.stdout:571 2023-03-30T08:15:12.745 INFO:teuthology.orchestra.run.smithi087.stdout:571.out 2023-03-30T08:15:12.745 INFO:teuthology.orchestra.run.smithi087.stdout:572 2023-03-30T08:15:12.745 INFO:teuthology.orchestra.run.smithi087.stdout:572.out 2023-03-30T08:15:12.745 INFO:teuthology.orchestra.run.smithi087.stdout:573 2023-03-30T08:15:12.745 INFO:teuthology.orchestra.run.smithi087.stdout:573.out 2023-03-30T08:15:12.745 INFO:teuthology.orchestra.run.smithi087.stdout:574 2023-03-30T08:15:12.745 INFO:teuthology.orchestra.run.smithi087.stdout:574.out 2023-03-30T08:15:12.745 INFO:teuthology.orchestra.run.smithi087.stdout:575 2023-03-30T08:15:12.746 INFO:teuthology.orchestra.run.smithi087.stdout:575.out 2023-03-30T08:15:12.746 INFO:teuthology.orchestra.run.smithi087.stdout:576 2023-03-30T08:15:12.746 INFO:teuthology.orchestra.run.smithi087.stdout:576.out 2023-03-30T08:15:12.746 INFO:teuthology.orchestra.run.smithi087.stdout:577 2023-03-30T08:15:12.746 INFO:teuthology.orchestra.run.smithi087.stdout:577.out 2023-03-30T08:15:12.746 INFO:teuthology.orchestra.run.smithi087.stdout:578 2023-03-30T08:15:12.746 INFO:teuthology.orchestra.run.smithi087.stdout:578.out 2023-03-30T08:15:12.746 INFO:teuthology.orchestra.run.smithi087.stdout:579 2023-03-30T08:15:12.747 INFO:teuthology.orchestra.run.smithi087.stdout:579.out 2023-03-30T08:15:12.747 INFO:teuthology.orchestra.run.smithi087.stdout:580 2023-03-30T08:15:12.747 INFO:teuthology.orchestra.run.smithi087.stdout:580.out 2023-03-30T08:15:12.747 INFO:teuthology.orchestra.run.smithi087.stdout:581 2023-03-30T08:15:12.747 INFO:teuthology.orchestra.run.smithi087.stdout:581.out 2023-03-30T08:15:12.747 INFO:teuthology.orchestra.run.smithi087.stdout:582 2023-03-30T08:15:12.747 INFO:teuthology.orchestra.run.smithi087.stdout:582.out 2023-03-30T08:15:12.747 INFO:teuthology.orchestra.run.smithi087.stdout:583 2023-03-30T08:15:12.748 INFO:teuthology.orchestra.run.smithi087.stdout:583.out 2023-03-30T08:15:12.748 INFO:teuthology.orchestra.run.smithi087.stdout:584 2023-03-30T08:15:12.748 INFO:teuthology.orchestra.run.smithi087.stdout:584.out 2023-03-30T08:15:12.748 INFO:teuthology.orchestra.run.smithi087.stdout:585 2023-03-30T08:15:12.748 INFO:teuthology.orchestra.run.smithi087.stdout:585.out 2023-03-30T08:15:12.748 INFO:teuthology.orchestra.run.smithi087.stdout:586 2023-03-30T08:15:12.748 INFO:teuthology.orchestra.run.smithi087.stdout:586.out 2023-03-30T08:15:12.748 INFO:teuthology.orchestra.run.smithi087.stdout:587 2023-03-30T08:15:12.749 INFO:teuthology.orchestra.run.smithi087.stdout:587.out 2023-03-30T08:15:12.749 INFO:teuthology.orchestra.run.smithi087.stdout:588 2023-03-30T08:15:12.749 INFO:teuthology.orchestra.run.smithi087.stdout:588.out 2023-03-30T08:15:12.749 INFO:teuthology.orchestra.run.smithi087.stdout:589 2023-03-30T08:15:12.749 INFO:teuthology.orchestra.run.smithi087.stdout:589.out 2023-03-30T08:15:12.749 INFO:teuthology.orchestra.run.smithi087.stdout:590 2023-03-30T08:15:12.749 INFO:teuthology.orchestra.run.smithi087.stdout:590.out 2023-03-30T08:15:12.750 INFO:teuthology.orchestra.run.smithi087.stdout:591 2023-03-30T08:15:12.750 INFO:teuthology.orchestra.run.smithi087.stdout:591.out 2023-03-30T08:15:12.750 INFO:teuthology.orchestra.run.smithi087.stdout:592 2023-03-30T08:15:12.750 INFO:teuthology.orchestra.run.smithi087.stdout:592.out 2023-03-30T08:15:12.750 INFO:teuthology.orchestra.run.smithi087.stdout:593 2023-03-30T08:15:12.750 INFO:teuthology.orchestra.run.smithi087.stdout:593.out 2023-03-30T08:15:12.750 INFO:teuthology.orchestra.run.smithi087.stdout:594 2023-03-30T08:15:12.750 INFO:teuthology.orchestra.run.smithi087.stdout:594.out 2023-03-30T08:15:12.751 INFO:teuthology.orchestra.run.smithi087.stdout:595 2023-03-30T08:15:12.751 INFO:teuthology.orchestra.run.smithi087.stdout:595.out 2023-03-30T08:15:12.751 INFO:teuthology.orchestra.run.smithi087.stdout:596 2023-03-30T08:15:12.751 INFO:teuthology.orchestra.run.smithi087.stdout:596.out 2023-03-30T08:15:12.751 INFO:teuthology.orchestra.run.smithi087.stdout:597 2023-03-30T08:15:12.751 INFO:teuthology.orchestra.run.smithi087.stdout:597.out 2023-03-30T08:15:12.751 INFO:teuthology.orchestra.run.smithi087.stdout:598 2023-03-30T08:15:12.751 INFO:teuthology.orchestra.run.smithi087.stdout:598.out 2023-03-30T08:15:12.752 INFO:teuthology.orchestra.run.smithi087.stdout:599 2023-03-30T08:15:12.752 INFO:teuthology.orchestra.run.smithi087.stdout:599.out 2023-03-30T08:15:12.752 INFO:teuthology.orchestra.run.smithi087.stdout:600 2023-03-30T08:15:12.752 INFO:teuthology.orchestra.run.smithi087.stdout:600.out 2023-03-30T08:15:12.752 INFO:teuthology.orchestra.run.smithi087.stdout:601 2023-03-30T08:15:12.752 INFO:teuthology.orchestra.run.smithi087.stdout:601.out 2023-03-30T08:15:12.752 INFO:teuthology.orchestra.run.smithi087.stdout:602 2023-03-30T08:15:12.752 INFO:teuthology.orchestra.run.smithi087.stdout:602.out 2023-03-30T08:15:12.753 INFO:teuthology.orchestra.run.smithi087.stdout:603 2023-03-30T08:15:12.753 INFO:teuthology.orchestra.run.smithi087.stdout:603.out 2023-03-30T08:15:12.753 INFO:teuthology.orchestra.run.smithi087.stdout:604 2023-03-30T08:15:12.753 INFO:teuthology.orchestra.run.smithi087.stdout:604.out 2023-03-30T08:15:12.753 INFO:teuthology.orchestra.run.smithi087.stdout:605 2023-03-30T08:15:12.753 INFO:teuthology.orchestra.run.smithi087.stdout:605.out 2023-03-30T08:15:12.753 INFO:teuthology.orchestra.run.smithi087.stdout:606 2023-03-30T08:15:12.754 INFO:teuthology.orchestra.run.smithi087.stdout:606.out 2023-03-30T08:15:12.754 INFO:teuthology.orchestra.run.smithi087.stdout:607 2023-03-30T08:15:12.754 INFO:teuthology.orchestra.run.smithi087.stdout:607.out 2023-03-30T08:15:12.754 INFO:teuthology.orchestra.run.smithi087.stdout:608 2023-03-30T08:15:12.754 INFO:teuthology.orchestra.run.smithi087.stdout:608.out 2023-03-30T08:15:12.754 INFO:teuthology.orchestra.run.smithi087.stdout:609 2023-03-30T08:15:12.754 INFO:teuthology.orchestra.run.smithi087.stdout:609.out 2023-03-30T08:15:12.754 INFO:teuthology.orchestra.run.smithi087.stdout:610 2023-03-30T08:15:12.755 INFO:teuthology.orchestra.run.smithi087.stdout:610.out 2023-03-30T08:15:12.755 INFO:teuthology.orchestra.run.smithi087.stdout:611 2023-03-30T08:15:12.755 INFO:teuthology.orchestra.run.smithi087.stdout:611.out 2023-03-30T08:15:12.755 INFO:teuthology.orchestra.run.smithi087.stdout:612 2023-03-30T08:15:12.755 INFO:teuthology.orchestra.run.smithi087.stdout:612.out 2023-03-30T08:15:12.755 INFO:teuthology.orchestra.run.smithi087.stdout:613 2023-03-30T08:15:12.755 INFO:teuthology.orchestra.run.smithi087.stdout:613.out 2023-03-30T08:15:12.756 INFO:teuthology.orchestra.run.smithi087.stdout:614 2023-03-30T08:15:12.756 INFO:teuthology.orchestra.run.smithi087.stdout:614.out 2023-03-30T08:15:12.756 INFO:teuthology.orchestra.run.smithi087.stdout:615 2023-03-30T08:15:12.756 INFO:teuthology.orchestra.run.smithi087.stdout:615.out 2023-03-30T08:15:12.756 INFO:teuthology.orchestra.run.smithi087.stdout:616 2023-03-30T08:15:12.756 INFO:teuthology.orchestra.run.smithi087.stdout:616.out 2023-03-30T08:15:12.756 INFO:teuthology.orchestra.run.smithi087.stdout:617 2023-03-30T08:15:12.756 INFO:teuthology.orchestra.run.smithi087.stdout:617.out 2023-03-30T08:15:12.757 INFO:teuthology.orchestra.run.smithi087.stdout:618 2023-03-30T08:15:12.757 INFO:teuthology.orchestra.run.smithi087.stdout:618.out 2023-03-30T08:15:12.757 INFO:teuthology.orchestra.run.smithi087.stdout:619 2023-03-30T08:15:12.757 INFO:teuthology.orchestra.run.smithi087.stdout:619.out 2023-03-30T08:15:12.757 INFO:teuthology.orchestra.run.smithi087.stdout:620 2023-03-30T08:15:12.757 INFO:teuthology.orchestra.run.smithi087.stdout:620.out 2023-03-30T08:15:12.757 INFO:teuthology.orchestra.run.smithi087.stdout:621 2023-03-30T08:15:12.757 INFO:teuthology.orchestra.run.smithi087.stdout:621.out 2023-03-30T08:15:12.758 INFO:teuthology.orchestra.run.smithi087.stdout:622 2023-03-30T08:15:12.758 INFO:teuthology.orchestra.run.smithi087.stdout:622.out 2023-03-30T08:15:12.758 INFO:teuthology.orchestra.run.smithi087.stdout:623 2023-03-30T08:15:12.758 INFO:teuthology.orchestra.run.smithi087.stdout:623.out 2023-03-30T08:15:12.758 INFO:teuthology.orchestra.run.smithi087.stdout:624 2023-03-30T08:15:12.758 INFO:teuthology.orchestra.run.smithi087.stdout:624.out 2023-03-30T08:15:12.758 INFO:teuthology.orchestra.run.smithi087.stdout:625 2023-03-30T08:15:12.758 INFO:teuthology.orchestra.run.smithi087.stdout:625.out 2023-03-30T08:15:12.759 INFO:teuthology.orchestra.run.smithi087.stdout:626 2023-03-30T08:15:12.759 INFO:teuthology.orchestra.run.smithi087.stdout:626.out 2023-03-30T08:15:12.759 INFO:teuthology.orchestra.run.smithi087.stdout:627 2023-03-30T08:15:12.759 INFO:teuthology.orchestra.run.smithi087.stdout:627.out 2023-03-30T08:15:12.759 INFO:teuthology.orchestra.run.smithi087.stdout:628 2023-03-30T08:15:12.759 INFO:teuthology.orchestra.run.smithi087.stdout:628.out 2023-03-30T08:15:12.759 INFO:teuthology.orchestra.run.smithi087.stdout:629 2023-03-30T08:15:12.759 INFO:teuthology.orchestra.run.smithi087.stdout:629.out 2023-03-30T08:15:12.760 INFO:teuthology.orchestra.run.smithi087.stdout:630 2023-03-30T08:15:12.760 INFO:teuthology.orchestra.run.smithi087.stdout:630.out 2023-03-30T08:15:12.760 INFO:teuthology.orchestra.run.smithi087.stdout:631 2023-03-30T08:15:12.760 INFO:teuthology.orchestra.run.smithi087.stdout:631.out 2023-03-30T08:15:12.760 INFO:teuthology.orchestra.run.smithi087.stdout:632 2023-03-30T08:15:12.760 INFO:teuthology.orchestra.run.smithi087.stdout:632.out 2023-03-30T08:15:12.760 INFO:teuthology.orchestra.run.smithi087.stdout:633 2023-03-30T08:15:12.760 INFO:teuthology.orchestra.run.smithi087.stdout:633.out 2023-03-30T08:15:12.761 INFO:teuthology.orchestra.run.smithi087.stdout:634 2023-03-30T08:15:12.761 INFO:teuthology.orchestra.run.smithi087.stdout:634.out 2023-03-30T08:15:12.761 INFO:teuthology.orchestra.run.smithi087.stdout:635 2023-03-30T08:15:12.761 INFO:teuthology.orchestra.run.smithi087.stdout:635.out 2023-03-30T08:15:12.761 INFO:teuthology.orchestra.run.smithi087.stdout:636 2023-03-30T08:15:12.761 INFO:teuthology.orchestra.run.smithi087.stdout:636.out 2023-03-30T08:15:12.761 INFO:teuthology.orchestra.run.smithi087.stdout:637 2023-03-30T08:15:12.762 INFO:teuthology.orchestra.run.smithi087.stdout:637.out 2023-03-30T08:15:12.762 INFO:teuthology.orchestra.run.smithi087.stdout:638 2023-03-30T08:15:12.762 INFO:teuthology.orchestra.run.smithi087.stdout:638.out 2023-03-30T08:15:12.762 INFO:teuthology.orchestra.run.smithi087.stdout:639 2023-03-30T08:15:12.762 INFO:teuthology.orchestra.run.smithi087.stdout:639.out 2023-03-30T08:15:12.762 INFO:teuthology.orchestra.run.smithi087.stdout:640 2023-03-30T08:15:12.762 INFO:teuthology.orchestra.run.smithi087.stdout:640.out 2023-03-30T08:15:12.762 INFO:teuthology.orchestra.run.smithi087.stdout:641 2023-03-30T08:15:12.763 INFO:teuthology.orchestra.run.smithi087.stdout:641.out 2023-03-30T08:15:12.763 INFO:teuthology.orchestra.run.smithi087.stdout:642 2023-03-30T08:15:12.763 INFO:teuthology.orchestra.run.smithi087.stdout:642.out 2023-03-30T08:15:12.763 INFO:teuthology.orchestra.run.smithi087.stdout:643 2023-03-30T08:15:12.763 INFO:teuthology.orchestra.run.smithi087.stdout:643.out 2023-03-30T08:15:12.763 INFO:teuthology.orchestra.run.smithi087.stdout:644 2023-03-30T08:15:12.763 INFO:teuthology.orchestra.run.smithi087.stdout:644.out 2023-03-30T08:15:12.764 INFO:teuthology.orchestra.run.smithi087.stdout:645 2023-03-30T08:15:12.764 INFO:teuthology.orchestra.run.smithi087.stdout:645.out 2023-03-30T08:15:12.764 INFO:teuthology.orchestra.run.smithi087.stdout:646 2023-03-30T08:15:12.764 INFO:teuthology.orchestra.run.smithi087.stdout:646.out 2023-03-30T08:15:12.764 INFO:teuthology.orchestra.run.smithi087.stdout:647 2023-03-30T08:15:12.764 INFO:teuthology.orchestra.run.smithi087.stdout:647.out 2023-03-30T08:15:12.765 INFO:teuthology.orchestra.run.smithi087.stdout:648 2023-03-30T08:15:12.765 INFO:teuthology.orchestra.run.smithi087.stdout:648.out 2023-03-30T08:15:12.765 INFO:teuthology.orchestra.run.smithi087.stdout:649 2023-03-30T08:15:12.765 INFO:teuthology.orchestra.run.smithi087.stdout:649.out 2023-03-30T08:15:12.765 INFO:teuthology.orchestra.run.smithi087.stdout:650 2023-03-30T08:15:12.766 INFO:teuthology.orchestra.run.smithi087.stdout:650.out 2023-03-30T08:15:12.766 INFO:teuthology.orchestra.run.smithi087.stdout:651 2023-03-30T08:15:12.766 INFO:teuthology.orchestra.run.smithi087.stdout:651.out 2023-03-30T08:15:12.766 INFO:teuthology.orchestra.run.smithi087.stdout:652 2023-03-30T08:15:12.766 INFO:teuthology.orchestra.run.smithi087.stdout:652.out 2023-03-30T08:15:12.766 INFO:teuthology.orchestra.run.smithi087.stdout:653 2023-03-30T08:15:12.766 INFO:teuthology.orchestra.run.smithi087.stdout:653.out 2023-03-30T08:15:12.767 INFO:teuthology.orchestra.run.smithi087.stdout:654 2023-03-30T08:15:12.767 INFO:teuthology.orchestra.run.smithi087.stdout:654.out 2023-03-30T08:15:12.767 INFO:teuthology.orchestra.run.smithi087.stdout:655 2023-03-30T08:15:12.767 INFO:teuthology.orchestra.run.smithi087.stdout:655.out 2023-03-30T08:15:12.768 INFO:teuthology.orchestra.run.smithi087.stdout:656 2023-03-30T08:15:12.768 INFO:teuthology.orchestra.run.smithi087.stdout:656.out 2023-03-30T08:15:12.768 INFO:teuthology.orchestra.run.smithi087.stdout:657 2023-03-30T08:15:12.768 INFO:teuthology.orchestra.run.smithi087.stdout:657.out 2023-03-30T08:15:12.769 INFO:teuthology.orchestra.run.smithi087.stdout:658 2023-03-30T08:15:12.769 INFO:teuthology.orchestra.run.smithi087.stdout:658.out 2023-03-30T08:15:12.769 INFO:teuthology.orchestra.run.smithi087.stdout:659 2023-03-30T08:15:12.769 INFO:teuthology.orchestra.run.smithi087.stdout:659.out 2023-03-30T08:15:12.769 INFO:teuthology.orchestra.run.smithi087.stdout:660 2023-03-30T08:15:12.770 INFO:teuthology.orchestra.run.smithi087.stdout:660.out 2023-03-30T08:15:12.770 INFO:teuthology.orchestra.run.smithi087.stdout:661 2023-03-30T08:15:12.770 INFO:teuthology.orchestra.run.smithi087.stdout:661.out 2023-03-30T08:15:12.770 INFO:teuthology.orchestra.run.smithi087.stdout:662 2023-03-30T08:15:12.770 INFO:teuthology.orchestra.run.smithi087.stdout:662.out 2023-03-30T08:15:12.771 INFO:teuthology.orchestra.run.smithi087.stdout:663 2023-03-30T08:15:12.771 INFO:teuthology.orchestra.run.smithi087.stdout:663.out 2023-03-30T08:15:12.771 INFO:teuthology.orchestra.run.smithi087.stdout:664 2023-03-30T08:15:12.771 INFO:teuthology.orchestra.run.smithi087.stdout:664.out 2023-03-30T08:15:12.771 INFO:teuthology.orchestra.run.smithi087.stdout:665 2023-03-30T08:15:12.771 INFO:teuthology.orchestra.run.smithi087.stdout:665.out 2023-03-30T08:15:12.771 INFO:teuthology.orchestra.run.smithi087.stdout:666 2023-03-30T08:15:12.772 INFO:teuthology.orchestra.run.smithi087.stdout:666.out 2023-03-30T08:15:12.772 INFO:teuthology.orchestra.run.smithi087.stdout:667 2023-03-30T08:15:12.772 INFO:teuthology.orchestra.run.smithi087.stdout:667.out 2023-03-30T08:15:12.772 INFO:teuthology.orchestra.run.smithi087.stdout:668 2023-03-30T08:15:12.772 INFO:teuthology.orchestra.run.smithi087.stdout:668.out 2023-03-30T08:15:12.772 INFO:teuthology.orchestra.run.smithi087.stdout:669 2023-03-30T08:15:12.772 INFO:teuthology.orchestra.run.smithi087.stdout:669.out 2023-03-30T08:15:12.772 INFO:teuthology.orchestra.run.smithi087.stdout:670 2023-03-30T08:15:12.773 INFO:teuthology.orchestra.run.smithi087.stdout:670.out 2023-03-30T08:15:12.773 INFO:teuthology.orchestra.run.smithi087.stdout:671 2023-03-30T08:15:12.773 INFO:teuthology.orchestra.run.smithi087.stdout:671.out 2023-03-30T08:15:12.773 INFO:teuthology.orchestra.run.smithi087.stdout:672 2023-03-30T08:15:12.773 INFO:teuthology.orchestra.run.smithi087.stdout:672.out 2023-03-30T08:15:12.773 INFO:teuthology.orchestra.run.smithi087.stdout:673 2023-03-30T08:15:12.773 INFO:teuthology.orchestra.run.smithi087.stdout:673.out 2023-03-30T08:15:12.774 INFO:teuthology.orchestra.run.smithi087.stdout:674 2023-03-30T08:15:12.774 INFO:teuthology.orchestra.run.smithi087.stdout:674.out 2023-03-30T08:15:12.774 INFO:teuthology.orchestra.run.smithi087.stdout:675 2023-03-30T08:15:12.774 INFO:teuthology.orchestra.run.smithi087.stdout:675.out 2023-03-30T08:15:12.774 INFO:teuthology.orchestra.run.smithi087.stdout:676 2023-03-30T08:15:12.774 INFO:teuthology.orchestra.run.smithi087.stdout:676.out 2023-03-30T08:15:12.775 INFO:teuthology.orchestra.run.smithi087.stdout:677 2023-03-30T08:15:12.775 INFO:teuthology.orchestra.run.smithi087.stdout:677.out 2023-03-30T08:15:12.775 INFO:teuthology.orchestra.run.smithi087.stdout:678 2023-03-30T08:15:12.775 INFO:teuthology.orchestra.run.smithi087.stdout:678.out 2023-03-30T08:15:12.775 INFO:teuthology.orchestra.run.smithi087.stdout:679 2023-03-30T08:15:12.775 INFO:teuthology.orchestra.run.smithi087.stdout:679.out 2023-03-30T08:15:12.775 INFO:teuthology.orchestra.run.smithi087.stdout:680 2023-03-30T08:15:12.775 INFO:teuthology.orchestra.run.smithi087.stdout:680.out 2023-03-30T08:15:12.776 INFO:teuthology.orchestra.run.smithi087.stdout:681 2023-03-30T08:15:12.776 INFO:teuthology.orchestra.run.smithi087.stdout:681.out 2023-03-30T08:15:12.776 INFO:teuthology.orchestra.run.smithi087.stdout:682 2023-03-30T08:15:12.776 INFO:teuthology.orchestra.run.smithi087.stdout:682.out 2023-03-30T08:15:12.776 INFO:teuthology.orchestra.run.smithi087.stdout:683 2023-03-30T08:15:12.776 INFO:teuthology.orchestra.run.smithi087.stdout:683.out 2023-03-30T08:15:12.776 INFO:teuthology.orchestra.run.smithi087.stdout:684 2023-03-30T08:15:12.777 INFO:teuthology.orchestra.run.smithi087.stdout:684.out 2023-03-30T08:15:12.777 INFO:teuthology.orchestra.run.smithi087.stdout:685 2023-03-30T08:15:12.777 INFO:teuthology.orchestra.run.smithi087.stdout:685.out 2023-03-30T08:15:12.777 INFO:teuthology.orchestra.run.smithi087.stdout:686 2023-03-30T08:15:12.777 INFO:teuthology.orchestra.run.smithi087.stdout:686.out 2023-03-30T08:15:12.777 INFO:teuthology.orchestra.run.smithi087.stdout:687 2023-03-30T08:15:12.778 INFO:teuthology.orchestra.run.smithi087.stdout:687.out 2023-03-30T08:15:12.778 INFO:teuthology.orchestra.run.smithi087.stdout:688 2023-03-30T08:15:12.778 INFO:teuthology.orchestra.run.smithi087.stdout:688.out 2023-03-30T08:15:12.778 INFO:teuthology.orchestra.run.smithi087.stdout:689 2023-03-30T08:15:12.778 INFO:teuthology.orchestra.run.smithi087.stdout:689.out 2023-03-30T08:15:12.778 INFO:teuthology.orchestra.run.smithi087.stdout:690 2023-03-30T08:15:12.778 INFO:teuthology.orchestra.run.smithi087.stdout:690.out 2023-03-30T08:15:12.778 INFO:teuthology.orchestra.run.smithi087.stdout:691 2023-03-30T08:15:12.779 INFO:teuthology.orchestra.run.smithi087.stdout:691.out 2023-03-30T08:15:12.779 INFO:teuthology.orchestra.run.smithi087.stdout:692 2023-03-30T08:15:12.779 INFO:teuthology.orchestra.run.smithi087.stdout:692.out 2023-03-30T08:15:12.779 INFO:teuthology.orchestra.run.smithi087.stdout:693 2023-03-30T08:15:12.779 INFO:teuthology.orchestra.run.smithi087.stdout:693.out 2023-03-30T08:15:12.779 INFO:teuthology.orchestra.run.smithi087.stdout:694 2023-03-30T08:15:12.780 INFO:teuthology.orchestra.run.smithi087.stdout:694.out 2023-03-30T08:15:12.780 INFO:teuthology.orchestra.run.smithi087.stdout:695 2023-03-30T08:15:12.780 INFO:teuthology.orchestra.run.smithi087.stdout:695.out 2023-03-30T08:15:12.780 INFO:teuthology.orchestra.run.smithi087.stdout:696 2023-03-30T08:15:12.780 INFO:teuthology.orchestra.run.smithi087.stdout:696.out 2023-03-30T08:15:12.780 INFO:teuthology.orchestra.run.smithi087.stdout:697 2023-03-30T08:15:12.780 INFO:teuthology.orchestra.run.smithi087.stdout:697.out 2023-03-30T08:15:12.780 INFO:teuthology.orchestra.run.smithi087.stdout:698 2023-03-30T08:15:12.781 INFO:teuthology.orchestra.run.smithi087.stdout:698.out 2023-03-30T08:15:12.781 INFO:teuthology.orchestra.run.smithi087.stdout:699 2023-03-30T08:15:12.781 INFO:teuthology.orchestra.run.smithi087.stdout:699.out 2023-03-30T08:15:12.781 INFO:teuthology.orchestra.run.smithi087.stdout:700 2023-03-30T08:15:12.781 INFO:teuthology.orchestra.run.smithi087.stdout:700.out 2023-03-30T08:15:12.781 INFO:teuthology.orchestra.run.smithi087.stdout:701 2023-03-30T08:15:12.781 INFO:teuthology.orchestra.run.smithi087.stdout:701.out 2023-03-30T08:15:12.782 INFO:teuthology.orchestra.run.smithi087.stdout:702 2023-03-30T08:15:12.782 INFO:teuthology.orchestra.run.smithi087.stdout:702.out 2023-03-30T08:15:12.782 INFO:teuthology.orchestra.run.smithi087.stdout:703 2023-03-30T08:15:12.782 INFO:teuthology.orchestra.run.smithi087.stdout:703.out 2023-03-30T08:15:12.782 INFO:teuthology.orchestra.run.smithi087.stdout:704 2023-03-30T08:15:12.782 INFO:teuthology.orchestra.run.smithi087.stdout:704.out 2023-03-30T08:15:12.782 INFO:teuthology.orchestra.run.smithi087.stdout:705 2023-03-30T08:15:12.782 INFO:teuthology.orchestra.run.smithi087.stdout:705.out 2023-03-30T08:15:12.783 INFO:teuthology.orchestra.run.smithi087.stdout:706 2023-03-30T08:15:12.783 INFO:teuthology.orchestra.run.smithi087.stdout:706.out 2023-03-30T08:15:12.783 INFO:teuthology.orchestra.run.smithi087.stdout:707 2023-03-30T08:15:12.783 INFO:teuthology.orchestra.run.smithi087.stdout:707.out 2023-03-30T08:15:12.783 INFO:teuthology.orchestra.run.smithi087.stdout:708 2023-03-30T08:15:12.783 INFO:teuthology.orchestra.run.smithi087.stdout:708.out 2023-03-30T08:15:12.783 INFO:teuthology.orchestra.run.smithi087.stdout:709 2023-03-30T08:15:12.783 INFO:teuthology.orchestra.run.smithi087.stdout:709.out 2023-03-30T08:15:12.784 INFO:teuthology.orchestra.run.smithi087.stdout:710 2023-03-30T08:15:12.784 INFO:teuthology.orchestra.run.smithi087.stdout:710.out 2023-03-30T08:15:12.784 INFO:teuthology.orchestra.run.smithi087.stdout:711 2023-03-30T08:15:12.784 INFO:teuthology.orchestra.run.smithi087.stdout:711.out 2023-03-30T08:15:12.784 INFO:teuthology.orchestra.run.smithi087.stdout:712 2023-03-30T08:15:12.784 INFO:teuthology.orchestra.run.smithi087.stdout:712.out 2023-03-30T08:15:12.785 INFO:teuthology.orchestra.run.smithi087.stdout:713 2023-03-30T08:15:12.785 INFO:teuthology.orchestra.run.smithi087.stdout:713.out 2023-03-30T08:15:12.785 INFO:teuthology.orchestra.run.smithi087.stdout:714 2023-03-30T08:15:12.785 INFO:teuthology.orchestra.run.smithi087.stdout:714.out 2023-03-30T08:15:12.785 INFO:teuthology.orchestra.run.smithi087.stdout:715 2023-03-30T08:15:12.785 INFO:teuthology.orchestra.run.smithi087.stdout:715.out 2023-03-30T08:15:12.785 INFO:teuthology.orchestra.run.smithi087.stdout:716 2023-03-30T08:15:12.785 INFO:teuthology.orchestra.run.smithi087.stdout:716.out 2023-03-30T08:15:12.786 INFO:teuthology.orchestra.run.smithi087.stdout:717 2023-03-30T08:15:12.786 INFO:teuthology.orchestra.run.smithi087.stdout:717.out 2023-03-30T08:15:12.786 INFO:teuthology.orchestra.run.smithi087.stdout:718 2023-03-30T08:15:12.786 INFO:teuthology.orchestra.run.smithi087.stdout:718.out 2023-03-30T08:15:12.786 INFO:teuthology.orchestra.run.smithi087.stdout:719 2023-03-30T08:15:12.786 INFO:teuthology.orchestra.run.smithi087.stdout:719.out 2023-03-30T08:15:12.786 INFO:teuthology.orchestra.run.smithi087.stdout:720 2023-03-30T08:15:12.786 INFO:teuthology.orchestra.run.smithi087.stdout:720.out 2023-03-30T08:15:12.787 INFO:teuthology.orchestra.run.smithi087.stdout:721 2023-03-30T08:15:12.787 INFO:teuthology.orchestra.run.smithi087.stdout:721.out 2023-03-30T08:15:12.787 INFO:teuthology.orchestra.run.smithi087.stdout:722 2023-03-30T08:15:12.787 INFO:teuthology.orchestra.run.smithi087.stdout:722.out 2023-03-30T08:15:12.787 INFO:teuthology.orchestra.run.smithi087.stdout:723 2023-03-30T08:15:12.787 INFO:teuthology.orchestra.run.smithi087.stdout:723.out 2023-03-30T08:15:12.787 INFO:teuthology.orchestra.run.smithi087.stdout:724 2023-03-30T08:15:12.787 INFO:teuthology.orchestra.run.smithi087.stdout:724.out 2023-03-30T08:15:12.788 INFO:teuthology.orchestra.run.smithi087.stdout:725 2023-03-30T08:15:12.788 INFO:teuthology.orchestra.run.smithi087.stdout:725.out 2023-03-30T08:15:12.788 INFO:teuthology.orchestra.run.smithi087.stdout:726 2023-03-30T08:15:12.788 INFO:teuthology.orchestra.run.smithi087.stdout:726.out 2023-03-30T08:15:12.788 INFO:teuthology.orchestra.run.smithi087.stdout:727 2023-03-30T08:15:12.788 INFO:teuthology.orchestra.run.smithi087.stdout:727.out 2023-03-30T08:15:12.788 INFO:teuthology.orchestra.run.smithi087.stdout:group.list 2023-03-30T08:15:12.788 INFO:teuthology.orchestra.run.smithi087.stdout:Makefile 2023-03-30T08:15:12.790 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-03-30T08:15:13.420 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:15:13.426 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:15:13.502 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:15:13.524 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:15:13.527 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:15:13.532 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:15:13.532 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:15:25.953 INFO:teuthology.orchestra.run.smithi087.stdout:generic/001 12s 2023-03-30T08:15:25.979 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/001 2023-03-30T08:15:25.979 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:15:25.990 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:15:26.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:15:26.314 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-03-30T08:15:27.008 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:15:27.030 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:15:27.032 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:15:27.036 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:15:27.037 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:15:28.469 INFO:teuthology.orchestra.run.smithi087.stdout:generic/002 1s 2023-03-30T08:15:28.490 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/002 2023-03-30T08:15:28.490 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:15:28.500 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:15:28.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:15:28.630 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-03-30T08:15:29.279 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:15:29.299 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:15:29.301 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:15:29.305 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:15:29.306 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:15:40.762 INFO:teuthology.orchestra.run.smithi087.stdout:generic/003 - output mismatch (see /tmp/tmp.dmK5MK8Zk9xfstests-dev/results//generic/003.out.bad) 2023-03-30T08:15:40.777 INFO:teuthology.orchestra.run.smithi087.stdout: --- tests/generic/003.out 2023-03-30 08:12:30.351001783 +0000 2023-03-30T08:15:40.777 INFO:teuthology.orchestra.run.smithi087.stdout: +++ /tmp/tmp.dmK5MK8Zk9xfstests-dev/results//generic/003.out.bad 2023-03-30 08:15:40.754388940 +0000 2023-03-30T08:15:40.777 INFO:teuthology.orchestra.run.smithi087.stdout: @@ -1,2 +1,6 @@ 2023-03-30T08:15:40.777 INFO:teuthology.orchestra.run.smithi087.stdout: QA output created by 003 2023-03-30T08:15:40.777 INFO:teuthology.orchestra.run.smithi087.stdout: +ERROR: access time has not been updated after accessing file1 first time 2023-03-30T08:15:40.777 INFO:teuthology.orchestra.run.smithi087.stdout: +ERROR: access time has not been updated after accessing file2 2023-03-30T08:15:40.778 INFO:teuthology.orchestra.run.smithi087.stdout: +ERROR: access time has not been updated after accessing file3 second time 2023-03-30T08:15:40.778 INFO:teuthology.orchestra.run.smithi087.stdout: +ERROR: access time has not been updated after accessing file3 third time 2023-03-30T08:15:40.778 INFO:teuthology.orchestra.run.smithi087.stdout: Silence is golden 2023-03-30T08:15:40.789 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/003 2023-03-30T08:15:40.789 INFO:teuthology.orchestra.run.smithi087.stdout:Failures: generic/003 2023-03-30T08:15:40.789 INFO:teuthology.orchestra.run.smithi087.stdout:Failed 1 of 1 tests 2023-03-30T08:15:40.800 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:15:40.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T08:15:40.834 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-03-30T08:15:40.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-03-30T08:15:40.835 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-03-30T08:15:41.496 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:15:41.515 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:15:41.517 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:15:41.522 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:15:41.522 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:15:42.424 INFO:teuthology.orchestra.run.smithi087.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-03-30T08:15:42.441 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/004 2023-03-30T08:15:42.441 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/004 2023-03-30T08:15:42.441 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:15:42.453 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:15:42.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:15:42.546 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-03-30T08:15:43.199 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:15:43.218 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:15:43.221 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:15:43.227 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:15:43.227 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:15:43.489 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:15:43.494 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:15:44.554 INFO:teuthology.orchestra.run.smithi087.stdout:generic/005 1s 2023-03-30T08:15:44.576 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/005 2023-03-30T08:15:44.577 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:15:44.587 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:15:44.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:15:44.738 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-03-30T08:15:45.388 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:15:45.405 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:15:45.408 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:15:45.413 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:15:45.413 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:16:12.518 INFO:teuthology.orchestra.run.smithi087.stdout:generic/006 27s 2023-03-30T08:16:12.543 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/006 2023-03-30T08:16:12.543 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:16:12.553 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:16:12.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:16:12.744 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-03-30T08:16:13.431 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:16:13.453 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:16:13.455 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:16:13.461 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:16:13.461 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:16:13.773 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:16:13.777 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:16:43.913 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:16:43.918 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:17:10.718 INFO:teuthology.orchestra.run.smithi087.stdout:generic/007 57s 2023-03-30T08:17:10.741 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/007 2023-03-30T08:17:10.741 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:17:10.750 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:17:10.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:17:10.880 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-03-30T08:17:11.573 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:17:11.592 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:17:11.595 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:17:11.600 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:17:11.600 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:17:12.585 INFO:teuthology.orchestra.run.smithi087.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-30T08:17:12.602 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/008 2023-03-30T08:17:12.602 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/008 2023-03-30T08:17:12.602 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:17:12.612 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:17:12.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:17:12.713 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-03-30T08:17:13.344 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:17:13.363 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:17:13.365 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:17:13.370 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:17:13.371 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:17:14.314 INFO:teuthology.orchestra.run.smithi087.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-30T08:17:14.328 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/009 2023-03-30T08:17:14.329 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/009 2023-03-30T08:17:14.329 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:17:14.338 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:17:14.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:17:14.433 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-03-30T08:17:15.071 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:17:15.091 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:17:15.094 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:17:15.097 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:17:15.097 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:17:15.407 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:17:15.413 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:17:15.910 INFO:teuthology.orchestra.run.smithi087.stdout:generic/010 [not run] /tmp/tmp.dmK5MK8Zk9xfstests-dev/src/dbtest not built 2023-03-30T08:17:15.927 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/010 2023-03-30T08:17:15.928 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/010 2023-03-30T08:17:15.928 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:17:15.939 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:17:16.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:17:16.046 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-03-30T08:17:16.702 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:17:16.722 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:17:16.724 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:17:16.729 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:17:16.730 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:17:45.602 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:17:45.607 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:17:55.794 INFO:teuthology.orchestra.run.smithi087.stdout:generic/011 38s 2023-03-30T08:17:55.822 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/011 2023-03-30T08:17:55.823 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:17:55.835 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:17:56.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:17:56.130 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-03-30T08:17:56.852 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:17:56.870 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:17:56.873 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:17:56.877 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:17:56.877 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:17:57.967 INFO:teuthology.orchestra.run.smithi087.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T08:17:57.985 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/012 2023-03-30T08:17:57.985 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/012 2023-03-30T08:17:57.985 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:17:57.994 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:17:58.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:17:58.151 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-03-30T08:17:58.781 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:17:58.798 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:17:58.801 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:17:58.805 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:17:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:18:16.308 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:18:16.313 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:18:46.801 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:18:46.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:18:59.322 INFO:teuthology.orchestra.run.smithi087.stdout:generic/013 60s 2023-03-30T08:18:59.342 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/013 2023-03-30T08:18:59.342 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:18:59.352 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:18:59.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:18:59.431 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-03-30T08:19:00.032 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:19:00.053 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:19:00.055 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:19:00.058 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:19:00.058 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:19:18.165 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:19:18.170 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:19:49.627 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:19:49.632 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:20:20.415 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:20:20.419 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:20:50.495 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:20:50.500 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:21:20.585 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:21:20.590 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:21:51.633 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:21:51.637 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:22:21.713 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:22:21.717 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:22:51.800 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:22:51.804 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:23:21.929 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:23:21.934 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:23:52.062 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:23:52.067 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:24:06.873 INFO:teuthology.orchestra.run.smithi087.stdout:generic/014 306s 2023-03-30T08:24:06.897 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/014 2023-03-30T08:24:06.897 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:24:06.907 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:06.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:24:06.998 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-03-30T08:24:07.591 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:24:07.604 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:24:07.606 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:24:07.610 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:24:07.611 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:08.363 INFO:teuthology.orchestra.run.smithi087.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T08:24:08.376 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/015 2023-03-30T08:24:08.377 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/015 2023-03-30T08:24:08.377 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:24:08.387 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:08.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:24:08.475 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-03-30T08:24:09.084 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:24:09.101 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:24:09.102 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:24:09.106 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:24:09.106 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:10.094 INFO:teuthology.orchestra.run.smithi087.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T08:24:10.107 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/016 2023-03-30T08:24:10.107 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/016 2023-03-30T08:24:10.107 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:24:10.118 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:10.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:24:10.421 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-03-30T08:24:11.078 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:24:11.095 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:24:11.096 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:24:11.099 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:24:11.099 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:11.852 INFO:teuthology.orchestra.run.smithi087.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-30T08:24:11.865 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/017 2023-03-30T08:24:11.866 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/017 2023-03-30T08:24:11.866 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:24:11.875 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:11.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:24:11.957 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-03-30T08:24:12.532 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:24:12.554 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:24:12.555 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:24:12.557 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:24:12.558 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:13.423 INFO:teuthology.orchestra.run.smithi087.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-03-30T08:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/018 2023-03-30T08:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/018 2023-03-30T08:24:13.487 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:24:13.494 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:13.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:24:13.575 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-03-30T08:24:14.113 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:24:14.128 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:24:14.129 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:24:14.133 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:14.844 INFO:teuthology.orchestra.run.smithi087.stdout:generic/019 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:24:14.859 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/019 2023-03-30T08:24:14.859 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/019 2023-03-30T08:24:14.859 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:24:14.868 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:14.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:24:14.944 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-03-30T08:24:15.501 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:24:15.518 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:24:15.521 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:24:15.526 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:24:15.526 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:22.238 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:24:22.243 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:24:26.839 INFO:teuthology.orchestra.run.smithi087.stdout:generic/020 - output mismatch (see /tmp/tmp.dmK5MK8Zk9xfstests-dev/results//generic/020.out.bad) 2023-03-30T08:24:26.848 INFO:teuthology.orchestra.run.smithi087.stdout: --- tests/generic/020.out 2023-03-30 08:12:30.351001783 +0000 2023-03-30T08:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout: +++ /tmp/tmp.dmK5MK8Zk9xfstests-dev/results//generic/020.out.bad 2023-03-30 08:24:26.834416576 +0000 2023-03-30T08:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout: @@ -47,9 +47,13 @@ 2023-03-30T08:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout: user.snrub="fish2\012" 2023-03-30T08:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout: *** really long value 2023-03-30T08:24:26.849 INFO:teuthology.orchestra.run.smithi087.stdout: -0000000 00 2023-03-30T08:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout: -* 2023-03-30T08:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout: -ATTRSIZE 2023-03-30T08:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout: +attr_set: No space left on device 2023-03-30T08:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout: +Could not set "long_attr" for 2023-03-30T08:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout: +attr_get: No data available 2023-03-30T08:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout: +Could not get "long_attr" for 2023-03-30T08:24:26.850 INFO:teuthology.orchestra.run.smithi087.stdout: +0000000 2023-03-30T08:24:26.851 INFO:teuthology.orchestra.run.smithi087.stdout: +attr_remove: No data available 2023-03-30T08:24:26.851 INFO:teuthology.orchestra.run.smithi087.stdout: +Could not remove "long_attr" for 2023-03-30T08:24:26.851 INFO:teuthology.orchestra.run.smithi087.stdout: *** set/get/remove really long names (expect failure) 2023-03-30T08:24:26.851 INFO:teuthology.orchestra.run.smithi087.stdout: attr_set: Invalid argument 2023-03-30T08:24:26.851 INFO:teuthology.orchestra.run.smithi087.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-03-30T08:24:26.857 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/020 2023-03-30T08:24:26.857 INFO:teuthology.orchestra.run.smithi087.stdout:Failures: generic/020 2023-03-30T08:24:26.857 INFO:teuthology.orchestra.run.smithi087.stdout:Failed 1 of 1 tests 2023-03-30T08:24:26.864 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:27.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T08:24:27.048 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-03-30T08:24:27.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-03-30T08:24:27.049 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-03-30T08:24:27.803 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:24:27.820 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:24:27.821 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:24:27.824 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:24:27.825 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:28.843 INFO:teuthology.orchestra.run.smithi087.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T08:24:28.859 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/021 2023-03-30T08:24:28.859 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/021 2023-03-30T08:24:28.860 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:24:28.867 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:29.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:24:29.150 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-03-30T08:24:29.820 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:24:29.835 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:24:29.837 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:24:29.840 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:24:29.841 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:30.788 INFO:teuthology.orchestra.run.smithi087.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T08:24:30.803 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/022 2023-03-30T08:24:30.804 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/022 2023-03-30T08:24:30.804 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:24:30.813 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:30.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:24:30.978 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-03-30T08:24:31.703 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:24:31.718 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:24:31.721 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:24:31.726 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:24:31.726 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:24:52.532 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:24:52.536 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:25:04.933 INFO:teuthology.orchestra.run.smithi087.stdout:generic/023 32s 2023-03-30T08:25:04.955 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/023 2023-03-30T08:25:04.956 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:25:04.965 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:05.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:25:05.150 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-03-30T08:25:05.909 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:25:05.924 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:25:05.927 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:25:05.930 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:25:05.930 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:06.682 INFO:teuthology.orchestra.run.smithi087.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-03-30T08:25:06.699 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/024 2023-03-30T08:25:06.699 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/024 2023-03-30T08:25:06.699 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:25:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:07.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:25:07.045 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-03-30T08:25:07.665 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:25:07.682 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:25:07.684 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:25:07.688 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:25:07.689 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:08.470 INFO:teuthology.orchestra.run.smithi087.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-03-30T08:25:08.485 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/025 2023-03-30T08:25:08.485 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/025 2023-03-30T08:25:08.485 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:25:08.494 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:08.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:25:08.808 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-03-30T08:25:09.507 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:25:09.521 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:25:09.524 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:25:09.527 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:25:09.527 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:10.397 INFO:teuthology.orchestra.run.smithi087.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-03-30T08:25:10.410 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/026 2023-03-30T08:25:10.411 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/026 2023-03-30T08:25:10.411 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:25:10.418 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:10.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:25:10.512 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-03-30T08:25:11.109 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:25:11.121 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:25:11.122 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:25:11.125 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:25:11.125 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:11.811 INFO:teuthology.orchestra.run.smithi087.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T08:25:11.827 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/027 2023-03-30T08:25:11.828 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/027 2023-03-30T08:25:11.828 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:25:11.835 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:11.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:25:11.905 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-03-30T08:25:12.469 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:25:12.485 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:25:12.486 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:25:12.489 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:25:12.489 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:18.215 INFO:teuthology.orchestra.run.smithi087.stdout:generic/028 6s 2023-03-30T08:25:18.235 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/028 2023-03-30T08:25:18.235 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:25:18.246 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:18.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:25:18.338 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-03-30T08:25:18.909 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:25:18.925 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:25:18.926 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:25:18.929 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:25:18.929 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:23.705 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:25:23.710 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:25:24.474 INFO:teuthology.orchestra.run.smithi087.stdout:generic/029 5s 2023-03-30T08:25:24.498 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/029 2023-03-30T08:25:24.498 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:25:24.506 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:24.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:25:24.531 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-03-30T08:25:25.112 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:25:25.127 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:25:25.129 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:25:25.132 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:25:25.133 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:27.822 INFO:teuthology.orchestra.run.smithi087.stdout:generic/030 2s 2023-03-30T08:25:27.840 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/030 2023-03-30T08:25:27.840 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:25:27.850 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:27.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:25:27.878 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-03-30T08:25:28.460 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:25:28.475 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:25:28.477 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:25:28.480 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:25:28.481 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:29.397 INFO:teuthology.orchestra.run.smithi087.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-03-30T08:25:29.417 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/031 2023-03-30T08:25:29.417 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/031 2023-03-30T08:25:29.417 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:25:29.428 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:29.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:25:29.511 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-03-30T08:25:30.103 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:25:30.117 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:25:30.118 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:25:30.122 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:25:30.123 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:30.844 INFO:teuthology.orchestra.run.smithi087.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T08:25:30.858 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/032 2023-03-30T08:25:30.858 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/032 2023-03-30T08:25:30.858 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:25:30.866 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:30.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:25:30.943 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-03-30T08:25:31.582 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:25:31.596 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:25:31.597 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:25:31.601 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:25:31.601 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:32.474 INFO:teuthology.orchestra.run.smithi087.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-30T08:25:32.487 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/033 2023-03-30T08:25:32.488 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/033 2023-03-30T08:25:32.488 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:25:32.496 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:32.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:25:32.580 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-03-30T08:25:33.122 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:25:33.137 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:25:33.139 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:25:33.142 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:25:33.142 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:33.854 INFO:teuthology.orchestra.run.smithi087.stdout:generic/034 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:25:33.869 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/034 2023-03-30T08:25:33.870 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/034 2023-03-30T08:25:33.870 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:25:33.879 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:33.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:25:33.949 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-03-30T08:25:34.535 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:25:34.549 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:25:34.550 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:25:34.553 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:25:34.553 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:35.378 INFO:teuthology.orchestra.run.smithi087.stdout:generic/035 1s 2023-03-30T08:25:35.411 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/035 2023-03-30T08:25:35.411 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:25:35.420 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:35.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:25:35.591 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-03-30T08:25:36.410 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:25:36.427 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:25:36.429 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:25:36.432 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:25:36.432 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:47.415 INFO:teuthology.orchestra.run.smithi087.stdout:generic/036 11s 2023-03-30T08:25:47.678 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/036 2023-03-30T08:25:47.679 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:25:47.686 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:47.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:25:47.975 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-03-30T08:25:48.643 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:25:48.655 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:25:48.656 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:25:48.660 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:25:48.661 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:25:53.892 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:25:53.895 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:26:00.246 INFO:teuthology.orchestra.run.smithi087.stdout:generic/037 12s 2023-03-30T08:26:00.267 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/037 2023-03-30T08:26:00.268 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:00.275 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:00.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:00.300 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-03-30T08:26:00.858 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:00.875 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:00.876 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:00.883 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:00.883 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:01.792 INFO:teuthology.orchestra.run.smithi087.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T08:26:01.811 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/038 2023-03-30T08:26:01.811 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/038 2023-03-30T08:26:01.811 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:01.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:01.909 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-03-30T08:26:02.563 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:02.582 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:02.584 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:02.589 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:02.589 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:03.478 INFO:teuthology.orchestra.run.smithi087.stdout:generic/039 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:26:03.494 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/039 2023-03-30T08:26:03.494 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/039 2023-03-30T08:26:03.494 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:03.506 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:03.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:03.617 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-03-30T08:26:04.269 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:04.287 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:04.290 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:04.296 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:04.296 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:05.184 INFO:teuthology.orchestra.run.smithi087.stdout:generic/040 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:26:05.203 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/040 2023-03-30T08:26:05.203 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/040 2023-03-30T08:26:05.204 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:05.213 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:05.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:05.313 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-03-30T08:26:05.962 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:05.982 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:05.985 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:05.989 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:05.989 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:06.884 INFO:teuthology.orchestra.run.smithi087.stdout:generic/041 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:26:06.902 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/041 2023-03-30T08:26:06.903 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/041 2023-03-30T08:26:06.903 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:06.916 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:07.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:07.005 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-03-30T08:26:07.658 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:07.678 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:07.680 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:07.686 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:07.686 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:08.702 INFO:teuthology.orchestra.run.smithi087.stdout:generic/042 [not run] ceph does not support shutdown 2023-03-30T08:26:08.778 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/042 2023-03-30T08:26:08.778 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/042 2023-03-30T08:26:08.779 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:08.790 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:08.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:08.856 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-03-30T08:26:09.493 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:09.513 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:09.515 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:09.519 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:09.519 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:10.556 INFO:teuthology.orchestra.run.smithi087.stdout:generic/043 [not run] ceph does not support shutdown 2023-03-30T08:26:10.633 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/043 2023-03-30T08:26:10.634 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/043 2023-03-30T08:26:10.634 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:10.645 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:10.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:10.739 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-03-30T08:26:11.424 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:11.442 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:11.444 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:11.448 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:11.449 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:12.501 INFO:teuthology.orchestra.run.smithi087.stdout:generic/044 [not run] ceph does not support shutdown 2023-03-30T08:26:12.566 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/044 2023-03-30T08:26:12.566 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/044 2023-03-30T08:26:12.567 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:12.577 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:12.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:12.658 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-03-30T08:26:13.296 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:13.317 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:13.320 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:13.324 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:13.325 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:14.420 INFO:teuthology.orchestra.run.smithi087.stdout:generic/045 [not run] ceph does not support shutdown 2023-03-30T08:26:14.486 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/045 2023-03-30T08:26:14.486 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/045 2023-03-30T08:26:14.486 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:14.497 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:14.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:14.600 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-03-30T08:26:15.261 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:15.280 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:15.282 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:15.289 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:15.289 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:16.376 INFO:teuthology.orchestra.run.smithi087.stdout:generic/046 [not run] ceph does not support shutdown 2023-03-30T08:26:16.445 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/046 2023-03-30T08:26:16.445 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/046 2023-03-30T08:26:16.445 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:16.456 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:16.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:16.529 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-03-30T08:26:17.162 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:17.181 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:17.183 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:17.188 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:17.188 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:18.259 INFO:teuthology.orchestra.run.smithi087.stdout:generic/047 [not run] ceph does not support shutdown 2023-03-30T08:26:18.310 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/047 2023-03-30T08:26:18.310 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/047 2023-03-30T08:26:18.311 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:18.322 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:18.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:18.408 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-03-30T08:26:19.063 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:19.081 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:19.084 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:19.088 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:19.088 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:20.128 INFO:teuthology.orchestra.run.smithi087.stdout:generic/048 [not run] ceph does not support shutdown 2023-03-30T08:26:20.205 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/048 2023-03-30T08:26:20.205 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/048 2023-03-30T08:26:20.206 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:20.216 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:20.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:20.299 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-03-30T08:26:20.968 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:20.988 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:20.990 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:20.993 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:20.994 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:22.067 INFO:teuthology.orchestra.run.smithi087.stdout:generic/049 [not run] ceph does not support shutdown 2023-03-30T08:26:22.138 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/049 2023-03-30T08:26:22.138 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/049 2023-03-30T08:26:22.138 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:22.151 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:22.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:22.238 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-03-30T08:26:22.877 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:22.897 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:22.899 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:22.904 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:22.904 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:23.959 INFO:teuthology.orchestra.run.smithi087.stdout:generic/050 [not run] ceph does not support shutdown 2023-03-30T08:26:24.034 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/050 2023-03-30T08:26:24.034 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/050 2023-03-30T08:26:24.034 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:24.047 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:24.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:24.157 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-03-30T08:26:24.801 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:24.819 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:24.822 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:24.827 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:24.827 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:25.089 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:26:25.096 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:26:25.857 INFO:teuthology.orchestra.run.smithi087.stdout:generic/051 [not run] ceph does not support shutdown 2023-03-30T08:26:25.872 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/051 2023-03-30T08:26:25.873 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/051 2023-03-30T08:26:25.873 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:25.884 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:25.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:25.953 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-03-30T08:26:26.562 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:26.582 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:26.585 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:26.590 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:26.590 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:27.664 INFO:teuthology.orchestra.run.smithi087.stdout:generic/052 [not run] ceph does not support shutdown 2023-03-30T08:26:27.733 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/052 2023-03-30T08:26:27.733 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/052 2023-03-30T08:26:27.733 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:27.744 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:27.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:27.825 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-03-30T08:26:28.488 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:28.508 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:28.510 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:28.514 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:28.514 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:30.479 INFO:teuthology.orchestra.run.smithi087.stdout:generic/053 2s 2023-03-30T08:26:30.528 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/053 2023-03-30T08:26:30.528 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:30.534 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:30.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:30.561 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-03-30T08:26:31.192 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:31.211 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:31.214 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:31.219 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:31.220 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:32.299 INFO:teuthology.orchestra.run.smithi087.stdout:generic/054 [not run] ceph does not support shutdown 2023-03-30T08:26:32.354 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/054 2023-03-30T08:26:32.355 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/054 2023-03-30T08:26:32.355 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:32.365 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:32.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:32.462 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-03-30T08:26:33.104 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:33.123 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:33.125 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:33.129 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:33.130 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:34.246 INFO:teuthology.orchestra.run.smithi087.stdout:generic/055 [not run] ceph does not support shutdown 2023-03-30T08:26:34.334 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/055 2023-03-30T08:26:34.335 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/055 2023-03-30T08:26:34.335 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:34.345 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:34.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:34.425 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-03-30T08:26:35.060 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:35.079 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:35.082 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:35.087 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:35.087 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:35.984 INFO:teuthology.orchestra.run.smithi087.stdout:generic/056 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:26:36.001 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/056 2023-03-30T08:26:36.002 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/056 2023-03-30T08:26:36.002 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:36.013 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:36.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:36.109 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-03-30T08:26:36.776 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:36.795 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:36.798 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:36.804 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:36.804 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:37.714 INFO:teuthology.orchestra.run.smithi087.stdout:generic/057 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:26:37.730 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/057 2023-03-30T08:26:37.730 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/057 2023-03-30T08:26:37.730 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:37.740 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:37.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:37.836 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-03-30T08:26:38.487 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:38.507 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:38.510 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:38.515 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:38.515 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:39.632 INFO:teuthology.orchestra.run.smithi087.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T08:26:39.648 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/058 2023-03-30T08:26:39.648 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/058 2023-03-30T08:26:39.648 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:39.660 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:40.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:40.025 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-03-30T08:26:40.662 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:40.680 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:40.682 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:40.688 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:40.688 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:41.559 INFO:teuthology.orchestra.run.smithi087.stdout:generic/059 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:26:41.576 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/059 2023-03-30T08:26:41.577 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/059 2023-03-30T08:26:41.577 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:41.588 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:41.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:41.673 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-03-30T08:26:42.316 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:42.338 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:42.340 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:42.345 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:42.345 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:43.426 INFO:teuthology.orchestra.run.smithi087.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T08:26:43.441 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/060 2023-03-30T08:26:43.442 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/060 2023-03-30T08:26:43.442 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:43.453 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:43.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:43.800 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-03-30T08:26:44.486 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:44.507 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:44.509 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:44.514 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:44.514 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:45.575 INFO:teuthology.orchestra.run.smithi087.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T08:26:45.594 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/061 2023-03-30T08:26:45.595 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/061 2023-03-30T08:26:45.595 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:45.606 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:45.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:45.950 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-03-30T08:26:46.608 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:46.629 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:46.632 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:46.637 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:46.637 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:51.168 INFO:teuthology.orchestra.run.smithi087.stdout:generic/062 5s 2023-03-30T08:26:51.216 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/062 2023-03-30T08:26:51.216 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:51.225 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:51.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:51.248 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-03-30T08:26:51.910 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:51.929 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:51.932 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:51.936 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:51.937 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:53.142 INFO:teuthology.orchestra.run.smithi087.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T08:26:53.159 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/063 2023-03-30T08:26:53.159 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/063 2023-03-30T08:26:53.160 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:53.172 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:53.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:53.379 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-03-30T08:26:54.150 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:54.173 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:54.175 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:54.179 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:54.179 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:55.071 INFO:teuthology.orchestra.run.smithi087.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-30T08:26:55.089 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/064 2023-03-30T08:26:55.089 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/064 2023-03-30T08:26:55.089 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:55.100 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:55.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:55.186 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-03-30T08:26:55.416 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:26:55.420 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:26:55.824 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:55.842 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:55.845 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:55.849 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:55.850 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:56.751 INFO:teuthology.orchestra.run.smithi087.stdout:generic/065 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:26:56.770 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/065 2023-03-30T08:26:56.770 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/065 2023-03-30T08:26:56.770 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:56.779 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:56.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:56.880 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-03-30T08:26:57.488 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:57.510 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:57.512 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:57.517 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:57.518 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:58.424 INFO:teuthology.orchestra.run.smithi087.stdout:generic/066 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:26:58.440 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/066 2023-03-30T08:26:58.441 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/066 2023-03-30T08:26:58.441 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:26:58.453 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:26:58.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:26:58.540 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-03-30T08:26:59.214 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:26:59.234 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:26:59.237 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:26:59.240 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:26:59.240 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:27:00.168 INFO:teuthology.orchestra.run.smithi087.stdout:generic/067 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:27:00.186 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/067 2023-03-30T08:27:00.187 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/067 2023-03-30T08:27:00.187 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:27:00.197 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:27:00.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:27:00.281 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-03-30T08:27:00.919 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:27:00.938 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:27:00.940 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:27:00.945 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:27:00.945 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:27:01.878 INFO:teuthology.orchestra.run.smithi087.stdout:generic/068 [not run] ceph does not support freezing 2023-03-30T08:27:01.894 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/068 2023-03-30T08:27:01.894 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/068 2023-03-30T08:27:01.894 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:27:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:27:01.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:27:01.997 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-03-30T08:27:02.642 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:27:02.661 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:27:02.664 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:27:02.668 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:27:02.668 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:27:23.242 INFO:teuthology.orchestra.run.smithi087.stdout:generic/069 20s 2023-03-30T08:27:23.278 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/069 2023-03-30T08:27:23.279 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:27:23.304 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:27:23.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:27:23.336 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-03-30T08:27:23.940 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:27:23.959 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:27:23.961 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:27:23.965 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:27:23.965 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:27:25.527 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:27:25.533 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:27:55.723 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:27:55.726 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:27:57.674 INFO:teuthology.orchestra.run.smithi087.stdout:generic/070 33s 2023-03-30T08:27:57.692 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/070 2023-03-30T08:27:57.692 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:27:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:27:57.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:27:57.961 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-03-30T08:27:58.804 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:27:58.824 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:27:58.825 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:27:58.827 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:27:58.828 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:27:59.565 INFO:teuthology.orchestra.run.smithi087.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-30T08:27:59.577 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/071 2023-03-30T08:27:59.577 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/071 2023-03-30T08:27:59.577 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:27:59.588 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:27:59.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:27:59.667 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-03-30T08:28:00.263 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:28:00.279 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:28:00.281 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:28:00.285 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:28:00.285 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:28:01.212 INFO:teuthology.orchestra.run.smithi087.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-03-30T08:28:01.226 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/072 2023-03-30T08:28:01.226 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/072 2023-03-30T08:28:01.227 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:28:01.234 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:28:01.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:28:01.319 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-03-30T08:28:01.895 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:28:01.911 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:28:01.913 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:28:01.917 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:28:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:28:02.665 INFO:teuthology.orchestra.run.smithi087.stdout:generic/073 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:28:02.679 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/073 2023-03-30T08:28:02.679 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/073 2023-03-30T08:28:02.679 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:28:02.687 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:28:02.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:28:02.766 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-03-30T08:28:03.361 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:28:03.382 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:28:03.383 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:28:03.387 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:28:03.387 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:28:25.884 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:28:25.889 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:28:47.741 INFO:teuthology.orchestra.run.smithi087.stdout:generic/074 44s 2023-03-30T08:28:47.761 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/074 2023-03-30T08:28:47.762 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:28:47.769 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:28:48.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:28:48.967 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-03-30T08:28:49.615 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:28:49.628 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:28:49.631 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:28:49.635 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:28:49.635 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:28:55.987 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:28:55.990 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:29:23.936 INFO:teuthology.orchestra.run.smithi087.stdout:generic/075 34s 2023-03-30T08:29:24.893 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/075 2023-03-30T08:29:24.894 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:29:24.901 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:25.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:29:25.167 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-03-30T08:29:25.878 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:29:25.893 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:29:25.896 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:29:25.899 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:29:25.899 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:26.587 INFO:teuthology.orchestra.run.smithi087.stdout:generic/076 [not run] require 172.21.15.87:6789:/scratch to be local device 2023-03-30T08:29:26.601 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/076 2023-03-30T08:29:26.602 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/076 2023-03-30T08:29:26.602 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:29:26.609 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:26.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:29:26.673 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-03-30T08:29:27.221 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:29:27.235 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:29:27.236 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:29:27.240 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:29:27.240 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:29.157 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:29:29.161 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:29:29.211 INFO:teuthology.orchestra.run.smithi087.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T08:29:29.226 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/077 2023-03-30T08:29:29.227 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/077 2023-03-30T08:29:29.227 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:29:29.229 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T08:29:29.224+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39133) UID: 0 2023-03-30T08:29:29.229 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T08:29:29.224+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39133) UID: 0 2023-03-30T08:29:29.234 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:29.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:29:29.588 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-03-30T08:29:30.255 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:29:30.269 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:29:30.270 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:29:30.275 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:29:30.275 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:31.042 INFO:teuthology.orchestra.run.smithi087.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-03-30T08:29:31.062 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/078 2023-03-30T08:29:31.062 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/078 2023-03-30T08:29:31.062 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:29:31.069 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:31.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:29:31.391 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-03-30T08:29:32.072 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:29:32.085 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:29:32.086 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:29:32.091 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:29:32.091 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:32.837 INFO:teuthology.orchestra.run.smithi087.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-03-30T08:29:32.854 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/079 2023-03-30T08:29:32.854 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/079 2023-03-30T08:29:32.855 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:29:32.862 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:32.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:29:32.967 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-03-30T08:29:33.537 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:29:33.552 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:29:33.553 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:29:33.558 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:29:33.558 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:36.390 INFO:teuthology.orchestra.run.smithi087.stdout:generic/080 3s 2023-03-30T08:29:36.405 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/080 2023-03-30T08:29:36.406 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:29:36.415 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:36.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:29:36.502 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-03-30T08:29:37.090 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:29:37.113 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:29:37.114 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:29:37.117 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:29:37.117 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:37.950 INFO:teuthology.orchestra.run.smithi087.stdout:generic/081 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:29:37.966 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/081 2023-03-30T08:29:37.966 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/081 2023-03-30T08:29:37.966 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:29:37.973 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:38.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:29:38.055 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-03-30T08:29:38.646 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:29:38.658 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:29:38.659 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:29:38.662 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:29:38.663 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:39.417 INFO:teuthology.orchestra.run.smithi087.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T08:29:39.432 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/082 2023-03-30T08:29:39.433 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/082 2023-03-30T08:29:39.433 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:29:39.442 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:39.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:29:39.520 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-03-30T08:29:40.077 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:29:40.088 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:29:40.090 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:29:40.092 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:29:40.093 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:40.839 INFO:teuthology.orchestra.run.smithi087.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T08:29:40.853 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/083 2023-03-30T08:29:40.853 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/083 2023-03-30T08:29:40.853 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:29:40.861 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:40.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:29:40.936 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-03-30T08:29:41.498 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:29:41.510 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:29:41.512 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:29:41.515 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:29:41.515 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:48.018 INFO:teuthology.orchestra.run.smithi087.stdout:generic/084 7s 2023-03-30T08:29:48.055 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/084 2023-03-30T08:29:48.056 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:29:48.066 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:48.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:29:48.098 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-03-30T08:29:48.665 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:29:48.677 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:29:48.678 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:29:48.683 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:29:48.683 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:49.428 INFO:teuthology.orchestra.run.smithi087.stdout:generic/085 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:29:49.442 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/085 2023-03-30T08:29:49.442 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/085 2023-03-30T08:29:49.442 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:29:49.450 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:49.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:29:49.533 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-03-30T08:29:50.133 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:29:50.149 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:29:50.151 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:29:50.156 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:29:50.156 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:50.958 INFO:teuthology.orchestra.run.smithi087.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T08:29:50.969 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/086 2023-03-30T08:29:50.969 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/086 2023-03-30T08:29:50.969 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:29:50.979 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:51.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:29:51.047 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-03-30T08:29:51.709 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:29:51.723 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:29:51.725 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:29:51.727 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:29:51.728 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:52.656 INFO:teuthology.orchestra.run.smithi087.stdout:generic/087 0s 2023-03-30T08:29:52.678 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/087 2023-03-30T08:29:52.679 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:29:52.688 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:52.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:29:52.915 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-03-30T08:29:53.682 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:29:53.705 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:29:53.706 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:29:53.710 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:29:53.710 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:54.476 INFO:teuthology.orchestra.run.smithi087.stdout:generic/088 0s 2023-03-30T08:29:54.501 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/088 2023-03-30T08:29:54.501 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:29:54.512 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:29:54.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:29:54.705 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-03-30T08:29:55.462 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:29:55.475 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:29:55.478 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:29:55.483 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:29:55.483 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:33:24.741 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:33:24.747 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:33:55.887 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:33:55.892 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:34:25.956 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:34:25.961 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:34:56.114 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:34:56.119 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:34:56.187 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T08:34:56.181+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39158) UID: 0 2023-03-30T08:34:56.187 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T08:34:56.181+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39158) UID: 0 2023-03-30T08:37:47.780 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:37:47.786 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:38:17.848 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:38:17.854 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:38:47.917 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:38:47.923 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:39:18.029 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:39:18.035 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:39:48.325 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:39:48.332 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:40:19.356 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:40:19.363 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:40:19.401 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T08:40:19.396+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39185) UID: 0 2023-03-30T08:40:19.401 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T08:40:19.396+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 39185) UID: 0 2023-03-30T08:42:02.392 INFO:teuthology.orchestra.run.smithi087.stdout:generic/089 727s 2023-03-30T08:42:02.751 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/089 2023-03-30T08:42:02.752 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:42:02.761 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:42:03.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:42:03.223 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-03-30T08:42:03.899 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:42:03.918 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:42:03.921 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:42:03.926 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:42:03.927 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:42:04.854 INFO:teuthology.orchestra.run.smithi087.stdout:generic/090 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:42:04.872 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/090 2023-03-30T08:42:04.872 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/090 2023-03-30T08:42:04.873 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:42:04.885 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:42:04.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:42:04.968 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-03-30T08:42:05.601 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:42:05.620 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:42:05.622 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:42:05.628 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:42:05.628 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:43:07.709 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:43:07.714 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:43:37.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:43:37.790 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:44:08.165 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:44:08.169 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:44:38.471 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:44:38.477 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:45:07.069 INFO:teuthology.orchestra.run.smithi087.stdout:generic/091 182s 2023-03-30T08:45:07.160 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/091 2023-03-30T08:45:07.161 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:45:07.173 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:07.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:45:07.421 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-03-30T08:45:08.389 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:45:08.407 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:45:08.410 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:45:08.415 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:45:08.415 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:08.652 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:45:08.657 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:45:09.295 INFO:teuthology.orchestra.run.smithi087.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T08:45:09.313 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/092 2023-03-30T08:45:09.313 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/092 2023-03-30T08:45:09.313 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:45:09.324 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:09.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:45:09.416 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-03-30T08:45:10.120 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:45:10.140 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:45:10.142 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:45:10.147 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:45:10.147 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:11.973 INFO:teuthology.orchestra.run.smithi087.stdout:generic/093 1s 2023-03-30T08:45:11.998 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/093 2023-03-30T08:45:11.999 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:45:12.009 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:12.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:45:12.389 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-03-30T08:45:13.076 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:45:13.096 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:45:13.098 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:45:13.103 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:45:13.103 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:14.046 INFO:teuthology.orchestra.run.smithi087.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-30T08:45:14.063 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/094 2023-03-30T08:45:14.063 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/094 2023-03-30T08:45:14.063 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:45:14.076 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:14.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:45:14.333 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-03-30T08:45:15.133 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:45:15.152 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:45:15.155 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:45:15.159 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:45:15.159 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:31.449 INFO:teuthology.orchestra.run.smithi087.stdout:generic/095 16s 2023-03-30T08:45:31.493 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/095 2023-03-30T08:45:31.494 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:45:31.506 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:31.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:45:31.559 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-03-30T08:45:32.318 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:45:32.339 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:45:32.341 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:45:32.346 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:45:32.346 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:33.360 INFO:teuthology.orchestra.run.smithi087.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-30T08:45:33.373 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/096 2023-03-30T08:45:33.374 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/096 2023-03-30T08:45:33.374 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:45:33.381 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:33.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:45:33.489 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-03-30T08:45:34.138 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:45:34.156 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:45:34.158 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:45:34.163 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:45:34.163 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:35.677 INFO:teuthology.orchestra.run.smithi087.stdout:generic/097 1s 2023-03-30T08:45:35.698 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/097 2023-03-30T08:45:35.698 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:45:35.705 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:35.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:45:35.786 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-03-30T08:45:36.460 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:45:36.480 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:45:36.483 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:45:36.488 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:45:36.488 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:38.728 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:45:38.735 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:45:40.311 INFO:teuthology.orchestra.run.smithi087.stdout:generic/098 4s 2023-03-30T08:45:40.336 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/098 2023-03-30T08:45:40.337 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:45:40.347 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:40.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:45:40.383 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-03-30T08:45:41.050 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:45:41.069 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:45:41.071 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:45:41.076 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:45:41.076 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:43.396 INFO:teuthology.orchestra.run.smithi087.stdout:generic/099 2s 2023-03-30T08:45:43.418 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/099 2023-03-30T08:45:43.418 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:45:43.429 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:45:43.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:45:43.755 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-03-30T08:45:44.523 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:45:44.543 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:45:44.545 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:45:44.550 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:45:44.550 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:09.272 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:46:09.277 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:46:25.618 INFO:teuthology.orchestra.run.smithi087.stdout:generic/100 41s 2023-03-30T08:46:25.641 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/100 2023-03-30T08:46:25.641 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:46:25.650 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:27.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:46:27.334 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-03-30T08:46:27.975 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:46:27.995 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:46:27.997 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:46:28.002 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:46:28.002 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:28.857 INFO:teuthology.orchestra.run.smithi087.stdout:generic/101 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:46:28.874 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/101 2023-03-30T08:46:28.874 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/101 2023-03-30T08:46:28.875 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:46:28.885 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:28.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:46:28.981 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-03-30T08:46:29.620 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:46:29.641 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:46:29.644 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:46:29.650 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:46:29.650 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:30.463 INFO:teuthology.orchestra.run.smithi087.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T08:46:30.481 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/102 2023-03-30T08:46:30.482 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/102 2023-03-30T08:46:30.482 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:46:30.492 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:30.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:46:30.576 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-03-30T08:46:31.227 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:46:31.245 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:46:31.247 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:46:31.252 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:46:31.252 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:32.178 INFO:teuthology.orchestra.run.smithi087.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T08:46:32.197 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/103 2023-03-30T08:46:32.197 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/103 2023-03-30T08:46:32.197 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:46:32.210 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:32.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:46:32.569 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-03-30T08:46:33.247 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:46:33.266 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:46:33.268 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:46:33.273 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:46:33.273 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:34.211 INFO:teuthology.orchestra.run.smithi087.stdout:generic/104 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:46:34.229 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/104 2023-03-30T08:46:34.229 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/104 2023-03-30T08:46:34.229 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:46:34.238 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:34.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:46:34.323 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-03-30T08:46:34.975 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:46:34.998 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:46:35.001 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:46:35.005 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:46:35.005 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:36.768 INFO:teuthology.orchestra.run.smithi087.stdout:generic/105 1s 2023-03-30T08:46:36.799 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/105 2023-03-30T08:46:36.799 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:46:36.814 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:36.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:46:36.847 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-03-30T08:46:37.485 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:46:37.506 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:46:37.509 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:46:37.512 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:46:37.513 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:38.480 INFO:teuthology.orchestra.run.smithi087.stdout:generic/106 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:46:38.499 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/106 2023-03-30T08:46:38.499 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/106 2023-03-30T08:46:38.499 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:46:38.511 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:38.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:46:38.617 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-03-30T08:46:39.265 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:46:39.284 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:46:39.286 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:46:39.292 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:46:39.292 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:39.340 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:46:39.343 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:46:40.236 INFO:teuthology.orchestra.run.smithi087.stdout:generic/107 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:46:40.255 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/107 2023-03-30T08:46:40.255 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/107 2023-03-30T08:46:40.255 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:46:40.267 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:40.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:46:40.362 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-03-30T08:46:41.015 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:46:41.035 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:46:41.037 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:46:41.041 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:46:41.042 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:42.183 INFO:teuthology.orchestra.run.smithi087.stdout:generic/108 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T08:46:42.201 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/108 2023-03-30T08:46:42.201 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/108 2023-03-30T08:46:42.201 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:46:42.210 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:42.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:46:42.292 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-03-30T08:46:42.944 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:46:42.964 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:46:42.967 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:46:42.971 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:46:42.971 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:53.318 INFO:teuthology.orchestra.run.smithi087.stdout:generic/109 10s 2023-03-30T08:46:53.340 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/109 2023-03-30T08:46:53.340 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:46:53.352 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:46:53.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:46:53.386 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-03-30T08:46:54.061 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:46:54.080 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:46:54.082 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:46:54.087 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:46:54.087 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:47:09.472 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:47:09.475 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:47:20.353 INFO:teuthology.orchestra.run.smithi087.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T08:47:20.371 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/110 2023-03-30T08:47:20.372 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/110 2023-03-30T08:47:20.372 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:47:20.382 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:47:20.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:47:20.718 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-03-30T08:47:21.383 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:47:21.402 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:47:21.404 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:47:21.408 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:47:21.408 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:47:22.357 INFO:teuthology.orchestra.run.smithi087.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T08:47:22.374 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/111 2023-03-30T08:47:22.374 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/111 2023-03-30T08:47:22.375 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:47:22.384 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:47:22.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:47:22.697 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-03-30T08:47:23.387 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:47:23.407 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:47:23.409 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:47:23.413 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:47:23.413 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:47:40.650 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:47:40.655 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:47:53.090 INFO:teuthology.orchestra.run.smithi087.stdout:generic/112 30s 2023-03-30T08:47:53.111 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/112 2023-03-30T08:47:53.112 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:47:53.121 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:47:53.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:47:53.392 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-03-30T08:47:54.132 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:47:54.151 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:47:54.154 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:47:54.158 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:47:54.158 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:10.722 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:48:10.729 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:48:15.094 INFO:teuthology.orchestra.run.smithi087.stdout:generic/113 21s 2023-03-30T08:48:15.120 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/113 2023-03-30T08:48:15.121 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:48:15.132 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:15.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:48:15.475 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-03-30T08:48:16.326 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:48:16.346 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:48:16.349 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:48:16.354 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:48:16.355 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:17.341 INFO:teuthology.orchestra.run.smithi087.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-03-30T08:48:17.359 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/114 2023-03-30T08:48:17.360 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/114 2023-03-30T08:48:17.360 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:48:17.372 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:17.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:48:17.460 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-03-30T08:48:18.097 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:48:18.116 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:48:18.118 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:48:18.123 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:48:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:19.068 INFO:teuthology.orchestra.run.smithi087.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T08:48:19.087 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/115 2023-03-30T08:48:19.087 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/115 2023-03-30T08:48:19.088 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:48:19.100 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:19.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:48:19.403 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-03-30T08:48:20.149 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:48:20.168 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:48:20.170 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:48:20.175 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:48:20.175 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:21.129 INFO:teuthology.orchestra.run.smithi087.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T08:48:21.145 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/116 2023-03-30T08:48:21.146 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/116 2023-03-30T08:48:21.146 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:48:21.157 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:21.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:48:21.567 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-03-30T08:48:22.240 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:48:22.259 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:48:22.261 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:48:22.266 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:48:22.266 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:36.802 INFO:teuthology.orchestra.run.smithi087.stdout:generic/117 14s 2023-03-30T08:48:36.830 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/117 2023-03-30T08:48:36.831 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:48:36.840 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:36.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:48:36.880 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-03-30T08:48:37.546 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:48:37.566 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:48:37.569 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:48:37.574 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:48:37.574 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:39.252 INFO:teuthology.orchestra.run.smithi087.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T08:48:39.274 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/118 2023-03-30T08:48:39.274 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/118 2023-03-30T08:48:39.275 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:48:39.286 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:39.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:48:39.690 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-03-30T08:48:40.302 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:48:40.324 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:48:40.327 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:48:40.332 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:48:40.332 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:40.804 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:48:40.811 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:48:41.251 INFO:teuthology.orchestra.run.smithi087.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T08:48:41.269 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/119 2023-03-30T08:48:41.269 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/119 2023-03-30T08:48:41.270 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:48:41.280 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:41.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:48:41.511 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-03-30T08:48:42.290 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:48:42.309 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:48:42.311 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:48:42.317 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:48:42.317 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:59.107 INFO:teuthology.orchestra.run.smithi087.stdout:generic/120 17s 2023-03-30T08:48:59.125 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/120 2023-03-30T08:48:59.126 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:48:59.133 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:48:59.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:48:59.165 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-03-30T08:48:59.811 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:48:59.829 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:48:59.831 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:48:59.835 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:48:59.835 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:49:00.798 INFO:teuthology.orchestra.run.smithi087.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-30T08:49:00.814 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/121 2023-03-30T08:49:00.814 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/121 2023-03-30T08:49:00.814 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:49:00.826 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:49:01.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:49:01.185 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-03-30T08:49:01.855 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:49:01.875 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:49:01.878 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:49:01.882 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:49:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:49:02.853 INFO:teuthology.orchestra.run.smithi087.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-30T08:49:02.872 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/122 2023-03-30T08:49:02.872 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/122 2023-03-30T08:49:02.872 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:49:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:49:03.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:49:03.035 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-03-30T08:49:03.868 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:49:03.885 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:49:03.887 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:49:03.893 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:49:03.893 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:49:05.414 INFO:teuthology.orchestra.run.smithi087.stdout:generic/123 1s 2023-03-30T08:49:05.439 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/123 2023-03-30T08:49:05.440 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:49:05.451 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:49:05.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:49:05.713 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-03-30T08:49:06.467 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:49:06.486 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:49:06.489 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:49:06.493 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:49:06.493 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:49:10.870 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:49:10.873 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:49:13.331 INFO:teuthology.orchestra.run.smithi087.stdout:generic/124 7s 2023-03-30T08:49:13.368 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/124 2023-03-30T08:49:13.368 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:49:13.391 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:49:13.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:49:13.622 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-03-30T08:49:14.433 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:49:14.453 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:49:14.455 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:49:14.459 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:49:14.459 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:49:40.993 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:49:40.999 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:50:11.325 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:50:11.331 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:50:16.831 INFO:teuthology.orchestra.run.smithi087.stdout:generic/125 62s 2023-03-30T08:50:16.853 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/125 2023-03-30T08:50:16.853 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:50:16.864 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:50:17.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:50:17.068 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-03-30T08:50:17.871 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:50:17.890 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:50:17.893 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:50:17.898 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:50:17.898 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:50:19.319 INFO:teuthology.orchestra.run.smithi087.stdout:generic/126 1s 2023-03-30T08:50:19.343 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/126 2023-03-30T08:50:19.343 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T08:50:19.356 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:50:19.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T08:50:19.761 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-03-30T08:50:20.431 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T08:50:20.453 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T08:50:20.455 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T08:50:20.460 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T08:50:20.461 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T08:50:41.415 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:50:41.418 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:51:11.501 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:51:11.505 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:51:41.609 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:51:41.616 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:52:11.926 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:52:11.930 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:52:42.056 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:52:42.060 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:53:12.190 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:53:12.197 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:53:42.318 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:53:42.323 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:54:12.456 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:54:12.462 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:54:42.560 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:54:42.564 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:55:12.672 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:55:12.691 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:55:42.775 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:55:42.781 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:56:12.938 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:56:12.944 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:56:43.026 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:56:43.030 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:57:13.096 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:57:13.102 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:57:44.282 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:57:44.287 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:58:14.499 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:58:14.505 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:58:44.572 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:58:44.576 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:59:14.653 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:59:14.656 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:59:44.757 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T08:59:44.762 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:00:14.876 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:00:14.885 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:00:45.006 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:00:45.011 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:01:15.101 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:01:15.106 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:01:45.167 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:01:45.174 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:02:15.348 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:02:15.352 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:02:45.412 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:02:45.416 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:03:15.537 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:03:15.543 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:03:45.610 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:03:45.614 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:04:15.697 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:04:15.703 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:04:45.763 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:04:45.767 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:05:15.845 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:05:15.850 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:05:46.942 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:05:46.947 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:06:17.029 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:06:17.033 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:06:47.090 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:06:47.094 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:07:17.294 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:07:17.298 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:07:47.368 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:07:47.374 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:07:59.354 INFO:teuthology.orchestra.run.smithi087.stdout:generic/127 1059s 2023-03-30T09:07:59.388 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/127 2023-03-30T09:07:59.388 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:07:59.400 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:07:59.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:07:59.645 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-03-30T09:08:00.467 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:08:00.489 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:08:00.490 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:08:00.496 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:08:00.496 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:08:02.687 INFO:teuthology.orchestra.run.smithi087.stdout:generic/128 2s 2023-03-30T09:08:02.708 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/128 2023-03-30T09:08:02.708 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:08:02.718 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:08:02.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:08:02.747 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-03-30T09:08:03.417 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:08:03.437 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:08:03.439 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:08:03.445 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:08:03.445 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:08:17.426 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:08:17.430 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:08:47.565 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:08:47.569 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:09:17.642 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:09:17.650 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:09:47.778 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:09:47.782 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:10:18.882 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:10:18.886 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:10:49.004 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:10:49.008 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:11:19.271 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:11:19.276 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:11:19.496 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T09:11:19.490+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40099) UID: 0 2023-03-30T09:11:19.496 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T09:11:19.490+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40099) UID: 0 2023-03-30T09:15:05.865 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T09:15:05.857+0000 7fe514cf5700 -1 Fail to open '/proc/40109/cmdline' error = (2) No such file or directory 2023-03-30T09:15:05.866 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T09:15:05.857+0000 7fe514cf5700 -1 received signal: Hangup from (PID: 40109) UID: 0 2023-03-30T09:15:05.866 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T09:15:05.857+0000 7fa38cf23700 -1 Fail to open '/proc/40109/cmdline' error = (2) No such file or directory 2023-03-30T09:15:05.866 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T09:15:05.857+0000 7fa38cf23700 -1 received signal: Hangup from (PID: 40109) UID: 0 2023-03-30T09:15:05.867 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T09:15:05.857+0000 7f27552d8700 -1 Fail to open '/proc/40109/cmdline' error = (2) No such file or directory 2023-03-30T09:15:05.867 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T09:15:05.857+0000 7f27552d8700 -1 received signal: Hangup from (PID: 40109) UID: 0 2023-03-30T09:15:05.867 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T09:15:05.857+0000 7f2ab2e9c700 -1 Fail to open '/proc/40109/cmdline' error = (2) No such file or directory 2023-03-30T09:15:05.867 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T09:15:05.857+0000 7f2ab2e9c700 -1 received signal: Hangup from (PID: 40109) UID: 0 2023-03-30T09:20:12.176 INFO:teuthology.orchestra.run.smithi115.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.6.log.1: 2023-03-30T09:20:12.177 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: stdin: file size changed while zipping 2023-03-30T09:20:51.235 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:20:51.242 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:20:51.325 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T09:20:51.318+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40128) UID: 0 2023-03-30T09:20:51.325 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T09:20:51.318+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40128) UID: 0 2023-03-30T09:20:51.326 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T09:20:51.318+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40128) UID: 0 2023-03-30T09:20:51.326 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T09:20:51.318+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40128) UID: 0 2023-03-30T09:20:51.753 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T09:20:51.750+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 175751) UID: 0 2023-03-30T09:20:51.754 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T09:20:51.750+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 175751) UID: 0 2023-03-30T09:20:51.756 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T09:20:51.750+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 175751) UID: 0 2023-03-30T09:20:51.757 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T09:20:51.750+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 175751) UID: 0 2023-03-30T09:31:37.402 INFO:teuthology.orchestra.run.smithi087.stdout:generic/129 1414s 2023-03-30T09:31:37.464 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/129 2023-03-30T09:31:37.464 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:31:37.473 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:31:37.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:31:37.500 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-03-30T09:31:38.438 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:31:38.459 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:31:38.460 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:31:38.464 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:31:38.464 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:31:57.719 INFO:teuthology.orchestra.run.smithi087.stdout:generic/130 19s 2023-03-30T09:31:57.766 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/130 2023-03-30T09:31:57.767 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:31:57.776 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:31:57.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:31:57.799 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-03-30T09:31:58.418 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:31:58.436 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:31:58.437 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:31:58.441 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:31:58.441 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:32:00.464 INFO:teuthology.orchestra.run.smithi087.stdout:generic/131 2s 2023-03-30T09:32:00.488 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/131 2023-03-30T09:32:00.489 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:32:00.497 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:32:00.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:32:00.813 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-03-30T09:32:01.576 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:32:01.596 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:32:01.597 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:32:01.600 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:32:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:32:17.327 INFO:teuthology.orchestra.run.smithi087.stdout:generic/132 16s 2023-03-30T09:32:17.347 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/132 2023-03-30T09:32:17.347 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:32:17.358 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:32:17.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:32:17.388 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-03-30T09:32:17.975 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:32:17.994 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:32:17.997 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:32:18.001 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:32:18.001 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:34:20.707 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:34:20.713 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:34:20.763 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T09:34:20.756+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178176) UID: 0 2023-03-30T09:34:20.763 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T09:34:20.756+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178176) UID: 0 2023-03-30T09:34:20.764 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T09:34:20.756+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178176) UID: 0 2023-03-30T09:34:20.764 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T09:34:20.756+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178176) UID: 0 2023-03-30T09:34:20.848 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T09:34:20.844+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40384) UID: 0 2023-03-30T09:34:20.849 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T09:34:20.844+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40384) UID: 0 2023-03-30T09:34:20.849 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T09:34:20.844+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40384) UID: 0 2023-03-30T09:34:20.850 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T09:34:20.844+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40384) UID: 0 2023-03-30T09:39:08.126 INFO:teuthology.orchestra.run.smithi087.stdout:generic/133 410s 2023-03-30T09:39:08.148 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/133 2023-03-30T09:39:08.149 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:08.158 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:08.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:08.450 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-03-30T09:39:09.248 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:09.267 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:09.269 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:09.273 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:09.273 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:10.158 INFO:teuthology.orchestra.run.smithi087.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:10.174 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/134 2023-03-30T09:39:10.174 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/134 2023-03-30T09:39:10.175 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:10.184 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:10.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:10.579 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-03-30T09:39:11.252 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:11.273 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:11.274 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:11.278 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:11.278 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:13.214 INFO:teuthology.orchestra.run.smithi087.stdout:generic/135 2s 2023-03-30T09:39:13.237 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/135 2023-03-30T09:39:13.238 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:13.248 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:13.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:13.278 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-03-30T09:39:13.870 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:13.888 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:13.889 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:13.892 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:13.893 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:14.777 INFO:teuthology.orchestra.run.smithi087.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-30T09:39:14.793 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/136 2023-03-30T09:39:14.793 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/136 2023-03-30T09:39:14.794 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:14.805 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:14.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:14.990 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-03-30T09:39:15.849 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:15.866 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:15.868 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:15.873 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:15.873 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:16.742 INFO:teuthology.orchestra.run.smithi087.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:16.758 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/137 2023-03-30T09:39:16.758 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/137 2023-03-30T09:39:16.758 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:16.767 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:17.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:17.021 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-03-30T09:39:17.816 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:17.834 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:17.836 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:17.840 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:17.840 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:18.716 INFO:teuthology.orchestra.run.smithi087.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:18.730 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/138 2023-03-30T09:39:18.730 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/138 2023-03-30T09:39:18.731 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:18.740 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:19.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:19.193 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-03-30T09:39:19.782 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:19.799 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:19.801 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:19.805 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:19.805 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:20.672 INFO:teuthology.orchestra.run.smithi087.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:20.686 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/139 2023-03-30T09:39:20.686 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/139 2023-03-30T09:39:20.686 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:20.698 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:20.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:20.920 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-03-30T09:39:21.724 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:21.744 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:21.746 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:21.751 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:21.751 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:22.616 INFO:teuthology.orchestra.run.smithi087.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:22.634 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/140 2023-03-30T09:39:22.634 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/140 2023-03-30T09:39:22.634 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:22.644 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:23.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:23.130 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-03-30T09:39:23.704 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:23.722 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:23.724 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:23.728 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:23.728 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:24.935 INFO:teuthology.orchestra.run.smithi087.stdout:generic/141 0s 2023-03-30T09:39:24.956 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/141 2023-03-30T09:39:24.956 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:24.965 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:24.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:24.994 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-03-30T09:39:25.569 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:25.585 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:25.587 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:25.591 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:25.591 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:26.455 INFO:teuthology.orchestra.run.smithi087.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:26.472 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/142 2023-03-30T09:39:26.472 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/142 2023-03-30T09:39:26.472 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:26.483 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:26.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:26.904 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-03-30T09:39:27.532 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:27.552 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:27.554 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:27.557 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:28.398 INFO:teuthology.orchestra.run.smithi087.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:28.412 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/143 2023-03-30T09:39:28.412 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/143 2023-03-30T09:39:28.412 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:28.422 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:28.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:28.785 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-03-30T09:39:29.451 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:29.467 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:29.469 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:29.474 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:29.474 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:30.346 INFO:teuthology.orchestra.run.smithi087.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:30.359 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/144 2023-03-30T09:39:30.359 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/144 2023-03-30T09:39:30.359 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:30.367 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:30.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:30.526 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-03-30T09:39:31.247 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:31.260 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:31.261 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:31.264 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:31.264 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:32.069 INFO:teuthology.orchestra.run.smithi087.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:32.085 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/145 2023-03-30T09:39:32.086 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/145 2023-03-30T09:39:32.086 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:32.094 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:32.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:32.379 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-03-30T09:39:33.136 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:33.154 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:33.156 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:33.161 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:33.161 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:34.033 INFO:teuthology.orchestra.run.smithi087.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:34.047 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/146 2023-03-30T09:39:34.047 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/146 2023-03-30T09:39:34.047 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:34.057 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:34.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:34.479 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-03-30T09:39:35.083 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:35.103 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:35.105 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:35.110 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:35.110 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:35.962 INFO:teuthology.orchestra.run.smithi087.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:35.979 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/147 2023-03-30T09:39:35.979 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/147 2023-03-30T09:39:35.979 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:35.988 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:36.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:36.384 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-03-30T09:39:36.937 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:36.950 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:36.951 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:36.955 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:36.955 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:37.777 INFO:teuthology.orchestra.run.smithi087.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:37.794 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/148 2023-03-30T09:39:37.795 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/148 2023-03-30T09:39:37.795 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:37.805 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:38.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:38.200 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-03-30T09:39:38.846 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:38.863 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:38.865 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:38.869 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:38.869 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:39.747 INFO:teuthology.orchestra.run.smithi087.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:39.762 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/149 2023-03-30T09:39:39.763 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/149 2023-03-30T09:39:39.763 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:39.772 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:40.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:40.109 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-03-30T09:39:40.757 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:40.775 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:40.777 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:40.781 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:40.781 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:41.623 INFO:teuthology.orchestra.run.smithi087.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:41.639 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/150 2023-03-30T09:39:41.640 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/150 2023-03-30T09:39:41.640 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:41.650 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:42.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:42.097 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-03-30T09:39:42.683 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:42.703 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:42.704 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:42.707 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:42.707 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:43.570 INFO:teuthology.orchestra.run.smithi087.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:43.586 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/151 2023-03-30T09:39:43.587 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/151 2023-03-30T09:39:43.587 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:43.596 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:43.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:43.927 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-03-30T09:39:44.641 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:44.658 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:44.659 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:44.663 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:44.664 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:45.505 INFO:teuthology.orchestra.run.smithi087.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:45.523 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/152 2023-03-30T09:39:45.524 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/152 2023-03-30T09:39:45.524 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:45.533 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:45.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:45.776 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-03-30T09:39:46.575 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:46.594 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:46.595 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:46.600 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:46.600 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:47.448 INFO:teuthology.orchestra.run.smithi087.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:47.464 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/153 2023-03-30T09:39:47.465 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/153 2023-03-30T09:39:47.465 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:47.474 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:47.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:47.962 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-03-30T09:39:48.539 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:48.555 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:48.556 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:48.561 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:48.561 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:49.413 INFO:teuthology.orchestra.run.smithi087.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:49.429 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/154 2023-03-30T09:39:49.430 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/154 2023-03-30T09:39:49.430 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:49.441 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:49.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:49.672 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-03-30T09:39:50.454 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:50.471 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:50.473 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:50.477 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:50.477 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:51.329 INFO:teuthology.orchestra.run.smithi087.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:51.347 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/155 2023-03-30T09:39:51.347 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/155 2023-03-30T09:39:51.347 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:51.357 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:51.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:51.628 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-03-30T09:39:52.387 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:52.404 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:52.407 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:52.411 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:52.411 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:53.286 INFO:teuthology.orchestra.run.smithi087.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:53.300 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/156 2023-03-30T09:39:53.300 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/156 2023-03-30T09:39:53.300 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:53.311 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:53.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:53.551 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-03-30T09:39:54.298 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:54.317 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:54.319 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:54.323 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:54.323 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:55.171 INFO:teuthology.orchestra.run.smithi087.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:39:55.189 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/157 2023-03-30T09:39:55.189 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/157 2023-03-30T09:39:55.190 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:55.200 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:55.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:55.448 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-03-30T09:39:56.186 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:56.202 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:56.205 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:56.210 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:56.210 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:57.123 INFO:teuthology.orchestra.run.smithi087.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-30T09:39:57.139 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/158 2023-03-30T09:39:57.139 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/158 2023-03-30T09:39:57.139 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:57.152 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:57.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:57.581 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-03-30T09:39:58.175 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:58.194 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:58.196 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:58.201 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:58.201 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:59.017 INFO:teuthology.orchestra.run.smithi087.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-03-30T09:39:59.033 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/159 2023-03-30T09:39:59.034 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/159 2023-03-30T09:39:59.034 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:39:59.044 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:39:59.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:39:59.129 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-03-30T09:39:59.748 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:39:59.766 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:39:59.769 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:39:59.774 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:39:59.774 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:00.605 INFO:teuthology.orchestra.run.smithi087.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-03-30T09:40:00.620 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/160 2023-03-30T09:40:00.621 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/160 2023-03-30T09:40:00.621 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:00.629 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:00.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:00.728 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-03-30T09:40:01.336 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:01.354 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:01.356 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:01.361 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:01.361 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:02.662 INFO:teuthology.orchestra.run.smithi087.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:02.738 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/161 2023-03-30T09:40:02.738 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/161 2023-03-30T09:40:02.739 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:02.776 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:03.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:03.010 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-03-30T09:40:03.548 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:03.562 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:03.564 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:03.568 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:03.568 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:04.536 INFO:teuthology.orchestra.run.smithi087.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-03-30T09:40:04.770 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/162 2023-03-30T09:40:04.770 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/162 2023-03-30T09:40:04.770 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:04.817 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:05.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:05.144 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-03-30T09:40:05.719 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:05.739 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:05.742 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:05.745 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:05.745 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:06.833 INFO:teuthology.orchestra.run.smithi087.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-03-30T09:40:07.134 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/163 2023-03-30T09:40:07.135 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/163 2023-03-30T09:40:07.135 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:07.151 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:07.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:07.373 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-03-30T09:40:07.939 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:07.954 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:07.956 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:07.960 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:07.960 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:09.227 INFO:teuthology.orchestra.run.smithi087.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:09.247 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/164 2023-03-30T09:40:09.248 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/164 2023-03-30T09:40:09.248 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:09.303 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:09.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:09.543 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-03-30T09:40:10.115 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:10.130 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:10.132 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:10.136 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:10.136 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:11.418 INFO:teuthology.orchestra.run.smithi087.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:11.435 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/165 2023-03-30T09:40:11.435 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/165 2023-03-30T09:40:11.436 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:11.449 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:11.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:11.790 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-03-30T09:40:12.367 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:12.384 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:12.386 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:12.391 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:12.391 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:13.663 INFO:teuthology.orchestra.run.smithi087.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:13.689 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/166 2023-03-30T09:40:13.690 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/166 2023-03-30T09:40:13.690 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:13.705 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:14.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:14.049 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-03-30T09:40:14.662 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:14.677 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:14.679 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:14.683 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:14.683 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:15.902 INFO:teuthology.orchestra.run.smithi087.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:16.005 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/167 2023-03-30T09:40:16.006 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/167 2023-03-30T09:40:16.006 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:16.022 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:16.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:16.272 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-03-30T09:40:16.896 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:16.915 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:16.916 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:16.922 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:16.922 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:18.160 INFO:teuthology.orchestra.run.smithi087.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:18.187 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/168 2023-03-30T09:40:18.187 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/168 2023-03-30T09:40:18.187 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:18.245 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:18.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:18.540 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-03-30T09:40:19.125 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:19.142 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:19.144 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:19.149 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:19.149 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:20.678 INFO:teuthology.orchestra.run.smithi087.stdout:generic/169 1s 2023-03-30T09:40:20.738 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/169 2023-03-30T09:40:20.739 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:20.748 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:20.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:20.777 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-03-30T09:40:21.373 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:21.390 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:21.391 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:21.395 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:21.395 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:22.810 INFO:teuthology.orchestra.run.smithi087.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:22.869 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/170 2023-03-30T09:40:22.870 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/170 2023-03-30T09:40:22.870 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:22.911 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:23.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:23.017 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-03-30T09:40:23.625 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:23.644 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:23.646 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:23.650 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:23.650 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:25.144 INFO:teuthology.orchestra.run.smithi087.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:25.258 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/171 2023-03-30T09:40:25.259 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/171 2023-03-30T09:40:25.259 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:25.274 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:25.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:25.373 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-03-30T09:40:26.067 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:26.089 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:26.091 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:26.095 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:26.095 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:27.713 INFO:teuthology.orchestra.run.smithi087.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:27.771 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/172 2023-03-30T09:40:27.771 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/172 2023-03-30T09:40:27.771 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:27.827 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:27.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:27.911 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-03-30T09:40:28.569 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:28.590 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:28.592 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:28.597 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:28.597 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:30.062 INFO:teuthology.orchestra.run.smithi087.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:30.251 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/173 2023-03-30T09:40:30.251 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/173 2023-03-30T09:40:30.251 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:30.259 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:30.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:30.352 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-03-30T09:40:31.012 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:31.033 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:31.036 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:31.041 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:31.041 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:32.441 INFO:teuthology.orchestra.run.smithi087.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:32.524 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/174 2023-03-30T09:40:32.525 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/174 2023-03-30T09:40:32.525 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:32.607 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:32.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:32.747 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-03-30T09:40:33.360 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:33.379 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:33.381 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:33.386 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:33.386 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:34.799 INFO:teuthology.orchestra.run.smithi087.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:34.817 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/175 2023-03-30T09:40:34.818 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/175 2023-03-30T09:40:34.818 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:34.828 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:35.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:35.098 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-03-30T09:40:35.707 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:35.728 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:35.731 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:35.736 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:35.737 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:37.053 INFO:teuthology.orchestra.run.smithi087.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:37.161 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/176 2023-03-30T09:40:37.161 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/176 2023-03-30T09:40:37.161 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:37.176 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:37.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:37.401 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-03-30T09:40:38.010 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:38.031 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:38.034 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:38.038 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:38.038 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:39.348 INFO:teuthology.orchestra.run.smithi087.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-30T09:40:39.367 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/177 2023-03-30T09:40:39.367 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/177 2023-03-30T09:40:39.367 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:39.376 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:39.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:39.656 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-03-30T09:40:40.457 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:40.474 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:40.477 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:40.482 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:40.482 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:41.489 INFO:teuthology.orchestra.run.smithi087.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:40:41.505 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/178 2023-03-30T09:40:41.506 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/178 2023-03-30T09:40:41.506 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:41.517 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:41.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:41.988 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-03-30T09:40:42.644 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:42.664 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:42.666 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:42.672 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:42.672 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:43.639 INFO:teuthology.orchestra.run.smithi087.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:40:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/179 2023-03-30T09:40:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/179 2023-03-30T09:40:43.657 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:43.671 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:44.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:44.063 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-03-30T09:40:44.761 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:44.779 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:44.782 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:44.787 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:44.788 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:45.753 INFO:teuthology.orchestra.run.smithi087.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:40:45.769 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/180 2023-03-30T09:40:45.769 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/180 2023-03-30T09:40:45.769 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:46.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:46.218 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-03-30T09:40:46.857 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:46.876 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:46.878 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:46.882 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:46.882 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:47.870 INFO:teuthology.orchestra.run.smithi087.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:40:47.886 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/181 2023-03-30T09:40:47.886 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/181 2023-03-30T09:40:47.886 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:47.895 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:48.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:48.107 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-03-30T09:40:48.932 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:48.949 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:48.951 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:48.956 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:48.956 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:49.949 INFO:teuthology.orchestra.run.smithi087.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-30T09:40:49.965 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/182 2023-03-30T09:40:49.966 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/182 2023-03-30T09:40:49.966 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:49.976 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:50.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:50.361 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-03-30T09:40:51.082 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:51.099 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:51.101 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:51.105 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:51.106 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:52.567 INFO:teuthology.orchestra.run.smithi087.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:52.694 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/183 2023-03-30T09:40:52.694 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/183 2023-03-30T09:40:52.695 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:52.767 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:52.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:52.865 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-03-30T09:40:53.494 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:53.512 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:53.514 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:53.518 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:53.518 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:53.955 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:40:53.959 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:40:54.515 INFO:teuthology.orchestra.run.smithi087.stdout:generic/184 1s 2023-03-30T09:40:54.539 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/184 2023-03-30T09:40:54.539 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:54.550 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:54.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:54.654 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-03-30T09:40:55.293 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:55.311 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:55.313 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:55.318 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:55.318 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:56.831 INFO:teuthology.orchestra.run.smithi087.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:56.898 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/185 2023-03-30T09:40:56.898 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/185 2023-03-30T09:40:56.898 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:56.918 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:57.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:57.041 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-03-30T09:40:57.697 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:40:57.715 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:40:57.718 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:40:57.722 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:40:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:59.144 INFO:teuthology.orchestra.run.smithi087.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:40:59.244 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/186 2023-03-30T09:40:59.244 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/186 2023-03-30T09:40:59.244 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:40:59.256 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:40:59.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:40:59.399 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-03-30T09:41:00.054 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:00.073 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:00.076 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:00.081 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:00.081 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:01.533 INFO:teuthology.orchestra.run.smithi087.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:01.650 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/187 2023-03-30T09:41:01.651 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/187 2023-03-30T09:41:01.651 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:01.699 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:01.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:01.803 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-03-30T09:41:02.434 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:02.454 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:02.456 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:02.461 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:02.461 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:03.875 INFO:teuthology.orchestra.run.smithi087.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:03.898 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/188 2023-03-30T09:41:03.898 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/188 2023-03-30T09:41:03.899 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:03.971 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:04.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:04.168 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-03-30T09:41:04.811 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:04.831 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:04.833 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:04.837 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:04.838 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:06.168 INFO:teuthology.orchestra.run.smithi087.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:06.262 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/189 2023-03-30T09:41:06.263 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/189 2023-03-30T09:41:06.263 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:06.278 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:06.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:06.484 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-03-30T09:41:07.107 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:07.127 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:07.129 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:07.134 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:07.134 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:08.487 INFO:teuthology.orchestra.run.smithi087.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:08.535 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/190 2023-03-30T09:41:08.535 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/190 2023-03-30T09:41:08.535 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:08.620 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:08.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:08.849 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-03-30T09:41:09.499 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:09.519 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:09.522 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:09.527 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:09.527 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:11.081 INFO:teuthology.orchestra.run.smithi087.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:11.182 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/191 2023-03-30T09:41:11.182 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/191 2023-03-30T09:41:11.182 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:11.194 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:11.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:11.267 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-03-30T09:41:11.914 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:11.934 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:11.936 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:11.941 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:11.942 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:18.337 INFO:teuthology.orchestra.run.smithi087.stdout:generic/192 - output mismatch (see /tmp/tmp.dmK5MK8Zk9xfstests-dev/results//generic/192.out.bad) 2023-03-30T09:41:18.347 INFO:teuthology.orchestra.run.smithi087.stdout: --- tests/generic/192.out 2023-03-30 08:12:30.375001192 +0000 2023-03-30T09:41:18.347 INFO:teuthology.orchestra.run.smithi087.stdout: +++ /tmp/tmp.dmK5MK8Zk9xfstests-dev/results//generic/192.out.bad 2023-03-30 09:41:18.330954923 +0000 2023-03-30T09:41:18.348 INFO:teuthology.orchestra.run.smithi087.stdout: @@ -1,5 +1,6 @@ 2023-03-30T09:41:18.348 INFO:teuthology.orchestra.run.smithi087.stdout: QA output created by 192 2023-03-30T09:41:18.348 INFO:teuthology.orchestra.run.smithi087.stdout: sleep for 5 seconds 2023-03-30T09:41:18.348 INFO:teuthology.orchestra.run.smithi087.stdout: test 2023-03-30T09:41:18.348 INFO:teuthology.orchestra.run.smithi087.stdout: -delta1 is in range 2023-03-30T09:41:18.348 INFO:teuthology.orchestra.run.smithi087.stdout: +delta1 has value of 0 2023-03-30T09:41:18.349 INFO:teuthology.orchestra.run.smithi087.stdout: +delta1 is NOT in range 5 .. 7 2023-03-30T09:41:18.349 INFO:teuthology.orchestra.run.smithi087.stdout: delta2 is in range 2023-03-30T09:41:18.359 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/192 2023-03-30T09:41:18.359 INFO:teuthology.orchestra.run.smithi087.stdout:Failures: generic/192 2023-03-30T09:41:18.359 INFO:teuthology.orchestra.run.smithi087.stdout:Failed 1 of 1 tests 2023-03-30T09:41:18.370 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:18.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T09:41:18.463 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-03-30T09:41:18.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-03-30T09:41:18.464 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-03-30T09:41:19.104 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:19.123 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:19.125 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:19.130 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:19.130 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:21.737 INFO:teuthology.orchestra.run.smithi087.stdout:generic/193 2s 2023-03-30T09:41:21.758 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/193 2023-03-30T09:41:21.758 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:21.769 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:22.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:22.023 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-03-30T09:41:22.826 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:22.843 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:22.846 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:22.850 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:22.851 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:24.248 INFO:teuthology.orchestra.run.smithi087.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:24.264 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/194 2023-03-30T09:41:24.264 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/194 2023-03-30T09:41:24.264 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:24.283 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:24.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:24.497 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-03-30T09:41:24.546 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:41:24.550 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:41:25.099 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:25.118 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:25.121 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:25.126 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:25.126 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:26.684 INFO:teuthology.orchestra.run.smithi087.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:26.738 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/195 2023-03-30T09:41:26.739 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/195 2023-03-30T09:41:26.739 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:26.790 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:26.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:26.884 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-03-30T09:41:27.532 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:27.550 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:27.553 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:27.558 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:27.558 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:29.135 INFO:teuthology.orchestra.run.smithi087.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:29.174 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/196 2023-03-30T09:41:29.174 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/196 2023-03-30T09:41:29.174 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:29.183 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:29.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:29.339 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-03-30T09:41:29.997 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:30.018 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:30.020 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:30.025 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:30.026 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:31.338 INFO:teuthology.orchestra.run.smithi087.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:31.354 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/197 2023-03-30T09:41:31.354 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/197 2023-03-30T09:41:31.355 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:31.432 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:31.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:31.733 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-03-30T09:41:32.368 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:32.387 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:32.390 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:32.395 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:32.396 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:34.243 INFO:teuthology.orchestra.run.smithi087.stdout:generic/198 2s 2023-03-30T09:41:34.264 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/198 2023-03-30T09:41:34.265 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:34.276 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:34.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:34.656 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-03-30T09:41:35.385 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:35.403 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:35.406 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:35.411 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:35.412 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:36.952 INFO:teuthology.orchestra.run.smithi087.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:37.037 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/199 2023-03-30T09:41:37.038 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/199 2023-03-30T09:41:37.038 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:37.075 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:37.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:37.160 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-03-30T09:41:37.813 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:37.835 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:37.837 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:37.841 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:37.841 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:39.442 INFO:teuthology.orchestra.run.smithi087.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:39.477 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/200 2023-03-30T09:41:39.477 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/200 2023-03-30T09:41:39.478 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:39.488 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:39.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:39.604 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-03-30T09:41:40.211 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:40.230 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:40.232 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:40.237 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:40.237 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:41.750 INFO:teuthology.orchestra.run.smithi087.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:41.807 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/201 2023-03-30T09:41:41.807 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/201 2023-03-30T09:41:41.807 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:41.843 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:41.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:41.965 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-03-30T09:41:42.608 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:42.629 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:42.631 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:42.635 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:42.635 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:44.173 INFO:teuthology.orchestra.run.smithi087.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:44.241 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/202 2023-03-30T09:41:44.241 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/202 2023-03-30T09:41:44.241 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:44.276 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:44.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:44.363 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-03-30T09:41:45.015 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:45.033 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:45.036 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:45.040 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:45.041 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:46.553 INFO:teuthology.orchestra.run.smithi087.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:46.702 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/203 2023-03-30T09:41:46.702 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/203 2023-03-30T09:41:46.702 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:46.711 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:46.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:46.799 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-03-30T09:41:47.447 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:47.466 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:47.468 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:47.473 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:47.473 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:49.120 INFO:teuthology.orchestra.run.smithi087.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T09:41:49.139 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/204 2023-03-30T09:41:49.139 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/204 2023-03-30T09:41:49.140 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:49.150 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:49.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:49.230 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-03-30T09:41:49.892 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:49.910 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:49.912 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:49.917 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:49.917 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:51.441 INFO:teuthology.orchestra.run.smithi087.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:51.486 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/205 2023-03-30T09:41:51.487 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/205 2023-03-30T09:41:51.487 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:51.517 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:51.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:51.624 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-03-30T09:41:52.285 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:52.304 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:52.306 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:52.311 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:52.312 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:53.790 INFO:teuthology.orchestra.run.smithi087.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:41:53.944 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/206 2023-03-30T09:41:53.945 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/206 2023-03-30T09:41:53.945 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:41:53.954 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:41:54.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:41:54.084 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-03-30T09:41:54.618 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:41:54.624 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:41:54.733 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:41:54.752 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:41:54.755 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:41:54.760 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:41:54.760 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:42:04.520 INFO:teuthology.orchestra.run.smithi087.stdout:generic/207 9s 2023-03-30T09:42:04.547 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/207 2023-03-30T09:42:04.547 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:42:04.557 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:42:04.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:42:04.929 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-03-30T09:42:05.621 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:42:05.644 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:42:05.646 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:42:05.651 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:42:05.652 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:42:24.707 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:42:24.713 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:42:54.771 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:42:54.779 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:43:24.841 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:43:24.849 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:43:54.943 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:43:54.951 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:44:25.014 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:44:25.018 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:44:55.092 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:44:55.096 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:45:25.329 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:45:25.334 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:45:26.878 INFO:teuthology.orchestra.run.smithi087.stdout:generic/208 200s 2023-03-30T09:45:26.903 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/208 2023-03-30T09:45:26.903 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:45:26.914 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:45:27.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:45:27.169 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-03-30T09:45:27.980 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:45:27.999 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:45:28.001 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:45:28.006 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:45:28.007 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:45:55.499 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:45:55.504 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:45:59.966 INFO:teuthology.orchestra.run.smithi087.stdout:generic/209 31s 2023-03-30T09:45:59.995 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/209 2023-03-30T09:45:59.996 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:00.006 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:00.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:00.337 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-03-30T09:46:01.018 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:01.039 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:01.041 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:01.046 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:01.046 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:02.179 INFO:teuthology.orchestra.run.smithi087.stdout:generic/210 1s 2023-03-30T09:46:02.207 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/210 2023-03-30T09:46:02.207 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:02.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:02.589 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-03-30T09:46:03.304 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:03.324 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:03.326 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:03.330 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:03.331 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:04.785 INFO:teuthology.orchestra.run.smithi087.stdout:generic/211 1s 2023-03-30T09:46:04.809 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/211 2023-03-30T09:46:04.810 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:04.820 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:04.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:04.922 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-03-30T09:46:05.581 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:05.599 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:05.602 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:05.606 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:05.606 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:06.685 INFO:teuthology.orchestra.run.smithi087.stdout:generic/212 1s 2023-03-30T09:46:06.711 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/212 2023-03-30T09:46:06.711 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:06.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:06.824 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-03-30T09:46:07.508 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:07.526 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:07.529 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:07.533 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:07.534 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:08.431 INFO:teuthology.orchestra.run.smithi087.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T09:46:08.447 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/213 2023-03-30T09:46:08.448 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/213 2023-03-30T09:46:08.448 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:08.458 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:08.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:08.542 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-03-30T09:46:09.195 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:09.214 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:09.216 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:09.220 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:09.220 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:10.138 INFO:teuthology.orchestra.run.smithi087.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T09:46:10.156 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/214 2023-03-30T09:46:10.157 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/214 2023-03-30T09:46:10.157 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:10.169 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:10.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:10.259 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-03-30T09:46:10.915 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:10.935 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:10.938 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:10.943 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:10.943 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:13.958 INFO:teuthology.orchestra.run.smithi087.stdout:generic/215 2s 2023-03-30T09:46:13.984 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/215 2023-03-30T09:46:13.984 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:14.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:14.147 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-03-30T09:46:14.776 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:14.792 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:14.794 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:14.799 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:14.799 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:16.233 INFO:teuthology.orchestra.run.smithi087.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:46:16.250 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/216 2023-03-30T09:46:16.251 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/216 2023-03-30T09:46:16.251 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:16.267 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:16.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:16.483 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-03-30T09:46:17.116 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:17.136 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:17.138 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:17.142 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:17.143 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:18.671 INFO:teuthology.orchestra.run.smithi087.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:46:18.729 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/217 2023-03-30T09:46:18.729 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/217 2023-03-30T09:46:18.730 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:18.752 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:18.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:18.920 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-03-30T09:46:19.577 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:19.596 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:19.598 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:19.603 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:19.603 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:21.007 INFO:teuthology.orchestra.run.smithi087.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:46:21.103 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/218 2023-03-30T09:46:21.103 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/218 2023-03-30T09:46:21.104 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:21.155 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:21.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:21.338 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-03-30T09:46:21.970 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:21.992 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:21.994 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:21.999 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:22.000 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:22.865 INFO:teuthology.orchestra.run.smithi087.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T09:46:22.882 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/219 2023-03-30T09:46:22.882 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/219 2023-03-30T09:46:22.882 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:22.893 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:22.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:22.973 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-03-30T09:46:23.614 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:23.634 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:23.636 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:23.641 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:23.641 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:25.015 INFO:teuthology.orchestra.run.smithi087.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:46:25.035 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/220 2023-03-30T09:46:25.035 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/220 2023-03-30T09:46:25.035 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:25.094 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:25.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:25.311 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-03-30T09:46:25.629 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:46:25.634 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:46:25.932 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:25.951 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:25.954 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:25.959 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:25.959 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:27.938 INFO:teuthology.orchestra.run.smithi087.stdout:generic/221 1s 2023-03-30T09:46:27.963 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/221 2023-03-30T09:46:27.963 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:27.973 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:28.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:28.082 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-03-30T09:46:28.730 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:28.747 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:28.749 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:28.755 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:28.755 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:30.270 INFO:teuthology.orchestra.run.smithi087.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:46:30.346 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/222 2023-03-30T09:46:30.346 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/222 2023-03-30T09:46:30.346 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:30.395 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:30.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:30.471 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-03-30T09:46:31.115 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:31.133 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:31.135 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:31.140 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:31.140 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:32.064 INFO:teuthology.orchestra.run.smithi087.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T09:46:32.083 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/223 2023-03-30T09:46:32.083 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/223 2023-03-30T09:46:32.083 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:32.093 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:32.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:32.200 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-03-30T09:46:32.863 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:32.882 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:32.885 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:32.890 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:32.891 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:33.772 INFO:teuthology.orchestra.run.smithi087.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T09:46:33.788 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/224 2023-03-30T09:46:33.788 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/224 2023-03-30T09:46:33.788 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:33.801 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:33.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:33.885 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-03-30T09:46:34.537 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:34.558 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:34.560 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:34.564 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:34.564 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:35.582 INFO:teuthology.orchestra.run.smithi087.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-30T09:46:35.600 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/225 2023-03-30T09:46:35.600 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/225 2023-03-30T09:46:35.601 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:35.612 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:35.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:35.804 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-03-30T09:46:36.675 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:36.694 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:36.697 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:36.702 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:36.702 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:37.684 INFO:teuthology.orchestra.run.smithi087.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T09:46:37.703 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/226 2023-03-30T09:46:37.703 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/226 2023-03-30T09:46:37.703 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:37.714 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:37.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:37.834 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-03-30T09:46:38.499 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:38.517 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:38.519 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:38.524 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:38.524 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:39.902 INFO:teuthology.orchestra.run.smithi087.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:46:39.920 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/227 2023-03-30T09:46:39.920 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/227 2023-03-30T09:46:39.920 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:39.930 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:40.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:40.198 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-03-30T09:46:40.828 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:40.847 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:40.849 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:40.854 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:40.854 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:41.783 INFO:teuthology.orchestra.run.smithi087.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T09:46:41.800 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/228 2023-03-30T09:46:41.801 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/228 2023-03-30T09:46:41.801 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:41.813 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:41.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:41.923 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-03-30T09:46:42.586 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:42.605 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:42.607 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:42.613 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:42.613 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:44.077 INFO:teuthology.orchestra.run.smithi087.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:46:44.238 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/229 2023-03-30T09:46:44.239 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/229 2023-03-30T09:46:44.239 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:44.293 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:44.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:44.389 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-03-30T09:46:45.041 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:45.062 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:45.064 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:45.069 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:45.069 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:45.885 INFO:teuthology.orchestra.run.smithi087.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T09:46:45.902 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/230 2023-03-30T09:46:45.903 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/230 2023-03-30T09:46:45.903 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:45.913 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:46.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:46.002 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-03-30T09:46:46.639 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:46.659 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:46.661 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:46.664 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:46.665 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:47.519 INFO:teuthology.orchestra.run.smithi087.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T09:46:47.536 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/231 2023-03-30T09:46:47.536 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/231 2023-03-30T09:46:47.537 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:47.548 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:47.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:47.641 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-03-30T09:46:48.303 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:48.322 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:48.324 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:48.328 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:48.329 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:49.174 INFO:teuthology.orchestra.run.smithi087.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T09:46:49.191 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/232 2023-03-30T09:46:49.191 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/232 2023-03-30T09:46:49.192 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:49.202 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:49.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:49.294 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-03-30T09:46:49.955 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:49.976 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:49.979 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:49.984 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:49.984 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:50.860 INFO:teuthology.orchestra.run.smithi087.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T09:46:50.881 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/233 2023-03-30T09:46:50.881 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/233 2023-03-30T09:46:50.882 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:50.893 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:50.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:50.989 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-03-30T09:46:51.660 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:51.681 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:51.683 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:51.689 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:51.689 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:52.581 INFO:teuthology.orchestra.run.smithi087.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T09:46:52.601 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/234 2023-03-30T09:46:52.601 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/234 2023-03-30T09:46:52.601 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:52.613 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:52.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:52.711 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-03-30T09:46:53.359 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:53.377 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:53.379 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:53.384 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:53.384 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:54.238 INFO:teuthology.orchestra.run.smithi087.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T09:46:54.257 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/235 2023-03-30T09:46:54.257 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/235 2023-03-30T09:46:54.257 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:54.270 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:54.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:54.354 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-03-30T09:46:55.012 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:55.032 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:55.035 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:55.039 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:55.039 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:55.698 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:46:55.703 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:46:57.095 INFO:teuthology.orchestra.run.smithi087.stdout:generic/236 2s 2023-03-30T09:46:57.122 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/236 2023-03-30T09:46:57.122 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:57.133 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:57.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:57.574 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-03-30T09:46:58.211 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:46:58.231 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:46:58.233 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:46:58.238 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:46:58.239 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:59.352 INFO:teuthology.orchestra.run.smithi087.stdout:generic/237 1s 2023-03-30T09:46:59.374 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/237 2023-03-30T09:46:59.374 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:46:59.384 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:46:59.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:46:59.841 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-03-30T09:47:00.482 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:47:00.502 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:47:00.505 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:47:00.509 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:47:00.509 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:47:01.956 INFO:teuthology.orchestra.run.smithi087.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:47:02.079 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/238 2023-03-30T09:47:02.079 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/238 2023-03-30T09:47:02.079 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:47:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:47:02.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:47:02.200 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-03-30T09:47:02.850 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:47:02.868 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:47:02.871 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:47:02.877 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:47:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:47:25.859 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:47:25.864 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:47:55.995 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:47:55.999 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:48:26.156 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:48:26.162 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:48:56.271 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:48:56.276 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:49:19.074 INFO:teuthology.orchestra.run.smithi087.stdout:generic/239 136s 2023-03-30T09:49:19.098 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/239 2023-03-30T09:49:19.099 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:49:19.110 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:49:19.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:49:19.484 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-03-30T09:49:20.100 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:49:20.118 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:49:20.120 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:49:20.124 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:49:20.124 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:49:21.715 INFO:teuthology.orchestra.run.smithi087.stdout:generic/240 1s 2023-03-30T09:49:22.447 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/240 2023-03-30T09:49:22.447 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:49:22.456 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:49:22.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:49:22.878 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-03-30T09:49:23.538 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:49:23.556 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:49:23.558 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:49:23.563 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:49:23.563 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:49:26.394 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:49:26.398 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:49:56.529 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:49:56.536 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:50:27.806 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:50:27.811 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:50:37.140 INFO:teuthology.orchestra.run.smithi087.stdout:generic/241 74s 2023-03-30T09:50:37.167 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/241 2023-03-30T09:50:37.167 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:50:37.180 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:50:39.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:50:39.741 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-03-30T09:50:41.023 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:50:41.044 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:50:41.045 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:50:41.049 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:50:41.049 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:50:42.293 INFO:teuthology.orchestra.run.smithi087.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:50:42.477 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/242 2023-03-30T09:50:42.478 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/242 2023-03-30T09:50:42.478 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:50:42.495 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:50:42.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:50:42.592 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-03-30T09:50:43.245 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:50:43.262 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:50:43.264 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:50:43.269 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:50:43.269 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:50:44.776 INFO:teuthology.orchestra.run.smithi087.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:50:44.804 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/243 2023-03-30T09:50:44.805 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/243 2023-03-30T09:50:44.805 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:50:44.831 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:50:44.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:50:44.951 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-03-30T09:50:45.574 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:50:45.590 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:50:45.592 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:50:45.597 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:50:45.597 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:50:46.443 INFO:teuthology.orchestra.run.smithi087.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T09:50:46.459 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/244 2023-03-30T09:50:46.460 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/244 2023-03-30T09:50:46.460 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:50:46.472 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:50:46.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:50:46.549 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-03-30T09:50:47.193 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:50:47.210 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:50:47.213 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:50:47.217 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:50:47.217 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:50:48.237 INFO:teuthology.orchestra.run.smithi087.stdout:generic/245 1s 2023-03-30T09:50:48.262 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/245 2023-03-30T09:50:48.262 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:50:48.271 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:50:48.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:50:48.670 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-03-30T09:50:49.304 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:50:49.325 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:50:49.327 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:50:49.332 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:50:49.332 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:50:50.318 INFO:teuthology.orchestra.run.smithi087.stdout:generic/246 1s 2023-03-30T09:50:50.339 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/246 2023-03-30T09:50:50.339 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:50:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:50:50.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:50:50.660 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-03-30T09:50:51.411 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:50:51.430 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:50:51.433 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:50:51.438 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:50:51.438 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:50:57.963 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:50:57.968 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:51:03.681 INFO:teuthology.orchestra.run.smithi087.stdout:generic/247 12s 2023-03-30T09:51:03.705 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/247 2023-03-30T09:51:03.706 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:03.717 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:03.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:03.750 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-03-30T09:51:04.413 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:04.434 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:04.436 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:04.441 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:04.442 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:05.375 INFO:teuthology.orchestra.run.smithi087.stdout:generic/248 1s 2023-03-30T09:51:05.399 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/248 2023-03-30T09:51:05.400 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:05.411 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:05.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:05.519 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-03-30T09:51:06.205 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:06.224 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:06.226 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:06.231 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:06.231 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:07.571 INFO:teuthology.orchestra.run.smithi087.stdout:generic/249 1s 2023-03-30T09:51:07.596 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/249 2023-03-30T09:51:07.597 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:07.609 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:07.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:07.801 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-03-30T09:51:08.674 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:08.693 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:08.696 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:08.701 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:08.702 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:09.663 INFO:teuthology.orchestra.run.smithi087.stdout:generic/250 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T09:51:09.679 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/250 2023-03-30T09:51:09.679 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/250 2023-03-30T09:51:09.680 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:09.690 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:09.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:09.771 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-03-30T09:51:10.423 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:10.442 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:10.445 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:10.449 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:10.449 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:11.503 INFO:teuthology.orchestra.run.smithi087.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:11.574 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/251 2023-03-30T09:51:11.574 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/251 2023-03-30T09:51:11.575 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:11.586 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:11.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:11.669 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-03-30T09:51:12.322 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:12.344 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:12.346 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:12.350 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:12.350 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:13.226 INFO:teuthology.orchestra.run.smithi087.stdout:generic/252 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T09:51:13.241 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/252 2023-03-30T09:51:13.241 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/252 2023-03-30T09:51:13.242 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:13.252 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:13.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:13.347 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-03-30T09:51:13.973 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:13.990 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:13.992 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:13.996 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:13.996 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:15.344 INFO:teuthology.orchestra.run.smithi087.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:51:15.367 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/253 2023-03-30T09:51:15.367 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/253 2023-03-30T09:51:15.367 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:15.377 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:15.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:15.623 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-03-30T09:51:16.221 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:16.239 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:16.242 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:16.247 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:16.247 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:17.806 INFO:teuthology.orchestra.run.smithi087.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:51:17.834 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/254 2023-03-30T09:51:17.834 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/254 2023-03-30T09:51:17.835 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:17.849 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:17.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:17.949 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-03-30T09:51:18.584 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:18.603 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:18.605 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:18.610 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:18.610 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:19.750 INFO:teuthology.orchestra.run.smithi087.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T09:51:19.770 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/255 2023-03-30T09:51:19.771 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/255 2023-03-30T09:51:19.771 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:19.781 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:19.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:19.995 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-03-30T09:51:20.773 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:20.791 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:20.793 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:20.798 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:20.798 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:22.187 INFO:teuthology.orchestra.run.smithi087.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T09:51:22.206 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/256 2023-03-30T09:51:22.206 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/256 2023-03-30T09:51:22.207 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:22.218 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:22.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:22.324 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-03-30T09:51:22.964 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:22.983 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:22.986 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:22.992 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:22.992 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:24.918 INFO:teuthology.orchestra.run.smithi087.stdout:generic/257 1s 2023-03-30T09:51:24.941 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/257 2023-03-30T09:51:24.941 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:24.952 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:25.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:25.282 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-03-30T09:51:25.974 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:26.019 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:26.028 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:26.033 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:26.033 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:26.900 INFO:teuthology.orchestra.run.smithi087.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-03-30T09:51:26.920 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/258 2023-03-30T09:51:26.920 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/258 2023-03-30T09:51:26.921 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:26.933 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:27.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:27.021 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-03-30T09:51:27.684 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:27.707 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:27.708 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:27.713 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:27.714 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:28.090 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:51:28.094 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:51:29.111 INFO:teuthology.orchestra.run.smithi087.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:51:29.221 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/259 2023-03-30T09:51:29.221 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/259 2023-03-30T09:51:29.221 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:29.233 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:29.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:29.403 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-03-30T09:51:30.049 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:30.067 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:30.070 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:30.074 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:30.075 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:31.163 INFO:teuthology.orchestra.run.smithi087.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:31.247 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/260 2023-03-30T09:51:31.247 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/260 2023-03-30T09:51:31.247 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:31.260 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:31.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:31.342 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-03-30T09:51:31.998 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:32.017 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:32.019 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:32.023 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:32.024 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:33.412 INFO:teuthology.orchestra.run.smithi087.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:51:33.429 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/261 2023-03-30T09:51:33.430 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/261 2023-03-30T09:51:33.430 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:33.550 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:33.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:33.710 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-03-30T09:51:34.342 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:34.361 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:34.364 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:34.369 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:34.369 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:35.920 INFO:teuthology.orchestra.run.smithi087.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:51:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/262 2023-03-30T09:51:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/262 2023-03-30T09:51:35.980 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:51:36.001 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:36.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:51:36.102 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-03-30T09:51:36.751 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:51:36.768 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:51:36.770 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:51:36.775 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:51:36.775 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:51:58.187 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:51:58.193 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:52:28.381 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:52:28.387 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:52:52.527 INFO:teuthology.orchestra.run.smithi087.stdout:generic/263 75s 2023-03-30T09:52:52.552 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/263 2023-03-30T09:52:52.552 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:52:52.563 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:52:52.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:52:52.961 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-03-30T09:52:53.595 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:52:53.615 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:52:53.617 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:52:53.623 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:52:53.623 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:52:55.020 INFO:teuthology.orchestra.run.smithi087.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:52:55.078 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/264 2023-03-30T09:52:55.079 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/264 2023-03-30T09:52:55.079 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:52:55.114 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:52:55.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:52:55.262 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-03-30T09:52:55.894 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:52:55.915 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:52:55.918 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:52:55.924 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:52:55.924 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:52:57.473 INFO:teuthology.orchestra.run.smithi087.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:52:57.530 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/265 2023-03-30T09:52:57.530 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/265 2023-03-30T09:52:57.531 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:52:57.540 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:52:57.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:52:57.614 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-03-30T09:52:58.238 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:52:58.258 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:52:58.261 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:52:58.265 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:52:58.266 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:52:58.444 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:52:58.450 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:52:59.846 INFO:teuthology.orchestra.run.smithi087.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:52:59.881 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/266 2023-03-30T09:52:59.882 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/266 2023-03-30T09:52:59.882 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:52:59.891 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:52:59.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:52:59.978 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-03-30T09:53:00.628 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:00.648 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:00.650 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:00.654 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:00.654 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:02.021 INFO:teuthology.orchestra.run.smithi087.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:02.037 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/267 2023-03-30T09:53:02.038 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/267 2023-03-30T09:53:02.038 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:02.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:02.354 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-03-30T09:53:03.015 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:03.034 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:03.037 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:03.042 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:03.043 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:04.574 INFO:teuthology.orchestra.run.smithi087.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:04.613 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/268 2023-03-30T09:53:04.613 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/268 2023-03-30T09:53:04.613 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:04.655 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:04.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:04.745 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-03-30T09:53:05.387 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:05.408 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:05.410 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:05.415 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:05.415 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:06.269 INFO:teuthology.orchestra.run.smithi087.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T09:53:06.286 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/269 2023-03-30T09:53:06.287 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/269 2023-03-30T09:53:06.287 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:06.299 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:06.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:06.380 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-03-30T09:53:07.024 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:07.043 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:07.046 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:07.051 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:07.052 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:07.893 INFO:teuthology.orchestra.run.smithi087.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T09:53:07.913 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/270 2023-03-30T09:53:07.913 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/270 2023-03-30T09:53:07.913 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:07.924 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:08.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:08.030 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-03-30T09:53:08.680 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:08.699 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:08.702 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:08.707 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:08.707 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:10.171 INFO:teuthology.orchestra.run.smithi087.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:10.194 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/271 2023-03-30T09:53:10.194 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/271 2023-03-30T09:53:10.194 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:10.220 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:10.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:10.327 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-03-30T09:53:10.955 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:10.972 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:10.974 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:10.979 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:10.979 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:12.362 INFO:teuthology.orchestra.run.smithi087.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:12.393 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/272 2023-03-30T09:53:12.394 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/272 2023-03-30T09:53:12.394 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:12.557 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:12.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:12.663 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-03-30T09:53:13.293 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:13.312 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:13.315 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:13.319 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:13.319 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:14.178 INFO:teuthology.orchestra.run.smithi087.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T09:53:14.195 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/273 2023-03-30T09:53:14.195 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/273 2023-03-30T09:53:14.195 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:14.207 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:14.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:14.298 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-03-30T09:53:14.945 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:14.963 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:14.966 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:14.971 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:14.971 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:15.858 INFO:teuthology.orchestra.run.smithi087.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-30T09:53:15.877 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/274 2023-03-30T09:53:15.878 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/274 2023-03-30T09:53:15.878 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:15.889 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:15.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:15.972 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-03-30T09:53:16.619 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:16.638 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:16.641 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:16.646 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:16.646 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:17.506 INFO:teuthology.orchestra.run.smithi087.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T09:53:17.524 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/275 2023-03-30T09:53:17.525 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/275 2023-03-30T09:53:17.525 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:17.535 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:17.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:17.623 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-03-30T09:53:18.294 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:18.312 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:18.314 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:18.319 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:18.319 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:19.771 INFO:teuthology.orchestra.run.smithi087.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:19.849 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/276 2023-03-30T09:53:19.850 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/276 2023-03-30T09:53:19.850 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:19.875 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:19.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:19.974 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-03-30T09:53:20.605 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:20.626 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:20.628 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:20.633 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:20.633 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:21.508 INFO:teuthology.orchestra.run.smithi087.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-03-30T09:53:21.526 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/277 2023-03-30T09:53:21.527 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/277 2023-03-30T09:53:21.527 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:21.537 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:21.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:21.628 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-03-30T09:53:22.292 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:22.311 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:22.314 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:22.319 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:22.319 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:23.748 INFO:teuthology.orchestra.run.smithi087.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:23.799 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/278 2023-03-30T09:53:23.800 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/278 2023-03-30T09:53:23.800 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:23.899 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:23.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:23.992 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-03-30T09:53:24.612 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:24.631 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:24.634 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:24.639 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:24.639 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:26.097 INFO:teuthology.orchestra.run.smithi087.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:26.236 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/279 2023-03-30T09:53:26.236 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/279 2023-03-30T09:53:26.236 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:26.258 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:26.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:26.322 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-03-30T09:53:26.953 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:26.971 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:26.974 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:26.978 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:26.978 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:27.877 INFO:teuthology.orchestra.run.smithi087.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T09:53:27.893 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/280 2023-03-30T09:53:27.894 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/280 2023-03-30T09:53:27.894 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:27.905 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:28.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:28.012 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-03-30T09:53:28.531 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:53:28.536 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:53:28.694 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:28.716 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:28.718 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:28.723 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:28.723 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:30.272 INFO:teuthology.orchestra.run.smithi087.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:30.308 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/281 2023-03-30T09:53:30.308 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/281 2023-03-30T09:53:30.308 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:30.333 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:30.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:30.404 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-03-30T09:53:31.021 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:31.039 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:31.042 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:31.046 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:31.047 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:32.593 INFO:teuthology.orchestra.run.smithi087.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:32.655 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/282 2023-03-30T09:53:32.655 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/282 2023-03-30T09:53:32.655 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:32.675 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:32.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:32.749 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-03-30T09:53:33.408 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:33.427 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:33.430 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:33.436 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:33.436 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:34.972 INFO:teuthology.orchestra.run.smithi087.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:35.007 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/283 2023-03-30T09:53:35.007 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/283 2023-03-30T09:53:35.007 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:35.026 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:35.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:35.126 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-03-30T09:53:35.757 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:35.776 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:35.779 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:35.783 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:35.784 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:37.277 INFO:teuthology.orchestra.run.smithi087.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:37.359 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/284 2023-03-30T09:53:37.360 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/284 2023-03-30T09:53:37.360 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:37.400 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:37.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:37.488 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-03-30T09:53:38.126 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:38.145 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:38.147 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:38.152 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:38.152 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:40.793 INFO:teuthology.orchestra.run.smithi087.stdout:generic/285 2s 2023-03-30T09:53:40.815 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/285 2023-03-30T09:53:40.816 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:40.825 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:41.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:41.549 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-03-30T09:53:42.297 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:42.311 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:42.313 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:42.319 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:42.319 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:43.062 INFO:teuthology.orchestra.run.smithi087.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T09:53:43.078 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/286 2023-03-30T09:53:43.078 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/286 2023-03-30T09:53:43.078 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:43.088 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:43.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:43.160 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-03-30T09:53:43.732 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:43.747 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:43.748 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:43.751 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:43.751 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:45.014 INFO:teuthology.orchestra.run.smithi087.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:45.056 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/287 2023-03-30T09:53:45.056 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/287 2023-03-30T09:53:45.056 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:45.095 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:45.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:45.260 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-03-30T09:53:45.842 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:45.857 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:45.859 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:45.863 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:45.863 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:46.812 INFO:teuthology.orchestra.run.smithi087.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:46.857 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/288 2023-03-30T09:53:46.858 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/288 2023-03-30T09:53:46.858 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:46.865 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:46.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:46.940 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-03-30T09:53:47.518 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:47.536 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:47.538 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:47.542 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:47.542 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:48.950 INFO:teuthology.orchestra.run.smithi087.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:48.994 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/289 2023-03-30T09:53:48.994 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/289 2023-03-30T09:53:48.994 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:49.009 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:49.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:49.192 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-03-30T09:53:49.845 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:49.867 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:49.869 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:49.873 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:49.873 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:51.256 INFO:teuthology.orchestra.run.smithi087.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:51.363 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/290 2023-03-30T09:53:51.363 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/290 2023-03-30T09:53:51.363 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:51.373 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:51.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:51.564 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-03-30T09:53:52.190 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:52.210 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:52.213 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:52.217 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:52.218 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:53.752 INFO:teuthology.orchestra.run.smithi087.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:53.845 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/291 2023-03-30T09:53:53.845 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/291 2023-03-30T09:53:53.845 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:53.861 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:53.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:53.942 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-03-30T09:53:54.589 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:54.610 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:54.613 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:54.617 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:54.617 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:56.112 INFO:teuthology.orchestra.run.smithi087.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:56.174 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/292 2023-03-30T09:53:56.175 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/292 2023-03-30T09:53:56.175 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:56.214 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:56.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:56.347 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-03-30T09:53:57.004 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:57.023 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:57.025 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:57.029 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:57.029 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:58.490 INFO:teuthology.orchestra.run.smithi087.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:53:58.548 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/293 2023-03-30T09:53:58.549 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/293 2023-03-30T09:53:58.549 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:53:58.644 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:53:58.648 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:53:58.651 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:53:58.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:53:58.738 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-03-30T09:53:58.743 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T09:53:58.737+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41297) UID: 0 2023-03-30T09:53:58.744 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T09:53:58.737+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41297) UID: 0 2023-03-30T09:53:58.744 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T09:53:58.741+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41297) UID: 0 2023-03-30T09:53:58.745 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T09:53:58.737+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41297) UID: 0 2023-03-30T09:53:59.447 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:53:59.467 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:53:59.469 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:53:59.473 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:53:59.473 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:01.192 INFO:teuthology.orchestra.run.smithi087.stdout:generic/294 2s 2023-03-30T09:54:01.300 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/294 2023-03-30T09:54:01.300 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:01.311 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:01.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:01.341 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-03-30T09:54:01.962 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:01.982 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:01.985 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:01.990 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:03.465 INFO:teuthology.orchestra.run.smithi087.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:54:03.552 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/295 2023-03-30T09:54:03.553 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/295 2023-03-30T09:54:03.553 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:03.567 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:03.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:03.714 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-03-30T09:54:04.316 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:04.334 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:04.337 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:04.342 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:04.342 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:05.708 INFO:teuthology.orchestra.run.smithi087.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:54:05.828 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/296 2023-03-30T09:54:05.828 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/296 2023-03-30T09:54:05.828 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:05.891 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:06.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:06.041 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-03-30T09:54:06.695 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:06.715 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:06.717 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:06.723 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:06.723 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:08.240 INFO:teuthology.orchestra.run.smithi087.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:54:08.319 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/297 2023-03-30T09:54:08.319 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/297 2023-03-30T09:54:08.319 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:08.343 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:08.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:08.439 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-03-30T09:54:09.102 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:09.122 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:09.124 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:09.129 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:09.129 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:10.399 INFO:teuthology.orchestra.run.smithi087.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:54:10.419 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/298 2023-03-30T09:54:10.419 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/298 2023-03-30T09:54:10.420 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:10.432 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:10.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:10.810 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-03-30T09:54:11.466 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:11.484 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:11.486 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:11.491 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:11.491 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:12.523 INFO:teuthology.orchestra.run.smithi087.stdout:generic/299 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T09:54:12.540 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/299 2023-03-30T09:54:12.540 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/299 2023-03-30T09:54:12.540 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:12.551 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:12.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:12.653 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-03-30T09:54:13.299 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:13.318 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:13.320 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:13.325 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:13.325 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:14.389 INFO:teuthology.orchestra.run.smithi087.stdout:generic/300 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T09:54:14.408 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/300 2023-03-30T09:54:14.408 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/300 2023-03-30T09:54:14.409 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:14.420 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:14.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:14.519 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-03-30T09:54:15.169 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:15.190 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:15.192 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:15.195 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:15.196 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:16.718 INFO:teuthology.orchestra.run.smithi087.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:54:16.751 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/301 2023-03-30T09:54:16.752 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/301 2023-03-30T09:54:16.752 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:16.793 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:16.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:16.888 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-03-30T09:54:17.518 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:17.538 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:17.541 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:17.545 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:17.545 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:18.863 INFO:teuthology.orchestra.run.smithi087.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:54:18.880 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/302 2023-03-30T09:54:18.880 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/302 2023-03-30T09:54:18.880 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:19.029 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:19.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:19.264 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-03-30T09:54:19.940 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:19.961 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:19.964 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:19.969 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:19.969 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:20.980 INFO:teuthology.orchestra.run.smithi087.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T09:54:20.998 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/303 2023-03-30T09:54:20.998 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/303 2023-03-30T09:54:20.998 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:21.008 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:21.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:21.365 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-03-30T09:54:22.059 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:22.078 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:22.081 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:22.085 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:22.085 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:23.065 INFO:teuthology.orchestra.run.smithi087.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-30T09:54:23.083 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/304 2023-03-30T09:54:23.084 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/304 2023-03-30T09:54:23.084 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:23.095 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:23.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:23.442 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-03-30T09:54:24.121 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:24.142 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:24.144 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:24.150 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:24.150 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:25.757 INFO:teuthology.orchestra.run.smithi087.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:54:25.804 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/305 2023-03-30T09:54:25.805 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/305 2023-03-30T09:54:25.805 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:25.817 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:25.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:25.915 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-03-30T09:54:26.638 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:26.656 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:26.658 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:26.663 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:26.663 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:28.544 INFO:teuthology.orchestra.run.smithi087.stdout:generic/306 1s 2023-03-30T09:54:28.590 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/306 2023-03-30T09:54:28.590 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:28.648 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:29.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:29.014 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-03-30T09:54:29.639 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:29.658 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:29.660 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:29.666 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:29.666 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:32.386 INFO:teuthology.orchestra.run.smithi087.stdout:generic/307 2s 2023-03-30T09:54:32.411 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/307 2023-03-30T09:54:32.411 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:32.421 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:32.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:32.459 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-03-30T09:54:33.105 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:33.127 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:33.129 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:33.133 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:33.133 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:34.078 INFO:teuthology.orchestra.run.smithi087.stdout:generic/308 1s 2023-03-30T09:54:34.104 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/308 2023-03-30T09:54:34.104 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:34.115 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:34.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:34.222 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-03-30T09:54:34.849 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:34.867 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:34.869 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:34.873 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:34.874 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:36.875 INFO:teuthology.orchestra.run.smithi087.stdout:generic/309 1s 2023-03-30T09:54:36.897 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/309 2023-03-30T09:54:36.898 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:54:36.909 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:54:37.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:54:37.187 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-03-30T09:54:37.917 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:54:37.937 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:54:37.939 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:54:37.944 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:54:37.944 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:06.238 INFO:teuthology.orchestra.run.smithi087.stdout:generic/310 88s 2023-03-30T09:56:06.263 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/310 2023-03-30T09:56:06.263 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:56:06.274 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:06.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:56:06.704 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-03-30T09:56:07.445 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:56:07.464 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:56:07.466 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:56:07.470 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:56:07.470 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:08.404 INFO:teuthology.orchestra.run.smithi087.stdout:generic/311 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T09:56:08.421 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/311 2023-03-30T09:56:08.421 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/311 2023-03-30T09:56:08.422 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:56:08.434 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:08.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:56:08.550 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-03-30T09:56:09.204 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:56:09.226 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:56:09.228 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:56:09.233 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:56:09.233 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:10.124 INFO:teuthology.orchestra.run.smithi087.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T09:56:10.140 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/312 2023-03-30T09:56:10.140 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/312 2023-03-30T09:56:10.141 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:56:10.154 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:10.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:56:10.259 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-03-30T09:56:10.914 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:56:10.935 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:56:10.937 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:56:10.942 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:56:10.942 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:15.918 INFO:teuthology.orchestra.run.smithi087.stdout:generic/313 4s 2023-03-30T09:56:15.942 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/313 2023-03-30T09:56:15.942 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:56:15.954 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:16.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:56:16.069 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-03-30T09:56:16.707 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:56:16.725 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:56:16.727 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:56:16.732 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:56:16.732 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:18.090 INFO:teuthology.orchestra.run.smithi087.stdout:generic/314 1s 2023-03-30T09:56:18.114 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/314 2023-03-30T09:56:18.114 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:56:18.124 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:18.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:56:18.234 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-03-30T09:56:18.896 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:56:18.915 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:56:18.917 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:56:18.922 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:56:18.922 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:19.812 INFO:teuthology.orchestra.run.smithi087.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-30T09:56:19.828 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/315 2023-03-30T09:56:19.828 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/315 2023-03-30T09:56:19.829 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:56:19.841 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:19.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:56:19.941 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-03-30T09:56:20.604 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:56:20.624 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:56:20.626 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:56:20.630 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:56:20.630 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:21.836 INFO:teuthology.orchestra.run.smithi087.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-30T09:56:21.855 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/316 2023-03-30T09:56:21.855 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/316 2023-03-30T09:56:21.856 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:56:21.868 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:22.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:56:22.264 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-03-30T09:56:22.933 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:56:22.952 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:56:22.955 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:56:22.961 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:56:22.961 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:25.618 INFO:teuthology.orchestra.run.smithi087.stdout:generic/317 2s 2023-03-30T09:56:25.640 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/317 2023-03-30T09:56:25.641 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:56:25.651 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:25.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:56:25.685 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-03-30T09:56:26.347 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:56:26.366 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:56:26.368 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:56:26.374 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:56:26.374 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:28.416 INFO:teuthology.orchestra.run.smithi087.stdout:generic/318 2s 2023-03-30T09:56:28.441 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/318 2023-03-30T09:56:28.441 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:56:28.452 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:28.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:56:28.487 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-03-30T09:56:29.150 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:56:29.170 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:56:29.173 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:56:29.178 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:56:29.179 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:generic/319 1s 2023-03-30T09:56:30.579 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/319 2023-03-30T09:56:30.580 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:56:30.589 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:30.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:56:30.625 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-03-30T09:56:31.268 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:56:31.288 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:56:31.291 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:56:31.295 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:56:31.296 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:32.187 INFO:teuthology.orchestra.run.smithi087.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T09:56:32.204 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/320 2023-03-30T09:56:32.204 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/320 2023-03-30T09:56:32.205 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:56:32.215 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:32.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:56:32.330 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-03-30T09:56:32.981 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:56:32.999 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:56:33.001 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:56:33.005 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:56:33.005 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:33.897 INFO:teuthology.orchestra.run.smithi087.stdout:generic/321 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T09:56:33.913 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/321 2023-03-30T09:56:33.914 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/321 2023-03-30T09:56:33.914 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:56:33.922 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:34.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:56:34.019 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-03-30T09:56:34.684 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:56:34.705 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:56:34.708 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:56:34.712 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:56:34.713 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:35.581 INFO:teuthology.orchestra.run.smithi087.stdout:generic/322 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T09:56:35.600 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/322 2023-03-30T09:56:35.600 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/322 2023-03-30T09:56:35.601 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:56:35.612 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:35.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:56:35.696 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-03-30T09:56:36.355 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:56:36.375 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:56:36.377 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:56:36.381 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:56:36.382 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:56:41.847 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:56:41.851 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:57:11.916 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:57:11.921 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:57:41.987 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:57:41.994 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T09:57:42.030 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T09:57:42.024+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 272980) UID: 0 2023-03-30T09:57:42.030 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T09:57:42.024+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 272980) UID: 0 2023-03-30T09:57:42.031 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T09:57:42.024+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 272980) UID: 0 2023-03-30T09:57:42.031 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T09:57:42.024+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 272980) UID: 0 2023-03-30T09:58:38.410 INFO:teuthology.orchestra.run.smithi087.stdout:generic/323 122s 2023-03-30T09:58:38.507 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/323 2023-03-30T09:58:38.507 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:58:38.517 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:58:38.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:58:38.958 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-03-30T09:58:40.164 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:58:40.182 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:58:40.184 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:58:40.189 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:58:40.189 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:58:40.996 INFO:teuthology.orchestra.run.smithi087.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-03-30T09:58:41.013 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/324 2023-03-30T09:58:41.014 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/324 2023-03-30T09:58:41.014 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:58:41.027 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:58:41.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:58:41.119 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-03-30T09:58:41.681 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:58:41.695 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:58:41.697 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:58:41.699 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:58:41.699 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:58:43.272 INFO:teuthology.orchestra.run.smithi087.stdout:generic/325 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T09:58:44.839 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/325 2023-03-30T09:58:44.839 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/325 2023-03-30T09:58:44.839 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:58:44.849 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:58:44.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:58:44.924 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-03-30T09:58:46.509 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:58:46.527 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:58:46.529 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:58:46.534 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:58:46.534 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:58:48.596 INFO:teuthology.orchestra.run.smithi087.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:58:48.713 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/326 2023-03-30T09:58:48.713 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/326 2023-03-30T09:58:48.713 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:58:48.723 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:58:48.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:58:48.936 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-03-30T09:58:49.455 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:58:49.474 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:58:49.476 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:58:49.480 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:58:49.481 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:58:50.855 INFO:teuthology.orchestra.run.smithi087.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:58:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/327 2023-03-30T09:58:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/327 2023-03-30T09:58:50.988 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:58:51.014 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:58:51.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:58:51.091 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-03-30T09:58:51.660 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:58:51.678 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:58:51.681 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:58:51.685 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:58:51.685 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:58:53.800 INFO:teuthology.orchestra.run.smithi087.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:58:53.932 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/328 2023-03-30T09:58:53.932 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/328 2023-03-30T09:58:53.932 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:58:53.952 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:58:54.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:58:54.059 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-03-30T09:58:54.709 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:58:54.725 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:58:54.729 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:58:54.731 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:58:54.731 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:58:56.330 INFO:teuthology.orchestra.run.smithi087.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:58:56.349 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/329 2023-03-30T09:58:56.349 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/329 2023-03-30T09:58:56.349 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:58:56.357 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:58:56.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:58:56.442 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-03-30T09:58:57.055 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:58:57.073 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:58:57.075 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:58:57.079 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:58:57.079 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:58:58.769 INFO:teuthology.orchestra.run.smithi087.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:58:58.785 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/330 2023-03-30T09:58:58.786 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/330 2023-03-30T09:58:58.786 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:58:58.898 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:58:59.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:58:59.164 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-03-30T09:58:59.755 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:58:59.773 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:58:59.775 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:58:59.780 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:58:59.781 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:01.174 INFO:teuthology.orchestra.run.smithi087.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:59:01.242 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/331 2023-03-30T09:59:01.242 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/331 2023-03-30T09:59:01.242 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:59:01.300 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:01.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:59:01.394 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-03-30T09:59:02.009 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:59:02.026 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:59:02.028 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:59:02.031 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:59:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:03.396 INFO:teuthology.orchestra.run.smithi087.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:59:03.460 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/332 2023-03-30T09:59:03.461 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/332 2023-03-30T09:59:03.461 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:59:03.486 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:03.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:59:03.693 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-03-30T09:59:04.248 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:59:04.262 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:59:04.264 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:59:04.268 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:59:04.269 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:05.780 INFO:teuthology.orchestra.run.smithi087.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:59:05.800 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/333 2023-03-30T09:59:05.804 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/333 2023-03-30T09:59:05.805 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:59:05.815 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:05.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:59:05.983 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-03-30T09:59:06.560 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:59:06.577 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:59:06.579 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:59:06.583 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:59:06.584 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:07.878 INFO:teuthology.orchestra.run.smithi087.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T09:59:07.927 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/334 2023-03-30T09:59:07.928 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/334 2023-03-30T09:59:07.928 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:59:07.964 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:08.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:59:08.130 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-03-30T09:59:08.740 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:59:08.759 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:59:08.762 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:59:08.767 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:59:08.767 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:09.627 INFO:teuthology.orchestra.run.smithi087.stdout:generic/335 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T09:59:09.644 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/335 2023-03-30T09:59:09.644 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/335 2023-03-30T09:59:09.644 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:59:09.654 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:09.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:59:09.743 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-03-30T09:59:10.316 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:59:10.333 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:59:10.336 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:59:10.340 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:59:10.340 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:11.232 INFO:teuthology.orchestra.run.smithi087.stdout:generic/336 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T09:59:11.249 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/336 2023-03-30T09:59:11.250 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/336 2023-03-30T09:59:11.250 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:59:11.261 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:11.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:59:11.359 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-03-30T09:59:11.959 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:59:11.975 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:59:11.977 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:59:11.981 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:59:11.981 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:13.326 INFO:teuthology.orchestra.run.smithi087.stdout:generic/337 1s 2023-03-30T09:59:13.359 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/337 2023-03-30T09:59:13.360 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:59:13.372 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:13.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:59:13.402 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-03-30T09:59:14.014 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:59:14.032 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:59:14.034 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:59:14.038 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:59:14.038 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:14.849 INFO:teuthology.orchestra.run.smithi087.stdout:generic/338 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T09:59:14.865 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/338 2023-03-30T09:59:14.866 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/338 2023-03-30T09:59:14.866 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T09:59:14.877 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T09:59:14.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T09:59:14.956 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-03-30T09:59:15.530 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T09:59:15.547 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T09:59:15.548 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T09:59:15.551 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T09:59:15.552 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:00:25.231 INFO:teuthology.orchestra.run.smithi087.stdout:generic/339 70s 2023-03-30T10:00:25.254 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/339 2023-03-30T10:00:25.254 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:00:25.267 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:00:25.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:00:25.304 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-03-30T10:00:25.935 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:00:25.953 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:00:25.955 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:00:25.959 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:00:25.959 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:00:32.774 INFO:teuthology.orchestra.run.smithi087.stdout:generic/340 6s 2023-03-30T10:00:32.810 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/340 2023-03-30T10:00:32.810 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:00:32.843 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:00:32.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:00:32.868 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-03-30T10:00:33.532 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:00:33.543 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:00:33.545 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:00:33.548 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:00:33.549 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:00:34.422 INFO:teuthology.orchestra.run.smithi087.stdout:generic/341 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T10:00:34.438 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/341 2023-03-30T10:00:34.439 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/341 2023-03-30T10:00:34.439 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:00:34.449 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:00:34.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:00:34.534 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-03-30T10:00:35.129 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:00:35.146 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:00:35.148 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:00:35.152 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:00:35.152 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:00:35.909 INFO:teuthology.orchestra.run.smithi087.stdout:generic/342 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T10:00:35.927 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/342 2023-03-30T10:00:35.928 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/342 2023-03-30T10:00:35.928 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:00:35.937 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:00:36.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:00:36.022 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-03-30T10:00:36.623 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:00:36.639 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:00:36.641 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:00:36.645 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:00:36.645 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:00:37.504 INFO:teuthology.orchestra.run.smithi087.stdout:generic/343 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T10:00:37.518 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/343 2023-03-30T10:00:37.519 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/343 2023-03-30T10:00:37.519 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:00:37.529 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:00:37.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:00:37.631 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-03-30T10:00:38.247 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:00:38.267 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:00:38.269 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:00:38.273 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:00:38.273 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:00:48.948 INFO:teuthology.orchestra.run.smithi087.stdout:generic/344 10s 2023-03-30T10:00:48.990 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/344 2023-03-30T10:00:48.990 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:00:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:00:49.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:00:49.020 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-03-30T10:00:49.660 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:00:49.673 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:00:49.675 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:00:49.677 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:00:49.677 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:01.542 INFO:teuthology.orchestra.run.smithi087.stdout:generic/345 11s 2023-03-30T10:01:01.634 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/345 2023-03-30T10:01:01.635 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:01.644 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:01.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:01.680 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-03-30T10:01:02.325 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:02.340 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:02.343 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:02.346 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:02.347 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:08.902 INFO:teuthology.orchestra.run.smithi087.stdout:generic/346 6s 2023-03-30T10:01:09.026 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/346 2023-03-30T10:01:09.026 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:09.037 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:09.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:09.074 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-03-30T10:01:09.723 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:09.739 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:09.740 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:09.742 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:09.743 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:10.745 INFO:teuthology.orchestra.run.smithi087.stdout:generic/347 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T10:01:10.764 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/347 2023-03-30T10:01:10.764 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/347 2023-03-30T10:01:10.765 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:10.775 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:10.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:10.857 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-03-30T10:01:11.511 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:11.529 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:11.531 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:11.536 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:11.536 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:12.477 INFO:teuthology.orchestra.run.smithi087.stdout:generic/348 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T10:01:12.494 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/348 2023-03-30T10:01:12.495 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/348 2023-03-30T10:01:12.495 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:12.506 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:12.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:12.619 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-03-30T10:01:13.267 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:13.287 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:13.289 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:13.292 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:13.293 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:14.258 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:01:14.264 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:01:15.320 INFO:teuthology.orchestra.run.smithi087.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-30T10:01:15.339 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/349 2023-03-30T10:01:15.339 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/349 2023-03-30T10:01:15.339 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:15.353 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:15.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:15.460 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-03-30T10:01:16.149 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:16.167 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:16.170 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:16.174 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:16.174 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:18.194 INFO:teuthology.orchestra.run.smithi087.stdout:generic/350 2s 2023-03-30T10:01:18.216 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/350 2023-03-30T10:01:18.216 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:18.227 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:18.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:18.256 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-03-30T10:01:18.919 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:18.942 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:18.944 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:18.950 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:18.950 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:19.811 INFO:teuthology.orchestra.run.smithi087.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T10:01:19.829 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/351 2023-03-30T10:01:19.829 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/351 2023-03-30T10:01:19.829 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:19.840 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:19.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:19.915 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-03-30T10:01:20.571 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:20.590 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:20.593 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:20.597 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:20.597 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:22.041 INFO:teuthology.orchestra.run.smithi087.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T10:01:22.075 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/352 2023-03-30T10:01:22.075 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/352 2023-03-30T10:01:22.075 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:22.102 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:22.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:22.216 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-03-30T10:01:22.829 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:22.849 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:22.851 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:22.855 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:22.856 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:24.335 INFO:teuthology.orchestra.run.smithi087.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T10:01:24.408 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/353 2023-03-30T10:01:24.408 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/353 2023-03-30T10:01:24.409 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:24.418 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:24.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:24.541 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-03-30T10:01:25.183 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:25.202 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:25.204 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:25.209 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:25.209 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:36.452 INFO:teuthology.orchestra.run.smithi087.stdout:generic/354 11s 2023-03-30T10:01:36.475 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/354 2023-03-30T10:01:36.475 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:36.486 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:36.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:36.518 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-03-30T10:01:37.176 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:37.189 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:37.191 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:37.200 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:37.201 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:38.971 INFO:teuthology.orchestra.run.smithi087.stdout:generic/355 1s 2023-03-30T10:01:38.990 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/355 2023-03-30T10:01:38.991 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:39.001 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:39.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:39.254 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-03-30T10:01:40.019 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:40.037 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:40.040 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:40.044 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:40.045 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:41.338 INFO:teuthology.orchestra.run.smithi087.stdout:generic/356 [not run] swapfiles are not supported 2023-03-30T10:01:41.355 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/356 2023-03-30T10:01:41.355 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/356 2023-03-30T10:01:41.355 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:41.365 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:41.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:41.455 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-03-30T10:01:42.126 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:42.145 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:42.148 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:42.153 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:42.153 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:43.451 INFO:teuthology.orchestra.run.smithi087.stdout:generic/357 [not run] swapfiles are not supported 2023-03-30T10:01:43.471 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/357 2023-03-30T10:01:43.471 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/357 2023-03-30T10:01:43.472 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:43.483 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:43.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:43.570 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-03-30T10:01:44.226 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:44.243 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:44.245 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:44.250 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:44.250 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:45.059 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:01:45.065 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:01:45.765 INFO:teuthology.orchestra.run.smithi087.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T10:01:45.835 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/358 2023-03-30T10:01:45.836 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/358 2023-03-30T10:01:45.836 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:45.852 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:45.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:45.947 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-03-30T10:01:46.580 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:46.599 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:46.601 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:46.605 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:46.606 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:48.073 INFO:teuthology.orchestra.run.smithi087.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T10:01:48.192 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/359 2023-03-30T10:01:48.192 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/359 2023-03-30T10:01:48.193 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:48.220 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:48.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:48.318 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-03-30T10:01:48.956 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:48.975 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:48.977 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:48.981 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:49.931 INFO:teuthology.orchestra.run.smithi087.stdout:generic/360 0s 2023-03-30T10:01:49.959 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/360 2023-03-30T10:01:49.959 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:49.971 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:50.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:50.063 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-03-30T10:01:50.669 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:50.687 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:50.690 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:50.694 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:50.694 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:51.531 INFO:teuthology.orchestra.run.smithi087.stdout:generic/361 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T10:01:51.549 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/361 2023-03-30T10:01:51.549 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/361 2023-03-30T10:01:51.549 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:51.563 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:51.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:51.645 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-03-30T10:01:52.320 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:52.340 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:52.343 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:52.348 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:52.348 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:53.195 INFO:teuthology.orchestra.run.smithi087.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-30T10:01:53.212 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/362 2023-03-30T10:01:53.212 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/362 2023-03-30T10:01:53.212 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:53.222 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:53.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:53.307 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-03-30T10:01:53.952 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:53.972 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:53.974 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:53.978 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:53.978 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:54.816 INFO:teuthology.orchestra.run.smithi087.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-30T10:01:54.835 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/363 2023-03-30T10:01:54.835 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/363 2023-03-30T10:01:54.835 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:54.845 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:54.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:54.935 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-03-30T10:01:55.564 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:55.584 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:55.586 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:55.591 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:55.591 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:56.423 INFO:teuthology.orchestra.run.smithi087.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-30T10:01:56.444 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/364 2023-03-30T10:01:56.444 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/364 2023-03-30T10:01:56.444 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:56.457 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:56.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:56.547 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-03-30T10:01:57.203 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:57.222 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:57.224 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:57.230 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:57.230 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:58.064 INFO:teuthology.orchestra.run.smithi087.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-30T10:01:58.081 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/365 2023-03-30T10:01:58.081 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/365 2023-03-30T10:01:58.082 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:58.093 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:58.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:58.191 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-03-30T10:01:58.851 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:01:58.871 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:01:58.873 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:01:58.878 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:01:58.878 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:59.680 INFO:teuthology.orchestra.run.smithi087.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-30T10:01:59.695 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/366 2023-03-30T10:01:59.696 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/366 2023-03-30T10:01:59.696 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:01:59.707 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:01:59.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:01:59.797 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-03-30T10:02:00.454 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:00.475 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:00.479 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:00.483 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:00.483 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:01.353 INFO:teuthology.orchestra.run.smithi087.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-30T10:02:01.371 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/367 2023-03-30T10:02:01.372 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/367 2023-03-30T10:02:01.372 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:01.385 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:01.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:01.470 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-03-30T10:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:02.137 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:02.139 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:02.964 INFO:teuthology.orchestra.run.smithi087.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-30T10:02:02.981 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/368 2023-03-30T10:02:02.982 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/368 2023-03-30T10:02:02.982 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:02.992 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:03.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:03.095 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-03-30T10:02:03.756 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:03.776 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:03.778 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:03.783 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:03.783 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:04.607 INFO:teuthology.orchestra.run.smithi087.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-30T10:02:04.625 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/369 2023-03-30T10:02:04.625 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/369 2023-03-30T10:02:04.626 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:04.636 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:04.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:04.727 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-03-30T10:02:05.383 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:05.403 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:05.405 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:05.410 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:05.410 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:06.273 INFO:teuthology.orchestra.run.smithi087.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-30T10:02:06.290 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/370 2023-03-30T10:02:06.290 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/370 2023-03-30T10:02:06.291 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:06.301 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:06.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:06.398 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-03-30T10:02:07.042 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:07.063 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:07.066 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:07.071 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:07.071 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:07.906 INFO:teuthology.orchestra.run.smithi087.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T10:02:07.925 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/371 2023-03-30T10:02:07.926 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/371 2023-03-30T10:02:07.926 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:07.937 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:08.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:08.036 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-03-30T10:02:08.717 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:08.739 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:08.742 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:08.747 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:08.747 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:10.119 INFO:teuthology.orchestra.run.smithi087.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T10:02:10.165 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/372 2023-03-30T10:02:10.165 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/372 2023-03-30T10:02:10.165 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:10.268 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:10.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:10.393 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-03-30T10:02:11.000 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:11.022 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:11.024 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:11.029 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:11.029 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:12.544 INFO:teuthology.orchestra.run.smithi087.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T10:02:12.576 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/373 2023-03-30T10:02:12.576 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/373 2023-03-30T10:02:12.576 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:12.597 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:12.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:12.684 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-03-30T10:02:13.295 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:13.314 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:13.316 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:13.320 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:13.321 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:14.523 INFO:teuthology.orchestra.run.smithi087.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-03-30T10:02:14.752 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/374 2023-03-30T10:02:14.752 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/374 2023-03-30T10:02:14.752 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:14.837 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:15.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:15.082 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-03-30T10:02:15.143 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:02:15.147 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:02:15.719 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:15.738 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:15.740 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:15.745 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:15.745 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:16.882 INFO:teuthology.orchestra.run.smithi087.stdout:generic/375 0s 2023-03-30T10:02:16.906 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/375 2023-03-30T10:02:16.907 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:16.916 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:17.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:17.266 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-03-30T10:02:17.921 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:17.942 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:17.944 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:17.949 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:17.949 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:18.882 INFO:teuthology.orchestra.run.smithi087.stdout:generic/376 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T10:02:18.900 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/376 2023-03-30T10:02:18.901 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/376 2023-03-30T10:02:18.901 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:18.912 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:19.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:19.002 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-03-30T10:02:19.632 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:19.652 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:19.655 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:19.660 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:19.660 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:20.995 INFO:teuthology.orchestra.run.smithi087.stdout:generic/377 0s 2023-03-30T10:02:21.017 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/377 2023-03-30T10:02:21.017 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:21.030 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:21.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:21.063 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-03-30T10:02:21.712 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:21.731 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:21.733 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:21.737 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:21.737 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:23.105 INFO:teuthology.orchestra.run.smithi087.stdout:generic/378 1s 2023-03-30T10:02:23.130 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/378 2023-03-30T10:02:23.130 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:23.141 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:23.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:23.530 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-03-30T10:02:24.164 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:24.183 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:24.186 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:24.190 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:24.190 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:25.068 INFO:teuthology.orchestra.run.smithi087.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T10:02:25.087 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/379 2023-03-30T10:02:25.088 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/379 2023-03-30T10:02:25.088 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:25.100 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:25.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:25.188 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-03-30T10:02:25.827 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:25.846 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:25.848 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:25.854 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:25.854 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:26.660 INFO:teuthology.orchestra.run.smithi087.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T10:02:26.680 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/380 2023-03-30T10:02:26.680 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/380 2023-03-30T10:02:26.680 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:26.692 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:26.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:26.794 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-03-30T10:02:27.451 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:27.471 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:27.474 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:27.479 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:27.479 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:28.337 INFO:teuthology.orchestra.run.smithi087.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T10:02:28.356 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/381 2023-03-30T10:02:28.356 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/381 2023-03-30T10:02:28.356 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:28.367 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:28.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:28.470 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-03-30T10:02:29.119 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:29.138 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:29.141 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:29.146 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:29.147 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:29.980 INFO:teuthology.orchestra.run.smithi087.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T10:02:29.999 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/382 2023-03-30T10:02:29.999 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/382 2023-03-30T10:02:29.999 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:30.010 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:30.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:30.087 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-03-30T10:02:30.754 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:30.773 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:30.776 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:30.781 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:30.782 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:31.635 INFO:teuthology.orchestra.run.smithi087.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T10:02:31.655 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/383 2023-03-30T10:02:31.655 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/383 2023-03-30T10:02:31.656 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:31.669 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:31.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:31.762 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-03-30T10:02:32.415 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:32.435 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:32.436 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:32.441 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:32.441 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:33.300 INFO:teuthology.orchestra.run.smithi087.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T10:02:33.318 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/384 2023-03-30T10:02:33.318 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/384 2023-03-30T10:02:33.319 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:33.328 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:33.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:33.439 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-03-30T10:02:34.107 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:34.124 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:34.127 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:34.132 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:34.132 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:34.996 INFO:teuthology.orchestra.run.smithi087.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T10:02:35.012 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/385 2023-03-30T10:02:35.012 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/385 2023-03-30T10:02:35.012 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:35.023 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:35.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:35.127 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-03-30T10:02:35.790 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:35.814 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:35.816 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:35.821 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:35.821 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:36.655 INFO:teuthology.orchestra.run.smithi087.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T10:02:36.671 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/386 2023-03-30T10:02:36.671 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/386 2023-03-30T10:02:36.671 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:36.682 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:36.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:36.754 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-03-30T10:02:37.436 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:37.457 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:37.469 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:37.469 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:37.470 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:38.940 INFO:teuthology.orchestra.run.smithi087.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T10:02:39.023 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/387 2023-03-30T10:02:39.023 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/387 2023-03-30T10:02:39.023 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:39.051 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:39.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:39.125 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-03-30T10:02:39.781 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:39.801 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:39.803 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:39.808 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:39.808 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:40.687 INFO:teuthology.orchestra.run.smithi087.stdout:generic/388 [not run] require 172.21.15.87:6789:/scratch to be local device 2023-03-30T10:02:40.704 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/388 2023-03-30T10:02:40.704 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/388 2023-03-30T10:02:40.704 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:40.715 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:40.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:40.802 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-03-30T10:02:41.465 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:41.487 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:41.490 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:41.495 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:41.495 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:42.356 INFO:teuthology.orchestra.run.smithi087.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-03-30T10:02:42.376 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/389 2023-03-30T10:02:42.376 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/389 2023-03-30T10:02:42.376 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:42.388 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:42.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:42.471 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-03-30T10:02:43.127 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:43.147 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:43.149 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:43.153 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:43.153 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:44.067 INFO:teuthology.orchestra.run.smithi087.stdout:generic/390 [not run] ceph does not support freezing 2023-03-30T10:02:44.085 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/390 2023-03-30T10:02:44.085 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/390 2023-03-30T10:02:44.085 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:44.097 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:44.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:44.190 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-03-30T10:02:44.851 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:44.871 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:44.873 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:44.877 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:44.878 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:45.264 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:02:45.270 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:02:45.750 INFO:teuthology.orchestra.run.smithi087.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T10:02:45.767 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/391 2023-03-30T10:02:45.767 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/391 2023-03-30T10:02:45.767 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:45.777 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:45.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:45.870 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-03-30T10:02:46.516 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:46.535 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:46.538 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:46.543 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:46.543 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:47.604 INFO:teuthology.orchestra.run.smithi087.stdout:generic/392 [not run] ceph does not support shutdown 2023-03-30T10:02:47.686 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/392 2023-03-30T10:02:47.686 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/392 2023-03-30T10:02:47.687 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:47.696 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:47.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:47.770 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-03-30T10:02:48.457 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:48.475 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:48.478 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:48.482 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:48.482 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:50.661 INFO:teuthology.orchestra.run.smithi087.stdout:generic/393 2s 2023-03-30T10:02:50.683 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/393 2023-03-30T10:02:50.683 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:50.694 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:50.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:50.731 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-03-30T10:02:51.391 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:51.410 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:51.412 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:51.418 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:51.418 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:52.374 INFO:teuthology.orchestra.run.smithi087.stdout:generic/394 1s 2023-03-30T10:02:52.399 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/394 2023-03-30T10:02:52.399 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:52.413 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:52.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:52.897 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-03-30T10:02:53.499 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:53.513 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:53.515 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:53.519 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:53.519 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:56.138 INFO:teuthology.orchestra.run.smithi087.stdout:generic/395 3s 2023-03-30T10:02:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/395 2023-03-30T10:02:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:56.203 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:56.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:56.231 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-03-30T10:02:56.873 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:56.890 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:56.893 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:56.897 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:56.897 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:58.737 INFO:teuthology.orchestra.run.smithi087.stdout:generic/396 1s 2023-03-30T10:02:58.761 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/396 2023-03-30T10:02:58.762 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:02:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:02:58.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:02:58.811 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-03-30T10:02:59.469 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:02:59.493 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:02:59.495 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:02:59.500 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:02:59.500 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:02.689 INFO:teuthology.orchestra.run.smithi087.stdout:generic/397 3s 2023-03-30T10:03:02.712 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/397 2023-03-30T10:03:02.713 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:02.723 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:02.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:02.756 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-03-30T10:03:03.419 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:03.439 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:03.441 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:03.446 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:03.446 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:04.961 INFO:teuthology.orchestra.run.smithi087.stdout:generic/398 [not run] kernel doesn't support renameat2 syscall 2023-03-30T10:03:04.980 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/398 2023-03-30T10:03:04.980 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/398 2023-03-30T10:03:04.981 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:04.993 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:05.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:05.221 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-03-30T10:03:06.020 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:06.040 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:06.043 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:06.047 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:06.047 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:07.512 INFO:teuthology.orchestra.run.smithi087.stdout:generic/399 [not run] Filesystem ceph not supported in _scratch_mkfs_sized_encrypted 2023-03-30T10:03:07.531 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/399 2023-03-30T10:03:07.532 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/399 2023-03-30T10:03:07.532 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:07.543 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:07.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:07.650 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-03-30T10:03:08.325 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:08.345 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:08.347 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:08.352 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:08.353 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:09.173 INFO:teuthology.orchestra.run.smithi087.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T10:03:09.190 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/400 2023-03-30T10:03:09.190 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/400 2023-03-30T10:03:09.190 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:09.203 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:09.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:09.307 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-03-30T10:03:09.906 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:09.929 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:09.931 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:09.937 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:09.937 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:11.696 INFO:teuthology.orchestra.run.smithi087.stdout:generic/401 1s 2023-03-30T10:03:11.727 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/401 2023-03-30T10:03:11.727 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:11.734 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:11.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:11.761 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-03-30T10:03:12.402 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:12.423 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:12.425 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:12.429 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:12.429 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:13.588 INFO:teuthology.orchestra.run.smithi087.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-03-30T10:03:13.646 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/402 2023-03-30T10:03:13.647 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/402 2023-03-30T10:03:13.647 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:13.657 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:13.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:13.758 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-03-30T10:03:14.431 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:14.450 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:14.452 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:14.456 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:14.457 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:15.352 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:03:15.356 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:03:16.422 INFO:teuthology.orchestra.run.smithi087.stdout:generic/403 2s 2023-03-30T10:03:16.445 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/403 2023-03-30T10:03:16.446 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:16.456 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:16.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:16.490 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-03-30T10:03:17.136 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:17.158 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:17.161 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:17.165 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:17.166 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:18.052 INFO:teuthology.orchestra.run.smithi087.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T10:03:18.068 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/404 2023-03-30T10:03:18.068 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/404 2023-03-30T10:03:18.068 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:18.080 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:18.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:18.182 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-03-30T10:03:18.832 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:18.853 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:18.855 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:18.860 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:18.860 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:19.833 INFO:teuthology.orchestra.run.smithi087.stdout:generic/405 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T10:03:19.853 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/405 2023-03-30T10:03:19.853 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/405 2023-03-30T10:03:19.854 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:19.864 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:19.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:19.940 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-03-30T10:03:20.599 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:20.617 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:20.620 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:20.625 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:20.625 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:24.041 INFO:teuthology.orchestra.run.smithi087.stdout:generic/406 4s 2023-03-30T10:03:24.065 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/406 2023-03-30T10:03:24.065 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:24.077 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:24.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:24.110 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-03-30T10:03:24.762 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:24.783 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:24.785 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:24.789 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:24.790 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:25.785 INFO:teuthology.orchestra.run.smithi087.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T10:03:25.795 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/407 2023-03-30T10:03:25.795 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/407 2023-03-30T10:03:25.795 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:25.802 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:26.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:26.230 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-03-30T10:03:26.855 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:26.876 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:26.878 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:26.883 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:26.883 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:27.871 INFO:teuthology.orchestra.run.smithi087.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-30T10:03:27.889 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/408 2023-03-30T10:03:27.889 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/408 2023-03-30T10:03:27.889 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:27.902 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:28.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:28.284 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-03-30T10:03:28.939 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:28.958 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:28.960 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:28.965 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:28.966 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:29.842 INFO:teuthology.orchestra.run.smithi087.stdout:generic/409 [not run] require 172.21.15.87:6789:/scratch to be local device 2023-03-30T10:03:29.858 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/409 2023-03-30T10:03:29.859 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/409 2023-03-30T10:03:29.859 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:29.869 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:29.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:29.941 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-03-30T10:03:30.588 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:30.607 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:30.610 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:30.614 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:30.614 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:31.507 INFO:teuthology.orchestra.run.smithi087.stdout:generic/410 [not run] require 172.21.15.87:6789:/scratch to be local device 2023-03-30T10:03:31.525 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/410 2023-03-30T10:03:31.525 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/410 2023-03-30T10:03:31.526 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:31.536 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:31.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:31.630 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-03-30T10:03:32.272 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:32.290 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:32.293 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:32.298 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:32.298 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:33.176 INFO:teuthology.orchestra.run.smithi087.stdout:generic/411 [not run] require 172.21.15.87:6789:/scratch to be local device 2023-03-30T10:03:33.194 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/411 2023-03-30T10:03:33.195 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/411 2023-03-30T10:03:33.195 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:33.207 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:33.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:33.309 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-03-30T10:03:33.939 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:33.959 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:33.961 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:33.966 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:33.966 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:35.570 INFO:teuthology.orchestra.run.smithi087.stdout:generic/412 1s 2023-03-30T10:03:35.594 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/412 2023-03-30T10:03:35.594 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:35.605 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:35.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:35.639 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-03-30T10:03:36.276 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:36.294 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:36.296 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:36.301 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:36.301 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:37.412 INFO:teuthology.orchestra.run.smithi087.stdout:generic/413 [not run] mount 172.21.15.87:6789:/scratch with dax failed 2023-03-30T10:03:37.429 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/413 2023-03-30T10:03:37.429 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/413 2023-03-30T10:03:37.429 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:37.441 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:37.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:37.539 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-03-30T10:03:38.178 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:38.197 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:38.200 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:38.204 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:38.204 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:39.515 INFO:teuthology.orchestra.run.smithi087.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T10:03:39.535 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/414 2023-03-30T10:03:39.535 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/414 2023-03-30T10:03:39.535 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:39.556 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:39.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:39.818 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-03-30T10:03:40.425 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:40.446 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:40.448 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:40.452 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:40.452 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:41.670 INFO:teuthology.orchestra.run.smithi087.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T10:03:41.869 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/415 2023-03-30T10:03:41.869 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/415 2023-03-30T10:03:41.869 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:41.971 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:42.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:42.098 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-03-30T10:03:42.740 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:42.761 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:42.764 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:42.769 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:42.769 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:43.663 INFO:teuthology.orchestra.run.smithi087.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T10:03:43.679 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/416 2023-03-30T10:03:43.679 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/416 2023-03-30T10:03:43.680 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:43.690 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:43.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:43.779 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-03-30T10:03:44.434 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:44.455 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:44.457 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:44.461 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:44.461 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:45.556 INFO:teuthology.orchestra.run.smithi087.stdout:generic/417 [not run] ceph does not support shutdown 2023-03-30T10:03:45.623 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/417 2023-03-30T10:03:45.623 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/417 2023-03-30T10:03:45.624 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:45.637 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:45.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:45.711 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-03-30T10:03:45.720 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:03:45.767 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:03:46.348 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:46.366 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:46.368 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:46.372 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:46.372 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:47.301 INFO:teuthology.orchestra.run.smithi087.stdout:generic/418 [not run] require 172.21.15.87:6789:/test to be valid block disk 2023-03-30T10:03:47.318 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/418 2023-03-30T10:03:47.319 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/418 2023-03-30T10:03:47.319 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:47.329 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:47.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:47.435 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-03-30T10:03:48.086 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:48.107 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:48.109 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:48.114 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:48.114 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:49.573 INFO:teuthology.orchestra.run.smithi087.stdout:generic/419 [not run] kernel doesn't support renameat2 syscall 2023-03-30T10:03:49.591 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/419 2023-03-30T10:03:49.591 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/419 2023-03-30T10:03:49.591 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:49.601 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:49.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:49.855 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-03-30T10:03:50.611 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:50.630 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:50.633 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:50.637 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:50.637 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:51.793 INFO:teuthology.orchestra.run.smithi087.stdout:generic/420 1s 2023-03-30T10:03:51.818 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/420 2023-03-30T10:03:51.818 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:03:51.828 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:03:52.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:03:52.214 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-03-30T10:03:52.909 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:03:52.928 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:03:52.931 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:03:52.936 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:03:52.936 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:04:03.756 INFO:teuthology.orchestra.run.smithi087.stdout:generic/421 10s 2023-03-30T10:04:03.773 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/421 2023-03-30T10:04:03.773 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:04:03.780 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:04:03.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:04:03.803 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-03-30T10:04:04.443 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:04:04.464 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:04:04.467 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:04:04.472 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:04:04.472 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:04:05.398 INFO:teuthology.orchestra.run.smithi087.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-30T10:04:05.417 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/422 2023-03-30T10:04:05.417 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/422 2023-03-30T10:04:05.418 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:04:05.428 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:04:05.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:04:05.537 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-03-30T10:04:06.203 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:04:06.221 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:04:06.223 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:04:06.228 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:04:06.228 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:04:07.362 INFO:teuthology.orchestra.run.smithi087.stdout:generic/423 1s 2023-03-30T10:04:07.387 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/423 2023-03-30T10:04:07.388 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:04:07.401 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:04:07.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:04:07.589 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-03-30T10:04:08.423 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:04:08.442 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:04:08.444 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:04:08.449 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:04:08.449 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:04:09.380 INFO:teuthology.orchestra.run.smithi087.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2023-03-30T10:04:09.399 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/424 2023-03-30T10:04:09.399 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/424 2023-03-30T10:04:09.400 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:04:09.412 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:04:09.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:04:09.507 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-03-30T10:04:10.148 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:04:10.166 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:04:10.168 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:04:10.173 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:04:10.173 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:04:11.135 INFO:teuthology.orchestra.run.smithi087.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-03-30T10:04:11.151 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/425 2023-03-30T10:04:11.152 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/425 2023-03-30T10:04:11.152 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:04:11.163 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:04:11.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:04:11.547 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-03-30T10:04:12.223 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:04:12.241 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:04:12.243 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:04:12.248 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:04:12.249 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:04:15.836 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:04:15.842 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:04:45.966 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:04:45.971 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:04:57.592 INFO:teuthology.orchestra.run.smithi087.stdout:generic/426 45s 2023-03-30T10:04:57.755 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/426 2023-03-30T10:04:57.755 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:04:57.779 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:04:58.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:04:58.210 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-03-30T10:05:00.071 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:05:00.091 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:05:00.093 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:05:00.097 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:05:00.097 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:01.193 INFO:teuthology.orchestra.run.smithi087.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T10:05:01.209 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/427 2023-03-30T10:05:01.209 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/427 2023-03-30T10:05:01.209 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:05:01.221 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:01.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:05:01.331 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-03-30T10:05:01.976 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:05:01.995 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:05:01.997 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:05:02.002 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:05:02.002 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:02.970 INFO:teuthology.orchestra.run.smithi087.stdout:generic/428 0s 2023-03-30T10:05:02.994 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/428 2023-03-30T10:05:02.994 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:05:03.006 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:03.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:05:03.118 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-03-30T10:05:03.766 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:05:03.786 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:05:03.787 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:05:03.791 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:05:03.791 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:16.867 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:05:16.873 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:05:16.916 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T10:05:16.908+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41854) UID: 0 2023-03-30T10:05:16.916 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T10:05:16.908+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41854) UID: 0 2023-03-30T10:05:17.033 INFO:teuthology.orchestra.run.smithi087.stdout:generic/429 13s 2023-03-30T10:05:17.059 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/429 2023-03-30T10:05:17.060 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:05:17.070 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:17.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:05:17.106 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-03-30T10:05:18.073 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:05:18.106 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:05:18.108 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:05:18.116 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:05:18.117 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:19.382 INFO:teuthology.orchestra.run.smithi087.stdout:generic/430 1s 2023-03-30T10:05:19.404 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/430 2023-03-30T10:05:19.404 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:05:19.415 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:19.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:05:19.692 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-03-30T10:05:20.441 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:05:20.460 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:05:20.462 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:05:20.466 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:05:20.466 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:21.622 INFO:teuthology.orchestra.run.smithi087.stdout:generic/431 1s 2023-03-30T10:05:21.649 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/431 2023-03-30T10:05:21.649 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:05:21.660 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:22.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:05:22.031 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-03-30T10:05:22.666 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:05:22.686 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:05:22.688 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:05:22.693 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:05:22.693 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:23.861 INFO:teuthology.orchestra.run.smithi087.stdout:generic/432 0s 2023-03-30T10:05:23.884 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/432 2023-03-30T10:05:23.885 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:05:23.894 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:24.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:05:24.103 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-03-30T10:05:24.914 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:05:24.935 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:05:24.937 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:05:24.942 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:05:24.942 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:26.027 INFO:teuthology.orchestra.run.smithi087.stdout:generic/433 1s 2023-03-30T10:05:26.055 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/433 2023-03-30T10:05:26.055 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:05:26.067 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:26.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:05:26.389 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-03-30T10:05:27.100 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:05:27.122 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:05:27.124 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:05:27.128 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:05:27.128 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:28.285 INFO:teuthology.orchestra.run.smithi087.stdout:generic/434 1s 2023-03-30T10:05:28.309 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/434 2023-03-30T10:05:28.310 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:05:28.320 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:05:28.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:05:28.601 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-03-30T10:05:29.317 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:05:29.338 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:05:29.340 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:05:29.345 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:05:29.345 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:08:07.148 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:08:07.155 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:08:37.284 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:08:37.288 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:09:07.435 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:09:07.440 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:09:38.134 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:09:38.141 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:10:08.198 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:10:08.202 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:10:38.474 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:10:38.479 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:11:08.612 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:11:08.618 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:11:40.258 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:11:40.262 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:11:40.323 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T10:11:40.317+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41886) UID: 0 2023-03-30T10:11:40.323 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T10:11:40.317+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41886) UID: 0 2023-03-30T10:15:24.827 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:15:24.833 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:15:54.988 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:15:54.992 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:16:26.051 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:16:26.063 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:16:56.165 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:16:56.172 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:16:56.210 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T10:16:56.204+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41916) UID: 0 2023-03-30T10:16:56.211 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T10:16:56.204+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41916) UID: 0 2023-03-30T10:18:27.192 INFO:teuthology.orchestra.run.smithi087.stdout:generic/435 778s 2023-03-30T10:18:27.229 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/435 2023-03-30T10:18:27.229 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:18:27.242 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:18:27.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:18:27.275 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-03-30T10:18:28.281 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:18:28.299 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:18:28.302 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:18:28.307 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:18:28.307 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:18:29.778 INFO:teuthology.orchestra.run.smithi087.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T10:18:29.796 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/436 2023-03-30T10:18:29.797 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/436 2023-03-30T10:18:29.797 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:18:29.807 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:18:30.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:18:30.167 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-03-30T10:18:30.820 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:18:30.841 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:18:30.844 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:18:30.849 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:18:30.849 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:18:32.687 INFO:teuthology.orchestra.run.smithi087.stdout:generic/437 1s 2023-03-30T10:18:32.711 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/437 2023-03-30T10:18:32.712 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:18:32.722 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:18:32.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:18:32.827 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-03-30T10:18:33.500 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:18:33.518 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:18:33.520 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:18:33.525 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:18:33.526 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:19:57.739 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:19:57.743 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:20:27.868 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:20:27.872 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:20:28.425 INFO:teuthology.orchestra.run.smithi087.stdout:generic/438 115s 2023-03-30T10:20:28.447 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/438 2023-03-30T10:20:28.448 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:20:28.457 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:28.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:20:28.542 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-03-30T10:20:29.196 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:20:29.212 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:20:29.215 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:20:29.220 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:20:29.220 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:31.300 INFO:teuthology.orchestra.run.smithi087.stdout:generic/439 2s 2023-03-30T10:20:31.324 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/439 2023-03-30T10:20:31.324 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:20:31.336 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:31.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:20:31.430 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-03-30T10:20:31.999 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:20:32.016 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:20:32.019 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:20:32.024 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:20:32.024 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:34.997 INFO:teuthology.orchestra.run.smithi087.stdout:generic/440 2s 2023-03-30T10:20:35.021 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/440 2023-03-30T10:20:35.021 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:20:35.032 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:35.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:20:35.065 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-03-30T10:20:35.707 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:20:35.727 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:20:35.729 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:20:35.734 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:20:35.734 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:36.750 INFO:teuthology.orchestra.run.smithi087.stdout:generic/441 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T10:20:36.769 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/441 2023-03-30T10:20:36.770 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/441 2023-03-30T10:20:36.770 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:20:36.781 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:36.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:20:36.863 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-03-30T10:20:37.535 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:20:37.552 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:20:37.554 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:20:37.559 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:20:37.559 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:38.474 INFO:teuthology.orchestra.run.smithi087.stdout:generic/442 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T10:20:38.490 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/442 2023-03-30T10:20:38.490 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/442 2023-03-30T10:20:38.491 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:20:38.501 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:38.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:20:38.610 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-03-30T10:20:39.260 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:20:39.280 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:20:39.283 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:20:39.288 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:20:39.288 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:40.218 INFO:teuthology.orchestra.run.smithi087.stdout:generic/443 1s 2023-03-30T10:20:40.244 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/443 2023-03-30T10:20:40.244 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:20:40.257 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:40.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:20:40.360 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-03-30T10:20:41.008 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:20:41.029 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:20:41.031 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:20:41.037 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:20:41.037 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:42.104 INFO:teuthology.orchestra.run.smithi087.stdout:generic/444 1s 2023-03-30T10:20:42.127 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/444 2023-03-30T10:20:42.127 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:20:42.139 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:42.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:20:42.252 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-03-30T10:20:42.901 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:20:42.920 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:20:42.923 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:20:42.928 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:20:42.928 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:44.444 INFO:teuthology.orchestra.run.smithi087.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T10:20:44.463 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/445 2023-03-30T10:20:44.464 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/445 2023-03-30T10:20:44.464 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:20:44.474 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:44.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:20:44.845 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-03-30T10:20:45.548 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:20:45.565 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:20:45.568 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:20:45.572 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:20:45.573 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:20:58.024 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:20:58.029 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:21:27.730 INFO:teuthology.orchestra.run.smithi087.stdout:generic/446 42s 2023-03-30T10:21:27.804 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/446 2023-03-30T10:21:27.804 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:21:27.823 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:21:27.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:21:27.866 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-03-30T10:21:28.093 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:21:28.099 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:21:28.493 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:21:28.512 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:21:28.515 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:21:28.518 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:21:28.519 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:21:29.958 INFO:teuthology.orchestra.run.smithi087.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T10:21:29.989 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/447 2023-03-30T10:21:29.990 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/447 2023-03-30T10:21:29.990 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:21:30.062 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:21:30.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:21:30.203 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-03-30T10:21:30.844 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:21:30.864 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:21:30.866 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:21:30.870 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:21:30.871 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:21:33.218 INFO:teuthology.orchestra.run.smithi087.stdout:generic/448 2s 2023-03-30T10:21:33.239 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/448 2023-03-30T10:21:33.239 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:21:33.250 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:21:33.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:21:33.520 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-03-30T10:21:34.295 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:21:34.314 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:21:34.316 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:21:34.321 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:21:34.321 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:21:35.303 INFO:teuthology.orchestra.run.smithi087.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T10:21:35.324 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/449 2023-03-30T10:21:35.325 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/449 2023-03-30T10:21:35.325 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:21:35.335 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:21:35.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:21:35.502 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-03-30T10:21:36.376 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:21:36.396 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:21:36.398 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:21:36.403 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:21:36.403 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:21:38.056 INFO:teuthology.orchestra.run.smithi087.stdout:generic/450 2s 2023-03-30T10:21:38.079 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/450 2023-03-30T10:21:38.080 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:21:38.090 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:21:38.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:21:38.481 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-03-30T10:21:39.168 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:21:39.188 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:21:39.191 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:21:39.197 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:21:39.197 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:21:58.162 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:21:58.167 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:22:10.461 INFO:teuthology.orchestra.run.smithi087.stdout:generic/451 31s 2023-03-30T10:22:10.484 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/451 2023-03-30T10:22:10.484 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:22:10.492 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:10.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:22:10.768 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-03-30T10:22:11.600 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:22:11.618 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:22:11.621 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:22:11.627 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:22:11.627 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:13.028 INFO:teuthology.orchestra.run.smithi087.stdout:generic/452 2s 2023-03-30T10:22:13.051 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/452 2023-03-30T10:22:13.052 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:22:13.062 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:13.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:22:13.095 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-03-30T10:22:13.776 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:22:13.796 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:22:13.799 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:22:13.804 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:22:13.804 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:14.637 INFO:teuthology.orchestra.run.smithi087.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-03-30T10:22:14.657 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/453 2023-03-30T10:22:14.658 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/453 2023-03-30T10:22:14.658 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:22:14.669 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:14.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:22:14.754 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-03-30T10:22:15.403 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:22:15.422 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:22:15.424 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:22:15.429 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:22:15.430 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:16.340 INFO:teuthology.orchestra.run.smithi087.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-03-30T10:22:16.358 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/454 2023-03-30T10:22:16.358 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/454 2023-03-30T10:22:16.358 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:22:16.369 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:16.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:22:16.468 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-03-30T10:22:17.126 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:22:17.145 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:22:17.147 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:22:17.152 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:22:17.152 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:18.254 INFO:teuthology.orchestra.run.smithi087.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-03-30T10:22:18.272 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/455 2023-03-30T10:22:18.272 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/455 2023-03-30T10:22:18.272 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:22:18.283 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:18.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:22:18.381 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-03-30T10:22:19.051 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:22:19.072 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:22:19.074 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:22:19.079 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:22:19.080 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:20.023 INFO:teuthology.orchestra.run.smithi087.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T10:22:20.043 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/456 2023-03-30T10:22:20.043 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/456 2023-03-30T10:22:20.043 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:22:20.054 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:20.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:22:20.178 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-03-30T10:22:20.819 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:22:20.839 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:22:20.841 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:22:20.846 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:22:20.846 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:22.489 INFO:teuthology.orchestra.run.smithi087.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T10:22:22.544 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/457 2023-03-30T10:22:22.544 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/457 2023-03-30T10:22:22.544 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:22:22.569 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:22.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:22:22.658 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-03-30T10:22:23.301 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:22:23.321 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:22:23.323 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:22:23.327 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:22:23.327 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:24.715 INFO:teuthology.orchestra.run.smithi087.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T10:22:24.868 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/458 2023-03-30T10:22:24.868 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/458 2023-03-30T10:22:24.868 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:22:24.882 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:25.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:22:25.017 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-03-30T10:22:25.640 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:22:25.660 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:22:25.663 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:22:25.668 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:22:25.669 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:26.975 INFO:teuthology.orchestra.run.smithi087.stdout:generic/459 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T10:22:26.991 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/459 2023-03-30T10:22:26.992 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/459 2023-03-30T10:22:26.992 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:22:27.003 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:27.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:22:27.099 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-03-30T10:22:27.759 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:22:27.780 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:22:27.782 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:22:27.786 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:22:27.786 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:28.309 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:22:28.314 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:22:31.723 INFO:teuthology.orchestra.run.smithi087.stdout:generic/460 3s 2023-03-30T10:22:31.746 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/460 2023-03-30T10:22:31.747 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:22:31.756 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:31.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:22:31.787 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-03-30T10:22:32.438 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:22:32.458 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:22:32.461 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:22:32.466 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:22:32.466 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:33.604 INFO:teuthology.orchestra.run.smithi087.stdout:generic/461 [not run] ceph does not support shutdown 2023-03-30T10:22:33.621 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/461 2023-03-30T10:22:33.622 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/461 2023-03-30T10:22:33.622 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:22:33.633 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:33.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:22:33.728 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-03-30T10:22:34.407 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:22:34.428 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:22:34.430 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:22:34.434 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:22:34.434 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:35.565 INFO:teuthology.orchestra.run.smithi087.stdout:generic/462 [not run] mount 172.21.15.87:6789:/scratch with dax failed 2023-03-30T10:22:35.583 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/462 2023-03-30T10:22:35.584 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/462 2023-03-30T10:22:35.584 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:22:35.597 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:35.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:22:35.693 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-03-30T10:22:36.377 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:22:36.396 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:22:36.398 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:22:36.402 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:22:36.403 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:37.440 INFO:teuthology.orchestra.run.smithi087.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T10:22:37.456 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/463 2023-03-30T10:22:37.456 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/463 2023-03-30T10:22:37.456 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:22:37.467 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:37.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:22:37.741 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-03-30T10:22:38.558 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:22:38.579 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:22:38.582 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:22:38.585 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:22:38.585 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:22:58.395 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:22:58.403 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:23:28.607 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:23:28.612 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:23:39.626 INFO:teuthology.orchestra.run.smithi087.stdout:generic/464 61s 2023-03-30T10:23:39.649 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/464 2023-03-30T10:23:39.650 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:23:39.660 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:23:39.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:23:39.695 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-03-30T10:23:40.340 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:23:40.359 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:23:40.362 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:23:40.366 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:23:40.367 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:23:48.491 INFO:teuthology.orchestra.run.smithi087.stdout:generic/465 7s 2023-03-30T10:23:48.540 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/465 2023-03-30T10:23:48.541 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:23:48.590 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:23:48.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:23:48.650 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-03-30T10:23:49.271 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:23:49.284 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:23:49.285 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:23:49.287 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:23:49.288 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:23:50.106 INFO:teuthology.orchestra.run.smithi087.stdout:generic/466 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T10:23:50.122 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/466 2023-03-30T10:23:50.123 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/466 2023-03-30T10:23:50.123 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:23:50.133 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:23:50.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:23:50.216 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-03-30T10:23:50.861 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:23:50.881 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:23:50.883 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:23:50.889 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:23:50.889 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:23:58.750 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:23:58.753 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:24:02.883 INFO:teuthology.orchestra.run.smithi087.stdout:generic/467 11s 2023-03-30T10:24:03.050 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/467 2023-03-30T10:24:03.050 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:24:03.062 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:03.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:24:03.312 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-03-30T10:24:05.284 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:24:05.303 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:24:05.305 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:24:05.310 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:24:05.310 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:06.499 INFO:teuthology.orchestra.run.smithi087.stdout:generic/468 [not run] ceph does not support shutdown 2023-03-30T10:24:06.569 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/468 2023-03-30T10:24:06.569 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/468 2023-03-30T10:24:06.570 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:24:06.581 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:06.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:24:06.663 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-03-30T10:24:07.340 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:24:07.360 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:24:07.362 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:24:07.367 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:24:07.367 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:08.258 INFO:teuthology.orchestra.run.smithi087.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-30T10:24:08.276 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/469 2023-03-30T10:24:08.276 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/469 2023-03-30T10:24:08.276 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:24:08.287 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:08.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:24:08.388 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-03-30T10:24:09.053 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:24:09.072 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:24:09.075 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:24:09.079 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:24:09.080 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:09.997 INFO:teuthology.orchestra.run.smithi087.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-03-30T10:24:10.012 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/470 2023-03-30T10:24:10.013 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/470 2023-03-30T10:24:10.013 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:24:10.022 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:10.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:24:10.102 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-03-30T10:24:10.765 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:24:10.786 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:24:10.789 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:24:10.793 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:24:10.793 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:11.845 INFO:teuthology.orchestra.run.smithi087.stdout:generic/471 [not run] xfs_io pwrite -V 1 -b 4k -N failed (old kernel/wrong fs?) 2023-03-30T10:24:11.863 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/471 2023-03-30T10:24:11.863 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/471 2023-03-30T10:24:11.864 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:24:11.874 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:12.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:24:12.256 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-03-30T10:24:12.979 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:24:13.000 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:24:13.002 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:24:13.006 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:24:13.006 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:14.369 INFO:teuthology.orchestra.run.smithi087.stdout:generic/472 [not run] swapfiles are not supported 2023-03-30T10:24:14.388 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/472 2023-03-30T10:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/472 2023-03-30T10:24:14.389 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:24:14.399 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:14.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:24:14.498 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-03-30T10:24:15.152 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:24:15.173 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:24:15.175 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:24:15.180 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:24:15.180 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:16.221 INFO:teuthology.orchestra.run.smithi087.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-30T10:24:16.241 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/473 2023-03-30T10:24:16.241 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/473 2023-03-30T10:24:16.241 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:24:16.253 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:16.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:24:16.351 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-03-30T10:24:16.995 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:24:17.015 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:24:17.017 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:24:17.023 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:24:17.023 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:18.144 INFO:teuthology.orchestra.run.smithi087.stdout:generic/474 [not run] ceph does not support shutdown 2023-03-30T10:24:18.226 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/474 2023-03-30T10:24:18.226 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/474 2023-03-30T10:24:18.227 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:24:18.238 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:18.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:24:18.322 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-03-30T10:24:18.974 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:24:18.993 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:24:18.995 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:24:18.999 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:24:19.000 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:19.951 INFO:teuthology.orchestra.run.smithi087.stdout:generic/475 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T10:24:19.968 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/475 2023-03-30T10:24:19.968 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/475 2023-03-30T10:24:19.968 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T10:24:19.979 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:20.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T10:24:20.097 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-03-30T10:24:20.759 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T10:24:20.777 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T10:24:20.779 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T10:24:20.783 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T10:24:20.784 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T10:24:30.457 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:24:30.461 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:24:30.817 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T10:24:30.813+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 457433) UID: 0 2023-03-30T10:24:30.817 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T10:24:30.809+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 457433) UID: 0 2023-03-30T10:24:30.822 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T10:24:30.813+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 457433) UID: 0 2023-03-30T10:24:30.831 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T10:24:30.809+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 457433) UID: 0 2023-03-30T10:32:33.306 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:32:33.312 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:32:33.457 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T10:32:33.452+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42376) UID: 0 2023-03-30T10:32:33.458 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T10:32:33.452+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42376) UID: 0 2023-03-30T10:32:33.462 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T10:32:33.452+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42376) UID: 0 2023-03-30T10:32:33.463 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T10:32:33.452+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42376) UID: 0 2023-03-30T10:32:33.635 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T10:32:33.630+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 457466) UID: 0 2023-03-30T10:32:33.636 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T10:32:33.630+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 457466) UID: 0 2023-03-30T10:32:33.639 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T10:32:33.634+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 457466) UID: 0 2023-03-30T10:32:33.639 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T10:32:33.634+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 457466) UID: 0 2023-03-30T10:39:44.169 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:39:44.175 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T10:39:44.210 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T10:39:44.204+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42421) UID: 0 2023-03-30T10:39:44.211 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T10:39:44.204+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42421) UID: 0 2023-03-30T10:46:37.211 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T10:46:37.209+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42466) UID: 0 2023-03-30T10:46:37.213 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T10:46:37.209+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42466) UID: 0 2023-03-30T10:46:37.214 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T10:46:37.209+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42466) UID: 0 2023-03-30T10:46:37.214 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T10:46:37.209+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42466) UID: 0 2023-03-30T11:08:05.612 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T11:08:05.635 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T11:08:05.772 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T11:08:05.770+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42566) UID: 0 2023-03-30T11:08:05.772 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T11:08:05.770+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42566) UID: 0 2023-03-30T11:08:06.074 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T11:08:06.067+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 457740) UID: 0 2023-03-30T11:08:06.131 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T11:08:06.127+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 457740) UID: 0 2023-03-30T11:08:06.132 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T11:08:06.127+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 457740) UID: 0 2023-03-30T11:08:06.144 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T11:08:06.119+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 457740) UID: 0 2023-03-30T11:18:28.027 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T11:18:28.022+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42614) UID: 0 2023-03-30T11:18:28.028 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T11:18:28.022+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42614) UID: 0 2023-03-30T11:18:28.029 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T11:18:28.022+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42614) UID: 0 2023-03-30T11:18:28.029 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T11:18:28.022+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42614) UID: 0 2023-03-30T11:31:53.134 INFO:teuthology.orchestra.run.smithi087.stdout:generic/476 4051s 2023-03-30T11:31:53.485 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/476 2023-03-30T11:31:53.485 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:31:53.495 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:31:53.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:31:53.543 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-03-30T11:32:05.975 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:32:05.987 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:32:05.989 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:32:05.992 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:32:05.992 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:40:32.073 INFO:teuthology.orchestra.run.smithi087.stdout:generic/477 55s 2023-03-30T11:40:32.506 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/477 2023-03-30T11:40:32.506 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:40:32.515 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:40:32.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:40:32.633 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-03-30T11:40:38.008 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:40:38.025 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:40:38.026 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:40:38.030 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:40:38.031 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:40:48.720 INFO:teuthology.orchestra.run.smithi087.stdout:generic/478 10s 2023-03-30T11:40:48.743 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/478 2023-03-30T11:40:48.744 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:40:48.753 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:40:48.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:40:48.857 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-03-30T11:40:49.521 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:40:49.536 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:40:49.537 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:40:49.540 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:40:49.540 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:40:50.614 INFO:teuthology.orchestra.run.smithi087.stdout:generic/479 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T11:40:50.649 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/479 2023-03-30T11:40:50.650 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/479 2023-03-30T11:40:50.650 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:40:50.659 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:40:50.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:40:50.758 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-03-30T11:40:51.326 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:40:51.348 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:40:51.349 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:40:51.353 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:40:51.353 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:40:52.383 INFO:teuthology.orchestra.run.smithi087.stdout:generic/480 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T11:40:52.401 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/480 2023-03-30T11:40:52.401 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/480 2023-03-30T11:40:52.401 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:40:52.408 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:40:52.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:40:52.501 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-03-30T11:40:53.199 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:40:53.217 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:40:53.218 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:40:53.230 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:40:53.230 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:40:54.141 INFO:teuthology.orchestra.run.smithi087.stdout:generic/481 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T11:40:54.155 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/481 2023-03-30T11:40:54.155 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/481 2023-03-30T11:40:54.155 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:40:54.163 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:40:54.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:40:54.251 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-03-30T11:40:54.930 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:40:54.943 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:40:54.944 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:40:54.948 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:40:54.949 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:40:55.852 INFO:teuthology.orchestra.run.smithi087.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-03-30T11:40:55.866 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/482 2023-03-30T11:40:55.867 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/482 2023-03-30T11:40:55.867 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:40:55.877 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:40:55.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:40:55.953 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-03-30T11:40:56.676 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:40:56.697 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:40:56.698 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:40:56.701 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:40:56.701 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:40:58.422 INFO:teuthology.orchestra.run.smithi087.stdout:generic/483 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T11:40:58.443 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/483 2023-03-30T11:40:58.443 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/483 2023-03-30T11:40:58.443 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:40:58.451 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:40:58.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:40:58.537 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-03-30T11:40:59.211 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:40:59.228 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:40:59.229 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:40:59.232 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:40:59.232 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:00.105 INFO:teuthology.orchestra.run.smithi087.stdout:generic/484 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T11:41:00.120 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/484 2023-03-30T11:41:00.120 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/484 2023-03-30T11:41:00.120 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:00.128 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:00.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:00.220 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-03-30T11:41:00.833 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:00.847 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:00.849 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:00.851 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:00.852 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:01.695 INFO:teuthology.orchestra.run.smithi087.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-30T11:41:01.711 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/485 2023-03-30T11:41:01.711 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/485 2023-03-30T11:41:01.711 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:01.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:01.810 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-03-30T11:41:02.458 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:02.472 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:02.473 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:02.475 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:02.476 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:03.898 INFO:teuthology.orchestra.run.smithi087.stdout:generic/486 1s 2023-03-30T11:41:03.918 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/486 2023-03-30T11:41:03.919 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:03.926 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:03.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:03.950 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-03-30T11:41:04.587 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:04.606 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:04.608 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:04.612 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:04.612 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:05.465 INFO:teuthology.orchestra.run.smithi087.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-03-30T11:41:05.480 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/487 2023-03-30T11:41:05.481 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/487 2023-03-30T11:41:05.481 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:05.487 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:05.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:05.562 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-03-30T11:41:06.247 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:06.262 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:06.264 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:06.273 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:06.274 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:07.093 INFO:teuthology.orchestra.run.smithi087.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T11:41:07.112 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/488 2023-03-30T11:41:07.112 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/488 2023-03-30T11:41:07.112 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:07.120 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:07.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:07.217 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-03-30T11:41:07.869 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:07.884 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:07.885 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:07.890 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:07.890 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:08.663 INFO:teuthology.orchestra.run.smithi087.stdout:generic/489 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T11:41:08.676 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/489 2023-03-30T11:41:08.677 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/489 2023-03-30T11:41:08.677 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:08.684 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:08.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:08.779 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-03-30T11:41:09.379 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:09.404 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:09.405 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:09.408 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:09.408 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:12.074 INFO:teuthology.orchestra.run.smithi087.stdout:generic/490 3s 2023-03-30T11:41:12.095 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/490 2023-03-30T11:41:12.120 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:12.121 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:12.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:12.629 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-03-30T11:41:13.295 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:13.308 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:13.309 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:13.314 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:13.314 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:14.118 INFO:teuthology.orchestra.run.smithi087.stdout:generic/491 [not run] ceph does not support freezing 2023-03-30T11:41:14.131 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/491 2023-03-30T11:41:14.132 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/491 2023-03-30T11:41:14.132 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:14.139 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:14.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:14.207 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-03-30T11:41:14.802 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:14.819 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:14.822 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:14.826 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:14.826 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:15.552 INFO:teuthology.orchestra.run.smithi087.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-03-30T11:41:15.566 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/492 2023-03-30T11:41:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/492 2023-03-30T11:41:15.567 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:15.574 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:15.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:15.658 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-03-30T11:41:16.249 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:16.265 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:16.269 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:16.273 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:16.273 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:17.488 INFO:teuthology.orchestra.run.smithi087.stdout:generic/493 [not run] swapfiles are not supported 2023-03-30T11:41:17.503 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/493 2023-03-30T11:41:17.503 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/493 2023-03-30T11:41:17.503 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:17.510 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:17.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:17.604 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-03-30T11:41:18.187 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:18.205 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:18.207 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:18.211 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:18.211 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:19.389 INFO:teuthology.orchestra.run.smithi087.stdout:generic/494 [not run] swapfiles are not supported 2023-03-30T11:41:19.404 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/494 2023-03-30T11:41:19.404 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/494 2023-03-30T11:41:19.404 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:19.413 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:19.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:19.492 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-03-30T11:41:20.064 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:20.080 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:20.081 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:20.084 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:20.084 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:21.205 INFO:teuthology.orchestra.run.smithi087.stdout:generic/495 [not run] swapfiles are not supported 2023-03-30T11:41:21.216 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/495 2023-03-30T11:41:21.216 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/495 2023-03-30T11:41:21.216 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:21.224 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:21.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:21.309 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-03-30T11:41:21.934 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:21.947 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:21.948 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:21.951 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:21.951 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:23.070 INFO:teuthology.orchestra.run.smithi087.stdout:generic/496 [not run] swapfiles are not supported 2023-03-30T11:41:23.093 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/496 2023-03-30T11:41:23.093 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/496 2023-03-30T11:41:23.094 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:23.100 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:23.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:23.170 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-03-30T11:41:23.781 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:23.795 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:23.797 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:23.800 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:23.800 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:24.966 INFO:teuthology.orchestra.run.smithi087.stdout:generic/497 [not run] swapfiles are not supported 2023-03-30T11:41:24.983 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/497 2023-03-30T11:41:24.983 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/497 2023-03-30T11:41:24.983 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:24.993 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:25.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:25.084 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-03-30T11:41:25.662 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:25.678 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:25.679 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:25.682 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:25.682 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:26.477 INFO:teuthology.orchestra.run.smithi087.stdout:generic/498 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T11:41:26.490 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/498 2023-03-30T11:41:26.490 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/498 2023-03-30T11:41:26.491 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:26.502 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:26.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:26.591 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-03-30T11:41:27.214 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:27.226 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:27.228 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:27.231 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:27.232 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:27.987 INFO:teuthology.orchestra.run.smithi087.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-30T11:41:28.001 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/499 2023-03-30T11:41:28.001 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/499 2023-03-30T11:41:28.001 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:28.010 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:28.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:28.107 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-03-30T11:41:28.713 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:28.727 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:28.729 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:28.732 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:28.732 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:29.554 INFO:teuthology.orchestra.run.smithi087.stdout:generic/500 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T11:41:29.566 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/500 2023-03-30T11:41:29.566 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/500 2023-03-30T11:41:29.567 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:29.579 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:29.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:29.635 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-03-30T11:41:30.250 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:30.264 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:30.265 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:30.267 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:30.268 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:31.968 INFO:teuthology.orchestra.run.smithi087.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T11:41:32.066 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/501 2023-03-30T11:41:32.066 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/501 2023-03-30T11:41:32.066 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:32.146 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:32.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:32.283 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-03-30T11:41:32.973 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:32.987 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:32.988 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:32.991 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:32.991 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:33.820 INFO:teuthology.orchestra.run.smithi087.stdout:generic/502 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T11:41:33.835 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/502 2023-03-30T11:41:33.835 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/502 2023-03-30T11:41:33.836 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:33.844 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:33.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:33.933 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-03-30T11:41:34.528 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:34.542 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:34.544 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:34.548 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:34.548 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:35.322 INFO:teuthology.orchestra.run.smithi087.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T11:41:35.336 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/503 2023-03-30T11:41:35.337 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/503 2023-03-30T11:41:35.337 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:35.351 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:35.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:35.438 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-03-30T11:41:36.032 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:36.044 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:36.046 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:36.049 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:36.049 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:36.917 INFO:teuthology.orchestra.run.smithi087.stdout:generic/504 0s 2023-03-30T11:41:36.936 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/504 2023-03-30T11:41:36.936 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:36.944 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:37.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:37.036 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-03-30T11:41:37.634 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:37.653 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:37.654 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:37.657 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:37.657 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:38.637 INFO:teuthology.orchestra.run.smithi087.stdout:generic/505 [not run] ceph does not support shutdown 2023-03-30T11:41:38.706 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/505 2023-03-30T11:41:38.706 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/505 2023-03-30T11:41:38.707 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:38.716 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:38.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:38.794 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-03-30T11:41:39.384 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:39.399 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:39.400 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:39.403 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:39.404 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:40.127 INFO:teuthology.orchestra.run.smithi087.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T11:41:40.139 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/506 2023-03-30T11:41:40.139 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/506 2023-03-30T11:41:40.140 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:40.149 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:40.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:40.232 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-03-30T11:41:40.431 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T11:41:40.435 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T11:41:40.528 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T11:41:40.524+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 471751) UID: 0 2023-03-30T11:41:40.529 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T11:41:40.524+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 471751) UID: 0 2023-03-30T11:41:40.529 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T11:41:40.524+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 471751) UID: 0 2023-03-30T11:41:40.529 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T11:41:40.524+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 471751) UID: 0 2023-03-30T11:41:40.642 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T11:41:40.641+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42696) UID: 0 2023-03-30T11:41:40.642 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T11:41:40.641+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42696) UID: 0 2023-03-30T11:41:40.841 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:40.857 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:40.858 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:40.863 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:40.863 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:41.735 INFO:teuthology.orchestra.run.smithi087.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-03-30T11:41:41.747 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/507 2023-03-30T11:41:41.748 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/507 2023-03-30T11:41:41.748 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:41.758 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:41.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:41.854 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-03-30T11:41:42.504 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:42.521 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:42.523 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:42.528 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:42.528 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:43.287 INFO:teuthology.orchestra.run.smithi087.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-03-30T11:41:43.299 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/508 2023-03-30T11:41:43.299 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/508 2023-03-30T11:41:43.299 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:43.310 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:43.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:43.395 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-03-30T11:41:44.047 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:44.069 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:44.070 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:44.075 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:44.075 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:44.906 INFO:teuthology.orchestra.run.smithi087.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-03-30T11:41:44.925 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/509 2023-03-30T11:41:44.926 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/509 2023-03-30T11:41:44.926 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:44.940 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:45.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:45.023 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-03-30T11:41:45.621 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:45.644 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:45.646 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:45.650 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:45.650 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:46.489 INFO:teuthology.orchestra.run.smithi087.stdout:generic/510 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T11:41:46.518 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/510 2023-03-30T11:41:46.518 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/510 2023-03-30T11:41:46.518 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:46.527 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:46.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:46.609 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-03-30T11:41:47.255 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:47.272 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:47.273 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:47.282 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:47.282 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:48.095 INFO:teuthology.orchestra.run.smithi087.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-30T11:41:48.111 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/511 2023-03-30T11:41:48.111 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/511 2023-03-30T11:41:48.111 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:48.121 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:48.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:48.221 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-03-30T11:41:48.838 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:48.853 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:48.855 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:48.858 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:48.859 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:49.696 INFO:teuthology.orchestra.run.smithi087.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T11:41:49.715 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/512 2023-03-30T11:41:49.715 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/512 2023-03-30T11:41:49.716 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:49.725 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:49.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:49.833 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-03-30T11:41:50.512 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:50.529 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:50.531 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:50.534 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:50.535 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:51.817 INFO:teuthology.orchestra.run.smithi087.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T11:41:51.883 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/513 2023-03-30T11:41:51.883 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/513 2023-03-30T11:41:51.883 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:51.950 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:52.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:52.155 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-03-30T11:41:52.769 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:52.787 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:52.793 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:52.805 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:52.805 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:54.015 INFO:teuthology.orchestra.run.smithi087.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T11:41:54.036 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/514 2023-03-30T11:41:54.037 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/514 2023-03-30T11:41:54.037 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:54.193 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:54.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:54.420 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-03-30T11:41:55.078 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:55.094 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:55.095 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:55.103 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:55.104 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:56.336 INFO:teuthology.orchestra.run.smithi087.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T11:41:56.419 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/515 2023-03-30T11:41:56.420 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/515 2023-03-30T11:41:56.420 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:56.560 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:56.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:56.787 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-03-30T11:41:57.477 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:57.494 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:57.496 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:57.499 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:57.499 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:58.377 INFO:teuthology.orchestra.run.smithi087.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-30T11:41:58.395 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/516 2023-03-30T11:41:58.395 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/516 2023-03-30T11:41:58.395 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:41:58.404 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:41:58.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:41:58.821 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-03-30T11:41:59.547 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:41:59.561 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:41:59.566 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:41:59.570 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:41:59.570 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:42:00.662 INFO:teuthology.orchestra.run.smithi087.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-03-30T11:42:00.871 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/517 2023-03-30T11:42:00.871 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/517 2023-03-30T11:42:00.871 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:42:00.885 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:42:01.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:42:01.303 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-03-30T11:42:01.942 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:42:01.957 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:42:01.958 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:42:01.961 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:42:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:42:03.182 INFO:teuthology.orchestra.run.smithi087.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T11:42:03.282 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/518 2023-03-30T11:42:03.340 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/518 2023-03-30T11:42:03.340 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:42:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:42:03.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:42:03.519 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-03-30T11:42:04.107 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:42:04.121 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:42:04.122 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:42:04.126 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:42:04.126 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:42:05.032 INFO:teuthology.orchestra.run.smithi087.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-03-30T11:42:05.047 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/519 2023-03-30T11:42:05.048 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/519 2023-03-30T11:42:05.048 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:42:05.057 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:42:05.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:42:05.427 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-03-30T11:42:06.226 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:42:06.242 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:42:06.247 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:42:06.250 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:42:06.250 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:42:07.066 INFO:teuthology.orchestra.run.smithi087.stdout:generic/520 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T11:42:07.080 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/520 2023-03-30T11:42:07.080 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/520 2023-03-30T11:42:07.080 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T11:42:07.087 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:42:07.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T11:42:07.171 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-03-30T11:42:07.790 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T11:42:07.808 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T11:42:07.809 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T11:42:07.812 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T11:42:07.812 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T11:52:31.928 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T11:52:31.925+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42719) UID: 0 2023-03-30T11:52:31.929 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T11:52:31.925+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42719) UID: 0 2023-03-30T11:52:31.929 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T11:52:31.925+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42719) UID: 0 2023-03-30T11:52:31.930 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T11:52:31.925+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42719) UID: 0 2023-03-30T12:02:49.154 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:02:49.160 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:02:49.435 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T12:02:49.429+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42743) UID: 0 2023-03-30T12:02:49.436 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T12:02:49.429+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42743) UID: 0 2023-03-30T12:02:49.436 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T12:02:49.429+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42743) UID: 0 2023-03-30T12:02:49.436 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T12:02:49.433+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42743) UID: 0 2023-03-30T12:02:49.444 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T12:02:49.436+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478315) UID: 0 2023-03-30T12:02:49.444 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T12:02:49.436+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478315) UID: 0 2023-03-30T12:02:49.453 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T12:02:49.436+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478315) UID: 0 2023-03-30T12:02:49.454 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T12:02:49.436+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478315) UID: 0 2023-03-30T12:14:22.294 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:14:22.300 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:14:22.556 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T12:14:22.548+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478350) UID: 0 2023-03-30T12:14:22.556 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T12:14:22.548+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478350) UID: 0 2023-03-30T12:14:22.557 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T12:14:22.548+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478350) UID: 0 2023-03-30T12:14:22.558 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T12:14:22.548+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478350) UID: 0 2023-03-30T12:20:22.329 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:20:22.335 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:20:52.679 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:20:52.684 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:21:22.851 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:21:22.856 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:21:52.941 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:21:52.945 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:22:23.227 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:22:23.231 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:22:53.354 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:22:53.359 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:22:53.406 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T12:22:53.397+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478389) UID: 0 2023-03-30T12:22:53.407 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T12:22:53.397+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478389) UID: 0 2023-03-30T12:22:53.407 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T12:22:53.397+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478389) UID: 0 2023-03-30T12:22:53.408 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T12:22:53.397+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478389) UID: 0 2023-03-30T12:27:12.566 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:27:12.573 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:27:12.808 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T12:27:12.799+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478407) UID: 0 2023-03-30T12:27:12.808 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T12:27:12.799+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478407) UID: 0 2023-03-30T12:27:12.809 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T12:27:12.799+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478407) UID: 0 2023-03-30T12:27:12.811 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T12:27:12.799+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478407) UID: 0 2023-03-30T12:31:12.077 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:31:12.082 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:31:12.120 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T12:31:12.110+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42821) UID: 0 2023-03-30T12:31:12.120 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T12:31:12.110+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42821) UID: 0 2023-03-30T12:31:12.121 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T12:31:12.110+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42821) UID: 0 2023-03-30T12:31:12.121 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T12:31:12.110+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42821) UID: 0 2023-03-30T12:35:14.130 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:35:14.136 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:35:44.281 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:35:44.286 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:36:14.371 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:36:14.376 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:36:14.415 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T12:36:14.408+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478439) UID: 0 2023-03-30T12:36:14.416 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T12:36:14.408+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478439) UID: 0 2023-03-30T12:36:14.417 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T12:36:14.408+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478439) UID: 0 2023-03-30T12:36:14.418 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T12:36:14.408+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478439) UID: 0 2023-03-30T12:39:45.723 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:39:45.728 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:40:15.807 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:40:15.812 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:40:45.870 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:40:45.874 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:41:15.951 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:41:15.955 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:41:46.100 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:41:46.104 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:42:16.190 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:42:16.195 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:42:46.682 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:42:46.686 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:43:16.745 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:43:16.750 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:43:46.840 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:43:46.844 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:44:16.952 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:44:16.958 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:44:47.086 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:44:47.092 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:45:17.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:45:17.247 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:45:48.218 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:45:48.222 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:46:18.302 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:46:18.306 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:46:49.064 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:46:49.069 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:47:19.142 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:47:19.147 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:47:19.183 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T12:47:19.176+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42896) UID: 0 2023-03-30T12:47:19.183 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T12:47:19.176+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42896) UID: 0 2023-03-30T12:47:19.184 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T12:47:19.176+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42896) UID: 0 2023-03-30T12:47:19.184 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T12:47:19.176+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42896) UID: 0 2023-03-30T12:51:17.879 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:51:17.885 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:51:17.997 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T12:51:17.992+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478509) UID: 0 2023-03-30T12:51:17.998 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T12:51:17.992+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478509) UID: 0 2023-03-30T12:51:17.998 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T12:51:17.992+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478509) UID: 0 2023-03-30T12:51:17.998 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T12:51:17.992+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478509) UID: 0 2023-03-30T12:55:21.855 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:55:21.863 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:55:21.921 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T12:55:21.915+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42935) UID: 0 2023-03-30T12:55:21.922 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T12:55:21.915+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42935) UID: 0 2023-03-30T12:55:21.922 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T12:55:21.915+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42935) UID: 0 2023-03-30T12:55:21.922 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T12:55:21.915+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42935) UID: 0 2023-03-30T12:59:30.186 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:59:30.191 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T12:59:30.229 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T12:59:30.222+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42945) UID: 0 2023-03-30T12:59:30.229 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T12:59:30.222+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42945) UID: 0 2023-03-30T12:59:30.230 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T12:59:30.222+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42945) UID: 0 2023-03-30T12:59:30.230 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T12:59:30.222+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42945) UID: 0 2023-03-30T12:59:30.267 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T12:59:30.261+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478537) UID: 0 2023-03-30T12:59:30.268 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T12:59:30.261+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478537) UID: 0 2023-03-30T12:59:30.269 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T12:59:30.261+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478537) UID: 0 2023-03-30T12:59:30.269 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T12:59:30.261+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478537) UID: 0 2023-03-30T13:03:29.385 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:03:29.390 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:03:29.489 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T13:03:29.483+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478550) UID: 0 2023-03-30T13:03:29.490 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T13:03:29.483+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478550) UID: 0 2023-03-30T13:03:29.490 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T13:03:29.483+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478550) UID: 0 2023-03-30T13:03:29.490 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T13:03:29.483+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478550) UID: 0 2023-03-30T13:07:41.524 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:07:41.529 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:07:41.569 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T13:07:41.565+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42970) UID: 0 2023-03-30T13:07:41.570 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T13:07:41.565+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42970) UID: 0 2023-03-30T13:07:41.572 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T13:07:41.565+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42970) UID: 0 2023-03-30T13:07:41.572 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T13:07:41.565+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42970) UID: 0 2023-03-30T13:07:41.772 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T13:07:41.770+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478568) UID: 0 2023-03-30T13:07:41.772 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T13:07:41.770+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478568) UID: 0 2023-03-30T13:07:41.775 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T13:07:41.770+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478568) UID: 0 2023-03-30T13:07:41.775 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T13:07:41.770+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478568) UID: 0 2023-03-30T13:12:14.669 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:12:14.674 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:12:44.831 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:12:44.837 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:13:15.670 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:13:15.677 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:13:46.579 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:13:46.584 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:14:17.032 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:14:17.037 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:14:47.103 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:14:47.108 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:15:17.170 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:15:17.174 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:15:48.135 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:15:48.141 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:15:48.188 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T13:15:48.187+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478607) UID: 0 2023-03-30T13:15:48.189 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T13:15:48.187+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478607) UID: 0 2023-03-30T13:15:48.189 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T13:15:48.187+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478607) UID: 0 2023-03-30T13:15:48.191 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T13:15:48.187+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 478607) UID: 0 2023-03-30T13:19:46.912 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:19:46.919 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:20:17.015 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:20:17.019 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:20:17.067 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T13:20:17.063+0000 7ff6b0c69700 -1 Fail to open '/proc/43018/cmdline' error = (2) No such file or directory 2023-03-30T13:20:17.068 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T13:20:17.063+0000 7ff6b0c69700 -1 received signal: Hangup from (PID: 43018) UID: 0 2023-03-30T13:20:17.068 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T13:20:17.063+0000 7f6165300700 -1 Fail to open '/proc/43018/cmdline' error = (2) No such file or directory 2023-03-30T13:20:17.068 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T13:20:17.063+0000 7f6165300700 -1 received signal: Hangup from (PID: 43018) UID: 0 2023-03-30T13:23:35.541 INFO:teuthology.orchestra.run.smithi115.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.b.log.1: 2023-03-30T13:23:35.542 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: stdin: file size changed while zipping 2023-03-30T13:23:58.731 INFO:teuthology.orchestra.run.smithi087.stdout:generic/521 6110s 2023-03-30T13:23:58.882 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/521 2023-03-30T13:23:58.883 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T13:23:58.898 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T13:23:59.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T13:23:59.138 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-03-30T13:24:01.043 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T13:24:01.057 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T13:24:01.058 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T13:24:01.061 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T13:24:01.062 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T13:24:09.972 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:24:09.977 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:24:10.025 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T13:24:10.020+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479097) UID: 0 2023-03-30T13:24:10.027 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T13:24:10.020+0000 7ff34eb53700 -1 Fail to open '/proc/479097/cmdline' error = (2) No such file or directory 2023-03-30T13:24:10.027 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T13:24:10.020+0000 7ff34eb53700 -1 received signal: Hangup from (PID: 479097) UID: 0 2023-03-30T13:24:10.028 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T13:24:10.024+0000 7f1a66e43700 -1 Fail to open '/proc/479097/cmdline' error = (2) No such file or directory 2023-03-30T13:24:10.028 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T13:24:10.024+0000 7f1a66e43700 -1 received signal: Hangup from (PID: 479097) UID: 0 2023-03-30T13:24:10.028 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T13:24:10.024+0000 7f22ceb53700 -1 Fail to open '/proc/479097/cmdline' error = (2) No such file or directory 2023-03-30T13:24:10.028 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T13:24:10.024+0000 7f22ceb53700 -1 received signal: Hangup from (PID: 479097) UID: 0 2023-03-30T13:27:54.834 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:27:54.840 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:28:24.984 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:28:24.990 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:28:55.053 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:28:55.057 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:29:25.186 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:29:25.190 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:29:55.256 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:29:55.260 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:30:25.351 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:30:25.355 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:30:55.455 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:30:55.462 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:31:25.956 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:31:25.961 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:31:56.029 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:31:56.034 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:32:26.096 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:32:26.104 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:32:56.160 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:32:56.167 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:33:26.261 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:33:26.267 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:33:56.320 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:33:56.325 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:34:26.391 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:34:26.395 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:34:56.520 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:34:56.525 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:35:26.583 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:35:26.589 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:35:56.657 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:35:56.662 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:36:26.718 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:36:26.724 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:36:57.715 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:36:57.721 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:36:57.772 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T13:36:57.768+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43102) UID: 0 2023-03-30T13:36:57.772 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T13:36:57.768+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43102) UID: 0 2023-03-30T13:36:57.772 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T13:36:57.768+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43102) UID: 0 2023-03-30T13:36:57.773 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T13:36:57.768+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43102) UID: 0 2023-03-30T13:41:19.706 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:41:19.712 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:41:19.882 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T13:41:19.875+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43114) UID: 0 2023-03-30T13:41:19.882 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T13:41:19.875+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43114) UID: 0 2023-03-30T13:41:19.883 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T13:41:19.875+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43114) UID: 0 2023-03-30T13:41:19.883 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T13:41:19.875+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43114) UID: 0 2023-03-30T13:45:44.765 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:45:44.771 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:45:44.816 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T13:45:44.806+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43129) UID: 0 2023-03-30T13:45:44.817 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T13:45:44.810+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43129) UID: 0 2023-03-30T13:45:44.817 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T13:45:44.806+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43129) UID: 0 2023-03-30T13:45:44.817 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T13:45:44.806+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43129) UID: 0 2023-03-30T13:50:28.553 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:50:28.558 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:50:28.723 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T13:50:28.717+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479212) UID: 0 2023-03-30T13:50:28.723 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T13:50:28.717+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479212) UID: 0 2023-03-30T13:50:28.724 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T13:50:28.717+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479212) UID: 0 2023-03-30T13:50:28.725 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T13:50:28.721+0000 7fb3091a7700 -1 received signal: Hangup from (PID: 479212) UID: 0 2023-03-30T13:50:29.086 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T13:50:29.081+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43144) UID: 0 2023-03-30T13:50:29.086 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T13:50:29.081+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43144) UID: 0 2023-03-30T13:50:29.087 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T13:50:29.081+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43144) UID: 0 2023-03-30T13:50:29.087 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T13:50:29.081+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43144) UID: 0 2023-03-30T13:58:09.276 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:58:09.281 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T13:58:09.325 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T13:58:09.322+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479237) UID: 0 2023-03-30T13:58:09.325 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T13:58:09.322+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479237) UID: 0 2023-03-30T13:58:09.326 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T13:58:09.322+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479237) UID: 0 2023-03-30T13:58:09.330 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T13:58:09.318+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479237) UID: 0 2023-03-30T14:02:03.177 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:02:03.183 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:02:33.316 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:02:33.327 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:03:03.446 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:03:03.451 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:03:33.596 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:03:33.600 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:03:33.651 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T14:03:33.643+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43183) UID: 0 2023-03-30T14:03:33.652 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T14:03:33.643+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43183) UID: 0 2023-03-30T14:03:33.652 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T14:03:33.643+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43183) UID: 0 2023-03-30T14:03:33.653 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T14:03:33.647+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43183) UID: 0 2023-03-30T14:07:38.450 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:07:38.456 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:07:38.498 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T14:07:38.493+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479272) UID: 0 2023-03-30T14:07:38.499 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T14:07:38.493+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479272) UID: 0 2023-03-30T14:07:38.499 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T14:07:38.493+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479272) UID: 0 2023-03-30T14:07:38.500 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T14:07:38.493+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479272) UID: 0 2023-03-30T14:11:58.619 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:11:58.624 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:12:28.889 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:12:28.894 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:12:58.975 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:12:58.980 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:13:29.044 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:13:29.058 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:14:00.311 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:14:00.316 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:14:30.406 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:14:30.411 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:15:00.544 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:15:00.549 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:15:31.244 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:15:31.250 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:16:01.315 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:16:01.320 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:16:31.382 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:16:31.386 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:17:02.136 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:17:02.142 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:17:32.990 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:17:32.994 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:18:03.075 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:18:03.081 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:18:33.169 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:18:33.177 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:19:03.265 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:19:03.271 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:19:33.355 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:19:33.360 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:20:03.510 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:20:03.521 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:20:33.591 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:20:33.596 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:21:03.698 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:21:03.703 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:21:03.758 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T14:21:03.751+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43262) UID: 0 2023-03-30T14:21:03.759 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T14:21:03.751+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43262) UID: 0 2023-03-30T14:21:03.759 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T14:21:03.755+0000 7f2ab2e9c700 -1 received signal: Hangup from (PID: 43262) UID: 0 2023-03-30T14:21:03.760 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T14:21:03.751+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43262) UID: 0 2023-03-30T14:25:19.458 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:25:19.463 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:25:19.559 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T14:25:19.554+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479355) UID: 0 2023-03-30T14:25:19.560 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T14:25:19.554+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479355) UID: 0 2023-03-30T14:25:19.560 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T14:25:19.554+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479355) UID: 0 2023-03-30T14:25:19.560 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T14:25:19.554+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 479355) UID: 0 2023-03-30T14:29:20.334 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:29:20.340 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:29:20.945 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T14:29:20.938+0000 7ff6b0c69700 -1 Fail to open '/proc/43286/cmdline' error = (2) No such file or directory 2023-03-30T14:29:20.945 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T14:29:20.938+0000 7ff6b0c69700 -1 received signal: Hangup from (PID: 43286) UID: 0 2023-03-30T14:29:20.945 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T14:29:20.938+0000 7f6165300700 -1 Fail to open '/proc/43286/cmdline' error = (2) No such file or directory 2023-03-30T14:29:20.945 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T14:29:20.938+0000 7f6165300700 -1 received signal: Hangup from (PID: 43286) UID: 0 2023-03-30T14:29:28.759 INFO:teuthology.orchestra.run.smithi087.stdout:generic/522 3927s 2023-03-30T14:29:28.920 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/522 2023-03-30T14:29:28.920 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T14:29:28.938 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:29.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T14:29:29.194 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-03-30T14:29:31.304 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T14:29:31.320 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T14:29:31.323 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T14:29:31.326 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T14:29:31.327 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:32.716 INFO:teuthology.orchestra.run.smithi087.stdout:generic/523 1s 2023-03-30T14:29:32.734 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/523 2023-03-30T14:29:32.734 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T14:29:32.742 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:32.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T14:29:32.772 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-03-30T14:29:33.322 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T14:29:33.338 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T14:29:33.341 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T14:29:33.346 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T14:29:33.346 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:41.583 INFO:teuthology.orchestra.run.smithi087.stdout:generic/524 8s 2023-03-30T14:29:41.599 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/524 2023-03-30T14:29:41.600 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T14:29:41.611 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:41.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T14:29:41.643 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-03-30T14:29:42.194 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T14:29:42.210 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T14:29:42.211 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T14:29:42.216 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T14:29:42.216 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:43.215 INFO:teuthology.orchestra.run.smithi087.stdout:generic/525 [not run] filesystem does not support huge file size 2023-03-30T14:29:43.274 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/525 2023-03-30T14:29:43.274 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/525 2023-03-30T14:29:43.274 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T14:29:43.284 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:43.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T14:29:43.383 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-03-30T14:29:43.923 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T14:29:43.936 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T14:29:43.938 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T14:29:43.942 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T14:29:43.942 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:44.833 INFO:teuthology.orchestra.run.smithi087.stdout:generic/526 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T14:29:44.847 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/526 2023-03-30T14:29:44.847 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/526 2023-03-30T14:29:44.848 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T14:29:44.857 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:44.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T14:29:44.994 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-03-30T14:29:45.554 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T14:29:45.567 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T14:29:45.571 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T14:29:45.574 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T14:29:45.574 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:46.369 INFO:teuthology.orchestra.run.smithi087.stdout:generic/527 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T14:29:46.384 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/527 2023-03-30T14:29:46.384 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/527 2023-03-30T14:29:46.384 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T14:29:46.393 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:46.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T14:29:46.484 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-03-30T14:29:47.088 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T14:29:47.108 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T14:29:47.110 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T14:29:47.113 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T14:29:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:48.082 INFO:teuthology.orchestra.run.smithi087.stdout:generic/528 1s 2023-03-30T14:29:48.100 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/528 2023-03-30T14:29:48.100 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T14:29:48.108 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:48.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T14:29:48.447 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-03-30T14:29:49.179 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T14:29:49.191 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T14:29:49.193 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T14:29:49.199 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T14:29:49.199 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:50.428 INFO:teuthology.orchestra.run.smithi087.stdout:generic/529 1s 2023-03-30T14:29:50.451 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/529 2023-03-30T14:29:50.451 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T14:29:50.461 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:50.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T14:29:50.496 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-03-30T14:29:51.055 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T14:29:51.069 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T14:29:51.071 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T14:29:51.074 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T14:29:51.075 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:52.047 INFO:teuthology.orchestra.run.smithi087.stdout:generic/530 [not run] ceph does not support shutdown 2023-03-30T14:29:52.096 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/530 2023-03-30T14:29:52.096 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/530 2023-03-30T14:29:52.097 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T14:29:52.106 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:29:52.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T14:29:52.194 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-03-30T14:29:52.749 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T14:29:52.768 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T14:29:52.769 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T14:29:52.772 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T14:29:52.772 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T14:34:28.956 INFO:teuthology.orchestra.run.smithi115.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.b.log.1: 2023-03-30T14:34:28.957 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: stdin: file size changed while zipping 2023-03-30T14:34:33.151 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T14:34:33.148+0000 7fa38cf23700 -1 Fail to open '/proc/43354/cmdline' error = (2) No such file or directory 2023-03-30T14:34:33.152 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T14:34:33.148+0000 7fa38cf23700 -1 received signal: Hangup from (PID: 43354) UID: 0 2023-03-30T14:34:33.152 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T14:34:33.148+0000 7f2ab2e9c700 -1 Fail to open '/proc/43354/cmdline' error = (2) No such file or directory 2023-03-30T14:34:33.152 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T14:34:33.148+0000 7f2ab2e9c700 -1 received signal: Hangup from (PID: 43354) UID: 0 2023-03-30T14:34:33.152 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T14:34:33.148+0000 7f27552d8700 -1 Fail to open '/proc/43354/cmdline' error = (2) No such file or directory 2023-03-30T14:34:33.153 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T14:34:33.148+0000 7f27552d8700 -1 received signal: Hangup from (PID: 43354) UID: 0 2023-03-30T14:34:33.153 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T14:34:33.148+0000 7fe514cf5700 -1 Fail to open '/proc/43354/cmdline' error = (2) No such file or directory 2023-03-30T14:34:33.153 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T14:34:33.148+0000 7fe514cf5700 -1 received signal: Hangup from (PID: 43354) UID: 0 2023-03-30T14:46:50.514 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:46:50.522 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T14:46:50.736 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T14:46:50.729+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 484138) UID: 0 2023-03-30T14:46:50.737 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T14:46:50.729+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 484138) UID: 0 2023-03-30T14:46:50.738 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T14:46:50.729+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 484138) UID: 0 2023-03-30T14:46:50.739 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T14:46:50.733+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 484138) UID: 0 2023-03-30T14:46:50.768 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T14:46:50.763+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43438) UID: 0 2023-03-30T14:46:50.769 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T14:46:50.763+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43438) UID: 0 2023-03-30T15:04:57.121 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T15:04:57.115+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43558) UID: 0 2023-03-30T15:04:57.122 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T15:04:57.115+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43558) UID: 0 2023-03-30T15:04:57.122 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T15:04:57.115+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43558) UID: 0 2023-03-30T15:04:57.122 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T15:04:57.115+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43558) UID: 0 2023-03-30T15:19:40.008 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T15:19:40.015 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T15:19:40.278 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T15:19:40.271+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43626) UID: 0 2023-03-30T15:19:40.279 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T15:19:40.271+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43626) UID: 0 2023-03-30T15:19:40.468 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T15:19:40.462+0000 7ff34eb53700 -1 Fail to open '/proc/484311/cmdline' error = (2) No such file or directory 2023-03-30T15:19:40.469 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T15:19:40.462+0000 7ff34eb53700 -1 received signal: Hangup from (PID: 484311) UID: 0 2023-03-30T15:19:40.469 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T15:19:40.462+0000 7f22ceb53700 -1 Fail to open '/proc/484311/cmdline' error = (2) No such file or directory 2023-03-30T15:19:40.469 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T15:19:40.462+0000 7f22ceb53700 -1 received signal: Hangup from (PID: 484311) UID: 0 2023-03-30T15:19:40.470 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T15:19:40.462+0000 7f1a66e43700 -1 Fail to open '/proc/484311/cmdline' error = (2) No such file or directory 2023-03-30T15:19:40.470 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T15:19:40.462+0000 7f1a66e43700 -1 received signal: Hangup from (PID: 484311) UID: 0 2023-03-30T15:19:40.470 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T15:19:40.462+0000 7fb3091a7700 -1 Fail to open '/proc/484311/cmdline' error = (2) No such file or directory 2023-03-30T15:19:40.471 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T15:19:40.462+0000 7fb3091a7700 -1 received signal: Hangup from (PID: 484311) UID: 0 2023-03-30T15:41:45.966 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T15:41:45.958+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43710) UID: 0 2023-03-30T15:41:45.991 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T15:41:45.958+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43710) UID: 0 2023-03-30T15:41:45.992 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T15:41:45.958+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43710) UID: 0 2023-03-30T15:41:45.992 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T15:41:45.958+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43710) UID: 0 2023-03-30T15:49:53.476 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T15:49:53.481 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T15:49:53.712 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T15:49:53.706+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 484423) UID: 0 2023-03-30T15:49:53.713 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T15:49:53.706+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 484423) UID: 0 2023-03-30T15:49:53.713 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T15:49:53.706+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 484423) UID: 0 2023-03-30T15:49:53.714 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T15:49:53.706+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 484423) UID: 0 2023-03-30T15:49:53.796 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T15:49:53.790+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43745) UID: 0 2023-03-30T15:49:53.797 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T15:49:53.790+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43745) UID: 0 2023-03-30T16:01:51.717 INFO:teuthology.orchestra.run.smithi087.stdout:generic/531 5518s 2023-03-30T16:01:51.838 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/531 2023-03-30T16:01:51.839 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:01:51.863 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:01:51.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:01:51.908 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-03-30T16:01:56.422 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:01:56.437 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:01:56.439 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:01:56.442 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:01:56.443 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:02:21.241 INFO:teuthology.orchestra.run.smithi087.stdout:generic/532 7s 2023-03-30T16:02:21.265 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/532 2023-03-30T16:02:21.265 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:02:21.275 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:02:31.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:02:31.974 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-03-30T16:02:37.050 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:02:37.067 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:02:37.069 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:02:37.073 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:02:37.074 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:03:22.995 INFO:teuthology.orchestra.run.smithi087.stdout:generic/533 23s 2023-03-30T16:03:23.018 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/533 2023-03-30T16:03:23.018 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:03:23.027 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:03:23.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:03:23.146 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-03-30T16:03:24.301 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:03:24.320 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:03:24.322 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:03:24.327 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:03:24.328 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:03:25.535 INFO:teuthology.orchestra.run.smithi087.stdout:generic/534 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T16:03:25.563 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/534 2023-03-30T16:03:25.563 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/534 2023-03-30T16:03:25.563 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:03:25.610 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:03:25.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:03:25.741 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-03-30T16:03:26.704 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:03:26.723 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:03:26.732 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:03:26.740 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:03:26.740 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:03:27.808 INFO:teuthology.orchestra.run.smithi087.stdout:generic/535 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T16:03:27.826 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/535 2023-03-30T16:03:27.827 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/535 2023-03-30T16:03:27.827 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:03:27.833 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:03:27.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:03:27.968 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-03-30T16:03:29.037 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:03:29.062 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:03:29.063 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:03:29.069 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:03:29.069 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:03:30.470 INFO:teuthology.orchestra.run.smithi087.stdout:generic/536 [not run] ceph does not support shutdown 2023-03-30T16:03:30.567 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/536 2023-03-30T16:03:30.567 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/536 2023-03-30T16:03:30.567 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:03:30.581 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:03:30.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:03:30.737 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-03-30T16:03:31.632 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:03:31.656 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:03:31.659 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:03:31.680 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:03:31.680 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:03:33.179 INFO:teuthology.orchestra.run.smithi087.stdout:generic/537 [not run] FSTRIM not supported 2023-03-30T16:03:33.270 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/537 2023-03-30T16:03:33.270 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/537 2023-03-30T16:03:33.270 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:03:33.283 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:03:33.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:03:33.388 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-03-30T16:03:34.338 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:03:34.358 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:03:34.367 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:03:34.372 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:03:34.372 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:14:37.456 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T16:14:37.451+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44055) UID: 0 2023-03-30T16:14:37.457 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T16:14:37.451+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44055) UID: 0 2023-03-30T16:14:37.458 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T16:14:37.451+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44055) UID: 0 2023-03-30T16:14:37.461 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T16:14:37.451+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44055) UID: 0 2023-03-30T16:20:58.110 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:20:58.130 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:20:58.328 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T16:20:58.326+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493069) UID: 0 2023-03-30T16:20:58.329 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T16:20:58.326+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493069) UID: 0 2023-03-30T16:20:58.329 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T16:20:58.326+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493069) UID: 0 2023-03-30T16:20:58.330 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T16:20:58.326+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493069) UID: 0 2023-03-30T16:20:58.370 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T16:20:58.364+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44138) UID: 0 2023-03-30T16:20:58.371 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T16:20:58.364+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44138) UID: 0 2023-03-30T16:23:28.387 INFO:teuthology.orchestra.run.smithi087.stdout:generic/538 1193s 2023-03-30T16:23:28.501 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/538 2023-03-30T16:23:28.501 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:23:28.513 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:28.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:23:28.791 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-03-30T16:23:30.518 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:23:30.537 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:23:30.539 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:23:30.544 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:23:30.544 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:33.759 INFO:teuthology.orchestra.run.smithi087.stdout:generic/539 3s 2023-03-30T16:23:33.779 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/539 2023-03-30T16:23:33.780 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:23:33.789 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:34.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:23:34.168 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-03-30T16:23:34.875 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:23:34.892 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:23:34.894 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:23:34.900 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:23:34.900 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:36.299 INFO:teuthology.orchestra.run.smithi087.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T16:23:36.377 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/540 2023-03-30T16:23:36.378 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/540 2023-03-30T16:23:36.378 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:23:36.385 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:36.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:23:36.501 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-03-30T16:23:37.074 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:23:37.094 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:23:37.095 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:23:37.098 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:23:37.099 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:38.420 INFO:teuthology.orchestra.run.smithi087.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T16:23:38.525 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/541 2023-03-30T16:23:38.527 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/541 2023-03-30T16:23:38.527 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:23:38.546 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:38.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:23:38.699 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-03-30T16:23:39.289 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:23:39.309 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:23:39.311 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:23:39.315 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:23:39.316 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:40.843 INFO:teuthology.orchestra.run.smithi087.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T16:23:40.866 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/542 2023-03-30T16:23:40.866 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/542 2023-03-30T16:23:40.866 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:23:40.920 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:40.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:23:41.000 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-03-30T16:23:41.569 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:23:41.586 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:23:41.587 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:23:41.591 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:23:41.591 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:42.777 INFO:teuthology.orchestra.run.smithi087.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T16:23:42.924 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/543 2023-03-30T16:23:42.924 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/543 2023-03-30T16:23:42.924 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:23:42.934 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:43.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:23:43.177 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-03-30T16:23:43.773 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:23:43.789 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:23:43.791 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:23:43.795 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:23:43.796 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:45.219 INFO:teuthology.orchestra.run.smithi087.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T16:23:45.244 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/544 2023-03-30T16:23:45.244 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/544 2023-03-30T16:23:45.244 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:23:45.290 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:45.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:23:45.425 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-03-30T16:23:46.000 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:23:46.019 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:23:46.021 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:23:46.026 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:23:46.027 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:47.100 INFO:teuthology.orchestra.run.smithi087.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-03-30T16:23:47.116 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/545 2023-03-30T16:23:47.117 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/545 2023-03-30T16:23:47.117 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:23:47.128 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:47.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:23:47.212 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-03-30T16:23:47.803 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:23:47.820 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:23:47.822 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:23:47.826 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:23:47.826 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:48.727 INFO:teuthology.orchestra.run.smithi087.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T16:23:48.745 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/546 2023-03-30T16:23:48.745 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/546 2023-03-30T16:23:48.745 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:23:48.757 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:48.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:23:48.855 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-03-30T16:23:49.432 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:23:49.449 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:23:49.451 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:23:49.456 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:23:49.456 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:50.304 INFO:teuthology.orchestra.run.smithi087.stdout:generic/547 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T16:23:50.319 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/547 2023-03-30T16:23:50.319 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/547 2023-03-30T16:23:50.319 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:23:50.329 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:50.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:23:50.430 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-03-30T16:23:51.017 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:23:51.034 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:23:51.036 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:23:51.040 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:23:51.041 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:53.081 INFO:teuthology.orchestra.run.smithi087.stdout:generic/548 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-30T16:23:53.094 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/548 2023-03-30T16:23:53.094 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/548 2023-03-30T16:23:53.094 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:23:53.102 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:53.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:23:53.181 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-03-30T16:23:53.759 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:23:53.776 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:23:53.779 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:23:53.784 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:23:53.784 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:55.857 INFO:teuthology.orchestra.run.smithi087.stdout:generic/549 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-30T16:23:55.870 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/549 2023-03-30T16:23:55.870 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/549 2023-03-30T16:23:55.870 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:23:55.877 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:55.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:23:55.967 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-03-30T16:23:56.527 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:23:56.540 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:23:56.542 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:23:56.545 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:23:56.545 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:58.014 INFO:teuthology.orchestra.run.smithi087.stdout:generic/550 [not run] encryption policy '-c 9 -n 9 -f 0' is unusable; probably missing kernel crypto API support 2023-03-30T16:23:58.100 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/550 2023-03-30T16:23:58.100 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/550 2023-03-30T16:23:58.100 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:23:58.111 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:23:58.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:23:58.195 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-03-30T16:23:58.784 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:23:58.801 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:23:58.803 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:23:58.808 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:23:58.808 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:29:56.994 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T16:29:56.987+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45161) UID: 0 2023-03-30T16:29:56.995 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T16:29:56.987+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45161) UID: 0 2023-03-30T16:29:56.995 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T16:29:56.987+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45161) UID: 0 2023-03-30T16:29:56.995 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T16:29:56.987+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45161) UID: 0 2023-03-30T16:33:27.790 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:33:27.798 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:33:58.033 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:33:58.039 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:34:28.099 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:34:28.106 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:34:58.243 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:34:58.247 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:35:28.308 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:35:28.313 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:35:58.375 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:35:58.381 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:36:28.464 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:36:28.470 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:36:58.534 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:36:58.539 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:37:28.818 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:37:28.823 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:37:58.932 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:37:58.937 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:38:29.041 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:38:29.046 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:38:59.143 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:38:59.150 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:39:29.268 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:39:29.272 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:39:59.358 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:39:59.364 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:40:29.666 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:40:29.673 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:40:59.800 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:40:59.806 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:41:29.913 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:41:29.917 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:41:59.993 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:41:59.997 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:42:30.106 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:42:30.113 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:42:30.172 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T16:42:30.169+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 502977) UID: 0 2023-03-30T16:42:30.173 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T16:42:30.169+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 502977) UID: 0 2023-03-30T16:42:30.173 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T16:42:30.169+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 502977) UID: 0 2023-03-30T16:42:30.174 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T16:42:30.169+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 502977) UID: 0 2023-03-30T16:45:27.080 INFO:teuthology.orchestra.run.smithi087.stdout:generic/551 1288s 2023-03-30T16:45:27.176 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/551 2023-03-30T16:45:27.176 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:27.184 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:27.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:27.219 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-03-30T16:45:28.836 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:28.854 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:28.857 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:28.862 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:28.862 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:30.011 INFO:teuthology.orchestra.run.smithi087.stdout:generic/552 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T16:45:30.031 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/552 2023-03-30T16:45:30.032 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/552 2023-03-30T16:45:30.032 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:30.051 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:30.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:30.154 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-03-30T16:45:30.725 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:30.742 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:30.745 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:30.749 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:30.749 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:31.709 INFO:teuthology.orchestra.run.smithi087.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2023-03-30T16:45:31.725 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/553 2023-03-30T16:45:31.725 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/553 2023-03-30T16:45:31.725 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:31.735 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:32.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:32.022 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-03-30T16:45:32.825 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:32.871 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:32.871 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:32.871 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:32.871 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:34.373 INFO:teuthology.orchestra.run.smithi087.stdout:generic/554 [not run] swapfiles are not supported 2023-03-30T16:45:34.389 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/554 2023-03-30T16:45:34.389 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/554 2023-03-30T16:45:34.389 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:34.399 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:34.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:34.673 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-03-30T16:45:35.438 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:35.455 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:35.458 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:35.461 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:35.462 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:36.398 INFO:teuthology.orchestra.run.smithi087.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2023-03-30T16:45:36.414 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/555 2023-03-30T16:45:36.415 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/555 2023-03-30T16:45:36.415 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:36.424 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:36.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:36.711 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-03-30T16:45:37.479 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:37.497 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:37.499 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:37.503 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:37.503 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:38.263 INFO:teuthology.orchestra.run.smithi087.stdout:generic/556 [not run] ceph does not support casefold feature 2023-03-30T16:45:38.279 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/556 2023-03-30T16:45:38.280 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/556 2023-03-30T16:45:38.280 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:38.290 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:38.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:38.377 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-03-30T16:45:38.965 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:38.982 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:38.984 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:38.988 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:38.988 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:39.852 INFO:teuthology.orchestra.run.smithi087.stdout:generic/557 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T16:45:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/557 2023-03-30T16:45:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/557 2023-03-30T16:45:39.868 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:39.877 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:39.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:39.959 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-03-30T16:45:40.565 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:40.585 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:40.586 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:40.588 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:40.588 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:41.388 INFO:teuthology.orchestra.run.smithi087.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-30T16:45:41.402 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/558 2023-03-30T16:45:41.403 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/558 2023-03-30T16:45:41.403 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:41.413 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:41.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:41.495 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-03-30T16:45:42.117 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:42.134 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:42.137 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:42.141 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:42.141 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:42.940 INFO:teuthology.orchestra.run.smithi087.stdout:generic/559 [not run] duperemove utility required, skipped this test 2023-03-30T16:45:42.957 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/559 2023-03-30T16:45:42.958 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/559 2023-03-30T16:45:42.958 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:42.971 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:43.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:43.064 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-03-30T16:45:43.681 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:43.700 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:43.703 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:43.705 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:43.706 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:44.553 INFO:teuthology.orchestra.run.smithi087.stdout:generic/560 [not run] duperemove utility required, skipped this test 2023-03-30T16:45:44.569 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/560 2023-03-30T16:45:44.570 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/560 2023-03-30T16:45:44.570 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:44.581 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:44.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:44.661 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-03-30T16:45:45.250 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:45.267 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:45.270 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:45.274 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:45.274 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:46.082 INFO:teuthology.orchestra.run.smithi087.stdout:generic/561 [not run] duperemove utility required, skipped this test 2023-03-30T16:45:46.097 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/561 2023-03-30T16:45:46.097 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/561 2023-03-30T16:45:46.097 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:46.111 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:46.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:46.197 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-03-30T16:45:46.805 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:46.822 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:46.824 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:46.829 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:46.830 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:48.219 INFO:teuthology.orchestra.run.smithi087.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T16:45:48.306 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/562 2023-03-30T16:45:48.306 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/562 2023-03-30T16:45:48.306 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:48.338 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:48.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:48.464 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-03-30T16:45:48.988 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:49.004 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:49.005 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:49.009 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:49.009 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:50.110 INFO:teuthology.orchestra.run.smithi087.stdout:generic/563 [not run] cgroup2 not mounted on /sys/fs/cgroup 2023-03-30T16:45:50.124 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/563 2023-03-30T16:45:50.125 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/563 2023-03-30T16:45:50.125 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:50.134 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:50.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:50.227 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-03-30T16:45:50.784 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:50.801 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:50.803 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:50.808 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:50.808 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:52.223 INFO:teuthology.orchestra.run.smithi087.stdout:generic/564 1s 2023-03-30T16:45:52.243 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/564 2023-03-30T16:45:52.244 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:52.254 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:52.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:52.647 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-03-30T16:45:53.309 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:53.323 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:53.324 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:53.327 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:53.328 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:54.608 INFO:teuthology.orchestra.run.smithi087.stdout:generic/565 1s 2023-03-30T16:45:54.625 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/565 2023-03-30T16:45:54.626 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:54.632 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:54.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:54.988 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-03-30T16:45:55.678 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:55.692 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:55.694 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:55.698 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:55.699 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:56.495 INFO:teuthology.orchestra.run.smithi087.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T16:45:56.509 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/566 2023-03-30T16:45:56.510 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/566 2023-03-30T16:45:56.510 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:56.520 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:56.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:56.603 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-03-30T16:45:57.149 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:57.167 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:57.173 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:57.174 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:57.174 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:58.910 INFO:teuthology.orchestra.run.smithi087.stdout:generic/567 1s 2023-03-30T16:45:58.934 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/567 2023-03-30T16:45:58.934 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:45:58.944 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:45:58.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:45:58.975 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-03-30T16:45:59.565 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:45:59.582 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:45:59.584 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:45:59.588 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:45:59.588 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:00.405 INFO:teuthology.orchestra.run.smithi087.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T16:46:00.421 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/568 2023-03-30T16:46:00.422 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/568 2023-03-30T16:46:00.422 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:00.431 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:00.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:00.549 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-03-30T16:46:01.145 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:01.164 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:01.166 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:01.171 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:01.171 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:01.982 INFO:teuthology.orchestra.run.smithi087.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T16:46:02.000 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/569 2023-03-30T16:46:02.000 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/569 2023-03-30T16:46:02.000 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:02.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:02.103 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-03-30T16:46:02.697 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:02.715 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:02.717 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:02.720 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:02.721 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:03.524 INFO:teuthology.orchestra.run.smithi087.stdout:generic/570 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T16:46:03.537 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/570 2023-03-30T16:46:03.567 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/570 2023-03-30T16:46:03.568 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:03.568 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:03.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:03.635 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-03-30T16:46:04.222 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:04.241 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:04.242 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:04.247 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:04.248 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:05.071 INFO:teuthology.orchestra.run.smithi087.stdout:generic/571 [not run] Require fcntl setlease support 2023-03-30T16:46:05.087 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/571 2023-03-30T16:46:05.088 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/571 2023-03-30T16:46:05.088 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:05.099 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:05.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:05.206 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-03-30T16:46:05.778 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:05.796 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:05.798 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:05.803 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:05.803 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:06.577 INFO:teuthology.orchestra.run.smithi087.stdout:generic/572 [not run] fsverity utility required, skipped this test 2023-03-30T16:46:06.593 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/572 2023-03-30T16:46:06.593 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/572 2023-03-30T16:46:06.593 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:06.604 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:06.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:06.684 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-03-30T16:46:07.282 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:07.301 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:07.302 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:07.306 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:07.306 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:08.098 INFO:teuthology.orchestra.run.smithi087.stdout:generic/573 [not run] fsverity utility required, skipped this test 2023-03-30T16:46:08.114 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/573 2023-03-30T16:46:08.114 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/573 2023-03-30T16:46:08.114 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:08.123 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:08.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:08.207 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-03-30T16:46:08.799 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:08.814 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:08.816 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:08.820 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:08.820 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:09.632 INFO:teuthology.orchestra.run.smithi087.stdout:generic/574 [not run] fsverity utility required, skipped this test 2023-03-30T16:46:09.649 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/574 2023-03-30T16:46:09.650 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/574 2023-03-30T16:46:09.650 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:09.659 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:09.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:09.741 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-03-30T16:46:10.345 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:10.361 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:10.363 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:10.367 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:10.367 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:11.211 INFO:teuthology.orchestra.run.smithi087.stdout:generic/575 [not run] fsverity utility required, skipped this test 2023-03-30T16:46:11.228 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/575 2023-03-30T16:46:11.229 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/575 2023-03-30T16:46:11.229 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:11.238 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:11.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:11.336 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-03-30T16:46:11.928 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:11.942 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:11.944 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:11.948 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:11.949 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:12.833 INFO:teuthology.orchestra.run.smithi087.stdout:generic/576 [not run] fsverity utility required, skipped this test 2023-03-30T16:46:12.849 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/576 2023-03-30T16:46:12.849 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/576 2023-03-30T16:46:12.850 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:12.859 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:12.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:12.944 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-03-30T16:46:13.559 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:13.576 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:13.578 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:13.582 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:13.582 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:14.361 INFO:teuthology.orchestra.run.smithi087.stdout:generic/577 [not run] fsverity utility required, skipped this test 2023-03-30T16:46:14.377 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/577 2023-03-30T16:46:14.378 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/577 2023-03-30T16:46:14.378 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:14.390 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:14.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:14.475 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-03-30T16:46:15.083 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:15.100 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:15.102 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:15.107 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:15.107 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:16.050 INFO:teuthology.orchestra.run.smithi087.stdout:generic/578 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T16:46:16.068 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/578 2023-03-30T16:46:16.069 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/578 2023-03-30T16:46:16.069 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:16.079 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:16.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:16.611 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-03-30T16:46:17.172 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:17.189 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:17.191 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:17.195 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:17.195 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:18.057 INFO:teuthology.orchestra.run.smithi087.stdout:generic/579 [not run] fsverity utility required, skipped this test 2023-03-30T16:46:18.072 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/579 2023-03-30T16:46:18.072 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/579 2023-03-30T16:46:18.073 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:18.082 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:18.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:18.160 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-03-30T16:46:18.752 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:18.769 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:18.770 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:18.774 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:18.775 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:23.644 INFO:teuthology.orchestra.run.smithi087.stdout:generic/580 4s 2023-03-30T16:46:23.667 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/580 2023-03-30T16:46:23.668 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:23.676 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:23.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:23.710 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-03-30T16:46:24.292 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:24.311 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:24.313 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:24.318 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:24.318 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:31.364 INFO:teuthology.orchestra.run.smithi087.stdout:generic/581 7s 2023-03-30T16:46:31.384 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/581 2023-03-30T16:46:31.384 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:31.394 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:31.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:31.426 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-03-30T16:46:32.002 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:32.017 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:32.018 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:32.022 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:32.022 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:34.053 INFO:teuthology.orchestra.run.smithi087.stdout:generic/582 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-30T16:46:34.065 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/582 2023-03-30T16:46:34.066 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/582 2023-03-30T16:46:34.066 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:34.075 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:34.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:34.171 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-03-30T16:46:34.761 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:34.786 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:34.787 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:34.787 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:34.787 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:36.829 INFO:teuthology.orchestra.run.smithi087.stdout:generic/583 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-30T16:46:36.845 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/583 2023-03-30T16:46:36.845 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/583 2023-03-30T16:46:36.845 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:36.852 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:36.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:36.933 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-03-30T16:46:37.498 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:37.515 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:37.517 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:37.522 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:37.522 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:39.005 INFO:teuthology.orchestra.run.smithi087.stdout:generic/584 [not run] encryption policy '-c 9 -n 9 -v 2 -f 0' is unusable; probably missing kernel crypto API support 2023-03-30T16:46:39.082 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/584 2023-03-30T16:46:39.082 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/584 2023-03-30T16:46:39.082 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:39.091 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:39.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:39.179 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-03-30T16:46:39.769 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:39.787 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:39.788 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:39.792 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:39.793 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:40.679 INFO:teuthology.orchestra.run.smithi087.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2023-03-30T16:46:40.696 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/585 2023-03-30T16:46:40.696 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/585 2023-03-30T16:46:40.696 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:40.707 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:41.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:41.037 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-03-30T16:46:41.776 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:41.794 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:41.797 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:41.802 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:41.802 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:42.778 INFO:teuthology.orchestra.run.smithi087.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T16:46:42.793 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/586 2023-03-30T16:46:42.794 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/586 2023-03-30T16:46:42.794 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:42.805 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:43.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:43.132 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-03-30T16:46:43.871 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:43.888 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:43.890 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:43.894 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:43.894 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:44.957 INFO:teuthology.orchestra.run.smithi087.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T16:46:44.974 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/587 2023-03-30T16:46:44.974 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/587 2023-03-30T16:46:44.974 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:44.983 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:45.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:45.063 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-03-30T16:46:45.637 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:45.656 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:45.658 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:45.663 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:45.663 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:47.186 INFO:teuthology.orchestra.run.smithi087.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T16:46:47.239 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/588 2023-03-30T16:46:47.239 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/588 2023-03-30T16:46:47.239 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:47.266 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:47.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:47.358 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-03-30T16:46:47.956 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:47.974 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:47.977 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:47.980 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:47.980 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:48.813 INFO:teuthology.orchestra.run.smithi087.stdout:generic/589 [not run] require 172.21.15.87:6789:/scratch to be local device 2023-03-30T16:46:48.829 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/589 2023-03-30T16:46:48.830 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/589 2023-03-30T16:46:48.830 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:48.838 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:48.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:48.907 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-03-30T16:46:49.498 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:49.513 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:49.516 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:49.521 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:49.521 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:50.329 INFO:teuthology.orchestra.run.smithi087.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T16:46:50.345 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/590 2023-03-30T16:46:50.345 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/590 2023-03-30T16:46:50.346 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:50.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:50.464 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-03-30T16:46:51.065 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:51.084 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:51.086 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:51.091 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:51.091 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:52.164 INFO:teuthology.orchestra.run.smithi087.stdout:generic/591 1s 2023-03-30T16:46:52.188 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/591 2023-03-30T16:46:52.189 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:52.199 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:52.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:52.471 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-03-30T16:46:53.242 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:53.258 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:53.260 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:53.263 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:53.263 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:55.020 INFO:teuthology.orchestra.run.smithi087.stdout:generic/592 [not run] kernel does not support encryption policy: '-c 1 -n 4 -v 2 -f 8' 2023-03-30T16:46:55.078 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/592 2023-03-30T16:46:55.079 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/592 2023-03-30T16:46:55.079 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:55.084 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:55.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:55.174 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-03-30T16:46:55.767 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:55.784 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:55.790 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:55.790 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:55.790 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:57.906 INFO:teuthology.orchestra.run.smithi087.stdout:generic/593 [not run] xfs_io add_enckey doesn't support -k 2023-03-30T16:46:57.971 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/593 2023-03-30T16:46:57.971 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/593 2023-03-30T16:46:57.971 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:57.982 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:58.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:58.080 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-03-30T16:46:58.712 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:46:58.729 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:46:58.730 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:46:58.734 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:46:58.734 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:59.591 INFO:teuthology.orchestra.run.smithi087.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T16:46:59.607 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/594 2023-03-30T16:46:59.607 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/594 2023-03-30T16:46:59.607 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:46:59.617 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:46:59.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:46:59.701 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-03-30T16:47:00.294 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:00.311 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:00.313 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:00.316 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:00.317 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:07.380 INFO:teuthology.orchestra.run.smithi087.stdout:generic/595 7s 2023-03-30T16:47:07.436 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/595 2023-03-30T16:47:07.436 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:07.443 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:07.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:07.469 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-03-30T16:47:08.643 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:08.660 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:08.662 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:08.667 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:08.667 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:09.444 INFO:teuthology.orchestra.run.smithi087.stdout:generic/596 [not run] accton utility required, skipped this test 2023-03-30T16:47:09.462 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/596 2023-03-30T16:47:09.462 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/596 2023-03-30T16:47:09.463 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:09.472 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:09.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:09.582 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-03-30T16:47:10.175 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:10.192 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:10.194 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:10.199 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:10.199 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:12.310 INFO:teuthology.orchestra.run.smithi087.stdout:generic/597 2s 2023-03-30T16:47:12.331 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/597 2023-03-30T16:47:12.332 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:12.340 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:12.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:12.734 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-03-30T16:47:13.393 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:13.412 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:13.414 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:13.419 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:13.419 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:15.261 INFO:teuthology.orchestra.run.smithi087.stdout:generic/598 2s 2023-03-30T16:47:15.282 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/598 2023-03-30T16:47:15.283 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:15.291 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:15.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:15.670 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-03-30T16:47:16.338 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:16.355 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:16.357 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:16.361 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:16.362 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:17.379 INFO:teuthology.orchestra.run.smithi087.stdout:generic/599 [not run] ceph does not support shutdown 2023-03-30T16:47:17.457 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/599 2023-03-30T16:47:17.459 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/599 2023-03-30T16:47:17.460 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:17.467 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:17.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:17.544 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-03-30T16:47:18.129 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:18.149 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:18.150 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:18.154 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:18.154 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:18.941 INFO:teuthology.orchestra.run.smithi087.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T16:47:18.956 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/600 2023-03-30T16:47:18.956 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/600 2023-03-30T16:47:18.957 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:18.967 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:19.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:19.047 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-03-30T16:47:19.638 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:19.656 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:19.658 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:19.662 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:19.662 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:20.452 INFO:teuthology.orchestra.run.smithi087.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/601 2023-03-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/601 2023-03-30T16:47:20.467 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:20.477 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:20.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:20.564 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-03-30T16:47:21.161 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:21.180 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:21.182 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:21.186 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:21.186 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:22.965 INFO:teuthology.orchestra.run.smithi087.stdout:generic/602 [not run] kernel does not support encryption policy: '-c 1 -n 4 -v 2 -f 16' 2023-03-30T16:47:23.039 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/602 2023-03-30T16:47:23.039 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/602 2023-03-30T16:47:23.040 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:23.051 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:23.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:23.142 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-03-30T16:47:23.754 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:23.771 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:23.773 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:23.777 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:23.777 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:24.578 INFO:teuthology.orchestra.run.smithi087.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T16:47:24.595 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/603 2023-03-30T16:47:24.595 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/603 2023-03-30T16:47:24.595 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:24.605 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:24.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:24.690 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-03-30T16:47:25.213 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:25.229 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:25.231 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:25.235 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:25.235 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:31.798 INFO:teuthology.orchestra.run.smithi087.stdout:generic/604 6s 2023-03-30T16:47:31.820 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/604 2023-03-30T16:47:31.820 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:31.831 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:31.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:31.863 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-03-30T16:47:32.469 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:32.485 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:32.487 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:32.491 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:32.492 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:35.738 INFO:teuthology.orchestra.run.smithi087.stdout:generic/605 [not run] mount 172.21.15.87:6789:/scratch with dax=always failed 2023-03-30T16:47:35.755 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/605 2023-03-30T16:47:35.756 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/605 2023-03-30T16:47:35.756 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:35.765 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:35.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:35.846 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-03-30T16:47:36.452 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:36.467 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:36.469 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:36.474 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:36.474 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:37.438 INFO:teuthology.orchestra.run.smithi087.stdout:generic/606 [not run] mount 172.21.15.87:6789:/scratch with dax=always failed 2023-03-30T16:47:37.455 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/606 2023-03-30T16:47:37.455 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/606 2023-03-30T16:47:37.456 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:37.466 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:37.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:37.558 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-03-30T16:47:38.167 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:38.184 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:38.186 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:38.191 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:38.191 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:39.068 INFO:teuthology.orchestra.run.smithi087.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2023-03-30T16:47:39.084 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/607 2023-03-30T16:47:39.084 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/607 2023-03-30T16:47:39.084 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:39.094 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:39.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:39.587 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-03-30T16:47:40.148 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:40.166 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:40.168 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:40.172 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:40.172 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:41.147 INFO:teuthology.orchestra.run.smithi087.stdout:generic/608 [not run] mount 172.21.15.87:6789:/scratch with dax=always failed 2023-03-30T16:47:41.163 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/608 2023-03-30T16:47:41.163 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/608 2023-03-30T16:47:41.163 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:41.174 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:41.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:41.265 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-03-30T16:47:41.869 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:41.888 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:41.890 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:41.895 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:41.895 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:43.298 INFO:teuthology.orchestra.run.smithi087.stdout:generic/609 1s 2023-03-30T16:47:43.319 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/609 2023-03-30T16:47:43.319 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:43.331 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:43.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:43.623 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-03-30T16:47:44.371 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:44.388 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:44.391 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:44.395 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:44.395 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:45.396 INFO:teuthology.orchestra.run.smithi087.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-30T16:47:45.411 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/610 2023-03-30T16:47:45.411 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/610 2023-03-30T16:47:45.411 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:45.422 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:45.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:45.532 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-03-30T16:47:46.134 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:46.150 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:46.152 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:46.155 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:46.156 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:47.659 INFO:teuthology.orchestra.run.smithi087.stdout:generic/611 1s 2023-03-30T16:47:47.679 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/611 2023-03-30T16:47:47.679 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:47.687 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:47.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:47.718 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-03-30T16:47:48.317 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:48.335 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:48.337 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:48.341 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:48.342 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:49.299 INFO:teuthology.orchestra.run.smithi087.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T16:47:49.315 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/612 2023-03-30T16:47:49.316 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/612 2023-03-30T16:47:49.316 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:49.326 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:49.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:49.593 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-03-30T16:47:50.308 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:50.324 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:50.326 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:50.331 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:52.079 INFO:teuthology.orchestra.run.smithi087.stdout:generic/613 [not run] _get_encryption_nonce() isn't implemented on ceph 2023-03-30T16:47:52.110 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/613 2023-03-30T16:47:52.110 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/613 2023-03-30T16:47:52.111 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:52.222 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:52.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:52.356 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-03-30T16:47:52.917 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:52.934 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:52.936 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:52.939 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:52.940 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:54.014 INFO:teuthology.orchestra.run.smithi087.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2023-03-30T16:47:54.106 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/614 2023-03-30T16:47:54.107 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/614 2023-03-30T16:47:54.107 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:47:54.117 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:47:54.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:47:54.209 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-03-30T16:47:54.792 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:47:54.809 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:47:54.811 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:47:54.814 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:47:54.814 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:48:29.992 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:48:29.999 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:48:30.061 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T16:48:30.057+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 549716) UID: 0 2023-03-30T16:48:30.062 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T16:48:30.057+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 549716) UID: 0 2023-03-30T16:48:30.062 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T16:48:30.057+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 549716) UID: 0 2023-03-30T16:48:30.063 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T16:48:30.057+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 549716) UID: 0 2023-03-30T16:49:01.537 INFO:teuthology.orchestra.run.smithi087.stdout:generic/615 66s 2023-03-30T16:49:01.556 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/615 2023-03-30T16:49:01.556 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:01.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:01.602 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-03-30T16:49:02.195 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:02.211 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:02.213 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:02.219 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:03.048 INFO:teuthology.orchestra.run.smithi087.stdout:generic/616 [not run] kernel does not support IO_URING 2023-03-30T16:49:03.063 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/616 2023-03-30T16:49:03.064 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/616 2023-03-30T16:49:03.064 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:03.075 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:03.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:03.160 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-03-30T16:49:03.756 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:03.776 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:03.778 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:03.782 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:03.783 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:04.624 INFO:teuthology.orchestra.run.smithi087.stdout:generic/617 [not run] kernel does not support IO_URING 2023-03-30T16:49:04.640 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/617 2023-03-30T16:49:04.640 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/617 2023-03-30T16:49:04.640 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:04.647 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:04.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:04.752 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-03-30T16:49:05.468 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:05.483 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:05.485 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:05.488 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:05.488 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:06.907 INFO:teuthology.orchestra.run.smithi087.stdout:generic/618 1s 2023-03-30T16:49:06.931 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/618 2023-03-30T16:49:06.931 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:06.940 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:06.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:06.969 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-03-30T16:49:07.578 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:07.594 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:07.596 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:07.601 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:07.601 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:08.428 INFO:teuthology.orchestra.run.smithi087.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T16:49:08.445 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/619 2023-03-30T16:49:08.445 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/619 2023-03-30T16:49:08.446 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:08.456 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:08.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:08.546 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-03-30T16:49:09.163 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:09.180 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:09.182 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:09.186 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:09.186 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:10.058 INFO:teuthology.orchestra.run.smithi087.stdout:generic/620 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T16:49:10.075 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/620 2023-03-30T16:49:10.076 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/620 2023-03-30T16:49:10.076 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:10.087 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:10.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:10.169 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-03-30T16:49:10.788 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:10.808 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:10.810 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:10.815 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:10.815 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:12.807 INFO:teuthology.orchestra.run.smithi087.stdout:generic/621 [not run] kernel doesn't support renameat2 syscall 2023-03-30T16:49:12.826 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/621 2023-03-30T16:49:12.827 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/621 2023-03-30T16:49:12.827 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:12.835 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:13.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:13.126 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-03-30T16:49:13.909 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:13.927 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:13.929 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:13.933 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:13.934 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:14.938 INFO:teuthology.orchestra.run.smithi087.stdout:generic/622 [not run] ceph does not support shutdown 2023-03-30T16:49:15.002 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/622 2023-03-30T16:49:15.003 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/622 2023-03-30T16:49:15.003 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:15.012 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:15.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:15.096 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-03-30T16:49:15.706 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:15.727 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:15.729 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:15.733 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:15.733 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:16.739 INFO:teuthology.orchestra.run.smithi087.stdout:generic/623 [not run] ceph does not support shutdown 2023-03-30T16:49:16.816 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/623 2023-03-30T16:49:16.816 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/623 2023-03-30T16:49:16.817 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:16.826 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:16.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:16.895 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-03-30T16:49:17.502 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:17.517 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:17.520 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:17.524 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:17.524 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:18.303 INFO:teuthology.orchestra.run.smithi087.stdout:generic/624 [not run] fsverity utility required, skipped this test 2023-03-30T16:49:18.318 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/624 2023-03-30T16:49:18.319 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/624 2023-03-30T16:49:18.319 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:18.328 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:18.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:18.410 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-03-30T16:49:19.008 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:19.023 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:19.024 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:19.029 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:19.029 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:19.808 INFO:teuthology.orchestra.run.smithi087.stdout:generic/625 [not run] fsverity utility required, skipped this test 2023-03-30T16:49:19.823 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/625 2023-03-30T16:49:19.824 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/625 2023-03-30T16:49:19.824 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:19.834 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:19.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:19.922 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-03-30T16:49:20.511 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:20.529 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:20.530 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:20.534 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:20.534 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:21.412 INFO:teuthology.orchestra.run.smithi087.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2023-03-30T16:49:21.427 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/626 2023-03-30T16:49:21.428 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/626 2023-03-30T16:49:21.428 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:21.438 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:21.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:21.707 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-03-30T16:49:22.467 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:22.485 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:22.487 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:22.491 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:22.491 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:23.421 INFO:teuthology.orchestra.run.smithi087.stdout:generic/627 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T16:49:23.438 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/627 2023-03-30T16:49:23.438 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/627 2023-03-30T16:49:23.439 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:23.449 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:23.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:23.543 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-03-30T16:49:24.160 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:24.178 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:24.180 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:24.183 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:24.184 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:25.486 INFO:teuthology.orchestra.run.smithi087.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T16:49:25.618 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/628 2023-03-30T16:49:25.618 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/628 2023-03-30T16:49:25.619 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:25.708 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:25.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:25.826 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-03-30T16:49:26.431 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:26.448 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:26.450 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:26.455 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:26.455 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:27.321 INFO:teuthology.orchestra.run.smithi087.stdout:generic/629 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T16:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/629 2023-03-30T16:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/629 2023-03-30T16:49:27.337 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:27.348 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:27.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:27.457 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-03-30T16:49:28.052 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:28.068 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:28.070 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:28.075 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:28.075 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:29.183 INFO:teuthology.orchestra.run.smithi087.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-03-30T16:49:29.429 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/630 2023-03-30T16:49:29.429 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/630 2023-03-30T16:49:29.430 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:49:29.481 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:49:29.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:49:29.762 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-03-30T16:49:30.350 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:49:30.368 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:49:30.370 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:49:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:49:30.375 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:02.717 INFO:teuthology.orchestra.run.smithi087.stdout:generic/631 - output mismatch (see /tmp/tmp.dmK5MK8Zk9xfstests-dev/results//generic/631.out.bad) 2023-03-30T16:50:02.775 INFO:teuthology.orchestra.run.smithi087.stdout: --- tests/generic/631.out 2023-03-30 08:12:30.442999514 +0000 2023-03-30T16:50:02.775 INFO:teuthology.orchestra.run.smithi087.stdout: +++ /tmp/tmp.dmK5MK8Zk9xfstests-dev/results//generic/631.out.bad 2023-03-30 16:50:02.663949295 +0000 2023-03-30T16:50:02.776 INFO:teuthology.orchestra.run.smithi087.stdout: @@ -1,2 +1,3560 @@ 2023-03-30T16:50:02.776 INFO:teuthology.orchestra.run.smithi087.stdout: QA output created by 631 2023-03-30T16:50:02.776 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.776 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.776 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.776 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.776 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.777 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.777 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.777 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.777 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.777 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.777 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.777 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.778 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.778 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.778 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.778 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.778 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.778 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.778 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.778 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.779 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.779 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.779 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.779 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.779 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.779 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.779 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.780 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.780 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.780 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.780 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.780 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.780 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.780 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.780 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.781 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.781 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.781 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.781 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.781 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.781 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.781 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.782 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.782 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:02.782 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.782 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.782 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.782 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.782 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.783 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.783 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.783 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.783 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.783 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.783 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.783 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.783 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.784 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.784 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.784 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.784 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.784 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.784 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.784 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.784 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.785 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.785 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.785 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.785 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.785 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.785 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.785 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.785 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.786 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: 2023-03-30T16:50:02.800 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.801 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.801 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.801 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.801 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.801 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:02.801 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.801 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.802 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.802 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.802 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.802 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.802 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.802 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.802 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.803 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.803 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.803 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.803 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.803 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.803 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directorymv: 2023-03-30T16:50:02.803 INFO:teuthology.orchestra.run.smithi087.stdout: +cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.803 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.804 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.804 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.804 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.804 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.804 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.804 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.804 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.805 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.805 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.805 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.805 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.805 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.805 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.805 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.805 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.806 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.806 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.806 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.806 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.806 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.806 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.806 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.806 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.807 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.807 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.807 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.807 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.807 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.807 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.807 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.808 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.808 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.808 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.808 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.808 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.808 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.808 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.808 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.809 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.809 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.809 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.809 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.809 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.809 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.809 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.809 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.810 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.810 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.810 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.810 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.810 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.810 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.810 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.810 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directorymv: 2023-03-30T16:50:02.811 INFO:teuthology.orchestra.run.smithi087.stdout: +cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.811 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf'cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:02.811 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.811 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.811 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.811 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.811 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.812 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.812 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.812 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.812 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.812 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.812 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.812 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.813 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.813 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.813 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.813 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.813 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.813 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.813 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.813 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.814 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.814 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.814 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.814 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.814 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.814 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.814 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.815 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.815 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.815 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.815 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.815 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.815 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.815 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.815 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.816 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.816 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.816 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.816 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.816 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.816 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.816 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.816 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.817 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.817 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.817 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.817 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf' 2023-03-30T16:50:02.817 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:02.817 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.817 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.818 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.818 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.818 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.818 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.818 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.818 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.818 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.818 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.819 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.819 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.819 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.819 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.819 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.819 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.819 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.819 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.820 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.820 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.820 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.820 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.820 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.820 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.820 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.820 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.821 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.821 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.821 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.821 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.821 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.821 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.821 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.822 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.822 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.822 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.822 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.822 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.822 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.822 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.822 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.823 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.823 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.823 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.823 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: mv: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:02.823 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.823 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.823 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.824 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.824 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted./tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.824 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.824 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.824 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.824 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.824 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.824 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.825 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.825 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.825 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.825 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.825 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.825 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.825 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.825 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.826 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.826 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.826 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.826 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.826 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.826 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.826 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.826 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.827 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.827 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.827 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.827 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.827 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.827 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.827 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.827 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.828 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.828 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.828 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.828 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.828 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.828 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.828 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.829 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.829 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.829 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.829 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.829 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.829 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.829 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.829 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.830 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.830 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.830 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.830 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.830 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.830 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.830 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.830 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.831 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.831 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.831 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.831 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.831 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.831 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.831 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.832 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.832 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.832 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.832 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.832 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.832 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.832 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.833 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.833 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.833 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.833 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.833 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.833 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.833 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.833 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: touch: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf'cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted./tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted./tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf' 2023-03-30T16:50:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: 2023-03-30T16:50:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: 2023-03-30T16:50:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directorymv: 2023-03-30T16:50:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: +cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: mount: 2023-03-30T16:50:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: 2023-03-30T16:50:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directorytouch: 2023-03-30T16:50:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: +cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: mv: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf' 2023-03-30T16:50:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: 2023-03-30T16:50:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.929 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.929 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.929 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.929 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.929 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.929 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.929 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: umount: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf'/tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.944 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.944 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.944 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.944 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.944 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.944 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.944 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.944 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.945 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.945 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.945 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.945 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.945 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.945 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.945 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.945 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.946 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.946 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.946 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.946 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.946 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.946 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.946 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.946 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.947 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.947 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.947 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.947 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.947 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.947 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.947 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.947 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.948 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.948 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.948 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: 2023-03-30T16:50:02.948 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.948 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.948 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.948 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.949 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.949 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.949 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.949 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.949 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.949 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.949 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.949 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.950 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.950 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.950 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.950 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.950 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.950 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.950 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.950 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.951 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.951 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.951 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.951 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.951 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.951 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.951 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.951 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.952 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.952 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.952 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.952 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.952 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.952 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.952 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.953 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.953 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.953 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.953 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.953 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.953 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.953 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.953 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.954 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.954 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.954 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.954 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.954 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.954 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.954 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.954 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.955 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.955 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.955 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.955 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.955 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.955 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.955 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.956 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.956 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.956 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.956 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.956 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.956 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.956 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.956 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.957 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.957 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.957 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.957 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.957 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.957 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.957 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.957 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf' 2023-03-30T16:50:02.958 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:02.958 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.958 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.958 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.958 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.958 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.958 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.958 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.959 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.959 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.959 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.959 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.959 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.959 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.959 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.960 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.960 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.960 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.960 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.960 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.960 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.960 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.960 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.961 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.961 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.961 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.961 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.961 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.961 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.961 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.962 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.962 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.962 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.962 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.962 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.962 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.962 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.963 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.963 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.964 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.964 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.964 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.964 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.964 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.964 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.964 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.965 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.965 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.965 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.965 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.965 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.965 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.965 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.965 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.966 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.966 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.966 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.966 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.966 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.966 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.966 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.966 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.967 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.967 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.967 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.967 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.967 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.967 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.967 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.968 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.968 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.968 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.968 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.968 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.968 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.968 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.968 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.969 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.969 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.969 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.969 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.969 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.969 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.969 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.969 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.970 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.970 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.970 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.970 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.970 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.970 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.970 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.971 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.971 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.971 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.971 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.971 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.971 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.971 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.971 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.972 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.972 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.972 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.972 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.972 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.972 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.972 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.972 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.973 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:02.973 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.973 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.973 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.973 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.973 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.973 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.973 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.974 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.974 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.974 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.974 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.974 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.974 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.974 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.974 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.975 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.975 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.975 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.975 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.975 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.975 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.975 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.975 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.976 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.976 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.976 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.976 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.976 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.976 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.976 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.977 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.977 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.977 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.977 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.977 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.977 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.977 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.977 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.978 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directorytouch: 2023-03-30T16:50:02.978 INFO:teuthology.orchestra.run.smithi087.stdout: +cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.978 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.978 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.978 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directorytouch: 2023-03-30T16:50:02.978 INFO:teuthology.orchestra.run.smithi087.stdout: +cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.978 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.978 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.979 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.979 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.979 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.979 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.979 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.979 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.979 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.979 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.980 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.980 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.980 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.980 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.980 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.980 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.980 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.980 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.981 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.981 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.981 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.981 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.981 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.981 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.981 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.982 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.982 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.982 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.982 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf' 2023-03-30T16:50:02.982 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:02.982 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.982 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.982 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.983 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.983 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.983 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.983 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.983 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.983 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.983 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.983 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:02.984 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.984 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.984 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.984 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.984 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.984 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.984 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.984 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.985 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.985 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.985 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.985 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.985 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.985 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.985 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.985 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.986 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.986 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.986 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.986 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.986 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.986 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.986 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.987 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.987 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.987 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.987 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.987 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.987 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.987 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.987 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.988 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.988 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.988 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.988 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.988 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.988 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.988 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.988 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.989 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.989 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.989 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.989 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.989 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.989 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.989 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.989 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.990 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.990 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.990 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.990 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.990 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.990 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.990 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.990 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.991 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.991 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.991 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.991 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.991 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.991 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.991 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.991 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.992 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.992 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.992 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.992 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.992 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.992 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.992 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.992 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.993 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.993 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.993 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.993 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.993 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.993 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.993 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.994 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.994 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.994 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.994 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.994 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.994 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: umount: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf'/tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.994 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:02.994 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.995 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.995 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.995 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.995 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.995 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.995 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.995 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.995 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.996 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.996 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.996 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.996 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:02.996 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:02.996 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:02.996 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:02.996 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.997 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.997 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.997 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:02.997 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.997 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:02.997 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:02.997 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.997 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.998 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.998 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.998 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:02.998 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:02.998 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.998 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.998 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.998 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.999 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:02.999 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:02.999 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:02.999 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:02.999 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:02.999 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:02.999 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:02.999 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.000 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.000 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.000 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.000 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.000 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.000 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.000 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.000 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.001 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.001 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.001 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.001 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.001 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.001 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.001 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.002 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.002 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.002 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.002 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.002 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.002 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.002 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.002 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.003 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.003 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.003 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.003 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.003 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.003 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.003 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.003 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.004 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.004 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.004 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.004 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.004 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.004 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.004 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.004 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.005 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.005 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.005 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.005 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.005 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.005 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.005 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.006 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.006 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.006 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.006 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.006 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.006 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.006 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.006 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.007 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.007 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.007 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.007 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.007 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.007 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.007 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.007 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.008 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.008 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.008 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.008 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.008 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.008 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.008 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.008 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.009 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.009 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.009 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.009 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.009 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.009 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.009 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.010 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.010 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.010 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.010 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.010 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.010 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.010 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.010 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.011 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.011 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.011 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.011 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.011 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.011 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.011 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.011 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.012 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.012 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.012 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.012 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.012 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.012 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.012 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.012 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.013 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.013 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.013 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.013 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.013 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.013 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.013 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.014 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.014 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.014 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.014 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.014 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.014 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.014 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.014 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.015 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.015 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.015 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.015 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.015 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: mv: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.015 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.015 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.015 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.016 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.016 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.016 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.016 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.016 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.016 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.016 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.016 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.017 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.017 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.017 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.017 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.017 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.017 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.017 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.018 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.018 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.018 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.018 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.018 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.018 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.018 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.018 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.019 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.019 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.019 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.019 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.019 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.019 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.019 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.019 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.020 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.020 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.020 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.020 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.020 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.020 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.020 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.020 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.021 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.021 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.021 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.021 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.021 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.021 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.021 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.022 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.022 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.022 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.022 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.022 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.022 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.022 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.022 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.023 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.023 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.023 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.023 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.023 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.023 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.023 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.023 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.024 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.024 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.024 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.024 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.024 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.024 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.024 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.024 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.025 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: 2023-03-30T16:50:03.025 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.025 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.025 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.025 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.025 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.025 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.025 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.026 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.026 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.026 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.026 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.026 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.026 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.026 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.026 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.028 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.028 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.029 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.029 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.029 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.029 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.029 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.029 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.029 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.030 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.030 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.030 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.030 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.030 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.030 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.030 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.030 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.031 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.031 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.031 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.031 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.031 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.031 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.031 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.031 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.032 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.032 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.032 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.032 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.032 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.032 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.032 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.032 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.033 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.033 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.033 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.033 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.033 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.033 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.033 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.034 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.034 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.034 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.034 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.034 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.034 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.034 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.034 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.035 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.035 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.035 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.035 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.035 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.035 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.035 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.035 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.036 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.036 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.036 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf' 2023-03-30T16:50:03.036 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:03.036 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.036 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.036 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.036 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.037 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.037 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.037 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.037 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.037 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.037 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.037 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.037 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.038 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.038 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.038 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.038 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.038 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.038 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.038 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.038 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.039 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.039 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.039 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.039 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.039 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.039 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.039 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.040 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.040 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.040 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.040 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.040 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.040 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.040 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.040 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.041 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.041 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.041 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.041 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.041 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directorytouch: 2023-03-30T16:50:03.041 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.041 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.041 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.042 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.042 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.042 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.042 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.042 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.042 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.042 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.042 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.043 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.043 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.043 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.043 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.043 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.043 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.043 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.043 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.044 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.044 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.044 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.044 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.044 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.044 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.044 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.045 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.045 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.045 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.045 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.045 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.045 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.045 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: mount: 2023-03-30T16:50:03.045 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted./tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.046 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.046 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.046 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.046 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.046 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.046 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.046 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.046 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.047 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.047 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.047 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.047 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.047 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.047 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.047 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.047 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.048 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.048 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.048 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.048 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.048 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.048 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.048 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.048 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.049 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.049 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.049 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.049 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.049 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.050 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.050 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: 2023-03-30T16:50:03.050 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.050 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.050 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.050 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.050 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.050 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf' 2023-03-30T16:50:03.051 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:03.051 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.051 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.051 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.051 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.051 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.051 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.051 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.052 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.052 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.052 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.052 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.052 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.052 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.052 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.052 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.053 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.054 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.055 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.055 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.055 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.055 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.055 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.055 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.055 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.055 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.056 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.056 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.056 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.056 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.056 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.056 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.056 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.056 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.057 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.057 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directorymv: 2023-03-30T16:50:03.057 INFO:teuthology.orchestra.run.smithi087.stdout: +cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.057 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.057 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.057 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.057 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.057 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.058 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.058 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.058 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.058 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.058 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.058 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.058 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.058 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.059 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.059 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.059 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.059 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.059 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.059 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.059 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.060 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.060 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.060 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.060 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.060 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.060 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.060 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.060 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.061 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.061 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.061 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf' 2023-03-30T16:50:03.061 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:03.061 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.061 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.061 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.061 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.062 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.062 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.062 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.062 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.062 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.062 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.062 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.062 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.063 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.063 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.063 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.063 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.063 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.063 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.063 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.063 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.064 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.064 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.064 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.064 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.064 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.064 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.064 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.064 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.065 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.065 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.065 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.065 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.065 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.065 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.065 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.065 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.066 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.066 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.066 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.066 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.066 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.066 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.066 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.066 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.067 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.067 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.067 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directorymv: 2023-03-30T16:50:03.067 INFO:teuthology.orchestra.run.smithi087.stdout: +cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.067 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.067 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.067 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.067 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.068 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.068 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.068 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.068 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.068 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.068 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.068 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.068 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.069 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.069 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.069 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.069 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.069 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.069 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.069 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.070 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.070 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.070 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.070 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.070 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.070 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.070 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.070 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.071 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.071 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.071 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.071 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.071 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.071 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.071 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.071 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.072 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.072 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.072 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.072 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.072 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.072 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.072 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.072 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.073 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.073 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.073 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.073 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.073 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directorymv: 2023-03-30T16:50:03.073 INFO:teuthology.orchestra.run.smithi087.stdout: +cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.073 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.073 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.074 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.074 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf' 2023-03-30T16:50:03.074 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:03.074 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.074 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.074 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.074 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.074 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.075 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.075 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.075 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.075 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.075 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.075 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.075 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.075 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.076 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.076 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.076 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.076 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.076 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.076 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.076 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.076 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.077 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.077 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.077 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.077 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.077 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.077 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.077 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.078 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.078 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.078 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.078 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.078 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.078 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.078 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.078 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.079 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.079 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.079 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.079 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.079 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.079 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.079 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.079 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.080 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.080 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.080 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.080 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.080 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.080 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.080 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.080 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.081 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.081 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.081 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.081 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.081 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.081 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.081 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.081 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.082 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.082 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.082 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.082 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.082 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.082 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.082 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.082 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.083 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.083 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.083 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.083 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.083 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.083 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.083 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.083 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.084 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.084 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:03.084 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.084 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.084 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.084 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.084 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.085 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.085 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.085 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.085 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.085 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.085 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf'cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.085 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.085 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.086 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.086 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.086 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.086 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.086 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.086 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.086 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.086 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.087 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.087 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.087 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.087 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.087 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.087 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.touch: 2023-03-30T16:50:03.087 INFO:teuthology.orchestra.run.smithi087.stdout: +cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.087 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.088 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.088 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.088 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.088 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.088 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.088 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.088 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.088 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.089 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.089 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: touch: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.089 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.089 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.089 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.089 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.089 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.089 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.090 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.090 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.090 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted.umount: 2023-03-30T16:50:03.090 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.090 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.090 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.090 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.090 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.091 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.091 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.091 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.091 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.091 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.091 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.091 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.092 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.092 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.092 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.092 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.092 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.092 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.092 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.092 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.093 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.093 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.093 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.093 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.093 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.093 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.093 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.093 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.094 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.094 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.094 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.094 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.094 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.094 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.094 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.094 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.095 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.095 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.095 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.095 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.095 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.095 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.095 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.095 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.096 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.096 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.096 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.096 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.096 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.096 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.096 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.096 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.097 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.097 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.097 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.097 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.097 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.097 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.097 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.097 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.098 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.098 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.098 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.098 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.098 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.098 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.098 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.098 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.099 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.099 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.099 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.099 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.099 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.099 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.099 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.100 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.100 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.100 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.100 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.100 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.100 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.100 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.100 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: mount: 2023-03-30T16:50:03.101 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.101 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.101 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.101 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.101 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.101 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.101 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.101 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.102 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.102 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directorytouch: : No such file or directory 2023-03-30T16:50:03.102 INFO:teuthology.orchestra.run.smithi087.stdout: +cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf' 2023-03-30T16:50:03.102 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:03.102 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.102 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.102 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.102 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.103 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.103 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.103 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.103 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.103 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.103 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.103 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.103 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.104 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.104 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.104 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.104 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.104 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.104 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.104 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.104 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.105 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.105 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.105 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.105 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.105 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.105 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.105 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.106 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.106 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.106 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.106 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.106 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.106 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.106 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.106 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.107 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.107 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.107 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.107 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.107 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.107 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.107 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.107 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.108 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.108 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.108 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.108 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.108 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.108 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.108 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.108 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.109 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.109 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.109 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.109 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.109 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.109 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.109 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.109 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.110 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.110 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.110 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.110 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.110 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.110 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.110 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.110 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.111 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.111 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.111 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.111 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.111 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.111 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.111 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.111 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.112 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.112 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.112 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.112 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.112 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.112 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.112 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.112 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.113 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.113 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.113 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.113 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.113 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.113 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.113 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.113 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.114 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.114 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.114 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.114 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.114 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.114 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.114 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.115 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.115 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.115 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.115 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.115 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.115 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.115 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.115 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.116 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.116 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.116 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.116 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.116 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.116 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.116 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.116 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.117 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.117 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.117 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.117 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directorytouch: : No such file or directory 2023-03-30T16:50:03.117 INFO:teuthology.orchestra.run.smithi087.stdout: +cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf' 2023-03-30T16:50:03.117 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:03.117 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.117 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.118 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.118 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.118 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.118 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.118 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.118 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.118 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.118 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.119 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.119 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.119 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.119 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.119 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.119 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.119 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.120 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.120 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.120 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.120 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.120 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.120 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.120 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.120 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.121 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.121 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.121 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.121 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.121 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.121 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.121 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.121 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.122 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.122 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.122 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.122 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.122 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.122 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.122 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.122 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.123 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf' 2023-03-30T16:50:03.123 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:03.123 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.123 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.123 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.123 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.123 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.123 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.124 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.124 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.124 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.124 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.124 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.124 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.124 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.124 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.125 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.125 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.125 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.125 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.125 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.125 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.125 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.125 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.126 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.126 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.126 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.126 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.126 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.126 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.126 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.126 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.127 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.127 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.127 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.127 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.127 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.127 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.127 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.127 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.128 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.128 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.128 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.128 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.128 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.128 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.128 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.129 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.129 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.129 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.129 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.129 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.129 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.129 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.129 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.130 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.130 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.130 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.130 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.130 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.130 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.130 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.130 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.131 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.131 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.131 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.131 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.131 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.131 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.131 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.131 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.132 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.132 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.132 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.132 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.132 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.132 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.132 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.132 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.133 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.133 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.133 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.133 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.133 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.133 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.133 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.134 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.134 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.134 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.134 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.134 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.134 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.134 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.134 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.135 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.135 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.135 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.135 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.135 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.135 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.135 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.135 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.136 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.136 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.136 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.136 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.136 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.136 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.136 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.136 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.137 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.137 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.137 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.137 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.137 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.137 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.137 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.137 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.138 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.138 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.138 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.138 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.138 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.138 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.138 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.138 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.139 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.139 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.139 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.139 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.139 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.139 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.139 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.139 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.140 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.140 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.140 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.140 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.140 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.140 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.140 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.141 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.141 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.141 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.141 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.141 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.141 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.141 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.141 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.142 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.142 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.142 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.142 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.142 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.142 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.142 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.142 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.143 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.143 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.143 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.143 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.143 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.143 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.143 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.143 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.144 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.144 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.144 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.144 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.144 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.144 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.144 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.144 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.145 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.145 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.145 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.145 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.145 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.145 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.145 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.145 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.146 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.146 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.146 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.146 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.146 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.146 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.146 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.146 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.147 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.147 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.147 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.147 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.147 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.147 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.147 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.147 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.148 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.148 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.148 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.148 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.148 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.148 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.148 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.148 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.149 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.149 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.149 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.149 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.149 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.149 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.149 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.149 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.150 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.150 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.150 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.150 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.150 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.150 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.150 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.150 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.151 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.151 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.151 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.151 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.151 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.151 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.151 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.152 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.152 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.152 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.152 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.152 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.152 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf' 2023-03-30T16:50:03.152 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:03.152 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.153 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.153 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.153 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.153 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.153 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.153 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.153 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.153 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.154 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.154 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.154 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.154 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.154 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.154 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.154 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.154 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.155 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.155 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.155 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.155 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.155 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.155 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.155 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.155 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.156 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.156 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.156 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.156 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.156 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.156 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.156 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.156 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.157 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.157 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.157 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.157 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.157 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.157 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.157 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.157 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.158 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.158 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.158 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.158 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.158 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.158 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.158 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.158 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.159 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.159 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.159 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.159 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.159 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.159 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.159 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.160 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.160 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.160 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.160 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.160 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.160 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.160 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.160 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.161 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.161 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.161 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.161 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.161 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.161 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.161 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.161 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.162 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.162 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.162 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.162 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.162 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.162 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.162 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.162 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.163 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.163 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.163 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.163 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.163 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.163 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.163 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.163 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted./tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.164 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.164 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.164 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.164 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.164 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.164 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.164 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.164 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.165 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.165 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.165 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.165 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.165 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.165 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.165 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.165 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.166 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.166 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.166 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.166 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.166 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.166 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.166 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.166 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.167 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.167 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.167 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.167 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.167 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.167 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.167 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.167 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.168 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.168 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.168 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.168 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted./tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.168 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.168 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.168 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.168 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.169 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.169 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.169 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.169 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.169 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.169 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.169 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.169 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.170 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.170 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.170 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.170 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.170 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.170 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.170 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.171 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.171 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.171 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.171 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.171 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.171 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.171 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.171 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.171 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.172 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.172 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.172 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.172 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.172 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.172 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.172 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.173 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.173 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.173 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.173 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.173 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.173 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.173 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.173 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.174 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.174 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.174 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.174 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.174 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.174 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.174 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.174 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.175 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.175 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.175 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.175 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.175 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.175 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.175 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.175 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.176 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.176 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.176 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.176 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.176 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.176 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.176 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.176 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.177 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.177 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.177 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.177 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.177 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.177 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.177 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.177 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.178 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.178 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.178 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.178 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.178 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.178 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.178 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.179 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.179 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.179 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.179 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.179 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.179 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.179 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.179 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.180 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.180 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.180 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.180 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.180 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.180 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.180 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.180 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.181 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.181 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.181 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.181 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.181 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.181 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.181 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.181 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.182 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.182 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.182 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.182 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.182 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.182 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.182 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.182 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.183 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.183 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.183 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.183 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.183 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.183 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.183 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.183 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.184 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.184 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.184 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.184 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.184 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.184 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.184 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.184 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.185 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.185 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.185 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.185 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.185 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.185 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.185 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.185 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.186 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.186 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.186 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.186 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.186 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.186 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.186 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.186 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.187 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.187 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: touch: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf'cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.187 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.187 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.187 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.187 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.187 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.187 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.188 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.188 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.188 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T16:50:03.190 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.190 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.191 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.191 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.191 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.191 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.191 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.191 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.191 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.192 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.192 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.192 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.192 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.192 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.192 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.192 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.192 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.193 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.193 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.193 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.193 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.193 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.193 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.193 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.194 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.194 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.194 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: touch: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf'cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.194 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.194 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directorytouch: 2023-03-30T16:50:03.194 INFO:teuthology.orchestra.run.smithi087.stdout: +cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.194 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.194 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.195 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.195 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.195 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.195 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.195 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.195 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.195 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.195 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.196 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.196 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.196 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directoryumount: 2023-03-30T16:50:03.196 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.196 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.196 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.196 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.196 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.197 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.197 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.197 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.197 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.197 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.197 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.197 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.197 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.198 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.198 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.198 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.198 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.198 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.198 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.198 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.199 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.199 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.199 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.199 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.199 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.199 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.199 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.199 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.200 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.200 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.200 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.200 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.200 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.200 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.200 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.200 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.201 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.201 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.201 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.201 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.201 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.201 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.201 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.202 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.202 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.202 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.202 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.202 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.202 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.202 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.202 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.203 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.203 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.203 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.203 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.203 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.203 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.203 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.203 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.204 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.204 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.204 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.204 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.204 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.204 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.204 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.204 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.205 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.205 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.205 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.205 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.205 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.205 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.205 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.205 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.206 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.206 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.206 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.206 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.206 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.206 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.206 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.206 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.207 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.207 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.207 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.207 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.207 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.207 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.207 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.208 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.208 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.208 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.208 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.208 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.208 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.208 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.208 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.209 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.209 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.209 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf' 2023-03-30T16:50:03.209 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:03.209 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf' 2023-03-30T16:50:03.209 INFO:teuthology.orchestra.run.smithi087.stdout: +: No such file or directory 2023-03-30T16:50:03.209 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.209 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.210 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.210 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.210 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.210 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.210 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.210 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.210 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.210 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.211 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.211 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.211 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.211 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.211 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.211 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.211 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.211 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.212 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.212 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.212 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.212 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.212 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.212 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.212 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.212 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.213 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.213 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.213 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: 2023-03-30T16:50:03.213 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.213 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.213 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.213 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.214 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.214 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.214 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.214 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.214 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.214 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.214 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.214 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.215 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.215 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.215 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.215 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.215 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.215 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.215 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.215 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.216 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.216 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.216 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.216 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.216 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.216 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.216 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.216 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.217 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.217 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.217 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.217 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.217 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.217 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.217 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.218 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.218 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.218 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.218 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.218 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.218 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.218 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.218 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.219 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.219 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.219 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.219 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.219 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.219 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.219 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.219 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.220 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.220 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.220 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.220 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.220 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.220 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.220 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.220 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.221 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.221 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.221 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.221 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.221 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.221 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.221 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.221 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.222 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.222 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.222 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.222 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.222 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.222 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.222 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.222 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.223 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.223 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.223 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.223 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.223 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.223 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.223 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.223 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.224 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.224 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.224 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.224 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.224 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.224 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.224 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted./tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.224 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.225 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.225 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.225 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.225 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.225 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.225 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.225 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.226 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.226 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.226 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.226 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.226 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.226 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.226 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.226 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.227 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.227 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.227 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.227 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.227 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf' 2023-03-30T16:50:03.227 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: : No such file or directorymv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf' 2023-03-30T16:50:03.227 INFO:teuthology.orchestra.run.smithi087.stdout: +cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-03-30T16:50:03.227 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.228 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.228 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.228 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.228 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.228 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.228 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.228 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.228 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.229 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.230 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.230 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.230 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.230 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.230 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.230 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.230 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.230 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.231 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.231 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.231 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.231 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.231 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-30T16:50:03.231 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.231 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.232 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.232 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.232 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.232 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.232 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.232 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.232 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.232 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.233 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.233 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.233 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.233 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.233 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.233 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.233 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.233 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.234 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.234 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.234 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.234 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.234 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.234 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.234 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.234 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.235 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.235 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.235 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.235 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.235 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.235 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.235 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.235 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.236 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.236 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.236 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.236 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.236 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.236 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.236 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.236 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.237 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.237 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.237 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.237 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.237 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.237 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.237 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.238 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.238 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.238 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.238 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.238 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.238 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.238 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.238 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.239 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.239 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.239 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.239 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.239 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.239 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.239 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.239 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.240 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.240 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.240 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.240 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.240 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.240 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.240 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.240 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.241 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.241 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.241 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.241 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.241 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.241 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.241 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.241 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.242 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.242 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.242 INFO:teuthology.orchestra.run.smithi087.stdout: + 2023-03-30T16:50:03.242 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.242 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.242 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.242 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.243 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.243 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.243 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.243 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.243 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.243 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.243 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.243 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.244 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.244 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.244 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.244 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.244 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.244 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.244 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.244 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.245 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.245 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.245 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.245 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.245 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.245 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.245 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.245 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.246 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.246 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.246 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.246 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.246 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.246 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.246 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.246 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.247 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.247 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.247 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.247 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.247 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.247 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.247 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.247 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.248 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.248 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.248 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.248 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.248 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.248 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.248 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.248 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted.mount: 2023-03-30T16:50:03.249 INFO:teuthology.orchestra.run.smithi087.stdout: +/tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.249 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.249 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.249 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.250 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.250 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.250 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.250 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.250 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.250 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.250 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.251 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.251 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.251 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.251 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.251 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.251 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.252 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.252 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.252 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.252 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.252 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.252 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.252 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged3/etc/access.conf': No such file or directory 2023-03-30T16:50:03.252 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.253 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.253 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.253 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged3: not mounted. 2023-03-30T16:50:03.253 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.253 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.253 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.253 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.254 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.254 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.254 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.254 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.254 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.255 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged0/etc/access.conf': No such file or directory 2023-03-30T16:50:03.255 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged1/etc/access.conf': No such file or directory 2023-03-30T16:50:03.255 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged2/etc/access.conf': No such file or directory 2023-03-30T16:50:03.255 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged0: not mounted. 2023-03-30T16:50:03.255 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged2: not mounted. 2023-03-30T16:50:03.255 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged1: not mounted. 2023-03-30T16:50:03.255 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.256 INFO:teuthology.orchestra.run.smithi087.stdout: +mount: /tmp/tmp.T6S6cZMyVfscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-30T16:50:03.256 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.256 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.256 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.256 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.256 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.256 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged4/etc/access.conf': No such file or directory 2023-03-30T16:50:03.256 INFO:teuthology.orchestra.run.smithi087.stdout: +mv: cannot stat '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.257 INFO:teuthology.orchestra.run.smithi087.stdout: +touch: cannot touch '/tmp/tmp.T6S6cZMyVfscratch/merged5/etc/access.conf': No such file or directory 2023-03-30T16:50:03.257 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged4: not mounted. 2023-03-30T16:50:03.257 INFO:teuthology.orchestra.run.smithi087.stdout: +umount: /tmp/tmp.T6S6cZMyVfscratch/merged5: not mounted. 2023-03-30T16:50:03.257 INFO:teuthology.orchestra.run.smithi087.stdout: Silence is golden. 2023-03-30T16:50:03.257 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:03.257 INFO:teuthology.orchestra.run.smithi087.stdout:HINT: You _MAY_ be missing kernel fix: 2023-03-30T16:50:03.257 INFO:teuthology.orchestra.run.smithi087.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2023-03-30T16:50:03.258 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:03.258 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/631 2023-03-30T16:50:03.258 INFO:teuthology.orchestra.run.smithi087.stdout:Failures: generic/631 2023-03-30T16:50:03.258 INFO:teuthology.orchestra.run.smithi087.stdout:Failed 1 of 1 tests 2023-03-30T16:50:03.258 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:03.258 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-03-30T16:50:03.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-03-30T16:50:03.260 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-03-30T16:50:03.875 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:50:03.892 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:50:03.894 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:50:03.900 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:50:03.900 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:07.590 INFO:teuthology.orchestra.run.smithi087.stdout:generic/632 3s 2023-03-30T16:50:07.610 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/632 2023-03-30T16:50:07.611 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:50:07.619 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:07.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:50:07.734 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-03-30T16:50:08.341 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:50:08.359 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:50:08.361 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:50:08.366 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:50:08.366 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:10.775 INFO:teuthology.orchestra.run.smithi087.stdout:generic/633 2s 2023-03-30T16:50:10.795 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/633 2023-03-30T16:50:10.795 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:50:10.803 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:11.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:50:11.003 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-03-30T16:50:11.848 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:50:11.865 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:50:11.867 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:50:11.871 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:50:11.871 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:14.039 INFO:teuthology.orchestra.run.smithi087.stdout:generic/634 2s 2023-03-30T16:50:14.061 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/634 2023-03-30T16:50:14.061 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:50:14.071 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:14.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:50:14.106 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-03-30T16:50:14.696 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:50:14.713 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:50:14.715 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:50:14.720 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:50:14.720 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:15.728 INFO:teuthology.orchestra.run.smithi087.stdout:generic/635 [not run] ceph does not support shutdown 2023-03-30T16:50:15.795 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/635 2023-03-30T16:50:15.796 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/635 2023-03-30T16:50:15.796 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:50:15.805 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:15.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:50:15.894 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-03-30T16:50:16.511 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:50:16.532 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:50:16.534 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:50:16.538 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:50:16.538 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:17.753 INFO:teuthology.orchestra.run.smithi087.stdout:generic/636 [not run] swapfiles are not supported 2023-03-30T16:50:17.770 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/636 2023-03-30T16:50:17.770 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/636 2023-03-30T16:50:17.770 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:50:17.780 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:17.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:50:17.883 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-03-30T16:50:18.491 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:50:18.508 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:50:18.510 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:50:18.514 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:50:18.514 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:20.092 INFO:teuthology.orchestra.run.smithi087.stdout:generic/637 2s 2023-03-30T16:50:20.113 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/637 2023-03-30T16:50:20.114 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:50:20.124 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:20.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:50:20.623 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-03-30T16:50:21.198 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:50:21.214 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:50:21.216 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:50:21.221 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:50:21.221 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:22.130 INFO:teuthology.orchestra.run.smithi087.stdout:generic/638 1s 2023-03-30T16:50:22.151 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/638 2023-03-30T16:50:22.151 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:50:22.159 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:22.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:50:22.241 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-03-30T16:50:22.844 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:50:22.861 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:50:22.862 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:50:22.867 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:50:22.868 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:23.917 INFO:teuthology.orchestra.run.smithi087.stdout:generic/639 0s 2023-03-30T16:50:23.938 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/639 2023-03-30T16:50:23.938 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:50:23.951 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:24.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:50:24.053 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-03-30T16:50:24.636 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:50:24.655 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:50:24.656 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:50:24.661 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:50:24.661 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:25.473 INFO:teuthology.orchestra.run.smithi087.stdout:generic/640 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T16:50:25.488 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/640 2023-03-30T16:50:25.488 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/640 2023-03-30T16:50:25.488 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:50:25.497 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:25.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:50:25.575 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-03-30T16:50:26.161 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:50:26.177 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:50:26.179 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:50:26.184 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:50:26.184 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:27.375 INFO:teuthology.orchestra.run.smithi087.stdout:generic/641 [not run] swapfiles are not supported 2023-03-30T16:50:27.392 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/641 2023-03-30T16:50:27.393 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/641 2023-03-30T16:50:27.393 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T16:50:27.402 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:50:27.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T16:50:27.489 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-03-30T16:50:28.080 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T16:50:28.096 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T16:50:28.098 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T16:50:28.102 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T16:50:28.102 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T16:51:31.468 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:51:31.476 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:52:01.623 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:52:01.629 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:52:31.760 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:52:31.767 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:53:01.939 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:53:01.946 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:53:33.052 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:53:33.064 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:54:03.162 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:54:03.168 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:54:33.255 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:54:33.260 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:55:03.341 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:55:03.346 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T16:55:03.391 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T16:55:03.387+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45924) UID: 0 2023-03-30T16:55:03.392 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T16:55:03.387+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45924) UID: 0 2023-03-30T16:57:49.928 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T16:57:49.924+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45935) UID: 0 2023-03-30T16:57:49.929 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T16:57:49.924+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45935) UID: 0 2023-03-30T16:57:49.929 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T16:57:49.924+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45935) UID: 0 2023-03-30T16:57:49.930 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T16:57:49.924+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45935) UID: 0 2023-03-30T17:01:13.259 INFO:teuthology.orchestra.run.smithi087.stdout:generic/642 645s 2023-03-30T17:01:13.283 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/642 2023-03-30T17:01:13.284 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:01:13.294 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:01:13.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:01:13.329 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-03-30T17:01:16.577 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:01:16.594 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:01:16.595 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:01:16.598 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:01:16.598 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:02:23.259 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:02:23.267 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:02:23.405 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T17:02:23.404+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45949) UID: 0 2023-03-30T17:02:23.406 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T17:02:23.404+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45949) UID: 0 2023-03-30T17:06:13.876 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T17:06:13.871+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45961) UID: 0 2023-03-30T17:06:13.877 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T17:06:13.871+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45961) UID: 0 2023-03-30T17:06:13.878 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T17:06:13.871+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45961) UID: 0 2023-03-30T17:06:13.878 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T17:06:13.871+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45961) UID: 0 2023-03-30T17:07:13.005 INFO:teuthology.orchestra.run.smithi087.stdout:generic/643 [not run] swapfiles are not supported 2023-03-30T17:07:13.021 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/643 2023-03-30T17:07:13.022 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/643 2023-03-30T17:07:13.022 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:07:13.032 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:07:13.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:07:13.131 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-03-30T17:07:13.649 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:07:13.664 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:07:13.665 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:07:13.669 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:07:13.669 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:07:14.473 INFO:teuthology.orchestra.run.smithi087.stdout:generic/644 [not run] vfstest not support by ceph 2023-03-30T17:07:14.489 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/644 2023-03-30T17:07:14.490 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/644 2023-03-30T17:07:14.490 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:07:14.501 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:07:14.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:07:14.624 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-03-30T17:07:15.272 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:07:15.293 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:07:15.295 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:07:15.300 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:07:15.300 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:07:16.161 INFO:teuthology.orchestra.run.smithi087.stdout:generic/645 [not run] vfstest not support by ceph 2023-03-30T17:07:16.180 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/645 2023-03-30T17:07:16.180 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/645 2023-03-30T17:07:16.180 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:07:16.191 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:07:16.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:07:16.282 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-03-30T17:07:16.932 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:07:16.950 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:07:16.952 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:07:16.957 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:07:16.957 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:07:18.061 INFO:teuthology.orchestra.run.smithi087.stdout:generic/646 [not run] ceph does not support shutdown 2023-03-30T17:07:18.129 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/646 2023-03-30T17:07:18.130 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/646 2023-03-30T17:07:18.130 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:07:18.140 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:07:18.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:07:18.225 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-03-30T17:07:18.876 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:07:18.959 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:07:18.960 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:07:18.960 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:07:18.961 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:07:20.219 INFO:teuthology.orchestra.run.smithi087.stdout:generic/647 1s 2023-03-30T17:07:20.241 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/647 2023-03-30T17:07:20.242 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:07:20.254 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:07:20.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:07:20.607 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-03-30T17:07:21.379 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:07:21.398 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:07:21.402 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:07:21.406 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:07:21.406 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:07:22.861 INFO:teuthology.orchestra.run.smithi087.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:07:22.963 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/648 2023-03-30T17:07:22.964 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/648 2023-03-30T17:07:22.964 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:07:23.063 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:07:23.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:07:23.158 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-03-30T17:07:23.817 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:07:23.836 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:07:23.839 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:07:23.845 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:07:23.845 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:07:25.177 INFO:teuthology.orchestra.run.smithi087.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2023-03-30T17:07:25.197 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/649 2023-03-30T17:07:25.197 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/649 2023-03-30T17:07:25.198 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:07:25.211 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:07:25.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:07:25.627 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-03-30T17:07:26.329 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:07:26.349 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:07:26.352 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:07:26.356 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:07:26.357 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:13:58.419 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:13:58.424 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:13:59.003 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T17:13:59.000+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585908) UID: 0 2023-03-30T17:13:59.003 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T17:13:59.000+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585908) UID: 0 2023-03-30T17:13:59.011 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T17:13:59.008+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585908) UID: 0 2023-03-30T17:13:59.018 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T17:13:59.012+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585908) UID: 0 2023-03-30T17:24:39.176 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:24:39.212 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:24:39.269 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T17:24:39.267+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46315) UID: 0 2023-03-30T17:24:39.269 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T17:24:39.267+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46315) UID: 0 2023-03-30T17:29:19.978 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:29:19.989 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:29:50.830 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:29:50.834 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:30:20.952 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:30:20.957 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:30:51.161 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:30:51.173 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:31:21.647 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:31:21.654 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:31:51.750 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:31:51.755 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:32:21.857 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:32:21.864 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:32:53.059 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:32:53.068 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:33:23.430 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:33:23.435 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:33:53.558 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:33:53.563 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:34:24.080 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:34:24.085 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:34:54.247 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:34:54.253 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:35:24.801 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:35:24.806 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:35:54.878 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:35:54.881 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:36:25.375 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:36:25.381 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:36:55.508 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:36:55.513 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:36:55.562 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T17:36:55.562+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46412) UID: 0 2023-03-30T17:36:55.562 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T17:36:55.562+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46412) UID: 0 2023-03-30T17:36:55.563 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T17:36:55.562+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46412) UID: 0 2023-03-30T17:36:55.564 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T17:36:55.562+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46412) UID: 0 2023-03-30T17:36:55.914 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T17:36:55.909+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 588661) UID: 0 2023-03-30T17:36:55.914 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T17:36:55.909+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 588661) UID: 0 2023-03-30T17:36:55.915 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T17:36:55.913+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 588661) UID: 0 2023-03-30T17:36:55.918 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T17:36:55.909+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 588661) UID: 0 2023-03-30T17:46:31.943 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:46:31.949 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:46:32.143 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T17:46:32.139+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46470) UID: 0 2023-03-30T17:46:32.144 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T17:46:32.139+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46470) UID: 0 2023-03-30T17:49:45.793 INFO:teuthology.orchestra.run.smithi087.stdout:generic/650 2539s 2023-03-30T17:49:45.925 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/650 2023-03-30T17:49:45.925 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:49:45.953 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:49:46.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:49:46.628 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-03-30T17:49:50.056 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:49:50.071 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:49:50.073 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:49:50.076 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:49:50.076 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:49:51.555 INFO:teuthology.orchestra.run.smithi087.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:49:51.598 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/651 2023-03-30T17:49:51.598 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/651 2023-03-30T17:49:51.598 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:49:51.608 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:49:51.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:49:51.797 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-03-30T17:49:52.371 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:49:52.385 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:49:52.386 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:49:52.390 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:49:52.391 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:49:53.706 INFO:teuthology.orchestra.run.smithi087.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:49:53.830 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/652 2023-03-30T17:49:53.831 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/652 2023-03-30T17:49:53.831 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:49:53.851 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:49:54.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:49:54.038 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-03-30T17:49:54.627 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:49:54.644 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:49:54.645 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:49:54.648 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:49:54.648 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:49:56.133 INFO:teuthology.orchestra.run.smithi087.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:49:56.228 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/653 2023-03-30T17:49:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/653 2023-03-30T17:49:56.229 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:49:56.240 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:49:56.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:49:56.415 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-03-30T17:49:57.037 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:49:57.051 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:49:57.053 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:49:57.057 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:49:57.058 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:49:58.497 INFO:teuthology.orchestra.run.smithi087.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:49:58.597 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/654 2023-03-30T17:49:58.597 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/654 2023-03-30T17:49:58.597 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:49:58.644 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:49:58.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:49:58.807 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-03-30T17:49:59.355 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:49:59.373 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:49:59.374 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:49:59.376 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:49:59.376 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:00.664 INFO:teuthology.orchestra.run.smithi087.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:00.711 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/655 2023-03-30T17:50:00.712 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/655 2023-03-30T17:50:00.712 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:00.769 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:01.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:01.057 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-03-30T17:50:01.649 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:01.664 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:01.665 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:01.669 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:02.466 INFO:teuthology.orchestra.run.smithi087.stdout:generic/656 [not run] vfstest not support by ceph 2023-03-30T17:50:02.482 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/656 2023-03-30T17:50:02.482 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/656 2023-03-30T17:50:02.482 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:02.491 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:02.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:02.568 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-03-30T17:50:03.131 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:03.142 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:03.143 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:03.150 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:03.151 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:04.504 INFO:teuthology.orchestra.run.smithi087.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:04.599 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/657 2023-03-30T17:50:04.600 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/657 2023-03-30T17:50:04.600 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:04.663 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:04.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:04.798 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-03-30T17:50:05.400 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:05.416 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:05.417 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:05.421 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:05.422 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:06.863 INFO:teuthology.orchestra.run.smithi087.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:06.960 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/658 2023-03-30T17:50:06.960 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/658 2023-03-30T17:50:06.960 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:06.974 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:07.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:07.119 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-03-30T17:50:07.706 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:07.725 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:07.726 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:07.730 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:07.730 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:08.998 INFO:teuthology.orchestra.run.smithi087.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:09.225 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/659 2023-03-30T17:50:09.225 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/659 2023-03-30T17:50:09.225 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:09.248 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:09.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:09.390 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-03-30T17:50:09.972 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:09.987 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:09.988 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:09.992 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:09.993 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:11.496 INFO:teuthology.orchestra.run.smithi087.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:11.556 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/660 2023-03-30T17:50:11.557 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/660 2023-03-30T17:50:11.557 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:11.588 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:11.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:11.705 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-03-30T17:50:12.278 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:12.293 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:12.295 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:12.299 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:12.300 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:13.678 INFO:teuthology.orchestra.run.smithi087.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/661 2023-03-30T17:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/661 2023-03-30T17:50:13.802 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:13.860 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:13.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:13.972 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-03-30T17:50:14.549 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:14.565 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:14.566 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:14.572 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:14.572 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:15.965 INFO:teuthology.orchestra.run.smithi087.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:16.039 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/662 2023-03-30T17:50:16.040 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/662 2023-03-30T17:50:16.040 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:16.069 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:16.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:16.193 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-03-30T17:50:16.775 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:16.789 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:16.791 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:16.794 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:16.796 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:18.143 INFO:teuthology.orchestra.run.smithi087.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:18.211 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/663 2023-03-30T17:50:18.211 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/663 2023-03-30T17:50:18.211 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:18.223 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:18.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:18.390 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-03-30T17:50:18.988 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:19.005 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:19.007 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:19.009 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:19.009 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:20.492 INFO:teuthology.orchestra.run.smithi087.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:20.518 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/664 2023-03-30T17:50:20.518 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/664 2023-03-30T17:50:20.519 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:20.631 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:20.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:20.741 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-03-30T17:50:21.391 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:21.406 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:21.407 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:21.410 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:21.411 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:23.509 INFO:teuthology.orchestra.run.smithi087.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:23.525 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/665 2023-03-30T17:50:23.526 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/665 2023-03-30T17:50:23.526 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:23.642 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:23.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:23.788 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-03-30T17:50:24.428 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:24.444 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:24.445 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:24.448 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:24.448 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:25.807 INFO:teuthology.orchestra.run.smithi087.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:25.826 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/666 2023-03-30T17:50:25.826 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/666 2023-03-30T17:50:25.827 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:25.841 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:26.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:26.029 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-03-30T17:50:26.619 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:26.631 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:26.633 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:26.635 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:26.636 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:27.989 INFO:teuthology.orchestra.run.smithi087.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:28.086 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/667 2023-03-30T17:50:28.086 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/667 2023-03-30T17:50:28.086 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:28.127 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:28.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:28.265 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-03-30T17:50:28.819 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:28.835 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:28.838 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:28.843 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:28.843 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:30.382 INFO:teuthology.orchestra.run.smithi087.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:30.495 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/668 2023-03-30T17:50:30.495 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/668 2023-03-30T17:50:30.496 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:30.536 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:30.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:30.695 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-03-30T17:50:31.256 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:31.270 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:31.271 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:31.275 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:31.275 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:32.681 INFO:teuthology.orchestra.run.smithi087.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:32.741 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/669 2023-03-30T17:50:32.741 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/669 2023-03-30T17:50:32.741 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:32.758 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:32.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:32.899 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-03-30T17:50:33.493 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:33.508 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:33.510 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:33.513 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:33.513 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:34.705 INFO:teuthology.orchestra.run.smithi087.stdout:generic/670 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:34.839 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/670 2023-03-30T17:50:34.845 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/670 2023-03-30T17:50:34.846 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:34.969 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:35.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:35.114 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-03-30T17:50:35.693 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:35.710 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:35.712 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:35.717 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:35.717 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:36.961 INFO:teuthology.orchestra.run.smithi087.stdout:generic/671 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:37.048 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/671 2023-03-30T17:50:37.049 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/671 2023-03-30T17:50:37.049 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:37.134 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:37.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:37.325 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-03-30T17:50:37.901 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:37.924 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:37.926 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:37.929 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:37.930 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:39.241 INFO:teuthology.orchestra.run.smithi087.stdout:generic/672 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:39.443 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/672 2023-03-30T17:50:39.444 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/672 2023-03-30T17:50:39.444 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:39.459 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:39.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:39.564 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-03-30T17:50:40.151 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:40.167 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:40.167 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:40.170 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:40.171 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:42.019 INFO:teuthology.orchestra.run.smithi087.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:42.190 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/673 2023-03-30T17:50:42.192 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/673 2023-03-30T17:50:42.192 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:42.215 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:42.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:42.384 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-03-30T17:50:42.955 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:42.969 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:42.971 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:42.976 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:42.976 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:44.121 INFO:teuthology.orchestra.run.smithi087.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-03-30T17:50:44.424 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/674 2023-03-30T17:50:44.424 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/674 2023-03-30T17:50:44.424 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:44.518 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:44.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:44.706 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-03-30T17:50:45.271 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:45.287 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:45.288 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:45.292 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:45.292 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:46.602 INFO:teuthology.orchestra.run.smithi087.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T17:50:46.624 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/675 2023-03-30T17:50:46.624 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/675 2023-03-30T17:50:46.625 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T17:50:46.683 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:46.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T17:50:46.938 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-03-30T17:50:47.512 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T17:50:47.524 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T17:50:47.527 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T17:50:47.530 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T17:50:47.530 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T17:50:49.226 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T17:50:49.222+0000 7fe514cf5700 -1 Fail to open '/proc/46477/cmdline' error = (2) No such file or directory 2023-03-30T17:50:49.227 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T17:50:49.222+0000 7fe514cf5700 -1 received signal: Hangup from (PID: 46477) UID: 0 2023-03-30T17:50:49.227 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T17:50:49.222+0000 7f2ab2e9c700 -1 Fail to open '/proc/46477/cmdline' error = (2) No such file or directory 2023-03-30T17:50:49.227 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T17:50:49.222+0000 7f2ab2e9c700 -1 received signal: Hangup from (PID: 46477) UID: 0 2023-03-30T17:50:49.228 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T17:50:49.222+0000 7fa38cf23700 -1 Fail to open '/proc/46477/cmdline' error = (2) No such file or directory 2023-03-30T17:50:49.228 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T17:50:49.222+0000 7fa38cf23700 -1 received signal: Hangup from (PID: 46477) UID: 0 2023-03-30T17:50:49.228 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T17:50:49.222+0000 7f27552d8700 -1 Fail to open '/proc/46477/cmdline' error = (2) No such file or directory 2023-03-30T17:50:49.228 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T17:50:49.222+0000 7f27552d8700 -1 received signal: Hangup from (PID: 46477) UID: 0 2023-03-30T17:57:22.927 INFO:teuthology.orchestra.run.smithi115.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.6.log.1: 2023-03-30T17:57:22.928 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: stdin: file size changed while zipping 2023-03-30T17:57:56.525 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:57:56.535 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T17:57:56.582 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T17:57:56.577+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 601826) UID: 0 2023-03-30T17:57:56.583 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T17:57:56.577+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 601826) UID: 0 2023-03-30T17:57:56.583 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T17:57:56.577+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 601826) UID: 0 2023-03-30T17:57:56.583 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T17:57:56.577+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 601826) UID: 0 2023-03-30T17:57:57.182 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T17:57:57.178+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46497) UID: 0 2023-03-30T17:57:57.182 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T17:57:57.178+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46497) UID: 0 2023-03-30T18:05:09.653 INFO:teuthology.orchestra.run.smithi087.stdout:generic/676 862s 2023-03-30T18:05:09.671 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/676 2023-03-30T18:05:09.671 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:09.681 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:10.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:10.166 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-03-30T18:05:10.912 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:10.927 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:10.929 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:10.932 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:10.933 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:11.859 INFO:teuthology.orchestra.run.smithi087.stdout:generic/677 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T18:05:11.875 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/677 2023-03-30T18:05:11.875 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/677 2023-03-30T18:05:11.875 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:11.884 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:11.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:11.972 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-03-30T18:05:12.602 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:12.625 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:12.628 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:12.632 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:12.632 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:14.219 INFO:teuthology.orchestra.run.smithi087.stdout:generic/678 [not run] kernel does not support IO_URING 2023-03-30T18:05:14.233 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/678 2023-03-30T18:05:14.233 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/678 2023-03-30T18:05:14.233 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:14.243 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:14.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:14.344 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-03-30T18:05:15.031 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:15.051 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:15.054 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:15.056 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:15.056 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:16.039 INFO:teuthology.orchestra.run.smithi087.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T18:05:16.056 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/679 2023-03-30T18:05:16.056 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/679 2023-03-30T18:05:16.057 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:16.068 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:16.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:16.156 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-03-30T18:05:16.785 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:16.797 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:16.799 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:16.804 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:16.805 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:18.618 INFO:teuthology.orchestra.run.smithi087.stdout:generic/680 1s 2023-03-30T18:05:18.648 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/680 2023-03-30T18:05:18.648 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:18.662 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:19.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:19.134 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-03-30T18:05:19.827 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:19.840 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:19.842 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:19.845 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:19.845 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:20.618 INFO:teuthology.orchestra.run.smithi087.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T18:05:20.633 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/681 2023-03-30T18:05:20.634 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/681 2023-03-30T18:05:20.634 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:20.642 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:20.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:20.730 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-03-30T18:05:21.355 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:21.370 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:21.372 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:21.378 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:21.379 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:22.149 INFO:teuthology.orchestra.run.smithi087.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T18:05:22.167 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/682 2023-03-30T18:05:22.168 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/682 2023-03-30T18:05:22.168 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:22.177 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:22.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:22.267 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-03-30T18:05:22.867 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:22.885 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:22.887 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:22.891 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:22.891 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:23.802 INFO:teuthology.orchestra.run.smithi087.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T18:05:23.818 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/683 2023-03-30T18:05:23.819 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/683 2023-03-30T18:05:23.819 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:23.829 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:23.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:23.929 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-03-30T18:05:24.549 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:24.566 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:24.567 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:24.576 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:24.576 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:29.687 INFO:teuthology.orchestra.run.smithi087.stdout:generic/684 5s 2023-03-30T18:05:29.718 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/684 2023-03-30T18:05:29.718 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:29.730 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:30.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:30.149 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-03-30T18:05:31.098 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:31.122 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:31.123 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:31.126 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:31.126 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:32.283 INFO:teuthology.orchestra.run.smithi087.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-30T18:05:32.295 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/685 2023-03-30T18:05:32.295 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/685 2023-03-30T18:05:32.295 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:32.306 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:32.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:32.401 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-03-30T18:05:33.037 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:33.053 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:33.054 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:33.058 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:33.058 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:34.065 INFO:teuthology.orchestra.run.smithi087.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-03-30T18:05:34.081 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/686 2023-03-30T18:05:34.082 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/686 2023-03-30T18:05:34.082 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:34.091 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:34.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:34.205 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-03-30T18:05:34.751 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:34.766 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:34.768 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:34.771 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:34.771 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:35.817 INFO:teuthology.orchestra.run.smithi087.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-03-30T18:05:35.832 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/687 2023-03-30T18:05:35.832 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/687 2023-03-30T18:05:35.833 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:35.842 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:35.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:35.951 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-03-30T18:05:36.555 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:36.574 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:36.575 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:36.581 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:36.581 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:37.427 INFO:teuthology.orchestra.run.smithi087.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-30T18:05:37.441 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/688 2023-03-30T18:05:37.441 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/688 2023-03-30T18:05:37.441 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:37.452 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:37.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:37.544 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-03-30T18:05:38.095 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:38.108 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:38.110 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:38.114 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:38.114 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:38.914 INFO:teuthology.orchestra.run.smithi087.stdout:generic/689 [not run] vfstest not support by ceph 2023-03-30T18:05:38.929 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/689 2023-03-30T18:05:38.930 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/689 2023-03-30T18:05:38.930 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:38.939 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:39.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:39.018 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-03-30T18:05:39.583 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:39.598 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:39.601 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:39.603 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:39.604 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:40.473 INFO:teuthology.orchestra.run.smithi087.stdout:generic/690 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T18:05:40.486 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/690 2023-03-30T18:05:40.487 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/690 2023-03-30T18:05:40.487 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:40.496 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:40.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:40.608 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-03-30T18:05:41.184 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:41.196 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:41.197 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:41.200 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:41.201 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:41.914 INFO:teuthology.orchestra.run.smithi087.stdout:generic/691 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-30T18:05:41.930 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/691 2023-03-30T18:05:41.930 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/691 2023-03-30T18:05:41.930 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:41.938 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:42.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:42.012 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-03-30T18:05:42.593 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:42.608 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:42.610 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:42.614 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:42.614 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:43.400 INFO:teuthology.orchestra.run.smithi087.stdout:generic/692 [not run] fsverity utility required, skipped this test 2023-03-30T18:05:43.413 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/692 2023-03-30T18:05:43.414 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/692 2023-03-30T18:05:43.414 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:43.421 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:43.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:43.510 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-03-30T18:05:44.073 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:44.090 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:44.091 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:44.094 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:44.094 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:45.461 INFO:teuthology.orchestra.run.smithi087.stdout:generic/693 [not run] encryption policy '-c 1 -n 10 -v 2 -f 0' is unusable; probably missing kernel crypto API support 2023-03-30T18:05:45.550 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/693 2023-03-30T18:05:45.550 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/693 2023-03-30T18:05:45.550 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:05:45.560 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:05:45.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:05:45.633 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-03-30T18:05:46.202 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:05:46.218 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:05:46.219 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:05:46.223 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:05:46.223 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:07.351 INFO:teuthology.orchestra.run.smithi087.stdout:generic/694 21s 2023-03-30T18:06:07.371 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/694 2023-03-30T18:06:07.371 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:06:07.378 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:07.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:06:07.473 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-03-30T18:06:08.043 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:06:08.057 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:06:08.058 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:06:08.060 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:06:08.061 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:08.884 INFO:teuthology.orchestra.run.smithi087.stdout:generic/695 [not run] require 172.21.15.87:6789:/scratch to be valid block disk 2023-03-30T18:06:08.900 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/695 2023-03-30T18:06:08.900 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/695 2023-03-30T18:06:08.900 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:06:08.909 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:08.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:06:08.987 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-03-30T18:06:09.575 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:06:09.592 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:06:09.593 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:06:09.597 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:06:09.597 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:10.813 INFO:teuthology.orchestra.run.smithi087.stdout:generic/696 1s 2023-03-30T18:06:10.833 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/696 2023-03-30T18:06:10.834 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:06:10.841 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:10.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:06:10.912 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-03-30T18:06:11.481 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:06:11.498 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:06:11.500 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:06:11.503 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:06:11.504 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:12.384 INFO:teuthology.orchestra.run.smithi087.stdout:generic/697 1s 2023-03-30T18:06:12.409 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/697 2023-03-30T18:06:12.409 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:06:12.419 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:12.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:06:12.531 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-03-30T18:06:13.101 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:06:13.115 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:06:13.115 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:06:13.119 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:06:13.119 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:14.228 INFO:teuthology.orchestra.run.smithi087.stdout:generic/698 [not run] vfstest not support by ceph 2023-03-30T18:06:14.242 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/698 2023-03-30T18:06:14.242 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/698 2023-03-30T18:06:14.242 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:06:14.252 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:14.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:06:14.349 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-03-30T18:06:14.924 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:06:14.937 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:06:14.938 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:06:14.942 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:06:14.942 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:15.807 INFO:teuthology.orchestra.run.smithi087.stdout:generic/699 [not run] vfstest not support by ceph 2023-03-30T18:06:15.820 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/699 2023-03-30T18:06:15.820 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/699 2023-03-30T18:06:15.820 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:06:15.831 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:15.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:06:15.924 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-03-30T18:06:16.501 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:06:16.518 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:06:16.519 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:06:16.521 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:06:16.522 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:17.433 INFO:teuthology.orchestra.run.smithi087.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2023-03-30T18:06:17.450 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/700 2023-03-30T18:06:17.451 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/700 2023-03-30T18:06:17.451 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:06:17.461 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:17.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:06:17.881 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-03-30T18:06:18.575 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:06:18.589 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:06:18.592 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:06:18.598 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:06:18.599 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:36.123 INFO:teuthology.orchestra.run.smithi087.stdout:generic/701 18s 2023-03-30T18:06:36.143 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/701 2023-03-30T18:06:36.143 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:06:36.155 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:41.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:06:41.560 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-03-30T18:06:42.217 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:06:42.236 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:06:42.238 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:06:42.242 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:06:42.243 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:43.580 INFO:teuthology.orchestra.run.smithi087.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-30T18:06:43.675 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/702 2023-03-30T18:06:43.675 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/702 2023-03-30T18:06:43.675 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:06:43.692 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:43.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:06:43.838 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-03-30T18:06:44.450 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:06:44.465 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:06:44.467 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:06:44.470 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:06:44.470 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:45.374 INFO:teuthology.orchestra.run.smithi087.stdout:generic/703 [not run] kernel does not support IO_URING 2023-03-30T18:06:45.389 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/703 2023-03-30T18:06:45.390 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/703 2023-03-30T18:06:45.390 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:06:45.400 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:45.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:06:45.511 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-03-30T18:06:46.092 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:06:46.108 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:06:46.109 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:06:46.113 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:06:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:46.975 INFO:teuthology.orchestra.run.smithi087.stdout:generic/704 [not run] require 172.21.15.87:6789:/test to be valid block disk 2023-03-30T18:06:46.989 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/704 2023-03-30T18:06:46.990 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/704 2023-03-30T18:06:46.990 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:06:46.998 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:47.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:06:47.086 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-03-30T18:06:47.629 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:06:47.646 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:06:47.647 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:06:47.650 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:06:47.651 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:48.857 INFO:teuthology.orchestra.run.smithi087.stdout:generic/705 [not run] ceph does not support shutdown 2023-03-30T18:06:48.928 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/705 2023-03-30T18:06:48.929 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/705 2023-03-30T18:06:48.929 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:06:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:49.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:06:49.025 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-03-30T18:06:49.641 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:06:49.662 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:06:49.664 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:06:49.667 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:06:49.667 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:52.657 INFO:teuthology.orchestra.run.smithi087.stdout:generic/706 2s 2023-03-30T18:06:52.678 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/706 2023-03-30T18:06:52.679 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T18:06:52.687 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:06:52.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T18:06:52.970 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-03-30T18:06:53.761 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T18:06:53.776 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T18:06:53.778 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T18:06:53.784 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T18:06:53.784 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T18:07:49.489 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T18:07:49.487+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48470) UID: 0 2023-03-30T18:07:49.490 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T18:07:49.487+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48470) UID: 0 2023-03-30T18:07:49.491 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T18:07:49.487+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48470) UID: 0 2023-03-30T18:07:49.495 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T18:07:49.487+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48470) UID: 0 2023-03-30T18:16:45.064 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:16:45.070 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:16:45.208 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T18:16:45.204+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 627458) UID: 0 2023-03-30T18:16:45.208 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T18:16:45.204+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 627458) UID: 0 2023-03-30T18:16:45.209 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T18:16:45.204+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 627458) UID: 0 2023-03-30T18:16:45.209 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T18:16:45.204+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 627458) UID: 0 2023-03-30T18:16:45.294 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T18:16:45.293+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48492) UID: 0 2023-03-30T18:16:45.295 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T18:16:45.293+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48492) UID: 0 2023-03-30T18:24:25.132 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:24:25.167 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:24:25.216 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T18:24:25.213+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 634532) UID: 0 2023-03-30T18:24:25.216 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T18:24:25.213+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 634532) UID: 0 2023-03-30T18:24:25.217 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T18:24:25.213+0000 7f22ceb53700 -1 received signal: Hangup from (PID: 634532) UID: 0 2023-03-30T18:24:25.218 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T18:24:25.213+0000 7f1a66e43700 -1 received signal: Hangup from (PID: 634532) UID: 0 2023-03-30T18:28:23.044 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:28:23.048 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:28:23.084 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T18:28:23.080+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48524) UID: 0 2023-03-30T18:28:23.085 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T18:28:23.080+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48524) UID: 0 2023-03-30T18:28:23.085 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T18:28:23.080+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48524) UID: 0 2023-03-30T18:28:23.086 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T18:28:23.080+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48524) UID: 0 2023-03-30T18:32:24.292 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:32:24.298 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:32:24.340 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T18:32:24.339+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 644698) UID: 0 2023-03-30T18:32:24.340 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T18:32:24.339+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 644698) UID: 0 2023-03-30T18:32:24.341 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T18:32:24.339+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 644698) UID: 0 2023-03-30T18:32:24.341 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T18:32:24.339+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 644698) UID: 0 2023-03-30T18:35:55.267 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:35:55.273 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:35:55.312 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T18:35:55.307+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48549) UID: 0 2023-03-30T18:35:55.312 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T18:35:55.307+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48549) UID: 0 2023-03-30T18:35:55.313 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T18:35:55.307+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48549) UID: 0 2023-03-30T18:35:55.313 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T18:35:55.307+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48549) UID: 0 2023-03-30T18:40:04.223 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:40:04.229 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:40:34.407 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:40:34.416 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:41:05.244 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:41:05.250 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:41:35.307 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:41:35.312 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:42:05.460 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:42:05.465 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:42:35.598 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:42:35.604 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:43:05.702 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:43:05.707 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:43:35.872 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:43:35.896 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:44:05.965 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:44:05.970 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:44:36.055 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:44:36.059 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:45:06.730 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:45:06.734 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:45:36.869 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:45:36.874 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:46:07.477 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:46:07.482 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:46:37.558 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:46:37.562 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:47:08.449 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:47:08.455 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:47:38.521 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:47:38.525 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:48:08.652 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:48:08.657 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:48:38.767 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:48:38.773 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:49:09.739 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:49:09.743 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:49:39.810 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:49:39.813 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:50:09.906 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:50:09.910 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:50:40.038 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:50:40.043 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:51:11.089 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:51:11.094 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:51:41.158 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:51:41.162 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:51:41.233 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T18:51:41.229+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 668960) UID: 0 2023-03-30T18:51:41.234 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T18:51:41.229+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 668960) UID: 0 2023-03-30T18:51:41.235 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T18:51:41.229+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 668960) UID: 0 2023-03-30T18:51:41.235 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T18:51:41.229+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 668960) UID: 0 2023-03-30T18:55:28.068 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:55:28.075 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T18:55:28.116 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T18:55:28.113+0000 7ff6b0c69700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48654) UID: 0 2023-03-30T18:55:28.116 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T18:55:28.113+0000 7f6165300700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48654) UID: 0 2023-03-30T18:58:51.578 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T18:58:51.573+0000 7fe514cf5700 -1 Fail to open '/proc/48664/cmdline' error = (2) No such file or directory 2023-03-30T18:58:51.580 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T18:58:51.573+0000 7fe514cf5700 -1 received signal: Hangup from (PID: 48664) UID: 0 2023-03-30T18:58:51.580 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T18:58:51.573+0000 7fa38cf23700 -1 Fail to open '/proc/48664/cmdline' error = (2) No such file or directory 2023-03-30T18:58:51.580 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T18:58:51.573+0000 7fa38cf23700 -1 received signal: Hangup from (PID: 48664) UID: 0 2023-03-30T18:58:51.581 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T18:58:51.573+0000 7f27552d8700 -1 Fail to open '/proc/48664/cmdline' error = (2) No such file or directory 2023-03-30T18:58:51.581 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T18:58:51.573+0000 7f27552d8700 -1 received signal: Hangup from (PID: 48664) UID: 0 2023-03-30T18:58:51.581 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T18:58:51.573+0000 7f2ab2e9c700 -1 Fail to open '/proc/48664/cmdline' error = (2) No such file or directory 2023-03-30T18:58:51.582 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T18:58:51.573+0000 7f2ab2e9c700 -1 received signal: Hangup from (PID: 48664) UID: 0 2023-03-30T19:02:54.775 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:02:54.781 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:02:55.010 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T19:02:55.008+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48675) UID: 0 2023-03-30T19:02:55.011 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T19:02:55.008+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48675) UID: 0 2023-03-30T19:02:55.011 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T19:02:55.008+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48675) UID: 0 2023-03-30T19:02:55.011 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T19:02:55.008+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48675) UID: 0 2023-03-30T19:10:41.053 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:10:41.058 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:10:41.107 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T19:10:41.099+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 686678) UID: 0 2023-03-30T19:10:41.108 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T19:10:41.103+0000 7ff34eb53700 -1 received signal: Hangup from (PID: 686678) UID: 0 2023-03-30T19:10:41.110 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T19:10:41.103+0000 7fb3091a7700 -1 Fail to open '/proc/686678/cmdline' error = (2) No such file or directory 2023-03-30T19:10:41.110 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T19:10:41.103+0000 7fb3091a7700 -1 received signal: Hangup from (PID: 686678) UID: 0 2023-03-30T19:10:41.110 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T19:10:41.103+0000 7f1a66e43700 -1 Fail to open '/proc/686678/cmdline' error = (2) No such file or directory 2023-03-30T19:10:41.110 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T19:10:41.103+0000 7f1a66e43700 -1 received signal: Hangup from (PID: 686678) UID: 0 2023-03-30T19:18:48.496 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:18:48.501 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:18:48.660 INFO:tasks.ceph.osd.0.smithi087.stderr:2023-03-30T19:18:48.656+0000 7ff34eb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 696909) UID: 0 2023-03-30T19:18:48.661 INFO:tasks.ceph.osd.2.smithi087.stderr:2023-03-30T19:18:48.656+0000 7f1a66e43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 696909) UID: 0 2023-03-30T19:18:48.661 INFO:tasks.ceph.osd.1.smithi087.stderr:2023-03-30T19:18:48.656+0000 7f22ceb53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 696909) UID: 0 2023-03-30T19:18:48.662 INFO:tasks.ceph.osd.3.smithi087.stderr:2023-03-30T19:18:48.656+0000 7fb3091a7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 696909) UID: 0 2023-03-30T19:22:38.207 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:22:38.212 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:23:08.354 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:23:08.357 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:23:39.347 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:23:39.351 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:24:09.421 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:24:09.426 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:24:39.640 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:24:39.645 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:25:09.712 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:25:09.716 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:25:40.687 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:25:40.691 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:26:10.750 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:26:10.755 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:26:41.625 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:26:41.629 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:27:13.028 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:27:13.033 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:27:43.103 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:27:43.108 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:28:13.501 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:28:13.505 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:28:43.563 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:28:43.567 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:29:13.627 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:29:13.632 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:29:43.704 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:29:43.709 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:30:13.766 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:30:13.771 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:30:14.499 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-03-30T19:30:14.497+0000 7fe514cf5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48770) UID: 0 2023-03-30T19:30:14.499 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-03-30T19:30:14.497+0000 7fa38cf23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48770) UID: 0 2023-03-30T19:30:14.500 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-03-30T19:30:14.497+0000 7f27552d8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48770) UID: 0 2023-03-30T19:30:14.500 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-03-30T19:30:14.497+0000 7f2ab2e9c700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48770) UID: 0 2023-03-30T19:34:22.050 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:34:22.054 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:34:22.473 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T19:34:22.468+0000 7ff6b0c69700 -1 Fail to open '/proc/48784/cmdline' error = (2) No such file or directory 2023-03-30T19:34:22.473 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-03-30T19:34:22.468+0000 7ff6b0c69700 -1 received signal: Hangup from (PID: 48784) UID: 0 2023-03-30T19:34:22.473 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T19:34:22.468+0000 7f6165300700 -1 Fail to open '/proc/48784/cmdline' error = (2) No such file or directory 2023-03-30T19:34:22.473 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-03-30T19:34:22.468+0000 7f6165300700 -1 received signal: Hangup from (PID: 48784) UID: 0 2023-03-30T19:34:33.791 INFO:teuthology.orchestra.run.smithi087.stdout:generic/707 5259s 2023-03-30T19:34:33.929 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/707 2023-03-30T19:34:33.930 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:34:33.952 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:33.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:34:33.994 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2023-03-30T19:34:35.859 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:34:35.873 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:34:35.879 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:34:35.883 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:34:35.883 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:40.946 INFO:teuthology.orchestra.run.smithi087.stdout:generic/708 0s 2023-03-30T19:34:40.971 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/708 2023-03-30T19:34:40.971 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:34:40.981 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:41.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:34:41.171 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2023-03-30T19:34:42.008 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:34:42.024 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:34:42.025 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:34:42.029 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:34:42.029 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:42.885 INFO:teuthology.orchestra.run.smithi087.stdout:generic/709 [not run] xfs_io swapext -v vfs not supported on ceph 2023-03-30T19:34:42.899 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/709 2023-03-30T19:34:42.900 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/709 2023-03-30T19:34:42.900 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:34:42.909 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:43.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:34:43.274 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2023-03-30T19:34:43.986 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:34:44.000 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:34:44.001 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:34:44.004 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:34:44.004 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:44.865 INFO:teuthology.orchestra.run.smithi087.stdout:generic/710 [not run] xfs_io swapext -v vfs not supported on ceph 2023-03-30T19:34:44.877 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/710 2023-03-30T19:34:44.878 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/710 2023-03-30T19:34:44.878 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:34:44.885 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:45.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:34:45.282 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2023-03-30T19:34:45.982 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:34:45.997 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:34:45.999 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:34:46.003 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:34:46.003 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:46.810 INFO:teuthology.orchestra.run.smithi087.stdout:generic/711 [not run] xfs_io swapext -v vfs not supported on ceph 2023-03-30T19:34:46.822 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/711 2023-03-30T19:34:46.822 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/711 2023-03-30T19:34:46.822 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:34:46.833 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:47.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:34:47.160 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2023-03-30T19:34:47.925 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:34:47.942 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:34:47.944 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:34:47.947 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:34:47.947 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:48.827 INFO:teuthology.orchestra.run.smithi087.stdout:generic/712 [not run] xfs_io swapext -v vfs not supported on ceph 2023-03-30T19:34:48.838 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/712 2023-03-30T19:34:48.838 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/712 2023-03-30T19:34:48.839 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:34:48.847 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:49.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:34:49.258 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2023-03-30T19:34:49.952 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:34:49.967 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:34:49.968 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:34:49.970 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:34:49.971 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:50.779 INFO:teuthology.orchestra.run.smithi087.stdout:generic/713 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph 2023-03-30T19:34:50.793 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/713 2023-03-30T19:34:50.793 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/713 2023-03-30T19:34:50.793 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:34:50.801 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:51.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:34:51.116 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2023-03-30T19:34:51.854 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:34:51.871 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:34:51.872 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:34:51.875 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:34:51.875 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:52.697 INFO:teuthology.orchestra.run.smithi087.stdout:generic/714 [not run] xfs_io swapext -v vfs not supported on ceph 2023-03-30T19:34:52.710 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/714 2023-03-30T19:34:52.711 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/714 2023-03-30T19:34:52.711 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:34:52.721 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:53.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:34:53.078 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2023-03-30T19:34:53.846 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:34:53.865 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:34:53.867 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:34:53.870 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:34:53.870 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:54.702 INFO:teuthology.orchestra.run.smithi087.stdout:generic/715 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph 2023-03-30T19:34:54.717 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/715 2023-03-30T19:34:54.717 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/715 2023-03-30T19:34:54.718 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:34:54.728 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:55.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:34:55.174 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2023-03-30T19:34:55.819 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:34:55.834 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:34:55.835 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:34:55.840 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:34:55.840 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:56.709 INFO:teuthology.orchestra.run.smithi087.stdout:generic/716 [not run] xfs_io swapext -v vfs not supported on ceph 2023-03-30T19:34:56.723 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/716 2023-03-30T19:34:56.723 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/716 2023-03-30T19:34:56.723 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:34:56.735 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:57.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:34:57.193 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2023-03-30T19:34:57.770 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:34:57.785 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:34:57.788 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:34:57.791 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:34:57.791 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:58.639 INFO:teuthology.orchestra.run.smithi087.stdout:generic/717 [not run] xfs_io swapext -v vfs not supported on ceph 2023-03-30T19:34:58.652 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/717 2023-03-30T19:34:58.653 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/717 2023-03-30T19:34:58.653 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:34:58.660 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:34:59.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:34:59.048 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2023-03-30T19:34:59.738 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:34:59.752 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:34:59.754 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:34:59.757 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:34:59.757 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:00.593 INFO:teuthology.orchestra.run.smithi087.stdout:generic/718 [not run] xfs_io swapext -v vfs not supported on ceph 2023-03-30T19:35:00.608 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/718 2023-03-30T19:35:00.608 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/718 2023-03-30T19:35:00.608 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:35:00.622 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:00.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:35:00.903 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2023-03-30T19:35:01.715 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:35:01.732 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:35:01.734 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:35:01.736 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:35:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:02.564 INFO:teuthology.orchestra.run.smithi087.stdout:generic/719 [not run] xfs_io swapext -v vfs not supported on ceph 2023-03-30T19:35:02.578 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/719 2023-03-30T19:35:02.578 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/719 2023-03-30T19:35:02.578 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:35:02.590 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:02.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:35:02.860 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2023-03-30T19:35:03.671 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:35:03.688 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:35:03.689 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:35:03.693 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:35:03.693 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:04.517 INFO:teuthology.orchestra.run.smithi087.stdout:generic/720 [not run] xfs_io swapext -v vfs not supported on ceph 2023-03-30T19:35:04.528 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/720 2023-03-30T19:35:04.528 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/720 2023-03-30T19:35:04.529 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:35:04.536 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:04.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:35:04.907 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2023-03-30T19:35:05.646 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:35:05.660 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:35:05.662 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:35:05.672 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:35:05.672 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:06.480 INFO:teuthology.orchestra.run.smithi087.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-03-30T19:35:06.498 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/721 2023-03-30T19:35:06.499 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/721 2023-03-30T19:35:06.499 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:35:06.505 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:06.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:35:06.650 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2023-03-30T19:35:07.220 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:35:07.238 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:35:07.239 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:35:07.243 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:35:07.243 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:08.073 INFO:teuthology.orchestra.run.smithi087.stdout:generic/722 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-03-30T19:35:08.088 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/722 2023-03-30T19:35:08.088 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/722 2023-03-30T19:35:08.088 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:35:08.096 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:08.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:35:08.476 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2023-03-30T19:35:09.133 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:35:09.148 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:35:09.149 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:35:09.152 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:35:09.152 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:09.996 INFO:teuthology.orchestra.run.smithi087.stdout:generic/723 [not run] xfs_io swapext -v vfs not supported on ceph 2023-03-30T19:35:10.013 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/723 2023-03-30T19:35:10.013 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/723 2023-03-30T19:35:10.013 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:35:10.023 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:10.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:35:10.332 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2023-03-30T19:35:11.134 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:35:11.149 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:35:11.151 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:35:11.154 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:35:11.154 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:11.965 INFO:teuthology.orchestra.run.smithi087.stdout:generic/724 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-03-30T19:35:11.979 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/724 2023-03-30T19:35:11.980 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/724 2023-03-30T19:35:11.980 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:35:11.989 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:12.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:35:12.276 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2023-03-30T19:35:13.003 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:35:13.019 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:35:13.020 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:35:13.023 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:35:13.023 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:13.805 INFO:teuthology.orchestra.run.smithi087.stdout:generic/725 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-03-30T19:35:13.815 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/725 2023-03-30T19:35:13.816 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/725 2023-03-30T19:35:13.816 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:35:13.824 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:14.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:35:14.192 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2023-03-30T19:35:14.908 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:35:14.920 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:35:14.921 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:35:14.924 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:35:14.924 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:16.281 INFO:teuthology.orchestra.run.smithi087.stdout:generic/726 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-03-30T19:35:16.295 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/726 2023-03-30T19:35:16.295 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/726 2023-03-30T19:35:16.295 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:35:16.303 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:16.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:35:16.790 DEBUG:teuthology.orchestra.run.smithi087:> (cd /tmp/tmp.dmK5MK8Zk9xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2023-03-30T19:35:17.433 INFO:teuthology.orchestra.run.smithi087.stdout:FSTYP -- ceph 2023-03-30T19:35:17.446 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM -- Linux/x86_64 smithi087 6.3.0-rc3-g6c26fb6d76aa #1 SMP PREEMPT_DYNAMIC Thu Mar 30 03:07:18 UTC 2023 2023-03-30T19:35:17.448 INFO:teuthology.orchestra.run.smithi087.stdout:MKFS_OPTIONS -- 172.21.15.87:6789:/scratch 2023-03-30T19:35:17.458 INFO:teuthology.orchestra.run.smithi087.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDIQyVkOKvxHxAA7NHYCmmEt2HSnnU7MrpqQQ== 172.21.15.87:6789:/scratch /tmp/tmp.T6S6cZMyVfscratch 2023-03-30T19:35:17.459 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:18.359 INFO:teuthology.orchestra.run.smithi087.stdout:generic/727 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-03-30T19:35:18.373 INFO:teuthology.orchestra.run.smithi087.stdout:Ran: generic/727 2023-03-30T19:35:18.373 INFO:teuthology.orchestra.run.smithi087.stdout:Not run: generic/727 2023-03-30T19:35:18.373 INFO:teuthology.orchestra.run.smithi087.stdout:Passed all 1 tests 2023-03-30T19:35:18.382 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:18.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-30T19:35:18.619 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 4========================================================= 2023-03-30T19:35:18.619 DEBUG:teuthology.orchestra.run.smithi087:> sudo userdel --force --remove fsgqa 2023-03-30T19:35:19.568 INFO:teuthology.orchestra.run.smithi087.stderr:userdel: user fsgqa is currently used by process 726845 2023-03-30T19:35:19.586 INFO:teuthology.orchestra.run.smithi087.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2023-03-30T19:35:20.218 DEBUG:teuthology.orchestra.run.smithi087:> sudo userdel --force --remove 123456-fsgqa 2023-03-30T19:35:20.282 INFO:teuthology.orchestra.run.smithi087.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2023-03-30T19:35:20.283 INFO:teuthology.orchestra.run.smithi087.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2023-03-30T19:35:20.633 DEBUG:teuthology.orchestra.run.smithi087:> sudo groupdel fsgqa 2023-03-30T19:35:20.666 INFO:teuthology.orchestra.run.smithi087.stderr:groupdel: group 'fsgqa' does not exist 2023-03-30T19:35:20.668 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-03-30T19:35:20.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:20.670 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.dmK5MK8Zk9xfstests-dev/results) 2023-03-30T19:35:20.781 INFO:teuthology.orchestra.run.smithi087.stdout: File: /tmp/tmp.dmK5MK8Zk9xfstests-dev/results 2023-03-30T19:35:20.781 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2023-03-30T19:35:20.781 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 801h/2049d Inode: 1320674 Links: 3 2023-03-30T19:35:20.782 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-30T19:35:20.782 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2023-03-30 08:15:13.435042584 +0000 2023-03-30T19:35:20.782 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2023-03-30 19:34:40.963077916 +0000 2023-03-30T19:35:20.782 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2023-03-30 19:34:40.963077916 +0000 2023-03-30T19:35:20.782 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2023-03-30T19:35:20.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:20.784 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2023-03-30T19:35:20.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:20.826 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.dmK5MK8Zk9xfstests-dev/results /var/log/ceph/xfstests-dev-results) 2023-03-30T19:35:21.553 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.dmK5MK8Zk9xfstests-dev to /var/log/ceph. 2023-03-30T19:35:21.554 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf /tmp/tmp.dmK5MK8Zk9xfstests-dev 2023-03-30T19:35:22.076 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-03-30T19:35:22.076 DEBUG:teuthology.orchestra.run.smithi087:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-30T19:35:22.194 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-30T19:35:22.388 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-03-30T19:35:22.389 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T19:35:22.389 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T19:35:22.413 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T19:35:22.414 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T19:35:22.467 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T19:35:23.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.274+0000 7f4ce7fff700 1 Processor -- start 2023-03-30T19:35:23.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.274+0000 7f4ce7fff700 1 -- start start 2023-03-30T19:35:23.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.278+0000 7f4ce7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4cdc0e0560 0x7f4cdc00c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:23.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.278+0000 7f4ce7fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4cdc053450 0x7f4cdc039df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:23.281 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.278+0000 7f4ce7fff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cdc038a20 con 0x7f4cdc00c9f0 2023-03-30T19:35:23.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.278+0000 7f4ce7fff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cdc00ce40 con 0x7f4cdc053450 2023-03-30T19:35:23.282 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.278+0000 7f4ce7fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc0395a0 con 0x7f4cdc0e0560 2023-03-30T19:35:23.287 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.278+0000 7f4ce6ffd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f4cdc00c9f0 0x7f4cdc052d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51798/0 (socket says 172.21.15.87:51798) 2023-03-30T19:35:23.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.278+0000 7f4ce6ffd700 1 -- 172.21.15.87:0/202197211 learned_addr learned my addr 172.21.15.87:0/202197211 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:23.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.278+0000 7f4cee234700 1 --2- 172.21.15.87:0/202197211 >> v2:172.21.15.87:3300/0 conn(0x7f4cdc053450 0x7f4cdc039df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:23.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.278+0000 7f4ce67fc700 1 -- 172.21.15.87:0/202197211 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065684943 0 0) 0x7f4cdc038a20 con 0x7f4cdc00c9f0 2023-03-30T19:35:23.288 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.278+0000 7f4ce67fc700 1 -- 172.21.15.87:0/202197211 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cd80035d0 con 0x7f4cdc00c9f0 2023-03-30T19:35:23.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.278+0000 7f4cee234700 1 -- 172.21.15.87:0/202197211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4cdc0e0560 msgr2=0x7f4cdc00c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:23.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.278+0000 7f4cee234700 1 --2- 172.21.15.87:0/202197211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4cdc0e0560 0x7f4cdc00c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:23.289 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.278+0000 7f4ce67fc700 1 -- 172.21.15.87:0/202197211 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 996999130 0 0) 0x7f4cd80035d0 con 0x7f4cdc00c9f0 2023-03-30T19:35:23.299 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.294+0000 7f4cee234700 1 -- 172.21.15.87:0/202197211 >> v1:172.21.15.87:6789/0 conn(0x7f4cdc00c9f0 legacy=0x7f4cdc052d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:23.299 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.294+0000 7f4cee234700 1 -- 172.21.15.87:0/202197211 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc0e0930 con 0x7f4cdc053450 2023-03-30T19:35:23.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.294+0000 7f4cee234700 1 --2- 172.21.15.87:0/202197211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cdc053450 0x7f4cdc039df0 secure :-1 s=READY pgs=3293 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0007b30 tx=0x7f4ce0007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb77dac6e59cd631 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:23.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.294+0000 7f4ce67fc700 1 -- 172.21.15.87:0/202197211 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4001670 con 0x7f4cdc053450 2023-03-30T19:35:23.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.306+0000 7f4ce67fc700 1 -- 172.21.15.87:0/202197211 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce000c7e0 con 0x7f4cdc053450 2023-03-30T19:35:23.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.306+0000 7f4ce67fc700 1 -- 172.21.15.87:0/202197211 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000c950 con 0x7f4cdc053450 2023-03-30T19:35:23.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.306+0000 7f4ce7fff700 1 -- 172.21.15.87:0/202197211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cdc053450 msgr2=0x7f4cdc039df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:23.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.306+0000 7f4ce7fff700 1 --2- 172.21.15.87:0/202197211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cdc053450 0x7f4cdc039df0 secure :-1 s=READY pgs=3293 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0007b30 tx=0x7f4ce0007e40 comp rx=0 tx=0).stop 2023-03-30T19:35:23.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.310+0000 7f4ce7fff700 1 -- 172.21.15.87:0/202197211 shutdown_connections 2023-03-30T19:35:23.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.310+0000 7f4ce7fff700 1 --2- 172.21.15.87:0/202197211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cdc053450 0x7f4cdc039df0 unknown :-1 s=CLOSED pgs=3293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:23.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.310+0000 7f4ce7fff700 1 --2- 172.21.15.87:0/202197211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4cdc0e0560 0x7f4cdc00c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:23.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.310+0000 7f4ce7fff700 1 -- 172.21.15.87:0/202197211 >> 172.21.15.87:0/202197211 conn(0x7f4cdc056fa0 msgr2=0x7f4cdc0573a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:23.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.310+0000 7f4ce7fff700 1 -- 172.21.15.87:0/202197211 shutdown_connections 2023-03-30T19:35:23.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.310+0000 7f4ce7fff700 1 -- 172.21.15.87:0/202197211 wait complete. 2023-03-30T19:35:23.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.314+0000 7f4ce7fff700 1 Processor -- start 2023-03-30T19:35:23.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.314+0000 7f4ce7fff700 1 -- start start 2023-03-30T19:35:23.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.314+0000 7f4ce7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cdc00c9f0 0x7f4cdc1752a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:23.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.314+0000 7f4ce7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4cdc053450 0x7f4cdc0d1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:23.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.314+0000 7f4ce7fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cdc0e0560 0x7f4cdc04d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:23.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4ce7fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc03a330 con 0x7f4cdc0e0560 2023-03-30T19:35:23.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4ce7fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc1757e0 con 0x7f4cdc00c9f0 2023-03-30T19:35:23.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4ce7fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc03a5d0 con 0x7f4cdc053450 2023-03-30T19:35:23.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4cee234700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cdc0e0560 0x7f4cdc04d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:23.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4cee234700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cdc0e0560 0x7f4cdc04d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38012/0 (socket says 172.21.15.87:38012) 2023-03-30T19:35:23.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4cee234700 1 -- 172.21.15.87:0/495983223 learned_addr learned my addr 172.21.15.87:0/495983223 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:23.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4cee234700 1 -- 172.21.15.87:0/495983223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4cdc053450 msgr2=0x7f4cdc0d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:23.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4cee234700 1 --2- 172.21.15.87:0/495983223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4cdc053450 0x7f4cdc0d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:23.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4cee234700 1 -- 172.21.15.87:0/495983223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cdc00c9f0 msgr2=0x7f4cdc1752a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:23.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4cee234700 1 --2- 172.21.15.87:0/495983223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cdc00c9f0 0x7f4cdc1752a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:23.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4cee234700 1 -- 172.21.15.87:0/495983223 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce000d040 con 0x7f4cdc0e0560 2023-03-30T19:35:23.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4cee234700 1 --2- 172.21.15.87:0/495983223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cdc0e0560 0x7f4cdc04d110 secure :-1 s=READY pgs=3294 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc039b90 tx=0x7f4ce0002350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:23.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4cd3fff700 1 -- 172.21.15.87:0/495983223 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce00072c0 con 0x7f4cdc0e0560 2023-03-30T19:35:23.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4cd3fff700 1 -- 172.21.15.87:0/495983223 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce001a660 con 0x7f4cdc0e0560 2023-03-30T19:35:23.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4ce7fff700 1 -- 172.21.15.87:0/495983223 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cdc038f50 con 0x7f4cdc0e0560 2023-03-30T19:35:23.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4cd3fff700 1 -- 172.21.15.87:0/495983223 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce001aa10 con 0x7f4cdc0e0560 2023-03-30T19:35:23.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.318+0000 7f4ce7fff700 1 -- 172.21.15.87:0/495983223 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cdc038c70 con 0x7f4cdc0e0560 2023-03-30T19:35:23.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.322+0000 7f4ce7fff700 1 -- 172.21.15.87:0/495983223 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cdc039230 con 0x7f4cdc0e0560 2023-03-30T19:35:23.361 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.358+0000 7f4cd3fff700 1 -- 172.21.15.87:0/495983223 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f4ce001ab70 con 0x7f4cdc0e0560 2023-03-30T19:35:23.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.358+0000 7f4cd3fff700 1 --2- 172.21.15.87:0/495983223 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4ccc0653f0 0x7f4ccc0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:23.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.358+0000 7f4cecfd2700 1 --2- 172.21.15.87:0/495983223 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4ccc0653f0 0x7f4ccc0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:23.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.362+0000 7f4cecfd2700 1 --2- 172.21.15.87:0/495983223 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4ccc0653f0 0x7f4ccc0678a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8063eb0 tx=0x7f4ce804eb70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:23.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.362+0000 7f4cd3fff700 1 -- 172.21.15.87:0/495983223 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f4ce001ae20 con 0x7f4cdc0e0560 2023-03-30T19:35:23.659 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.654+0000 7f4cd3fff700 1 -- 172.21.15.87:0/495983223 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f4ce0052880 con 0x7f4cdc0e0560 2023-03-30T19:35:23.937 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.934+0000 7f4ce7fff700 1 -- 172.21.15.87:0/495983223 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cdc0055d0 con 0x7f4cdc0e0560 2023-03-30T19:35:23.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.970+0000 7f4cd3fff700 1 -- 172.21.15.87:0/495983223 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+18123 (secure 0 0 0) 0x7f4ce0029020 con 0x7f4cdc0e0560 2023-03-30T19:35:23.976 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:23.976 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":45,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:12:40.165947+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:12:14.871645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-03-30T08:12:15.991480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":4}]},{"pgid":"7.2a","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T19:35:23.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.978+0000 7f4ce7fff700 1 -- 172.21.15.87:0/495983223 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4ccc0653f0 msgr2=0x7f4ccc0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:23.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.978+0000 7f4ce7fff700 1 --2- 172.21.15.87:0/495983223 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4ccc0653f0 0x7f4ccc0678a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8063eb0 tx=0x7f4ce804eb70 comp rx=0 tx=0).stop 2023-03-30T19:35:23.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.978+0000 7f4ce7fff700 1 -- 172.21.15.87:0/495983223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cdc0e0560 msgr2=0x7f4cdc04d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:23.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.978+0000 7f4ce7fff700 1 --2- 172.21.15.87:0/495983223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cdc0e0560 0x7f4cdc04d110 secure :-1 s=READY pgs=3294 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc039b90 tx=0x7f4ce0002350 comp rx=0 tx=0).stop 2023-03-30T19:35:23.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.978+0000 7f4ce7fff700 1 -- 172.21.15.87:0/495983223 shutdown_connections 2023-03-30T19:35:23.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.978+0000 7f4ce7fff700 1 --2- 172.21.15.87:0/495983223 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f4ccc0653f0 0x7f4ccc0678a0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:23.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.978+0000 7f4ce7fff700 1 --2- 172.21.15.87:0/495983223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cdc0e0560 0x7f4cdc04d110 unknown :-1 s=CLOSED pgs=3294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:23.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.978+0000 7f4ce7fff700 1 --2- 172.21.15.87:0/495983223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4cdc053450 0x7f4cdc0d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:23.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.978+0000 7f4ce7fff700 1 --2- 172.21.15.87:0/495983223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cdc00c9f0 0x7f4cdc1752a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:23.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.978+0000 7f4ce7fff700 1 -- 172.21.15.87:0/495983223 >> 172.21.15.87:0/495983223 conn(0x7f4cdc056fa0 msgr2=0x7f4cdc052d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:23.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.978+0000 7f4ce7fff700 1 -- 172.21.15.87:0/495983223 shutdown_connections 2023-03-30T19:35:23.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:23.978+0000 7f4ce7fff700 1 -- 172.21.15.87:0/495983223 wait complete. 2023-03-30T19:35:24.015 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-30T08:12:14.871645+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-03-30T08:12:15.991480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-30T19:35:24.016 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T19:35:24.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.210+0000 7fe06ca4c700 1 Processor -- start 2023-03-30T19:35:24.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.210+0000 7fe06ca4c700 1 -- start start 2023-03-30T19:35:24.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.214+0000 7fe06ca4c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe06003e7b0 0x7fe0600553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:24.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.214+0000 7fe06ca4c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe06000eff0 0x7fe060056fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:24.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.214+0000 7fe06ca4c700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe060038950 con 0x7fe060058ba0 2023-03-30T19:35:24.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.214+0000 7fe06ca4c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0600e6fe0 con 0x7fe06003e7b0 2023-03-30T19:35:24.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.214+0000 7fe06ca4c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0600e72c0 con 0x7fe06000eff0 2023-03-30T19:35:24.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.214+0000 7fe0677fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe06003e7b0 0x7fe0600553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:24.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.214+0000 7fe0677fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe06003e7b0 0x7fe0600553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38026/0 (socket says 172.21.15.87:38026) 2023-03-30T19:35:24.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.214+0000 7fe0677fe700 1 -- 172.21.15.87:0/3304427342 learned_addr learned my addr 172.21.15.87:0/3304427342 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:24.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.214+0000 7fe0677fe700 1 -- 172.21.15.87:0/3304427342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe06000eff0 msgr2=0x7fe060056fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:24.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.214+0000 7fe0677fe700 1 --2- 172.21.15.87:0/3304427342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe06000eff0 0x7fe060056fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.214+0000 7fe0677fe700 1 -- 172.21.15.87:0/3304427342 >> v1:172.21.15.115:6789/0 conn(0x7fe060058ba0 legacy=0x7fe06000e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:24.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.214+0000 7fe0677fe700 1 -- 172.21.15.87:0/3304427342 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe060053860 con 0x7fe06003e7b0 2023-03-30T19:35:24.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.214+0000 7fe0677fe700 1 --2- 172.21.15.87:0/3304427342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe06003e7b0 0x7fe0600553c0 secure :-1 s=READY pgs=3295 cs=0 l=1 rev1=1 crypto rx=0x7fe068068010 tx=0x7fe06804e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849985b8e3d06463 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:24.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.218+0000 7fe0667fc700 1 -- 172.21.15.87:0/3304427342 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06808d070 con 0x7fe06003e7b0 2023-03-30T19:35:24.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.218+0000 7fe0667fc700 1 -- 172.21.15.87:0/3304427342 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0680678a0 con 0x7fe06003e7b0 2023-03-30T19:35:24.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.218+0000 7fe0667fc700 1 -- 172.21.15.87:0/3304427342 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0680723c0 con 0x7fe06003e7b0 2023-03-30T19:35:24.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.218+0000 7fe06ca4c700 1 -- 172.21.15.87:0/3304427342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe06003e7b0 msgr2=0x7fe0600553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:24.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.218+0000 7fe06ca4c700 1 --2- 172.21.15.87:0/3304427342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe06003e7b0 0x7fe0600553c0 secure :-1 s=READY pgs=3295 cs=0 l=1 rev1=1 crypto rx=0x7fe068068010 tx=0x7fe06804e9e0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.218+0000 7fe06ca4c700 1 -- 172.21.15.87:0/3304427342 shutdown_connections 2023-03-30T19:35:24.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.218+0000 7fe06ca4c700 1 --2- 172.21.15.87:0/3304427342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe06000eff0 0x7fe060056fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.218+0000 7fe06ca4c700 1 --2- 172.21.15.87:0/3304427342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe06003e7b0 0x7fe0600553c0 unknown :-1 s=CLOSED pgs=3295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.218+0000 7fe06ca4c700 1 -- 172.21.15.87:0/3304427342 >> 172.21.15.87:0/3304427342 conn(0x7fe060059170 msgr2=0x7fe060059570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:24.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.218+0000 7fe06ca4c700 1 -- 172.21.15.87:0/3304427342 shutdown_connections 2023-03-30T19:35:24.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.218+0000 7fe06ca4c700 1 -- 172.21.15.87:0/3304427342 wait complete. 2023-03-30T19:35:24.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe06ca4c700 1 Processor -- start 2023-03-30T19:35:24.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe06ca4c700 1 -- start start 2023-03-30T19:35:24.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe06ca4c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe06000eff0 0x7fe06003a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:24.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe06ca4c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe06003e7b0 0x7fe0600e5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:24.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe06ca4c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe060058ba0 0x7fe060178290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:24.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe06ca4c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0600513c0 con 0x7fe060058ba0 2023-03-30T19:35:24.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe06ca4c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06003aea0 con 0x7fe06003e7b0 2023-03-30T19:35:24.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe06ca4c700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06003b170 con 0x7fe06000eff0 2023-03-30T19:35:24.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe067fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe060058ba0 0x7fe060178290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:24.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe067fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe060058ba0 0x7fe060178290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38036/0 (socket says 172.21.15.87:38036) 2023-03-30T19:35:24.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe067fff700 1 -- 172.21.15.87:0/2384412751 learned_addr learned my addr 172.21.15.87:0/2384412751 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:24.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe0677fe700 1 --2- 172.21.15.87:0/2384412751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe06000eff0 0x7fe06003a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:24.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe067fff700 1 -- 172.21.15.87:0/2384412751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe06000eff0 msgr2=0x7fe06003a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:24.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe067fff700 1 --2- 172.21.15.87:0/2384412751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe06000eff0 0x7fe06003a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe067fff700 1 -- 172.21.15.87:0/2384412751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe06003e7b0 msgr2=0x7fe0600e5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:24.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe067fff700 1 --2- 172.21.15.87:0/2384412751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe06003e7b0 0x7fe0600e5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe067fff700 1 -- 172.21.15.87:0/2384412751 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06003eb80 con 0x7fe060058ba0 2023-03-30T19:35:24.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.222+0000 7fe067fff700 1 --2- 172.21.15.87:0/2384412751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe060058ba0 0x7fe060178290 secure :-1 s=READY pgs=3296 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00b430 tx=0x7fe05c00b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:24.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.226+0000 7fe053fff700 1 -- 172.21.15.87:0/2384412751 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c011830 con 0x7fe060058ba0 2023-03-30T19:35:24.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.226+0000 7fe06ca4c700 1 -- 172.21.15.87:0/2384412751 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe060053b40 con 0x7fe060058ba0 2023-03-30T19:35:24.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.226+0000 7fe053fff700 1 -- 172.21.15.87:0/2384412751 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05c011990 con 0x7fe060058ba0 2023-03-30T19:35:24.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.226+0000 7fe053fff700 1 -- 172.21.15.87:0/2384412751 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c011d20 con 0x7fe060058ba0 2023-03-30T19:35:24.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.226+0000 7fe06ca4c700 1 -- 172.21.15.87:0/2384412751 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe060053e20 con 0x7fe060058ba0 2023-03-30T19:35:24.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.226+0000 7fe06ca4c700 1 -- 172.21.15.87:0/2384412751 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe060051530 con 0x7fe060058ba0 2023-03-30T19:35:24.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.226+0000 7fe053fff700 1 -- 172.21.15.87:0/2384412751 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fe05c01a400 con 0x7fe060058ba0 2023-03-30T19:35:24.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.226+0000 7fe053fff700 1 --2- 172.21.15.87:0/2384412751 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe04c0653f0 0x7fe04c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:24.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.226+0000 7fe053fff700 1 -- 172.21.15.87:0/2384412751 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fe05c082b80 con 0x7fe060058ba0 2023-03-30T19:35:24.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.230+0000 7fe0677fe700 1 --2- 172.21.15.87:0/2384412751 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe04c0653f0 0x7fe04c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:24.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.230+0000 7fe0677fe700 1 --2- 172.21.15.87:0/2384412751 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe04c0653f0 0x7fe04c0678a0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fe060010280 tx=0x7fe06808d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:24.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.238+0000 7fe053fff700 1 -- 172.21.15.87:0/2384412751 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fe060051530 con 0x7fe060058ba0 2023-03-30T19:35:24.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.502+0000 7fe06ca4c700 1 -- 172.21.15.87:0/2384412751 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe060051500 con 0x7fe060058ba0 2023-03-30T19:35:24.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.526+0000 7fe053fff700 1 -- 172.21.15.87:0/2384412751 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe05c082e60 con 0x7fe060058ba0 2023-03-30T19:35:24.532 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T19:35:24.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.530+0000 7fe06ca4c700 1 -- 172.21.15.87:0/2384412751 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe04c0653f0 msgr2=0x7fe04c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:24.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.530+0000 7fe06ca4c700 1 --2- 172.21.15.87:0/2384412751 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe04c0653f0 0x7fe04c0678a0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fe060010280 tx=0x7fe06808d000 comp rx=0 tx=0).stop 2023-03-30T19:35:24.535 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.530+0000 7fe06ca4c700 1 -- 172.21.15.87:0/2384412751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe060058ba0 msgr2=0x7fe060178290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:24.536 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.530+0000 7fe06ca4c700 1 --2- 172.21.15.87:0/2384412751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe060058ba0 0x7fe060178290 secure :-1 s=READY pgs=3296 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00b430 tx=0x7fe05c00b7f0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.538+0000 7fe06ca4c700 1 -- 172.21.15.87:0/2384412751 shutdown_connections 2023-03-30T19:35:24.540 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.538+0000 7fe06ca4c700 1 --2- 172.21.15.87:0/2384412751 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe04c0653f0 0x7fe04c0678a0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.538+0000 7fe06ca4c700 1 --2- 172.21.15.87:0/2384412751 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe060058ba0 0x7fe060178290 unknown :-1 s=CLOSED pgs=3296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.538+0000 7fe06ca4c700 1 --2- 172.21.15.87:0/2384412751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe06003e7b0 0x7fe0600e5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.538+0000 7fe06ca4c700 1 --2- 172.21.15.87:0/2384412751 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe06000eff0 0x7fe06003a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.538+0000 7fe06ca4c700 1 -- 172.21.15.87:0/2384412751 >> 172.21.15.87:0/2384412751 conn(0x7fe060059170 msgr2=0x7fe06003bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:24.541 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.538+0000 7fe06ca4c700 1 -- 172.21.15.87:0/2384412751 shutdown_connections 2023-03-30T19:35:24.542 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.538+0000 7fe06ca4c700 1 -- 172.21.15.87:0/2384412751 wait complete. 2023-03-30T19:35:24.566 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T19:35:24.751 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.746+0000 7f5e250ee700 1 Processor -- start 2023-03-30T19:35:24.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.746+0000 7f5e250ee700 1 -- start start 2023-03-30T19:35:24.753 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.750+0000 7f5e250ee700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e200b8380 0x7f5e200d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:24.753 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.750+0000 7f5e250ee700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5e200d27e0 0x7f5e20069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:24.753 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.750+0000 7f5e250ee700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e20160ef0 con 0x7f5e201609f0 2023-03-30T19:35:24.754 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.750+0000 7f5e250ee700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e200cd6a0 con 0x7f5e200d27e0 2023-03-30T19:35:24.754 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.750+0000 7f5e250ee700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200cd3a0 con 0x7f5e200b8380 2023-03-30T19:35:24.754 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.750+0000 7f5e1ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e200b8380 0x7f5e200d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:24.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.750+0000 7f5e1ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e200b8380 0x7f5e200d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:49004/0 (socket says 172.21.15.87:49004) 2023-03-30T19:35:24.755 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.750+0000 7f5e1ffff700 1 -- 172.21.15.87:0/4279030412 learned_addr learned my addr 172.21.15.87:0/4279030412 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:24.767 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.762+0000 7f5e177fe700 1 --2- 172.21.15.87:0/4279030412 >> v2:172.21.15.115:3300/0 conn(0x7f5e200d27e0 0x7f5e20069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:24.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.910+0000 7f5e1ffff700 1 -- 172.21.15.87:0/4279030412 >> v2:172.21.15.115:3300/0 conn(0x7f5e200d27e0 msgr2=0x7f5e20069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:24.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.910+0000 7f5e1ffff700 1 --2- 172.21.15.87:0/4279030412 >> v2:172.21.15.115:3300/0 conn(0x7f5e200d27e0 0x7f5e20069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.910+0000 7f5e1ffff700 1 -- 172.21.15.87:0/4279030412 >> v1:172.21.15.115:6789/0 conn(0x7f5e201609f0 legacy=0x7f5e2006b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:24.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.910+0000 7f5e1ffff700 1 -- 172.21.15.87:0/4279030412 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e200cef00 con 0x7f5e200b8380 2023-03-30T19:35:24.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.910+0000 7f5e177fe700 1 --2- 172.21.15.87:0/4279030412 >> v2:172.21.15.115:3300/0 conn(0x7f5e200d27e0 0x7f5e20069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T19:35:24.928 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.926+0000 7f5e1ffff700 1 --2- 172.21.15.87:0/4279030412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e200b8380 0x7f5e200d2200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009910 tx=0x7f5e10009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=715b1a13e2af824d server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:24.946 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.942+0000 7f5e1f7fe700 1 -- 172.21.15.87:0/4279030412 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10011830 con 0x7f5e200b8380 2023-03-30T19:35:24.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.946+0000 7f5e1f7fe700 1 -- 172.21.15.87:0/4279030412 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e10011990 con 0x7f5e200b8380 2023-03-30T19:35:24.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.946+0000 7f5e1f7fe700 1 -- 172.21.15.87:0/4279030412 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10011d40 con 0x7f5e200b8380 2023-03-30T19:35:24.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.946+0000 7f5e250ee700 1 -- 172.21.15.87:0/4279030412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e200b8380 msgr2=0x7f5e200d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:24.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.946+0000 7f5e250ee700 1 --2- 172.21.15.87:0/4279030412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e200b8380 0x7f5e200d2200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009910 tx=0x7f5e10009c20 comp rx=0 tx=0).stop 2023-03-30T19:35:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.946+0000 7f5e250ee700 1 -- 172.21.15.87:0/4279030412 shutdown_connections 2023-03-30T19:35:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.946+0000 7f5e250ee700 1 --2- 172.21.15.87:0/4279030412 >> v2:172.21.15.115:3300/0 conn(0x7f5e200d27e0 0x7f5e20069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.946+0000 7f5e250ee700 1 --2- 172.21.15.87:0/4279030412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e200b8380 0x7f5e200d2200 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.951 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.946+0000 7f5e250ee700 1 -- 172.21.15.87:0/4279030412 >> 172.21.15.87:0/4279030412 conn(0x7f5e200b53f0 msgr2=0x7f5e200cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.946+0000 7f5e250ee700 1 -- 172.21.15.87:0/4279030412 shutdown_connections 2023-03-30T19:35:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.946+0000 7f5e250ee700 1 -- 172.21.15.87:0/4279030412 wait complete. 2023-03-30T19:35:24.955 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.950+0000 7f5e250ee700 1 Processor -- start 2023-03-30T19:35:24.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.954+0000 7f5e250ee700 1 -- start start 2023-03-30T19:35:24.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.954+0000 7f5e250ee700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e200b8380 0x7f5e201f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:24.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.954+0000 7f5e250ee700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e201609f0 0x7f5e200cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:24.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.954+0000 7f5e250ee700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e201f50e0 0x7f5e201f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:24.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.954+0000 7f5e250ee700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e201f2b40 con 0x7f5e201f50e0 2023-03-30T19:35:24.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.954+0000 7f5e250ee700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e201f5a90 con 0x7f5e200b8380 2023-03-30T19:35:24.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.954+0000 7f5e250ee700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200cc2b0 con 0x7f5e201609f0 2023-03-30T19:35:24.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.954+0000 7f5e1ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e200b8380 0x7f5e201f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:24.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.954+0000 7f5e1ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e200b8380 0x7f5e201f2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:40072/0 (socket says 172.21.15.87:40072) 2023-03-30T19:35:24.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.954+0000 7f5e1ffff700 1 -- 172.21.15.87:0/255946735 learned_addr learned my addr 172.21.15.87:0/255946735 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:24.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.954+0000 7f5e248ed700 1 --2- 172.21.15.87:0/255946735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e201f50e0 0x7f5e201f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:24.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.954+0000 7f5e177fe700 1 --2- 172.21.15.87:0/255946735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e201609f0 0x7f5e200cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:24.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.958+0000 7f5e248ed700 1 -- 172.21.15.87:0/255946735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e201609f0 msgr2=0x7f5e200cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:24.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.958+0000 7f5e248ed700 1 --2- 172.21.15.87:0/255946735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e201609f0 0x7f5e200cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.958+0000 7f5e248ed700 1 -- 172.21.15.87:0/255946735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e200b8380 msgr2=0x7f5e201f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:24.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.958+0000 7f5e248ed700 1 --2- 172.21.15.87:0/255946735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e200b8380 0x7f5e201f2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:24.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.958+0000 7f5e248ed700 1 -- 172.21.15.87:0/255946735 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e080094b0 con 0x7f5e201f50e0 2023-03-30T19:35:24.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.958+0000 7f5e248ed700 1 --2- 172.21.15.87:0/255946735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e201f50e0 0x7f5e201f5550 secure :-1 s=READY pgs=3297 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800cb10 tx=0x7f5e1800ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:24.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.958+0000 7f5e1d7fa700 1 -- 172.21.15.87:0/255946735 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18003c20 con 0x7f5e201f50e0 2023-03-30T19:35:24.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.958+0000 7f5e1d7fa700 1 -- 172.21.15.87:0/255946735 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e18003d80 con 0x7f5e201f50e0 2023-03-30T19:35:24.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.958+0000 7f5e1d7fa700 1 -- 172.21.15.87:0/255946735 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1800a9e0 con 0x7f5e201f50e0 2023-03-30T19:35:24.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.958+0000 7f5e250ee700 1 -- 172.21.15.87:0/255946735 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e10009570 con 0x7f5e201f50e0 2023-03-30T19:35:24.963 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.958+0000 7f5e250ee700 1 -- 172.21.15.87:0/255946735 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e200cf480 con 0x7f5e201f50e0 2023-03-30T19:35:24.964 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.962+0000 7f5e250ee700 1 -- 172.21.15.87:0/255946735 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e200cf1a0 con 0x7f5e201f50e0 2023-03-30T19:35:24.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.986+0000 7f5e1d7fa700 1 -- 172.21.15.87:0/255946735 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f5e1800ab40 con 0x7f5e201f50e0 2023-03-30T19:35:24.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.986+0000 7f5e1d7fa700 1 --2- 172.21.15.87:0/255946735 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5e000654c0 0x7f5e00067970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:24.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.986+0000 7f5e1d7fa700 1 -- 172.21.15.87:0/255946735 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f5e180832f0 con 0x7f5e201f50e0 2023-03-30T19:35:24.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.990+0000 7f5e1d7fa700 1 -- 172.21.15.87:0/255946735 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f5e18083770 con 0x7f5e201f50e0 2023-03-30T19:35:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.990+0000 7f5e1ffff700 1 --2- 172.21.15.87:0/255946735 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5e000654c0 0x7f5e00067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:24.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:24.990+0000 7f5e1ffff700 1 --2- 172.21.15.87:0/255946735 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5e000654c0 0x7f5e00067970 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009150 tx=0x7f5e10008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:25.262 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.258+0000 7f5e250ee700 1 -- 172.21.15.87:0/255946735 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5e20072cf0 con 0x7f5e201f50e0 2023-03-30T19:35:25.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.258+0000 7f5e1d7fa700 1 -- 172.21.15.87:0/255946735 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5e18050d70 con 0x7f5e201f50e0 2023-03-30T19:35:25.263 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T19:35:25.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.262+0000 7f5e250ee700 1 -- 172.21.15.87:0/255946735 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5e000654c0 msgr2=0x7f5e00067970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:25.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.262+0000 7f5e250ee700 1 --2- 172.21.15.87:0/255946735 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5e000654c0 0x7f5e00067970 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009150 tx=0x7f5e10008030 comp rx=0 tx=0).stop 2023-03-30T19:35:25.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.262+0000 7f5e250ee700 1 -- 172.21.15.87:0/255946735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e201f50e0 msgr2=0x7f5e201f5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:25.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.262+0000 7f5e250ee700 1 --2- 172.21.15.87:0/255946735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e201f50e0 0x7f5e201f5550 secure :-1 s=READY pgs=3297 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800cb10 tx=0x7f5e1800ce20 comp rx=0 tx=0).stop 2023-03-30T19:35:25.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.262+0000 7f5e250ee700 1 -- 172.21.15.87:0/255946735 shutdown_connections 2023-03-30T19:35:25.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.262+0000 7f5e250ee700 1 --2- 172.21.15.87:0/255946735 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f5e000654c0 0x7f5e00067970 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:25.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.262+0000 7f5e250ee700 1 --2- 172.21.15.87:0/255946735 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5e201f50e0 0x7f5e201f5550 unknown :-1 s=CLOSED pgs=3297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:25.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.262+0000 7f5e250ee700 1 --2- 172.21.15.87:0/255946735 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e201609f0 0x7f5e200cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:25.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.262+0000 7f5e250ee700 1 --2- 172.21.15.87:0/255946735 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e200b8380 0x7f5e201f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:25.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.262+0000 7f5e250ee700 1 -- 172.21.15.87:0/255946735 >> 172.21.15.87:0/255946735 conn(0x7f5e200b53f0 msgr2=0x7f5e200d1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:25.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.262+0000 7f5e250ee700 1 -- 172.21.15.87:0/255946735 shutdown_connections 2023-03-30T19:35:25.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.262+0000 7f5e250ee700 1 -- 172.21.15.87:0/255946735 wait complete. 2023-03-30T19:35:25.289 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-30T19:35:25.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.474+0000 7f960bfff700 1 Processor -- start 2023-03-30T19:35:25.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.474+0000 7f960bfff700 1 -- start start 2023-03-30T19:35:25.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960bfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f960c069f40 0x7f960c06b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:25.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960bfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f960c0af5e0 0x7f960c0c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:25.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960bfff700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960c06d330 con 0x7f960c0add60 2023-03-30T19:35:25.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960bfff700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c0c9680 con 0x7f960c0af5e0 2023-03-30T19:35:25.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960bfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c0ca420 con 0x7f960c069f40 2023-03-30T19:35:25.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960b7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f960c0add60 0x7f960c06a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51808/0 (socket says 172.21.15.87:51808) 2023-03-30T19:35:25.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960b7fe700 1 -- 172.21.15.87:0/2529170818 learned_addr learned my addr 172.21.15.87:0/2529170818 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:25.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960affd700 1 --2- 172.21.15.87:0/2529170818 >> v2:172.21.15.115:3300/0 conn(0x7f960c069f40 0x7f960c06b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:25.481 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f9603fff700 1 --2- 172.21.15.87:0/2529170818 >> v2:172.21.15.87:3300/0 conn(0x7f960c0af5e0 0x7f960c0c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:25.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960a7fc700 1 -- 172.21.15.87:0/2529170818 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070933665 0 0) 0x7f960c06d330 con 0x7f960c0add60 2023-03-30T19:35:25.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960a7fc700 1 -- 172.21.15.87:0/2529170818 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95f80035d0 con 0x7f960c0add60 2023-03-30T19:35:25.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960affd700 1 -- 172.21.15.87:0/2529170818 >> v2:172.21.15.87:3300/0 conn(0x7f960c0af5e0 msgr2=0x7f960c0c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:25.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960affd700 1 --2- 172.21.15.87:0/2529170818 >> v2:172.21.15.87:3300/0 conn(0x7f960c0af5e0 0x7f960c0c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:25.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960affd700 1 -- 172.21.15.87:0/2529170818 >> v1:172.21.15.87:6789/0 conn(0x7f960c0add60 legacy=0x7f960c06a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:25.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f9603fff700 1 --2- 172.21.15.87:0/2529170818 >> v2:172.21.15.87:3300/0 conn(0x7f960c0af5e0 0x7f960c0c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T19:35:25.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960a7fc700 1 -- 172.21.15.87:0/2529170818 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2787729416 0 0) 0x7f95f80035d0 con 0x7f960c0add60 2023-03-30T19:35:25.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960affd700 1 -- 172.21.15.87:0/2529170818 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c06d5a0 con 0x7f960c069f40 2023-03-30T19:35:25.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960affd700 1 --2- 172.21.15.87:0/2529170818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f960c069f40 0x7f960c06b1b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f960c06f550 tx=0x7f95f4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=963fa7b9813ccdc8 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:25.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960a7fc700 1 -- 172.21.15.87:0/2529170818 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96040019f0 con 0x7f960c069f40 2023-03-30T19:35:25.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960a7fc700 1 -- 172.21.15.87:0/2529170818 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f4004030 con 0x7f960c069f40 2023-03-30T19:35:25.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.478+0000 7f960a7fc700 1 -- 172.21.15.87:0/2529170818 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40043a0 con 0x7f960c069f40 2023-03-30T19:35:25.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.482+0000 7f960bfff700 1 -- 172.21.15.87:0/2529170818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f960c069f40 msgr2=0x7f960c06b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:25.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.482+0000 7f960bfff700 1 --2- 172.21.15.87:0/2529170818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f960c069f40 0x7f960c06b1b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f960c06f550 tx=0x7f95f4009b30 comp rx=0 tx=0).stop 2023-03-30T19:35:25.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.482+0000 7f960bfff700 1 -- 172.21.15.87:0/2529170818 shutdown_connections 2023-03-30T19:35:25.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.482+0000 7f960bfff700 1 --2- 172.21.15.87:0/2529170818 >> v2:172.21.15.87:3300/0 conn(0x7f960c0af5e0 0x7f960c0c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:25.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.482+0000 7f960bfff700 1 --2- 172.21.15.87:0/2529170818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f960c069f40 0x7f960c06b1b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:25.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.482+0000 7f960bfff700 1 -- 172.21.15.87:0/2529170818 >> 172.21.15.87:0/2529170818 conn(0x7f960c0cf410 msgr2=0x7f960c0cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:25.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.482+0000 7f960bfff700 1 -- 172.21.15.87:0/2529170818 shutdown_connections 2023-03-30T19:35:25.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.482+0000 7f960bfff700 1 -- 172.21.15.87:0/2529170818 wait complete. 2023-03-30T19:35:25.490 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.486+0000 7f960bfff700 1 Processor -- start 2023-03-30T19:35:25.491 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.486+0000 7f960bfff700 1 -- start start 2023-03-30T19:35:25.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960bfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f960c069f40 0x7f960c0c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:25.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f960c0add60 0x7f960c0bd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:25.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f960c0af5e0 0x7f960c0bd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:25.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960bfff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0c82b0 con 0x7f960c0add60 2023-03-30T19:35:25.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960bfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0c7210 con 0x7f960c069f40 2023-03-30T19:35:25.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960bfff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0c74f0 con 0x7f960c0af5e0 2023-03-30T19:35:25.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960b7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f960c0af5e0 0x7f960c0bd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:25.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960b7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f960c0af5e0 0x7f960c0bd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:49026/0 (socket says 172.21.15.87:49026) 2023-03-30T19:35:25.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960b7fe700 1 -- 172.21.15.87:0/2716808452 learned_addr learned my addr 172.21.15.87:0/2716808452 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:25.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960b7fe700 1 -- 172.21.15.87:0/2716808452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f960c069f40 msgr2=0x7f960c0c68a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-30T19:35:25.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960b7fe700 1 --2- 172.21.15.87:0/2716808452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f960c069f40 0x7f960c0c68a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:25.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960b7fe700 1 -- 172.21.15.87:0/2716808452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f960c0add60 msgr2=0x7f960c0bd360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-30T19:35:25.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960b7fe700 1 --2- 172.21.15.87:0/2716808452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f960c0add60 0x7f960c0bd360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:25.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960b7fe700 1 -- 172.21.15.87:0/2716808452 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f40094b0 con 0x7f960c0af5e0 2023-03-30T19:35:25.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960b7fe700 1 --2- 172.21.15.87:0/2716808452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f960c0af5e0 0x7f960c0bd8a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f960400ccc0 tx=0x7f960400a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:25.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f96037fe700 1 -- 172.21.15.87:0/2716808452 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960400ad60 con 0x7f960c0af5e0 2023-03-30T19:35:25.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f96037fe700 1 -- 172.21.15.87:0/2716808452 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96040070d0 con 0x7f960c0af5e0 2023-03-30T19:35:25.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f96037fe700 1 -- 172.21.15.87:0/2716808452 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604007480 con 0x7f960c0af5e0 2023-03-30T19:35:25.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960bfff700 1 -- 172.21.15.87:0/2716808452 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c089830 con 0x7f960c0af5e0 2023-03-30T19:35:25.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.490+0000 7f960bfff700 1 -- 172.21.15.87:0/2716808452 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c0c92a0 con 0x7f960c0af5e0 2023-03-30T19:35:25.496 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.494+0000 7f960bfff700 1 -- 172.21.15.87:0/2716808452 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c0c9860 con 0x7f960c0af5e0 2023-03-30T19:35:25.497 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.494+0000 7f96037fe700 1 -- 172.21.15.87:0/2716808452 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f96040075e0 con 0x7f960c0af5e0 2023-03-30T19:35:25.498 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.494+0000 7f96037fe700 1 --2- 172.21.15.87:0/2716808452 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f95ec0653f0 0x7f95ec0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:25.498 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.494+0000 7f960affd700 1 --2- 172.21.15.87:0/2716808452 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f95ec0653f0 0x7f95ec0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:25.499 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.494+0000 7f960affd700 1 --2- 172.21.15.87:0/2716808452 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f95ec0653f0 0x7f95ec0678a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f95f4000c00 tx=0x7f95f4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:25.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:25.622+0000 7f96037fe700 1 -- 172.21.15.87:0/2716808452 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f960405bd90 con 0x7f960c0af5e0 2023-03-30T19:35:26.699 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:26.694+0000 7f96037fe700 1 -- 172.21.15.87:0/2716808452 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f9604050040 con 0x7f960c0af5e0 2023-03-30T19:35:26.934 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:26.930+0000 7f960bfff700 1 -- 172.21.15.87:0/2716808452 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f960c0ccee0 con 0x7f960c0af5e0 2023-03-30T19:35:27.082 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.078+0000 7f96037fe700 1 -- 172.21.15.87:0/2716808452 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96040180a0 con 0x7f960c0af5e0 2023-03-30T19:35:27.083 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T19:35:27.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.082+0000 7f960bfff700 1 -- 172.21.15.87:0/2716808452 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f95ec0653f0 msgr2=0x7f95ec0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:27.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.082+0000 7f960bfff700 1 --2- 172.21.15.87:0/2716808452 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f95ec0653f0 0x7f95ec0678a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f95f4000c00 tx=0x7f95f4008030 comp rx=0 tx=0).stop 2023-03-30T19:35:27.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.082+0000 7f960bfff700 1 -- 172.21.15.87:0/2716808452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f960c0af5e0 msgr2=0x7f960c0bd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:27.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.082+0000 7f960bfff700 1 --2- 172.21.15.87:0/2716808452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f960c0af5e0 0x7f960c0bd8a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f960400ccc0 tx=0x7f960400a340 comp rx=0 tx=0).stop 2023-03-30T19:35:27.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.082+0000 7f960bfff700 1 -- 172.21.15.87:0/2716808452 shutdown_connections 2023-03-30T19:35:27.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.082+0000 7f960bfff700 1 --2- 172.21.15.87:0/2716808452 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f95ec0653f0 0x7f95ec0678a0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.082+0000 7f960bfff700 1 --2- 172.21.15.87:0/2716808452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f960c0af5e0 0x7f960c0bd8a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.082+0000 7f960bfff700 1 --2- 172.21.15.87:0/2716808452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f960c0add60 0x7f960c0bd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.082+0000 7f960bfff700 1 --2- 172.21.15.87:0/2716808452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f960c069f40 0x7f960c0c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.082+0000 7f960bfff700 1 -- 172.21.15.87:0/2716808452 >> 172.21.15.87:0/2716808452 conn(0x7f960c0cf410 msgr2=0x7f960c0b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:27.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.082+0000 7f960bfff700 1 -- 172.21.15.87:0/2716808452 shutdown_connections 2023-03-30T19:35:27.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.082+0000 7f960bfff700 1 -- 172.21.15.87:0/2716808452 wait complete. 2023-03-30T19:35:27.112 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-30T19:35:27.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.298+0000 7fc09f59e700 1 Processor -- start 2023-03-30T19:35:27.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.298+0000 7fc09f59e700 1 -- start start 2023-03-30T19:35:27.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.298+0000 7fc09f59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc0a00cd4e0 0x7fc0a00ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:27.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.298+0000 7fc09f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a00cd8b0 0x7fc0a00cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:27.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.298+0000 7fc09f59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc0a00cb120 0x7fc0a00cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:27.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.298+0000 7fc09f59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a015a940 con 0x7fc0a00cb120 2023-03-30T19:35:27.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.298+0000 7fc09f59e700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a00b00d0 con 0x7fc0a00cd4e0 2023-03-30T19:35:27.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.298+0000 7fc09f59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00cea70 con 0x7fc0a00cd8b0 2023-03-30T19:35:27.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.298+0000 7fc09e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc0a00cd4e0 0x7fc0a00ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:27.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.298+0000 7fc09dd9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a00cd8b0 0x7fc0a00cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:27.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.298+0000 7fc09e59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc0a00cd4e0 0x7fc0a00ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:40088/0 (socket says 172.21.15.87:40088) 2023-03-30T19:35:27.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.298+0000 7fc09e59c700 1 -- 172.21.15.87:0/3343523149 learned_addr learned my addr 172.21.15.87:0/3343523149 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.298+0000 7fc09ed9d700 1 --2- 172.21.15.87:0/3343523149 >> v2:172.21.15.87:3300/0 conn(0x7fc0a00cb120 0x7fc0a00cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.302+0000 7fc09e59c700 1 -- 172.21.15.87:0/3343523149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a00cd8b0 msgr2=0x7fc0a00cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.302+0000 7fc09e59c700 1 --2- 172.21.15.87:0/3343523149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a00cd8b0 0x7fc0a00cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.302+0000 7fc09e59c700 1 -- 172.21.15.87:0/3343523149 >> v2:172.21.15.87:3300/0 conn(0x7fc0a00cb120 msgr2=0x7fc0a00cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.302+0000 7fc09e59c700 1 --2- 172.21.15.87:0/3343523149 >> v2:172.21.15.87:3300/0 conn(0x7fc0a00cb120 0x7fc0a00cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.305 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.302+0000 7fc09e59c700 1 -- 172.21.15.87:0/3343523149 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a00ced50 con 0x7fc0a00cd4e0 2023-03-30T19:35:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.302+0000 7fc09dd9b700 1 --2- 172.21.15.87:0/3343523149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a00cd8b0 0x7fc0a00cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T19:35:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.302+0000 7fc09e59c700 1 --2- 172.21.15.87:0/3343523149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0a00cd4e0 0x7fc0a00ccb40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc090009940 tx=0x7fc090009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1e1e269822a32a6 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:27.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.302+0000 7fc09d59a700 1 -- 172.21.15.87:0/3343523149 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090005e50 con 0x7fc0a00cd4e0 2023-03-30T19:35:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.302+0000 7fc09d59a700 1 -- 172.21.15.87:0/3343523149 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc090009e90 con 0x7fc0a00cd4e0 2023-03-30T19:35:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.302+0000 7fc09d59a700 1 -- 172.21.15.87:0/3343523149 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000b7f0 con 0x7fc0a00cd4e0 2023-03-30T19:35:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.302+0000 7fc09f59e700 1 -- 172.21.15.87:0/3343523149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0a00cd4e0 msgr2=0x7fc0a00ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.302+0000 7fc09f59e700 1 --2- 172.21.15.87:0/3343523149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0a00cd4e0 0x7fc0a00ccb40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc090009940 tx=0x7fc090009c50 comp rx=0 tx=0).stop 2023-03-30T19:35:27.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.306+0000 7fc09f59e700 1 -- 172.21.15.87:0/3343523149 shutdown_connections 2023-03-30T19:35:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.306+0000 7fc09f59e700 1 --2- 172.21.15.87:0/3343523149 >> v2:172.21.15.87:3300/0 conn(0x7fc0a00cb120 0x7fc0a00cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.306+0000 7fc09f59e700 1 --2- 172.21.15.87:0/3343523149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a00cd8b0 0x7fc0a00cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.306+0000 7fc09f59e700 1 --2- 172.21.15.87:0/3343523149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0a00cd4e0 0x7fc0a00ccb40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.306+0000 7fc09f59e700 1 -- 172.21.15.87:0/3343523149 >> 172.21.15.87:0/3343523149 conn(0x7fc0a0099dc0 msgr2=0x7fc0a00d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.306+0000 7fc09f59e700 1 -- 172.21.15.87:0/3343523149 shutdown_connections 2023-03-30T19:35:27.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.306+0000 7fc09f59e700 1 -- 172.21.15.87:0/3343523149 wait complete. 2023-03-30T19:35:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.306+0000 7fc09f59e700 1 Processor -- start 2023-03-30T19:35:27.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09f59e700 1 -- start start 2023-03-30T19:35:27.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09f59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0a00cb120 0x7fc0a01518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:27.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a00cd4e0 0x7fc0a014daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:27.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0a00cd8b0 0x7fc0a00c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:27.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09f59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a0151e20 con 0x7fc0a00cb120 2023-03-30T19:35:27.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09f59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00c9d90 con 0x7fc0a00cd8b0 2023-03-30T19:35:27.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09f59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00b5ec0 con 0x7fc0a00cd4e0 2023-03-30T19:35:27.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09e59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0a00cb120 0x7fc0a01518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09e59c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0a00cb120 0x7fc0a01518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38068/0 (socket says 172.21.15.87:38068) 2023-03-30T19:35:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09e59c700 1 -- 172.21.15.87:0/1701002138 learned_addr learned my addr 172.21.15.87:0/1701002138 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09dd9b700 1 --2- 172.21.15.87:0/1701002138 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a00cd4e0 0x7fc0a014daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09ed9d700 1 --2- 172.21.15.87:0/1701002138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0a00cd8b0 0x7fc0a00c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09e59c700 1 -- 172.21.15.87:0/1701002138 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a00cd4e0 msgr2=0x7fc0a014daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09e59c700 1 --2- 172.21.15.87:0/1701002138 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a00cd4e0 0x7fc0a014daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09e59c700 1 -- 172.21.15.87:0/1701002138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0a00cd8b0 msgr2=0x7fc0a00c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:27.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09e59c700 1 --2- 172.21.15.87:0/1701002138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0a00cd8b0 0x7fc0a00c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09e59c700 1 -- 172.21.15.87:0/1701002138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc090009520 con 0x7fc0a00cb120 2023-03-30T19:35:27.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09e59c700 1 --2- 172.21.15.87:0/1701002138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0a00cb120 0x7fc0a01518e0 secure :-1 s=READY pgs=3299 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00b0210 tx=0x7fc090004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:27.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc08effd700 1 -- 172.21.15.87:0/1701002138 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090003ad0 con 0x7fc0a00cb120 2023-03-30T19:35:27.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc08effd700 1 -- 172.21.15.87:0/1701002138 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc090003c30 con 0x7fc0a00cb120 2023-03-30T19:35:27.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc08effd700 1 -- 172.21.15.87:0/1701002138 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000b5d0 con 0x7fc0a00cb120 2023-03-30T19:35:27.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09f59e700 1 -- 172.21.15.87:0/1701002138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a00d0820 con 0x7fc0a00cb120 2023-03-30T19:35:27.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.310+0000 7fc09f59e700 1 -- 172.21.15.87:0/1701002138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a00cf030 con 0x7fc0a00cb120 2023-03-30T19:35:27.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.314+0000 7fc09f59e700 1 -- 172.21.15.87:0/1701002138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a00cd1d0 con 0x7fc0a00cb120 2023-03-30T19:35:27.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.322+0000 7fc08effd700 1 -- 172.21.15.87:0/1701002138 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc090023070 con 0x7fc0a00cb120 2023-03-30T19:35:27.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.322+0000 7fc08effd700 1 --2- 172.21.15.87:0/1701002138 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0800653f0 0x7fc0800678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:27.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.322+0000 7fc08effd700 1 -- 172.21.15.87:0/1701002138 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc090084970 con 0x7fc0a00cb120 2023-03-30T19:35:27.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.322+0000 7fc09dd9b700 1 --2- 172.21.15.87:0/1701002138 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0800653f0 0x7fc0800678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:27.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.322+0000 7fc09dd9b700 1 --2- 172.21.15.87:0/1701002138 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0800653f0 0x7fc0800678a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fc0a006f1d0 tx=0x7fc094008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:27.397 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.394+0000 7fc08effd700 1 -- 172.21.15.87:0/1701002138 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fc0900524e0 con 0x7fc0a00cb120 2023-03-30T19:35:27.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.642+0000 7fc09f59e700 1 -- 172.21.15.87:0/1701002138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc0a0072cf0 con 0x7fc0a00cb120 2023-03-30T19:35:27.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.642+0000 7fc08effd700 1 -- 172.21.15.87:0/1701002138 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc090055b00 con 0x7fc0a00cb120 2023-03-30T19:35:27.646 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-03-30T19:35:27.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.646+0000 7fc09f59e700 1 -- 172.21.15.87:0/1701002138 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0800653f0 msgr2=0x7fc0800678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:27.649 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.646+0000 7fc09f59e700 1 --2- 172.21.15.87:0/1701002138 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0800653f0 0x7fc0800678a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fc0a006f1d0 tx=0x7fc094008040 comp rx=0 tx=0).stop 2023-03-30T19:35:27.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.646+0000 7fc09f59e700 1 -- 172.21.15.87:0/1701002138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0a00cb120 msgr2=0x7fc0a01518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:27.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.646+0000 7fc09f59e700 1 --2- 172.21.15.87:0/1701002138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0a00cb120 0x7fc0a01518e0 secure :-1 s=READY pgs=3299 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00b0210 tx=0x7fc090004770 comp rx=0 tx=0).stop 2023-03-30T19:35:27.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.646+0000 7fc09f59e700 1 -- 172.21.15.87:0/1701002138 shutdown_connections 2023-03-30T19:35:27.650 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.646+0000 7fc09f59e700 1 --2- 172.21.15.87:0/1701002138 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc0800653f0 0x7fc0800678a0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.646+0000 7fc09f59e700 1 --2- 172.21.15.87:0/1701002138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0a00cd8b0 0x7fc0a00c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.646+0000 7fc09f59e700 1 --2- 172.21.15.87:0/1701002138 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc0a00cd4e0 0x7fc0a014daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.646+0000 7fc09f59e700 1 --2- 172.21.15.87:0/1701002138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc0a00cb120 0x7fc0a01518e0 secure :-1 s=CLOSED pgs=3299 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00b0210 tx=0x7fc090004770 comp rx=0 tx=0).stop 2023-03-30T19:35:27.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.646+0000 7fc09f59e700 1 -- 172.21.15.87:0/1701002138 >> 172.21.15.87:0/1701002138 conn(0x7fc0a0099dc0 msgr2=0x7fc0a00b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:27.651 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.646+0000 7fc09f59e700 1 -- 172.21.15.87:0/1701002138 shutdown_connections 2023-03-30T19:35:27.652 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.646+0000 7fc09f59e700 1 -- 172.21.15.87:0/1701002138 wait complete. 2023-03-30T19:35:27.673 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-30T19:35:27.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.858+0000 7f1641326700 1 Processor -- start 2023-03-30T19:35:27.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.858+0000 7f1641326700 1 -- start start 2023-03-30T19:35:27.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.858+0000 7f1641326700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f163c0b8380 0x7f163c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:27.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.858+0000 7f1641326700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f163c0d27e0 0x7f163c069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:27.866 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.858+0000 7f1641326700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f163c160ef0 con 0x7f163c1609f0 2023-03-30T19:35:27.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.858+0000 7f1641326700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163c0cd6a0 con 0x7f163c0d27e0 2023-03-30T19:35:27.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.858+0000 7f1641326700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0cd3a0 con 0x7f163c0b8380 2023-03-30T19:35:27.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.858+0000 7f163b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f163c1609f0 0x7f163c06b1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:54230/0 (socket says 172.21.15.87:54230) 2023-03-30T19:35:27.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.858+0000 7f163b7fe700 1 -- 172.21.15.87:0/3292747113 learned_addr learned my addr 172.21.15.87:0/3292747113 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:27.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.858+0000 7f163a7fc700 1 --2- 172.21.15.87:0/3292747113 >> v2:172.21.15.87:3300/0 conn(0x7f163c0d27e0 0x7f163c069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:27.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.858+0000 7f163a7fc700 1 -- 172.21.15.87:0/3292747113 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f163c0b8380 msgr2=0x7f163c0d2200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-30T19:35:27.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.858+0000 7f163a7fc700 1 --2- 172.21.15.87:0/3292747113 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f163c0b8380 0x7f163c0d2200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.858+0000 7f163a7fc700 1 -- 172.21.15.87:0/3292747113 >> v1:172.21.15.115:6789/0 conn(0x7f163c1609f0 legacy=0x7f163c06b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:27.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.858+0000 7f163a7fc700 1 -- 172.21.15.87:0/3292747113 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c0cef00 con 0x7f163c0d27e0 2023-03-30T19:35:27.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.862+0000 7f163a7fc700 1 --2- 172.21.15.87:0/3292747113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f163c0d27e0 0x7f163c069cd0 secure :-1 s=READY pgs=3300 cs=0 l=1 rev1=1 crypto rx=0x7f162c009ab0 tx=0x7f162c009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed433c547d52736f server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:27.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.862+0000 7f1639ffb700 1 -- 172.21.15.87:0/3292747113 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c004230 con 0x7f163c0d27e0 2023-03-30T19:35:27.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.862+0000 7f1639ffb700 1 -- 172.21.15.87:0/3292747113 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c004390 con 0x7f163c0d27e0 2023-03-30T19:35:27.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.862+0000 7f1639ffb700 1 -- 172.21.15.87:0/3292747113 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c0036c0 con 0x7f163c0d27e0 2023-03-30T19:35:27.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.862+0000 7f1641326700 1 -- 172.21.15.87:0/3292747113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f163c0d27e0 msgr2=0x7f163c069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:27.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.862+0000 7f1641326700 1 --2- 172.21.15.87:0/3292747113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f163c0d27e0 0x7f163c069cd0 secure :-1 s=READY pgs=3300 cs=0 l=1 rev1=1 crypto rx=0x7f162c009ab0 tx=0x7f162c009dc0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.866+0000 7f1641326700 1 -- 172.21.15.87:0/3292747113 shutdown_connections 2023-03-30T19:35:27.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.866+0000 7f1641326700 1 --2- 172.21.15.87:0/3292747113 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f163c0d27e0 0x7f163c069cd0 unknown :-1 s=CLOSED pgs=3300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.866+0000 7f1641326700 1 --2- 172.21.15.87:0/3292747113 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f163c0b8380 0x7f163c0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.866+0000 7f1641326700 1 -- 172.21.15.87:0/3292747113 >> 172.21.15.87:0/3292747113 conn(0x7f163c0b53f0 msgr2=0x7f163c0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:27.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.866+0000 7f1641326700 1 -- 172.21.15.87:0/3292747113 shutdown_connections 2023-03-30T19:35:27.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.866+0000 7f1641326700 1 -- 172.21.15.87:0/3292747113 wait complete. 2023-03-30T19:35:27.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.866+0000 7f1641326700 1 Processor -- start 2023-03-30T19:35:27.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.866+0000 7f1641326700 1 -- start start 2023-03-30T19:35:27.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f1641326700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f163c0b8380 0x7f163c15ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:27.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f1641326700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f163c1609f0 0x7f163c0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:27.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f1641326700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f163c0ccca0 0x7f163c0c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:27.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f1641326700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0cd100 con 0x7f163c0ccca0 2023-03-30T19:35:27.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f1641326700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c1f2f10 con 0x7f163c0b8380 2023-03-30T19:35:27.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f1641326700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0c67e0 con 0x7f163c1609f0 2023-03-30T19:35:27.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f163b7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f163c0ccca0 0x7f163c0c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:27.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f163b7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f163c0ccca0 0x7f163c0c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38096/0 (socket says 172.21.15.87:38096) 2023-03-30T19:35:27.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f163b7fe700 1 -- 172.21.15.87:0/2486499638 learned_addr learned my addr 172.21.15.87:0/2486499638 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:27.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f163affd700 1 --2- 172.21.15.87:0/2486499638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f163c0b8380 0x7f163c15ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:27.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f163a7fc700 1 --2- 172.21.15.87:0/2486499638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f163c1609f0 0x7f163c0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:27.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f163affd700 1 -- 172.21.15.87:0/2486499638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f163c1609f0 msgr2=0x7f163c0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:27.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f163affd700 1 --2- 172.21.15.87:0/2486499638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f163c1609f0 0x7f163c0cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f163affd700 1 -- 172.21.15.87:0/2486499638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f163c0ccca0 msgr2=0x7f163c0c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:27.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f163affd700 1 --2- 172.21.15.87:0/2486499638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f163c0ccca0 0x7f163c0c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:27.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f163affd700 1 -- 172.21.15.87:0/2486499638 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0094b0 con 0x7f163c0b8380 2023-03-30T19:35:27.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f163affd700 1 --2- 172.21.15.87:0/2486499638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f163c0b8380 0x7f163c15ed30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f162400b470 tx=0x7f162400b780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:27.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f16337fe700 1 -- 172.21.15.87:0/2486499638 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624011830 con 0x7f163c0b8380 2023-03-30T19:35:27.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f16337fe700 1 -- 172.21.15.87:0/2486499638 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1624011990 con 0x7f163c0b8380 2023-03-30T19:35:27.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f1641326700 1 -- 172.21.15.87:0/2486499638 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163c0cf480 con 0x7f163c0b8380 2023-03-30T19:35:27.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f16337fe700 1 -- 172.21.15.87:0/2486499638 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624011d40 con 0x7f163c0b8380 2023-03-30T19:35:27.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.870+0000 7f1641326700 1 -- 172.21.15.87:0/2486499638 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f163c0cf1a0 con 0x7f163c0b8380 2023-03-30T19:35:27.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.874+0000 7f1641326700 1 -- 172.21.15.87:0/2486499638 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163c0b8750 con 0x7f163c0b8380 2023-03-30T19:35:27.947 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.942+0000 7f16337fe700 1 -- 172.21.15.87:0/2486499638 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f162401a400 con 0x7f163c0b8380 2023-03-30T19:35:27.948 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.946+0000 7f16337fe700 1 --2- 172.21.15.87:0/2486499638 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f161c065440 0x7f161c0678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:27.949 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.946+0000 7f163a7fc700 1 --2- 172.21.15.87:0/2486499638 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f161c065440 0x7f161c0678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:27.950 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.946+0000 7f163a7fc700 1 --2- 172.21.15.87:0/2486499638 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f161c065440 0x7f161c0678f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f163c0d3db0 tx=0x7f162c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:27.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:27.954+0000 7f16337fe700 1 -- 172.21.15.87:0/2486499638 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f162405c730 con 0x7f163c0b8380 2023-03-30T19:35:28.550 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:28.546+0000 7f16337fe700 1 -- 172.21.15.87:0/2486499638 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f1624050980 con 0x7f163c0b8380 2023-03-30T19:35:28.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:28.834+0000 7f1641326700 1 -- 172.21.15.87:0/2486499638 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f163c072cf0 con 0x7f163c0b8380 2023-03-30T19:35:28.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:28.881+0000 7f16337fe700 1 -- 172.21.15.87:0/2486499638 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v45) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1624015080 con 0x7f163c0b8380 2023-03-30T19:35:28.890 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:28.885+0000 7f1641326700 1 -- 172.21.15.87:0/2486499638 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f161c065440 msgr2=0x7f161c0678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:28.890 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:28.885+0000 7f1641326700 1 --2- 172.21.15.87:0/2486499638 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f161c065440 0x7f161c0678f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f163c0d3db0 tx=0x7f162c008030 comp rx=0 tx=0).stop 2023-03-30T19:35:28.890 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:28.885+0000 7f1641326700 1 -- 172.21.15.87:0/2486499638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f163c0b8380 msgr2=0x7f163c15ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:28.891 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:28.885+0000 7f1641326700 1 --2- 172.21.15.87:0/2486499638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f163c0b8380 0x7f163c15ed30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f162400b470 tx=0x7f162400b780 comp rx=0 tx=0).stop 2023-03-30T19:35:28.891 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:28.885+0000 7f1641326700 1 -- 172.21.15.87:0/2486499638 shutdown_connections 2023-03-30T19:35:28.891 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:28.885+0000 7f1641326700 1 --2- 172.21.15.87:0/2486499638 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f161c065440 0x7f161c0678f0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:28.892 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:28.885+0000 7f1641326700 1 --2- 172.21.15.87:0/2486499638 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f163c0ccca0 0x7f163c0c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:28.892 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:28.885+0000 7f1641326700 1 --2- 172.21.15.87:0/2486499638 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f163c1609f0 0x7f163c0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:28.892 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:28.885+0000 7f1641326700 1 --2- 172.21.15.87:0/2486499638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f163c0b8380 0x7f163c15ed30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:28.892 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:28.885+0000 7f1641326700 1 -- 172.21.15.87:0/2486499638 >> 172.21.15.87:0/2486499638 conn(0x7f163c0b53f0 msgr2=0x7f163c0b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:28.893 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:28.885+0000 7f1641326700 1 -- 172.21.15.87:0/2486499638 shutdown_connections 2023-03-30T19:35:28.893 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:28.889+0000 7f1641326700 1 -- 172.21.15.87:0/2486499638 wait complete. 2023-03-30T19:35:28.894 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2023-03-30T19:35:28.919 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-03-30T19:35:28.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:28.920 DEBUG:teuthology.orchestra.run.smithi087:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-03-30T19:35:29.005 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2023-03-30T19:35:29.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:29.006 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-03-30T19:35:29.035 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T19:35:29.036 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T19:35:29.060 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352432k,nr_inodes=4088108,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13290 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-03-30T19:35:29.061 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T19:35:29.061 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T19:35:29.086 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352416k,nr_inodes=4088104,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12641 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-03-30T19:35:29.086 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T19:35:29.087 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T19:35:29.135 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352432k,nr_inodes=4088108,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13290 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-03-30T19:35:29.136 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T19:35:29.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc19646f700 1 Processor -- start 2023-03-30T19:35:29.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc19646f700 1 -- start start 2023-03-30T19:35:29.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc19646f700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc1900b8380 0x7fc1900d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc19646f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc19006a3e0 0x7fc1900d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc19646f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc190160ef0 con 0x7fc1900d27e0 2023-03-30T19:35:29.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc19646f700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1900cd6a0 con 0x7fc1900b8380 2023-03-30T19:35:29.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc19646f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900cd3a0 con 0x7fc19006a3e0 2023-03-30T19:35:29.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc194c6c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc1900d27e0 0x7fc190069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:51816/0 (socket says 172.21.15.87:51816) 2023-03-30T19:35:29.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc194c6c700 1 -- 172.21.15.87:0/3314031909 learned_addr learned my addr 172.21.15.87:0/3314031909 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:29.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc19546d700 1 --2- 172.21.15.87:0/3314031909 >> v2:172.21.15.115:3300/0 conn(0x7fc1900b8380 0x7fc1900d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc195c6e700 1 --2- 172.21.15.87:0/3314031909 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc19006a3e0 0x7fc1900d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 -- 172.21.15.87:0/3314031909 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997034321 0 0) 0x7fc190160ef0 con 0x7fc1900d27e0 2023-03-30T19:35:29.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 -- 172.21.15.87:0/3314031909 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc17c0035d0 con 0x7fc1900d27e0 2023-03-30T19:35:29.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 -- 172.21.15.87:0/3314031909 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1590749265 0 0) 0x7fc17c0035d0 con 0x7fc1900d27e0 2023-03-30T19:35:29.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 -- 172.21.15.87:0/3314031909 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc19006a3e0 msgr2=0x7fc1900d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:29.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 --2- 172.21.15.87:0/3314031909 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc19006a3e0 0x7fc1900d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 -- 172.21.15.87:0/3314031909 >> v2:172.21.15.115:3300/0 conn(0x7fc1900b8380 msgr2=0x7fc1900d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:29.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 --2- 172.21.15.87:0/3314031909 >> v2:172.21.15.115:3300/0 conn(0x7fc1900b8380 0x7fc1900d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 -- 172.21.15.87:0/3314031909 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1900cef00 con 0x7fc1900d27e0 2023-03-30T19:35:29.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 -- 172.21.15.87:0/3314031909 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7fc180001670 con 0x7fc1900d27e0 2023-03-30T19:35:29.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 -- 172.21.15.87:0/3314031909 >> v1:172.21.15.87:6789/0 conn(0x7fc1900d27e0 legacy=0x7fc190069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:29.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 --2- 172.21.15.87:0/3314031909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc17c003a20 0x7fc17c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 --2- 172.21.15.87:0/3314031909 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc19006a3e0 0x7fc17c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 --2- 172.21.15.87:0/3314031909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc17c004db0 0x7fc17c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 -- 172.21.15.87:0/3314031909 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900cd6a0 con 0x7fc17c004db0 2023-03-30T19:35:29.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 -- 172.21.15.87:0/3314031909 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900cd3a0 con 0x7fc17c003a20 2023-03-30T19:35:29.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc187fff700 1 -- 172.21.15.87:0/3314031909 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c00ba30 con 0x7fc19006a3e0 2023-03-30T19:35:29.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.309+0000 7fc195c6e700 1 --2- 172.21.15.87:0/3314031909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc17c004db0 0x7fc17c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc195c6e700 1 -- 172.21.15.87:0/3314031909 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc19006a3e0 msgr2=0x7fc17c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:29.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc195c6e700 1 --2- 172.21.15.87:0/3314031909 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc19006a3e0 0x7fc17c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc195c6e700 1 -- 172.21.15.87:0/3314031909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc17c003a20 msgr2=0x7fc17c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:29.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc19546d700 1 --2- 172.21.15.87:0/3314031909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc17c003a20 0x7fc17c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc195c6e700 1 --2- 172.21.15.87:0/3314031909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc17c003a20 0x7fc17c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc195c6e700 1 -- 172.21.15.87:0/3314031909 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c0035d0 con 0x7fc17c004db0 2023-03-30T19:35:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc19546d700 1 --2- 172.21.15.87:0/3314031909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc17c003a20 0x7fc17c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T19:35:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc195c6e700 1 --2- 172.21.15.87:0/3314031909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc17c004db0 0x7fc17c005220 secure :-1 s=READY pgs=3302 cs=0 l=1 rev1=1 crypto rx=0x7fc188009fc0 tx=0x7fc17c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a09fac282365cdc server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc187fff700 1 -- 172.21.15.87:0/3314031909 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18800ebd0 con 0x7fc17c004db0 2023-03-30T19:35:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc187fff700 1 -- 172.21.15.87:0/3314031909 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18800f040 con 0x7fc17c004db0 2023-03-30T19:35:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc187fff700 1 -- 172.21.15.87:0/3314031909 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc188014480 con 0x7fc17c004db0 2023-03-30T19:35:29.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc19646f700 1 -- 172.21.15.87:0/3314031909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc17c004db0 msgr2=0x7fc17c005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc19646f700 1 --2- 172.21.15.87:0/3314031909 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc17c004db0 0x7fc17c005220 secure :-1 s=READY pgs=3302 cs=0 l=1 rev1=1 crypto rx=0x7fc188009fc0 tx=0x7fc17c0058a0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc195c6e700 1 -- 172.21.15.87:0/3314031909 reap_dead start 2023-03-30T19:35:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc19646f700 1 -- 172.21.15.87:0/3314031909 shutdown_connections 2023-03-30T19:35:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc19646f700 1 -- 172.21.15.87:0/3314031909 >> 172.21.15.87:0/3314031909 conn(0x7fc1900b53f0 msgr2=0x7fc1900cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc19646f700 1 -- 172.21.15.87:0/3314031909 shutdown_connections 2023-03-30T19:35:29.321 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.313+0000 7fc19646f700 1 -- 172.21.15.87:0/3314031909 wait complete. 2023-03-30T19:35:29.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc19646f700 1 Processor -- start 2023-03-30T19:35:29.322 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc19646f700 1 -- start start 2023-03-30T19:35:29.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc19646f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc17c004db0 0x7fc1900d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc19646f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc190153d10 0x7fc19015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc19646f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1901576d0 0x7fc19015b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc19646f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19015d580 con 0x7fc190153d10 2023-03-30T19:35:29.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc19646f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19015f920 con 0x7fc1901576d0 2023-03-30T19:35:29.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc194c6c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc190153d10 0x7fc19015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc194c6c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc190153d10 0x7fc19015ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:38106/0 (socket says 172.21.15.87:38106) 2023-03-30T19:35:29.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc194c6c700 1 -- 172.21.15.87:0/2737785856 learned_addr learned my addr 172.21.15.87:0/2737785856 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:29.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc19646f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900d1230 con 0x7fc17c004db0 2023-03-30T19:35:29.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc19546d700 1 --2- 172.21.15.87:0/2737785856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc17c004db0 0x7fc1900d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc195c6e700 1 --2- 172.21.15.87:0/2737785856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1901576d0 0x7fc19015b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc194c6c700 1 -- 172.21.15.87:0/2737785856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc17c004db0 msgr2=0x7fc1900d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:29.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc194c6c700 1 --2- 172.21.15.87:0/2737785856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc17c004db0 0x7fc1900d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc194c6c700 1 -- 172.21.15.87:0/2737785856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1901576d0 msgr2=0x7fc19015b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:29.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc194c6c700 1 --2- 172.21.15.87:0/2737785856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1901576d0 0x7fc19015b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc194c6c700 1 -- 172.21.15.87:0/2737785856 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1900cf480 con 0x7fc190153d10 2023-03-30T19:35:29.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc194c6c700 1 --2- 172.21.15.87:0/2737785856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc190153d10 0x7fc19015ab80 secure :-1 s=READY pgs=3303 cs=0 l=1 rev1=1 crypto rx=0x7fc18000ca70 tx=0x7fc18000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:29.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc185ffb700 1 -- 172.21.15.87:0/2737785856 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc180004ca0 con 0x7fc190153d10 2023-03-30T19:35:29.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc185ffb700 1 -- 172.21.15.87:0/2737785856 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc180004e00 con 0x7fc190153d10 2023-03-30T19:35:29.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc19646f700 1 -- 172.21.15.87:0/2737785856 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1900cf1a0 con 0x7fc190153d10 2023-03-30T19:35:29.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.317+0000 7fc185ffb700 1 -- 172.21.15.87:0/2737785856 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1800072f0 con 0x7fc190153d10 2023-03-30T19:35:29.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.321+0000 7fc19646f700 1 -- 172.21.15.87:0/2737785856 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1900b8750 con 0x7fc190153d10 2023-03-30T19:35:29.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.321+0000 7fc19646f700 1 -- 172.21.15.87:0/2737785856 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc190072cf0 con 0x7fc190153d10 2023-03-30T19:35:29.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.329+0000 7fc185ffb700 1 -- 172.21.15.87:0/2737785856 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc180007450 con 0x7fc190153d10 2023-03-30T19:35:29.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.333+0000 7fc185ffb700 1 --2- 172.21.15.87:0/2737785856 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc1740653f0 0x7fc1740678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.333+0000 7fc185ffb700 1 -- 172.21.15.87:0/2737785856 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc1800822f0 con 0x7fc190153d10 2023-03-30T19:35:29.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.333+0000 7fc19546d700 1 --2- 172.21.15.87:0/2737785856 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc1740653f0 0x7fc1740678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.333+0000 7fc19546d700 1 --2- 172.21.15.87:0/2737785856 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc1740653f0 0x7fc1740678a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009bd0 tx=0x7fc18c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:29.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.337+0000 7fc185ffb700 1 -- 172.21.15.87:0/2737785856 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fc18004fe60 con 0x7fc190153d10 2023-03-30T19:35:29.658 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.653+0000 7fc19646f700 1 -- 172.21.15.87:0/2737785856 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc19015d6c0 con 0x7fc190153d10 2023-03-30T19:35:29.679 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.673+0000 7fc185ffb700 1 -- 172.21.15.87:0/2737785856 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4671 (secure 0 0 0) 0x7fc180053480 con 0x7fc190153d10 2023-03-30T19:35:29.683 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:29.683 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4958,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/474261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":474261391},{"type":"v1","addr":"172.21.15.115:6833","nonce":474261391}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/2626542689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2626542689},{"type":"v1","addr":"172.21.15.87:6836","nonce":2626542689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3981806958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3981806958},{"type":"v1","addr":"172.21.15.87:6837","nonce":3981806958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-30T08:12:16.963002+0000","modified":"2023-03-30T08:12:20.012842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6835/450554084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":450554084},{"type":"v1","addr":"172.21.15.115:6835","nonce":450554084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-30T19:35:29.687 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.681+0000 7fc19646f700 1 -- 172.21.15.87:0/2737785856 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc1740653f0 msgr2=0x7fc1740678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:29.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.681+0000 7fc19646f700 1 --2- 172.21.15.87:0/2737785856 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc1740653f0 0x7fc1740678a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009bd0 tx=0x7fc18c008040 comp rx=0 tx=0).stop 2023-03-30T19:35:29.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.681+0000 7fc19646f700 1 -- 172.21.15.87:0/2737785856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc190153d10 msgr2=0x7fc19015ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:29.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.681+0000 7fc19646f700 1 --2- 172.21.15.87:0/2737785856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc190153d10 0x7fc19015ab80 secure :-1 s=READY pgs=3303 cs=0 l=1 rev1=1 crypto rx=0x7fc18000ca70 tx=0x7fc18000ce30 comp rx=0 tx=0).stop 2023-03-30T19:35:29.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.681+0000 7fc19646f700 1 -- 172.21.15.87:0/2737785856 shutdown_connections 2023-03-30T19:35:29.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.681+0000 7fc19646f700 1 --2- 172.21.15.87:0/2737785856 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fc1740653f0 0x7fc1740678a0 secure :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009bd0 tx=0x7fc18c008040 comp rx=0 tx=0).stop 2023-03-30T19:35:29.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.681+0000 7fc19646f700 1 --2- 172.21.15.87:0/2737785856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1901576d0 0x7fc19015b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.688 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.681+0000 7fc19646f700 1 --2- 172.21.15.87:0/2737785856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc190153d10 0x7fc19015ab80 unknown :-1 s=CLOSED pgs=3303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.681+0000 7fc19646f700 1 --2- 172.21.15.87:0/2737785856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc17c004db0 0x7fc1900d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.681+0000 7fc19646f700 1 -- 172.21.15.87:0/2737785856 >> 172.21.15.87:0/2737785856 conn(0x7fc1900b53f0 msgr2=0x7fc1900b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:29.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.685+0000 7fc19646f700 1 -- 172.21.15.87:0/2737785856 shutdown_connections 2023-03-30T19:35:29.689 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.685+0000 7fc19646f700 1 -- 172.21.15.87:0/2737785856 wait complete. 2023-03-30T19:35:29.690 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 17 2023-03-30T19:35:29.710 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T19:35:29.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe156e6700 1 Processor -- start 2023-03-30T19:35:29.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe156e6700 1 -- start start 2023-03-30T19:35:29.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe156e6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe1006a3e0 0x7fbe1015c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe156e6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1006c790 con 0x7fbe1015c340 2023-03-30T19:35:29.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe156e6700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe100c9ee0 con 0x7fbe100adc30 2023-03-30T19:35:29.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe156e6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100ac790 con 0x7fbe1006a3e0 2023-03-30T19:35:29.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe0effd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbe1015c340 0x7fbe100ac080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34228/0 (socket says 172.21.15.87:34228) 2023-03-30T19:35:29.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe0effd700 1 -- 172.21.15.87:0/1314980037 learned_addr learned my addr 172.21.15.87:0/1314980037 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:29.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe0f7fe700 1 --2- 172.21.15.87:0/1314980037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe1006a3e0 0x7fbe1015c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142067253 0 0) 0x7fbe1006c790 con 0x7fbe1015c340 2023-03-30T19:35:29.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf80035d0 con 0x7fbe1015c340 2023-03-30T19:35:29.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744157179 0 0) 0x7fbe100c9ee0 con 0x7fbe100adc30 2023-03-30T19:35:29.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe1006c790 con 0x7fbe100adc30 2023-03-30T19:35:29.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 309154785 0 0) 0x7fbdf80035d0 con 0x7fbe1015c340 2023-03-30T19:35:29.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe1006a3e0 msgr2=0x7fbe1015c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:29.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe0dffb700 1 --2- 172.21.15.87:0/1314980037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe1006a3e0 0x7fbe1015c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 >> v1:172.21.15.115:6789/0 conn(0x7fbe100adc30 legacy=0x7fbe10069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:29.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe100ca180 con 0x7fbe1015c340 2023-03-30T19:35:29.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.897+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7fbe04001670 con 0x7fbe1015c340 2023-03-30T19:35:29.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 >> v1:172.21.15.87:6789/0 conn(0x7fbe1015c340 legacy=0x7fbe100ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:29.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0dffb700 1 --2- 172.21.15.87:0/1314980037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf8003be0 0x7fbdf8003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0dffb700 1 --2- 172.21.15.87:0/1314980037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdf8004870 0x7fbdf8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.907 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0dffb700 1 --2- 172.21.15.87:0/1314980037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf8005270 0x7fbdf800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.908 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100ac790 con 0x7fbdf8004870 2023-03-30T19:35:29.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf800c130 con 0x7fbdf8003be0 2023-03-30T19:35:29.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf800c2f0 con 0x7fbdf8005270 2023-03-30T19:35:29.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0f7fe700 1 --2- 172.21.15.87:0/1314980037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf8005270 0x7fbdf800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0effd700 1 --2- 172.21.15.87:0/1314980037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf8003be0 0x7fbdf8003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0e7fc700 1 --2- 172.21.15.87:0/1314980037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdf8004870 0x7fbdf8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0e7fc700 1 -- 172.21.15.87:0/1314980037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf8005270 msgr2=0x7fbdf800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:29.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0e7fc700 1 --2- 172.21.15.87:0/1314980037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf8005270 0x7fbdf800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0e7fc700 1 -- 172.21.15.87:0/1314980037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf8003be0 msgr2=0x7fbdf8003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:29.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0e7fc700 1 --2- 172.21.15.87:0/1314980037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbdf8003be0 0x7fbdf8003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0e7fc700 1 -- 172.21.15.87:0/1314980037 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80035d0 con 0x7fbdf8004870 2023-03-30T19:35:29.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0f7fe700 1 --2- 172.21.15.87:0/1314980037 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf8005270 0x7fbdf800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T19:35:29.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0e7fc700 1 --2- 172.21.15.87:0/1314980037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdf8004870 0x7fbdf8004ce0 secure :-1 s=READY pgs=3305 cs=0 l=1 rev1=1 crypto rx=0x7fbe00007fd0 tx=0x7fbdf80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd86cb8143456c0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:29.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00001450 con 0x7fbdf8004870 2023-03-30T19:35:29.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe000052f0 con 0x7fbdf8004870 2023-03-30T19:35:29.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe0dffb700 1 -- 172.21.15.87:0/1314980037 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00001d60 con 0x7fbdf8004870 2023-03-30T19:35:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe156e6700 1 -- 172.21.15.87:0/1314980037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdf8004870 msgr2=0x7fbdf8004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.901+0000 7fbe156e6700 1 --2- 172.21.15.87:0/1314980037 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbdf8004870 0x7fbdf8004ce0 secure :-1 s=READY pgs=3305 cs=0 l=1 rev1=1 crypto rx=0x7fbe00007fd0 tx=0x7fbdf80058a0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.905+0000 7fbe0f7fe700 1 -- 172.21.15.87:0/1314980037 reap_dead start 2023-03-30T19:35:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.905+0000 7fbe156e6700 1 -- 172.21.15.87:0/1314980037 shutdown_connections 2023-03-30T19:35:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.905+0000 7fbe156e6700 1 -- 172.21.15.87:0/1314980037 >> 172.21.15.87:0/1314980037 conn(0x7fbe100cf410 msgr2=0x7fbe100cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.905+0000 7fbe156e6700 1 -- 172.21.15.87:0/1314980037 shutdown_connections 2023-03-30T19:35:29.912 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.905+0000 7fbe156e6700 1 -- 172.21.15.87:0/1314980037 wait complete. 2023-03-30T19:35:29.913 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.905+0000 7fbe156e6700 1 Processor -- start 2023-03-30T19:35:29.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.905+0000 7fbe156e6700 1 -- start start 2023-03-30T19:35:29.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe156e6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf8004870 0x7fbe10159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe156e6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe1015a2b0 0x7fbe101f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe156e6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe101f2450 0x7fbe100cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe0e7fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe1015a2b0 0x7fbe101f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe0e7fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe1015a2b0 0x7fbe101f1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:53996/0 (socket says 172.21.15.87:53996) 2023-03-30T19:35:29.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe0e7fc700 1 -- 172.21.15.87:0/2632306378 learned_addr learned my addr 172.21.15.87:0/2632306378 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:29.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe156e6700 1 -- 172.21.15.87:0/2632306378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe101595f0 con 0x7fbe1015a2b0 2023-03-30T19:35:29.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe156e6700 1 -- 172.21.15.87:0/2632306378 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe10158550 con 0x7fbe101f2450 2023-03-30T19:35:29.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe156e6700 1 -- 172.21.15.87:0/2632306378 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe10158830 con 0x7fbdf8004870 2023-03-30T19:35:29.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe0effd700 1 --2- 172.21.15.87:0/2632306378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf8004870 0x7fbe10159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe0f7fe700 1 --2- 172.21.15.87:0/2632306378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe101f2450 0x7fbe100cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe0e7fc700 1 -- 172.21.15.87:0/2632306378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf8004870 msgr2=0x7fbe10159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:29.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe0e7fc700 1 --2- 172.21.15.87:0/2632306378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf8004870 0x7fbe10159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe0e7fc700 1 -- 172.21.15.87:0/2632306378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe101f2450 msgr2=0x7fbe100cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:29.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe0e7fc700 1 --2- 172.21.15.87:0/2632306378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe101f2450 0x7fbe100cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:29.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe0e7fc700 1 -- 172.21.15.87:0/2632306378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1006c420 con 0x7fbe1015a2b0 2023-03-30T19:35:29.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe0e7fc700 1 --2- 172.21.15.87:0/2632306378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe1015a2b0 0x7fbe101f1f10 secure :-1 s=READY pgs=3306 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000c3c0 tx=0x7fbe000012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:29.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbdf77fe700 1 -- 172.21.15.87:0/2632306378 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00006a80 con 0x7fbe1015a2b0 2023-03-30T19:35:29.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbdf77fe700 1 -- 172.21.15.87:0/2632306378 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe00006be0 con 0x7fbe1015a2b0 2023-03-30T19:35:29.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbdf77fe700 1 -- 172.21.15.87:0/2632306378 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00007040 con 0x7fbe1015a2b0 2023-03-30T19:35:29.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe156e6700 1 -- 172.21.15.87:0/2632306378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe100ca460 con 0x7fbe1015a2b0 2023-03-30T19:35:29.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.909+0000 7fbe156e6700 1 -- 172.21.15.87:0/2632306378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1015c710 con 0x7fbe1015a2b0 2023-03-30T19:35:29.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.913+0000 7fbe156e6700 1 -- 172.21.15.87:0/2632306378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe100733a0 con 0x7fbe1015a2b0 2023-03-30T19:35:29.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.913+0000 7fbdf77fe700 1 -- 172.21.15.87:0/2632306378 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fbe000071a0 con 0x7fbe1015a2b0 2023-03-30T19:35:29.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.913+0000 7fbdf77fe700 1 --2- 172.21.15.87:0/2632306378 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbdfc065420 0x7fbdfc0678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:29.921 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.917+0000 7fbe0effd700 1 --2- 172.21.15.87:0/2632306378 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbdfc065420 0x7fbdfc0678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:29.922 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.917+0000 7fbe0effd700 1 --2- 172.21.15.87:0/2632306378 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbdfc065420 0x7fbdfc0678d0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fbe04001eb0 tx=0x7fbe04001e20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:30.000 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:29.997+0000 7fbdf77fe700 1 -- 172.21.15.87:0/2632306378 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fbe0005cec0 con 0x7fbe1015a2b0 2023-03-30T19:35:30.009 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.005+0000 7fbdf77fe700 1 -- 172.21.15.87:0/2632306378 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fbe00051170 con 0x7fbe1015a2b0 2023-03-30T19:35:30.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.265+0000 7fbe156e6700 1 -- 172.21.15.87:0/2632306378 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe100cbd40 con 0x7fbe1015a2b0 2023-03-30T19:35:30.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.269+0000 7fbdf77fe700 1 -- 172.21.15.87:0/2632306378 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+18123 (secure 0 0 0) 0x7fbe00054790 con 0x7fbe1015a2b0 2023-03-30T19:35:30.273 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:30.274 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":45,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:12:40.165947+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:12:14.871645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-03-30T08:12:15.991480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":4}]},{"pgid":"7.2a","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T19:35:30.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.273+0000 7fbe156e6700 1 -- 172.21.15.87:0/2632306378 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbdfc065420 msgr2=0x7fbdfc0678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:30.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.273+0000 7fbe156e6700 1 --2- 172.21.15.87:0/2632306378 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbdfc065420 0x7fbdfc0678d0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fbe04001eb0 tx=0x7fbe04001e20 comp rx=0 tx=0).stop 2023-03-30T19:35:30.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.273+0000 7fbe156e6700 1 -- 172.21.15.87:0/2632306378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe1015a2b0 msgr2=0x7fbe101f1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:30.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.273+0000 7fbe156e6700 1 --2- 172.21.15.87:0/2632306378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe1015a2b0 0x7fbe101f1f10 secure :-1 s=READY pgs=3306 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000c3c0 tx=0x7fbe000012d0 comp rx=0 tx=0).stop 2023-03-30T19:35:30.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.273+0000 7fbe156e6700 1 -- 172.21.15.87:0/2632306378 shutdown_connections 2023-03-30T19:35:30.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.273+0000 7fbe156e6700 1 --2- 172.21.15.87:0/2632306378 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbdfc065420 0x7fbdfc0678d0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:30.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.273+0000 7fbe156e6700 1 --2- 172.21.15.87:0/2632306378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe101f2450 0x7fbe100cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:30.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.273+0000 7fbe156e6700 1 --2- 172.21.15.87:0/2632306378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbe1015a2b0 0x7fbe101f1f10 unknown :-1 s=CLOSED pgs=3306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:30.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.273+0000 7fbe156e6700 1 --2- 172.21.15.87:0/2632306378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbdf8004870 0x7fbe10159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:30.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.273+0000 7fbe156e6700 1 -- 172.21.15.87:0/2632306378 >> 172.21.15.87:0/2632306378 conn(0x7fbe100cf410 msgr2=0x7fbe1006ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:30.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.273+0000 7fbe156e6700 1 -- 172.21.15.87:0/2632306378 shutdown_connections 2023-03-30T19:35:30.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.273+0000 7fbe156e6700 1 -- 172.21.15.87:0/2632306378 wait complete. 2023-03-30T19:35:30.301 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-30T08:10:43.966262+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-30T08:10:51.233222+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-30T08:12:14.871645+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-03-30T08:12:15.991480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-30T19:35:30.302 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-30T19:35:30.490 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.485+0000 7f632d606700 1 Processor -- start 2023-03-30T19:35:30.491 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.485+0000 7f632d606700 1 -- start start 2023-03-30T19:35:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.489+0000 7f632d606700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63280b8380 0x7f63280d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.489+0000 7f632d606700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f63280d27e0 0x7f6328069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:30.492 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.489+0000 7f632d606700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6328160ef0 con 0x7f63281609f0 2023-03-30T19:35:30.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.489+0000 7f632d606700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63280cd6a0 con 0x7f63280d27e0 2023-03-30T19:35:30.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.489+0000 7f632d606700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63280cd3a0 con 0x7f63280b8380 2023-03-30T19:35:30.493 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.489+0000 7f63277fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f63280d27e0 0x7f6328069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:30.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.489+0000 7f63277fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f63280d27e0 0x7f6328069cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54000/0 (socket says 172.21.15.87:54000) 2023-03-30T19:35:30.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.489+0000 7f63277fe700 1 -- 172.21.15.87:0/1674766230 learned_addr learned my addr 172.21.15.87:0/1674766230 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:30.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.489+0000 7f6327fff700 1 --2- 172.21.15.87:0/1674766230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63280b8380 0x7f63280d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:30.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.489+0000 7f63277fe700 1 -- 172.21.15.87:0/1674766230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63280b8380 msgr2=0x7f63280d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:30.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.489+0000 7f63277fe700 1 --2- 172.21.15.87:0/1674766230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63280b8380 0x7f63280d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:30.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.489+0000 7f63277fe700 1 -- 172.21.15.87:0/1674766230 >> v1:172.21.15.115:6789/0 conn(0x7f63281609f0 legacy=0x7f632806b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:30.494 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.489+0000 7f63277fe700 1 -- 172.21.15.87:0/1674766230 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63280cef00 con 0x7f63280d27e0 2023-03-30T19:35:30.495 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.489+0000 7f63277fe700 1 --2- 172.21.15.87:0/1674766230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63280d27e0 0x7f6328069cd0 secure :-1 s=READY pgs=3307 cs=0 l=1 rev1=1 crypto rx=0x7f6318009910 tx=0x7f6318009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba8f6ceb5261285 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:30.499 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.493+0000 7f6326ffd700 1 -- 172.21.15.87:0/1674766230 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318004230 con 0x7f63280d27e0 2023-03-30T19:35:30.499 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.493+0000 7f6326ffd700 1 -- 172.21.15.87:0/1674766230 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6318004390 con 0x7f63280d27e0 2023-03-30T19:35:30.499 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.493+0000 7f6326ffd700 1 -- 172.21.15.87:0/1674766230 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318009e60 con 0x7f63280d27e0 2023-03-30T19:35:30.499 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.493+0000 7f632d606700 1 -- 172.21.15.87:0/1674766230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63280d27e0 msgr2=0x7f6328069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:30.499 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.493+0000 7f632d606700 1 --2- 172.21.15.87:0/1674766230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63280d27e0 0x7f6328069cd0 secure :-1 s=READY pgs=3307 cs=0 l=1 rev1=1 crypto rx=0x7f6318009910 tx=0x7f6318009c20 comp rx=0 tx=0).stop 2023-03-30T19:35:30.500 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.493+0000 7f632d606700 1 -- 172.21.15.87:0/1674766230 shutdown_connections 2023-03-30T19:35:30.500 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.493+0000 7f632d606700 1 --2- 172.21.15.87:0/1674766230 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63280d27e0 0x7f6328069cd0 unknown :-1 s=CLOSED pgs=3307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:30.500 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.493+0000 7f632d606700 1 --2- 172.21.15.87:0/1674766230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63280b8380 0x7f63280d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:30.500 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.493+0000 7f632d606700 1 -- 172.21.15.87:0/1674766230 >> 172.21.15.87:0/1674766230 conn(0x7f63280b53f0 msgr2=0x7f63280cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:30.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.493+0000 7f632d606700 1 -- 172.21.15.87:0/1674766230 shutdown_connections 2023-03-30T19:35:30.501 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.493+0000 7f632d606700 1 -- 172.21.15.87:0/1674766230 wait complete. 2023-03-30T19:35:30.502 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.497+0000 7f632d606700 1 Processor -- start 2023-03-30T19:35:30.503 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.497+0000 7f632d606700 1 -- start start 2023-03-30T19:35:30.505 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f632d606700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63280b8380 0x7f63281f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:30.505 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f632d606700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63281609f0 0x7f63280c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:30.505 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f632d606700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f632815e390 0x7f63281f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:30.506 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f63277fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63281609f0 0x7f63280c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:30.506 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f63277fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63281609f0 0x7f63280c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54002/0 (socket says 172.21.15.87:54002) 2023-03-30T19:35:30.506 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f63277fe700 1 -- 172.21.15.87:0/150306452 learned_addr learned my addr 172.21.15.87:0/150306452 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:30.506 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f632ce05700 1 --2- 172.21.15.87:0/150306452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f632815e390 0x7f63281f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:30.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f632d606700 1 -- 172.21.15.87:0/150306452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280c7bd0 con 0x7f63281609f0 2023-03-30T19:35:30.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f632d606700 1 -- 172.21.15.87:0/150306452 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280c8430 con 0x7f63280b8380 2023-03-30T19:35:30.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f632d606700 1 -- 172.21.15.87:0/150306452 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63281f5a80 con 0x7f632815e390 2023-03-30T19:35:30.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f6327fff700 1 --2- 172.21.15.87:0/150306452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63280b8380 0x7f63281f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:30.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f63277fe700 1 -- 172.21.15.87:0/150306452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f632815e390 msgr2=0x7f63281f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f63277fe700 1 --2- 172.21.15.87:0/150306452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f632815e390 0x7f63281f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f63277fe700 1 -- 172.21.15.87:0/150306452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63280b8380 msgr2=0x7f63281f54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f63277fe700 1 --2- 172.21.15.87:0/150306452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63280b8380 0x7f63281f54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.501+0000 7f63277fe700 1 -- 172.21.15.87:0/150306452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6318009570 con 0x7f63281609f0 2023-03-30T19:35:30.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.513+0000 7f63277fe700 1 --2- 172.21.15.87:0/150306452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63281609f0 0x7f63280c7ef0 secure :-1 s=READY pgs=3308 cs=0 l=1 rev1=1 crypto rx=0x7f6318000c00 tx=0x7f6318004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:30.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.513+0000 7f6324ff9700 1 -- 172.21.15.87:0/150306452 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631800bd00 con 0x7f63281609f0 2023-03-30T19:35:30.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.513+0000 7f6324ff9700 1 -- 172.21.15.87:0/150306452 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631801f070 con 0x7f63281609f0 2023-03-30T19:35:30.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.513+0000 7f6324ff9700 1 -- 172.21.15.87:0/150306452 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318003900 con 0x7f63281609f0 2023-03-30T19:35:30.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.513+0000 7f632d606700 1 -- 172.21.15.87:0/150306452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63280cf480 con 0x7f63281609f0 2023-03-30T19:35:30.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.513+0000 7f632d606700 1 -- 172.21.15.87:0/150306452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63280cf1a0 con 0x7f63281609f0 2023-03-30T19:35:30.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.513+0000 7f632d606700 1 -- 172.21.15.87:0/150306452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63280b8750 con 0x7f63281609f0 2023-03-30T19:35:30.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.525+0000 7f6324ff9700 1 -- 172.21.15.87:0/150306452 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6318021030 con 0x7f63281609f0 2023-03-30T19:35:30.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.525+0000 7f6324ff9700 1 --2- 172.21.15.87:0/150306452 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f63080653f0 0x7f63080678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:30.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.525+0000 7f6324ff9700 1 -- 172.21.15.87:0/150306452 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f63180842f0 con 0x7f63281609f0 2023-03-30T19:35:30.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.529+0000 7f6327fff700 1 --2- 172.21.15.87:0/150306452 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f63080653f0 0x7f63080678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:30.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.529+0000 7f6327fff700 1 --2- 172.21.15.87:0/150306452 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f63080653f0 0x7f63080678a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f63280b7ad0 tx=0x7f6310008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:30.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.529+0000 7f6324ff9700 1 -- 172.21.15.87:0/150306452 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f6318051e60 con 0x7f63281609f0 2023-03-30T19:35:30.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.793+0000 7f632d606700 1 -- 172.21.15.87:0/150306452 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f63280b8750 con 0x7f63281609f0 2023-03-30T19:35:30.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.793+0000 7f6324ff9700 1 -- 172.21.15.87:0/150306452 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6318055480 con 0x7f63281609f0 2023-03-30T19:35:30.800 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2023-03-30T19:35:30.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.797+0000 7f632d606700 1 -- 172.21.15.87:0/150306452 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f63080653f0 msgr2=0x7f63080678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:30.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.797+0000 7f632d606700 1 --2- 172.21.15.87:0/150306452 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f63080653f0 0x7f63080678a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f63280b7ad0 tx=0x7f6310008040 comp rx=0 tx=0).stop 2023-03-30T19:35:30.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.797+0000 7f632d606700 1 -- 172.21.15.87:0/150306452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63281609f0 msgr2=0x7f63280c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:30.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.797+0000 7f632d606700 1 --2- 172.21.15.87:0/150306452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63281609f0 0x7f63280c7ef0 secure :-1 s=READY pgs=3308 cs=0 l=1 rev1=1 crypto rx=0x7f6318000c00 tx=0x7f6318004770 comp rx=0 tx=0).stop 2023-03-30T19:35:30.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.801+0000 7f632d606700 1 -- 172.21.15.87:0/150306452 shutdown_connections 2023-03-30T19:35:30.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.801+0000 7f632d606700 1 --2- 172.21.15.87:0/150306452 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f63080653f0 0x7f63080678a0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:30.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.801+0000 7f632d606700 1 --2- 172.21.15.87:0/150306452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f632815e390 0x7f63281f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:30.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.801+0000 7f632d606700 1 --2- 172.21.15.87:0/150306452 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63281609f0 0x7f63280c7ef0 secure :-1 s=CLOSED pgs=3308 cs=0 l=1 rev1=1 crypto rx=0x7f6318000c00 tx=0x7f6318004770 comp rx=0 tx=0).stop 2023-03-30T19:35:30.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.801+0000 7f632d606700 1 --2- 172.21.15.87:0/150306452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63280b8380 0x7f63281f54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:30.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.801+0000 7f632d606700 1 -- 172.21.15.87:0/150306452 >> 172.21.15.87:0/150306452 conn(0x7f63280b53f0 msgr2=0x7f63280b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:30.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.801+0000 7f632d606700 1 -- 172.21.15.87:0/150306452 shutdown_connections 2023-03-30T19:35:30.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:30.801+0000 7f632d606700 1 -- 172.21.15.87:0/150306452 wait complete. 2023-03-30T19:35:30.827 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-30T19:35:31.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.009+0000 7fbbcd20f700 1 Processor -- start 2023-03-30T19:35:31.013 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.009+0000 7fbbcd20f700 1 -- start start 2023-03-30T19:35:31.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.009+0000 7fbbcd20f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbc0038560 0x7fbbc003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:31.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.009+0000 7fbbcd20f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc0007360 con 0x7fbbc003b160 2023-03-30T19:35:31.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.009+0000 7fbbcd20f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc0053f70 con 0x7fbbc00e29f0 2023-03-30T19:35:31.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.009+0000 7fbbcd20f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc003b600 con 0x7fbbc0038560 2023-03-30T19:35:31.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.009+0000 7fbbcca0e700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fbbc003b160 0x7fbbc0057210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34232/0 (socket says 172.21.15.87:34232) 2023-03-30T19:35:31.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.009+0000 7fbbcca0e700 1 -- 172.21.15.87:0/3394030333 learned_addr learned my addr 172.21.15.87:0/3394030333 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:31.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.009+0000 7fbbc7fff700 1 --1- 172.21.15.87:0/3394030333 >> v1:172.21.15.115:6789/0 conn(0x7fbbc00e29f0 0x7fbbc0055490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:50306/0 (socket says 172.21.15.87:50306) 2023-03-30T19:35:31.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.009+0000 7fbbc77fe700 1 --2- 172.21.15.87:0/3394030333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbc0038560 0x7fbbc003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:31.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.009+0000 7fbbc6ffd700 1 -- 172.21.15.87:0/3394030333 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542788102 0 0) 0x7fbbc0007360 con 0x7fbbc003b160 2023-03-30T19:35:31.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.009+0000 7fbbc6ffd700 1 -- 172.21.15.87:0/3394030333 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb80035d0 con 0x7fbbc003b160 2023-03-30T19:35:31.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.009+0000 7fbbc6ffd700 1 -- 172.21.15.87:0/3394030333 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354270838 0 0) 0x7fbbc0053f70 con 0x7fbbc00e29f0 2023-03-30T19:35:31.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.013+0000 7fbbc6ffd700 1 -- 172.21.15.87:0/3394030333 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc0007360 con 0x7fbbc00e29f0 2023-03-30T19:35:31.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.013+0000 7fbbc77fe700 1 -- 172.21.15.87:0/3394030333 >> v1:172.21.15.115:6789/0 conn(0x7fbbc00e29f0 legacy=0x7fbbc0055490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:31.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.013+0000 7fbbc77fe700 1 -- 172.21.15.87:0/3394030333 >> v1:172.21.15.87:6789/0 conn(0x7fbbc003b160 legacy=0x7fbbc0057210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:31.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.013+0000 7fbbc77fe700 1 -- 172.21.15.87:0/3394030333 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc0006dc0 con 0x7fbbc0038560 2023-03-30T19:35:31.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.013+0000 7fbbc77fe700 1 --2- 172.21.15.87:0/3394030333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbc0038560 0x7fbbc003ac20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009880 tx=0x7fbbb4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=218806824ca99dd server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:31.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.013+0000 7fbbc6ffd700 1 -- 172.21.15.87:0/3394030333 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4011830 con 0x7fbbc0038560 2023-03-30T19:35:31.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.013+0000 7fbbc6ffd700 1 -- 172.21.15.87:0/3394030333 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb4011990 con 0x7fbbc0038560 2023-03-30T19:35:31.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.013+0000 7fbbc6ffd700 1 -- 172.21.15.87:0/3394030333 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4011d20 con 0x7fbbc0038560 2023-03-30T19:35:31.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.013+0000 7fbbcd20f700 1 -- 172.21.15.87:0/3394030333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbc0038560 msgr2=0x7fbbc003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:31.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.013+0000 7fbbcd20f700 1 --2- 172.21.15.87:0/3394030333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbc0038560 0x7fbbc003ac20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009880 tx=0x7fbbb4009b90 comp rx=0 tx=0).stop 2023-03-30T19:35:31.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.013+0000 7fbbcd20f700 1 -- 172.21.15.87:0/3394030333 shutdown_connections 2023-03-30T19:35:31.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.013+0000 7fbbcd20f700 1 --2- 172.21.15.87:0/3394030333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbc0038560 0x7fbbc003ac20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:31.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.013+0000 7fbbcd20f700 1 -- 172.21.15.87:0/3394030333 >> 172.21.15.87:0/3394030333 conn(0x7fbbc0055c20 msgr2=0x7fbbc0056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:31.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.013+0000 7fbbcd20f700 1 -- 172.21.15.87:0/3394030333 shutdown_connections 2023-03-30T19:35:31.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.013+0000 7fbbcd20f700 1 -- 172.21.15.87:0/3394030333 wait complete. 2023-03-30T19:35:31.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.017+0000 7fbbcd20f700 1 Processor -- start 2023-03-30T19:35:31.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.017+0000 7fbbcd20f700 1 -- start start 2023-03-30T19:35:31.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.017+0000 7fbbcd20f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc0038560 0x7fbbc00dc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:31.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.017+0000 7fbbcd20f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbc003b160 0x7fbbc00e0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:31.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.017+0000 7fbbcd20f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc00e29f0 0x7fbbc0057110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:31.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.017+0000 7fbbcd20f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc00dcbb0 con 0x7fbbc00e29f0 2023-03-30T19:35:31.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.017+0000 7fbbcd20f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc00e1550 con 0x7fbbc0038560 2023-03-30T19:35:31.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.017+0000 7fbbcd20f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc00e1830 con 0x7fbbc003b160 2023-03-30T19:35:31.023 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.017+0000 7fbbc7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc0038560 0x7fbbc00dc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:31.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.017+0000 7fbbc7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc0038560 0x7fbbc00dc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:39352/0 (socket says 172.21.15.87:39352) 2023-03-30T19:35:31.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.017+0000 7fbbc7fff700 1 -- 172.21.15.87:0/3758370608 learned_addr learned my addr 172.21.15.87:0/3758370608 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:31.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.021+0000 7fbbc7fff700 1 -- 172.21.15.87:0/3758370608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbc003b160 msgr2=0x7fbbc00e0c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-30T19:35:31.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.021+0000 7fbbc7fff700 1 --2- 172.21.15.87:0/3758370608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbc003b160 0x7fbbc00e0c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:31.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.021+0000 7fbbc7fff700 1 -- 172.21.15.87:0/3758370608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc00e29f0 msgr2=0x7fbbc0057110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:31.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.021+0000 7fbbc7fff700 1 --2- 172.21.15.87:0/3758370608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc00e29f0 0x7fbbc0057110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:31.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.021+0000 7fbbc7fff700 1 -- 172.21.15.87:0/3758370608 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb40094b0 con 0x7fbbc0038560 2023-03-30T19:35:31.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.021+0000 7fbbc7fff700 1 --2- 172.21.15.87:0/3758370608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc0038560 0x7fbbc00dc670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc00c4d0 tx=0x7fbbbc00c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:31.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.021+0000 7fbbc4ff9700 1 -- 172.21.15.87:0/3758370608 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc005cd0 con 0x7fbbc0038560 2023-03-30T19:35:31.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.021+0000 7fbbcd20f700 1 -- 172.21.15.87:0/3758370608 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc0053920 con 0x7fbbc0038560 2023-03-30T19:35:31.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.021+0000 7fbbcd20f700 1 -- 172.21.15.87:0/3758370608 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc0007080 con 0x7fbbc0038560 2023-03-30T19:35:31.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.021+0000 7fbbc4ff9700 1 -- 172.21.15.87:0/3758370608 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc005e30 con 0x7fbbc0038560 2023-03-30T19:35:31.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.021+0000 7fbbc4ff9700 1 -- 172.21.15.87:0/3758370608 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc0072f0 con 0x7fbbc0038560 2023-03-30T19:35:31.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:31.021+0000 7fbbcd20f700 1 -- 172.21.15.87:0/3758370608 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc0053c00 con 0x7fbbc0038560 2023-03-30T19:35:32.516 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:32.513+0000 7fbbc4ff9700 1 -- 172.21.15.87:0/3758370608 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fbbbc007450 con 0x7fbbc0038560 2023-03-30T19:35:32.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:32.513+0000 7fbbc4ff9700 1 --2- 172.21.15.87:0/3758370608 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbbac065440 0x7fbbac0678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:32.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:32.513+0000 7fbbc4ff9700 1 -- 172.21.15.87:0/3758370608 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fbbbc082430 con 0x7fbbc0038560 2023-03-30T19:35:32.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:32.513+0000 7fbbc77fe700 1 --2- 172.21.15.87:0/3758370608 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbbac065440 0x7fbbac0678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:32.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:32.513+0000 7fbbc77fe700 1 --2- 172.21.15.87:0/3758370608 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbbac065440 0x7fbbac0678f0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0038930 tx=0x7fbbb4010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:34.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:34.513+0000 7fbbc4ff9700 1 -- 172.21.15.87:0/3758370608 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fbbbc04ff10 con 0x7fbbc0038560 2023-03-30T19:35:34.788 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:34.781+0000 7fbbcd20f700 1 -- 172.21.15.87:0/3758370608 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbbc0005570 con 0x7fbbc0038560 2023-03-30T19:35:34.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:34.813+0000 7fbbc4ff9700 1 -- 172.21.15.87:0/3758370608 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbbbc017070 con 0x7fbbc0038560 2023-03-30T19:35:34.822 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2023-03-30T19:35:34.823 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:34.817+0000 7fbbcd20f700 1 -- 172.21.15.87:0/3758370608 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbbac065440 msgr2=0x7fbbac0678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:34.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:34.817+0000 7fbbcd20f700 1 --2- 172.21.15.87:0/3758370608 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbbac065440 0x7fbbac0678f0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0038930 tx=0x7fbbb4010000 comp rx=0 tx=0).stop 2023-03-30T19:35:34.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:34.817+0000 7fbbcd20f700 1 -- 172.21.15.87:0/3758370608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc0038560 msgr2=0x7fbbc00dc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:34.824 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:34.817+0000 7fbbcd20f700 1 --2- 172.21.15.87:0/3758370608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc0038560 0x7fbbc00dc670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc00c4d0 tx=0x7fbbbc00c890 comp rx=0 tx=0).stop 2023-03-30T19:35:34.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:34.821+0000 7fbbcd20f700 1 -- 172.21.15.87:0/3758370608 shutdown_connections 2023-03-30T19:35:34.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:34.821+0000 7fbbcd20f700 1 --2- 172.21.15.87:0/3758370608 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fbbac065440 0x7fbbac0678f0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:34.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:34.821+0000 7fbbcd20f700 1 --2- 172.21.15.87:0/3758370608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbbc00e29f0 0x7fbbc0057110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:34.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:34.821+0000 7fbbcd20f700 1 --2- 172.21.15.87:0/3758370608 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbbc003b160 0x7fbbc00e0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:34.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:34.821+0000 7fbbcd20f700 1 --2- 172.21.15.87:0/3758370608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbc0038560 0x7fbbc00dc670 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:34.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:34.821+0000 7fbbcd20f700 1 -- 172.21.15.87:0/3758370608 >> 172.21.15.87:0/3758370608 conn(0x7fbbc0055c20 msgr2=0x7fbbc00dcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:34.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:34.821+0000 7fbbcd20f700 1 -- 172.21.15.87:0/3758370608 shutdown_connections 2023-03-30T19:35:34.827 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:34.821+0000 7fbbcd20f700 1 -- 172.21.15.87:0/3758370608 wait complete. 2023-03-30T19:35:34.851 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-30T19:35:35.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.029+0000 7fd50dc68700 1 Processor -- start 2023-03-30T19:35:35.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.029+0000 7fd50dc68700 1 -- start start 2023-03-30T19:35:35.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.029+0000 7fd50dc68700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd508158bf0 0x7fd50815cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:35.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.029+0000 7fd50dc68700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50815d480 con 0x7fd5080cceb0 2023-03-30T19:35:35.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.029+0000 7fd50dc68700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50806c4f0 con 0x7fd508158820 2023-03-30T19:35:35.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.029+0000 7fd50dc68700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd50806c190 con 0x7fd508158bf0 2023-03-30T19:35:35.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.029+0000 7fd507fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd5080cceb0 0x7fd508070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34248/0 (socket says 172.21.15.87:34248) 2023-03-30T19:35:35.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.029+0000 7fd507fff700 1 -- 172.21.15.87:0/1727272598 learned_addr learned my addr 172.21.15.87:0/1727272598 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:35.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.029+0000 7fd506ffd700 1 --2- 172.21.15.87:0/1727272598 >> v2:172.21.15.115:3300/0 conn(0x7fd508158bf0 0x7fd50815cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:35.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.029+0000 7fd5067fc700 1 -- 172.21.15.87:0/1727272598 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509424977 0 0) 0x7fd500001490 con 0x7fd5080cceb0 2023-03-30T19:35:35.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.029+0000 7fd5067fc700 1 -- 172.21.15.87:0/1727272598 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4f00035d0 con 0x7fd5080cceb0 2023-03-30T19:35:35.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.029+0000 7fd506ffd700 1 -- 172.21.15.87:0/1727272598 >> v1:172.21.15.115:6789/0 conn(0x7fd508158820 legacy=0x7fd5080c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:35.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.029+0000 7fd506ffd700 1 -- 172.21.15.87:0/1727272598 >> v1:172.21.15.87:6789/0 conn(0x7fd5080cceb0 legacy=0x7fd508070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:35.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.029+0000 7fd506ffd700 1 -- 172.21.15.87:0/1727272598 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50806cd90 con 0x7fd508158bf0 2023-03-30T19:35:35.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.053+0000 7fd506ffd700 1 --2- 172.21.15.87:0/1727272598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508158bf0 0x7fd50815cf40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009850 tx=0x7fd4fc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7a80da975956f41 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:35.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.053+0000 7fd5067fc700 1 -- 172.21.15.87:0/1727272598 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc004230 con 0x7fd508158bf0 2023-03-30T19:35:35.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.053+0000 7fd5067fc700 1 -- 172.21.15.87:0/1727272598 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4fc004390 con 0x7fd508158bf0 2023-03-30T19:35:35.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.053+0000 7fd5067fc700 1 -- 172.21.15.87:0/1727272598 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc0036c0 con 0x7fd508158bf0 2023-03-30T19:35:35.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.053+0000 7fd50dc68700 1 -- 172.21.15.87:0/1727272598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508158bf0 msgr2=0x7fd50815cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:35.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.053+0000 7fd50dc68700 1 --2- 172.21.15.87:0/1727272598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508158bf0 0x7fd50815cf40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009850 tx=0x7fd4fc009b60 comp rx=0 tx=0).stop 2023-03-30T19:35:35.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.053+0000 7fd50dc68700 1 -- 172.21.15.87:0/1727272598 shutdown_connections 2023-03-30T19:35:35.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.053+0000 7fd50dc68700 1 --2- 172.21.15.87:0/1727272598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508158bf0 0x7fd50815cf40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.053+0000 7fd50dc68700 1 -- 172.21.15.87:0/1727272598 >> 172.21.15.87:0/1727272598 conn(0x7fd5080ce960 msgr2=0x7fd5080ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:35.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.053+0000 7fd50dc68700 1 -- 172.21.15.87:0/1727272598 shutdown_connections 2023-03-30T19:35:35.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.053+0000 7fd50dc68700 1 -- 172.21.15.87:0/1727272598 wait complete. 2023-03-30T19:35:35.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.057+0000 7fd50dc68700 1 Processor -- start 2023-03-30T19:35:35.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.057+0000 7fd50dc68700 1 -- start start 2023-03-30T19:35:35.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.057+0000 7fd50dc68700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5080cceb0 0x7fd508148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:35.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.057+0000 7fd50dc68700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd508158820 0x7fd5080afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:35.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.057+0000 7fd50dc68700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508158bf0 0x7fd50815b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:35.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.057+0000 7fd50dc68700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080c5a30 con 0x7fd508158820 2023-03-30T19:35:35.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.057+0000 7fd50dc68700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd508159d70 con 0x7fd508158bf0 2023-03-30T19:35:35.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.057+0000 7fd50dc68700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080af610 con 0x7fd5080cceb0 2023-03-30T19:35:35.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.057+0000 7fd506ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd508158820 0x7fd5080afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:35.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.057+0000 7fd506ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd508158820 0x7fd5080afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54022/0 (socket says 172.21.15.87:54022) 2023-03-30T19:35:35.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.057+0000 7fd506ffd700 1 -- 172.21.15.87:0/3572609939 learned_addr learned my addr 172.21.15.87:0/3572609939 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:35.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.057+0000 7fd507fff700 1 --2- 172.21.15.87:0/3572609939 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508158bf0 0x7fd50815b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:35.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.057+0000 7fd5077fe700 1 --2- 172.21.15.87:0/3572609939 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5080cceb0 0x7fd508148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:35.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.061+0000 7fd507fff700 1 -- 172.21.15.87:0/3572609939 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5080cceb0 msgr2=0x7fd508148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:35.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.061+0000 7fd507fff700 1 --2- 172.21.15.87:0/3572609939 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5080cceb0 0x7fd508148950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.061+0000 7fd507fff700 1 -- 172.21.15.87:0/3572609939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd508158820 msgr2=0x7fd5080afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:35.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.061+0000 7fd507fff700 1 --2- 172.21.15.87:0/3572609939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd508158820 0x7fd5080afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.061+0000 7fd507fff700 1 -- 172.21.15.87:0/3572609939 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc0094b0 con 0x7fd508158bf0 2023-03-30T19:35:35.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.061+0000 7fd507fff700 1 --2- 172.21.15.87:0/3572609939 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508158bf0 0x7fd50815b3d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd50000caa0 tx=0x7fd50000cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:35.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.061+0000 7fd4effff700 1 -- 172.21.15.87:0/3572609939 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500007480 con 0x7fd508158bf0 2023-03-30T19:35:35.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.061+0000 7fd4effff700 1 -- 172.21.15.87:0/3572609939 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5000075e0 con 0x7fd508158bf0 2023-03-30T19:35:35.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.061+0000 7fd4effff700 1 -- 172.21.15.87:0/3572609939 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500007970 con 0x7fd508158bf0 2023-03-30T19:35:35.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.061+0000 7fd50dc68700 1 -- 172.21.15.87:0/3572609939 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50806c740 con 0x7fd508158bf0 2023-03-30T19:35:35.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.061+0000 7fd50dc68700 1 -- 172.21.15.87:0/3572609939 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5080cd430 con 0x7fd508158bf0 2023-03-30T19:35:35.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.065+0000 7fd4effff700 1 -- 172.21.15.87:0/3572609939 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd5000113a0 con 0x7fd508158bf0 2023-03-30T19:35:35.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.065+0000 7fd50dc68700 1 -- 172.21.15.87:0/3572609939 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50806ca20 con 0x7fd508158bf0 2023-03-30T19:35:35.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.065+0000 7fd4effff700 1 --2- 172.21.15.87:0/3572609939 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4f4065420 0x7fd4f40678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:35.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.065+0000 7fd4effff700 1 -- 172.21.15.87:0/3572609939 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fd500081d90 con 0x7fd508158bf0 2023-03-30T19:35:35.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.065+0000 7fd5077fe700 1 --2- 172.21.15.87:0/3572609939 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4f4065420 0x7fd4f40678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:35.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.069+0000 7fd5077fe700 1 --2- 172.21.15.87:0/3572609939 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4f4065420 0x7fd4f40678d0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8007fd0 tx=0x7fd4f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:35.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.077+0000 7fd4effff700 1 -- 172.21.15.87:0/3572609939 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fd50004f820 con 0x7fd508158bf0 2023-03-30T19:35:35.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.333+0000 7fd50dc68700 1 -- 172.21.15.87:0/3572609939 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd50815d480 con 0x7fd508158bf0 2023-03-30T19:35:35.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.333+0000 7fd4effff700 1 -- 172.21.15.87:0/3572609939 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd500017020 con 0x7fd508158bf0 2023-03-30T19:35:35.340 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2023-03-30T19:35:35.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.341+0000 7fd50dc68700 1 -- 172.21.15.87:0/3572609939 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4f4065420 msgr2=0x7fd4f40678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:35.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.341+0000 7fd50dc68700 1 --2- 172.21.15.87:0/3572609939 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4f4065420 0x7fd4f40678d0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8007fd0 tx=0x7fd4f8009040 comp rx=0 tx=0).stop 2023-03-30T19:35:35.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.341+0000 7fd50dc68700 1 -- 172.21.15.87:0/3572609939 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508158bf0 msgr2=0x7fd50815b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:35.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.341+0000 7fd50dc68700 1 --2- 172.21.15.87:0/3572609939 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508158bf0 0x7fd50815b3d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd50000caa0 tx=0x7fd50000cad0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.341+0000 7fd50dc68700 1 -- 172.21.15.87:0/3572609939 shutdown_connections 2023-03-30T19:35:35.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.341+0000 7fd50dc68700 1 --2- 172.21.15.87:0/3572609939 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fd4f4065420 0x7fd4f40678d0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.341+0000 7fd50dc68700 1 --2- 172.21.15.87:0/3572609939 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508158bf0 0x7fd50815b3d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.341+0000 7fd50dc68700 1 --2- 172.21.15.87:0/3572609939 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd508158820 0x7fd5080afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.341+0000 7fd50dc68700 1 --2- 172.21.15.87:0/3572609939 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5080cceb0 0x7fd508148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.341+0000 7fd50dc68700 1 -- 172.21.15.87:0/3572609939 >> 172.21.15.87:0/3572609939 conn(0x7fd5080ce960 msgr2=0x7fd5080c9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:35.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.341+0000 7fd50dc68700 1 -- 172.21.15.87:0/3572609939 shutdown_connections 2023-03-30T19:35:35.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.341+0000 7fd50dc68700 1 -- 172.21.15.87:0/3572609939 wait complete. 2023-03-30T19:35:35.370 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-30T19:35:35.556 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12f59e700 1 Processor -- start 2023-03-30T19:35:35.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12f59e700 1 -- start start 2023-03-30T19:35:35.557 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12f59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa1300b8570 0x7fa130160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:35.558 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa13006a3e0 0x7fa1300d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:35.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12f59e700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1300d09f0 con 0x7fa1300ceeb0 2023-03-30T19:35:35.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12f59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1300cd240 con 0x7fa1300b8570 2023-03-30T19:35:35.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12f59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300cda50 con 0x7fa13006a3e0 2023-03-30T19:35:35.560 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12e59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa1300b8570 0x7fa130160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:35.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12dd9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fa1300ceeb0 0x7fa130069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:50324/0 (socket says 172.21.15.87:50324) 2023-03-30T19:35:35.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12dd9b700 1 -- 172.21.15.87:0/2294209059 learned_addr learned my addr 172.21.15.87:0/2294209059 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:35.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12e59c700 1 -- 172.21.15.87:0/2294209059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa13006a3e0 msgr2=0x7fa1300d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:35.561 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12e59c700 1 --2- 172.21.15.87:0/2294209059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa13006a3e0 0x7fa1300d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12e59c700 1 -- 172.21.15.87:0/2294209059 >> v1:172.21.15.115:6789/0 conn(0x7fa1300ceeb0 legacy=0x7fa130069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:35.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12e59c700 1 -- 172.21.15.87:0/2294209059 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1300cf300 con 0x7fa1300b8570 2023-03-30T19:35:35.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12d59a700 1 -- 172.21.15.87:0/2294209059 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100964909 0 0) 0x7fa1300d09f0 con 0x7fa1300ceeb0 2023-03-30T19:35:35.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12e59c700 1 --2- 172.21.15.87:0/2294209059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1300b8570 0x7fa130160930 secure :-1 s=READY pgs=3311 cs=0 l=1 rev1=1 crypto rx=0x7fa120009850 tx=0x7fa120009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8bad258dfd4fa1 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:35.562 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12d59a700 1 -- 172.21.15.87:0/2294209059 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120011830 con 0x7fa1300b8570 2023-03-30T19:35:35.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12d59a700 1 -- 172.21.15.87:0/2294209059 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa120011990 con 0x7fa1300b8570 2023-03-30T19:35:35.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.553+0000 7fa12d59a700 1 -- 172.21.15.87:0/2294209059 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120011d20 con 0x7fa1300b8570 2023-03-30T19:35:35.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.557+0000 7fa12f59e700 1 -- 172.21.15.87:0/2294209059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1300b8570 msgr2=0x7fa130160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:35.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.557+0000 7fa12f59e700 1 --2- 172.21.15.87:0/2294209059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1300b8570 0x7fa130160930 secure :-1 s=READY pgs=3311 cs=0 l=1 rev1=1 crypto rx=0x7fa120009850 tx=0x7fa120009b60 comp rx=0 tx=0).stop 2023-03-30T19:35:35.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.557+0000 7fa12f59e700 1 -- 172.21.15.87:0/2294209059 shutdown_connections 2023-03-30T19:35:35.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.557+0000 7fa12f59e700 1 --2- 172.21.15.87:0/2294209059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa13006a3e0 0x7fa1300d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.557+0000 7fa12f59e700 1 --2- 172.21.15.87:0/2294209059 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1300b8570 0x7fa130160930 unknown :-1 s=CLOSED pgs=3311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.565 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.557+0000 7fa12f59e700 1 -- 172.21.15.87:0/2294209059 >> 172.21.15.87:0/2294209059 conn(0x7fa1300b5320 msgr2=0x7fa1300cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:35.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.557+0000 7fa12f59e700 1 -- 172.21.15.87:0/2294209059 shutdown_connections 2023-03-30T19:35:35.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.557+0000 7fa12f59e700 1 -- 172.21.15.87:0/2294209059 wait complete. 2023-03-30T19:35:35.566 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.557+0000 7fa12f59e700 1 Processor -- start 2023-03-30T19:35:35.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.565+0000 7fa12f59e700 1 -- start start 2023-03-30T19:35:35.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.565+0000 7fa12f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa13006a3e0 0x7fa1300708a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:35.570 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.565+0000 7fa12f59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1300b8570 0x7fa130159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:35.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.565+0000 7fa12e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa13006a3e0 0x7fa1300708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:35.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.565+0000 7fa12e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa13006a3e0 0x7fa1300708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:39372/0 (socket says 172.21.15.87:39372) 2023-03-30T19:35:35.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.565+0000 7fa12dd9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1300b8570 0x7fa130159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:35.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.565+0000 7fa12dd9b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1300b8570 0x7fa130159e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54044/0 (socket says 172.21.15.87:54044) 2023-03-30T19:35:35.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.565+0000 7fa12e59c700 1 -- 172.21.15.87:0/1974013655 learned_addr learned my addr 172.21.15.87:0/1974013655 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:35.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.565+0000 7fa12f59e700 1 --2- 172.21.15.87:0/1974013655 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1300ceeb0 0x7fa13015e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:35.573 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.565+0000 7fa12f59e700 1 -- 172.21.15.87:0/1974013655 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13015f900 con 0x7fa1300b8570 2023-03-30T19:35:35.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.565+0000 7fa12f59e700 1 -- 172.21.15.87:0/1974013655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300ca960 con 0x7fa13006a3e0 2023-03-30T19:35:35.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.565+0000 7fa12f59e700 1 -- 172.21.15.87:0/1974013655 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13015f340 con 0x7fa1300ceeb0 2023-03-30T19:35:35.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.569+0000 7fa12dd9b700 1 -- 172.21.15.87:0/1974013655 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1300ceeb0 msgr2=0x7fa13015e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:35.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.569+0000 7fa12dd9b700 1 --2- 172.21.15.87:0/1974013655 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1300ceeb0 0x7fa13015e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.569+0000 7fa12dd9b700 1 -- 172.21.15.87:0/1974013655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa13006a3e0 msgr2=0x7fa1300708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:35.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.569+0000 7fa12dd9b700 1 --2- 172.21.15.87:0/1974013655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa13006a3e0 0x7fa1300708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.569+0000 7fa12dd9b700 1 -- 172.21.15.87:0/1974013655 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1200094b0 con 0x7fa1300b8570 2023-03-30T19:35:35.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.573+0000 7fa12dd9b700 1 --2- 172.21.15.87:0/1974013655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1300b8570 0x7fa130159e40 secure :-1 s=READY pgs=3312 cs=0 l=1 rev1=1 crypto rx=0x7fa12400c480 tx=0x7fa12400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:35.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.573+0000 7fa11effd700 1 -- 172.21.15.87:0/1974013655 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa124004cf0 con 0x7fa1300b8570 2023-03-30T19:35:35.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.573+0000 7fa11effd700 1 -- 172.21.15.87:0/1974013655 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa124004e50 con 0x7fa1300b8570 2023-03-30T19:35:35.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.573+0000 7fa11effd700 1 -- 172.21.15.87:0/1974013655 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa124007310 con 0x7fa1300b8570 2023-03-30T19:35:35.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.573+0000 7fa12f59e700 1 -- 172.21.15.87:0/1974013655 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1300cd490 con 0x7fa1300b8570 2023-03-30T19:35:35.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.573+0000 7fa12f59e700 1 -- 172.21.15.87:0/1974013655 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1300d28c0 con 0x7fa1300b8570 2023-03-30T19:35:35.580 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.577+0000 7fa12f59e700 1 -- 172.21.15.87:0/1974013655 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1300cd770 con 0x7fa1300b8570 2023-03-30T19:35:35.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.593+0000 7fa11effd700 1 -- 172.21.15.87:0/1974013655 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa124007470 con 0x7fa1300b8570 2023-03-30T19:35:35.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.597+0000 7fa11effd700 1 --2- 172.21.15.87:0/1974013655 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa110065440 0x7fa1100678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:35.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.597+0000 7fa11effd700 1 -- 172.21.15.87:0/1974013655 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa124082c80 con 0x7fa1300b8570 2023-03-30T19:35:35.605 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.601+0000 7fa11effd700 1 -- 172.21.15.87:0/1974013655 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fa124050760 con 0x7fa1300b8570 2023-03-30T19:35:35.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.605+0000 7fa12e59c700 1 --2- 172.21.15.87:0/1974013655 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa110065440 0x7fa1100678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:35.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.609+0000 7fa12e59c700 1 --2- 172.21.15.87:0/1974013655 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa110065440 0x7fa1100678f0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa120009ba0 tx=0x7fa12001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:35.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.857+0000 7fa12f59e700 1 -- 172.21.15.87:0/1974013655 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa1300cab20 con 0x7fa1300b8570 2023-03-30T19:35:35.864 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.861+0000 7fa11effd700 1 -- 172.21.15.87:0/1974013655 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa124053d80 con 0x7fa1300b8570 2023-03-30T19:35:35.864 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2023-03-30T19:35:35.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.861+0000 7fa12f59e700 1 -- 172.21.15.87:0/1974013655 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa110065440 msgr2=0x7fa1100678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:35.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.861+0000 7fa12f59e700 1 --2- 172.21.15.87:0/1974013655 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa110065440 0x7fa1100678f0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa120009ba0 tx=0x7fa12001c040 comp rx=0 tx=0).stop 2023-03-30T19:35:35.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.861+0000 7fa12f59e700 1 -- 172.21.15.87:0/1974013655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1300b8570 msgr2=0x7fa130159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:35.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.861+0000 7fa12f59e700 1 --2- 172.21.15.87:0/1974013655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1300b8570 0x7fa130159e40 secure :-1 s=READY pgs=3312 cs=0 l=1 rev1=1 crypto rx=0x7fa12400c480 tx=0x7fa12400c790 comp rx=0 tx=0).stop 2023-03-30T19:35:35.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.865+0000 7fa12f59e700 1 -- 172.21.15.87:0/1974013655 shutdown_connections 2023-03-30T19:35:35.869 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.865+0000 7fa12f59e700 1 --2- 172.21.15.87:0/1974013655 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fa110065440 0x7fa1100678f0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.865+0000 7fa12f59e700 1 --2- 172.21.15.87:0/1974013655 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa1300ceeb0 0x7fa13015e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.865+0000 7fa12f59e700 1 --2- 172.21.15.87:0/1974013655 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa1300b8570 0x7fa130159e40 unknown :-1 s=CLOSED pgs=3312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.865+0000 7fa12f59e700 1 --2- 172.21.15.87:0/1974013655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa13006a3e0 0x7fa1300708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:35.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.865+0000 7fa12f59e700 1 -- 172.21.15.87:0/1974013655 >> 172.21.15.87:0/1974013655 conn(0x7fa1300b5320 msgr2=0x7fa13006b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:35.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.865+0000 7fa12f59e700 1 -- 172.21.15.87:0/1974013655 shutdown_connections 2023-03-30T19:35:35.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:35.865+0000 7fa12f59e700 1 -- 172.21.15.87:0/1974013655 wait complete. 2023-03-30T19:35:35.893 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T19:35:36.079 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.073+0000 7f15de848700 1 Processor -- start 2023-03-30T19:35:36.080 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15de848700 1 -- start start 2023-03-30T19:35:36.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15de848700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f15d80b8570 0x7f15d8160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:36.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15de848700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80ceeb0 0x7f15d8069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:36.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15de848700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d80d09f0 con 0x7f15d806a210 2023-03-30T19:35:36.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15de848700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d806a660 con 0x7f15d80b8570 2023-03-30T19:35:36.083 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15de848700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d80cd240 con 0x7f15d80ceeb0 2023-03-30T19:35:36.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15de047700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f15d806a210 0x7f15d806b1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34254/0 (socket says 172.21.15.87:34254) 2023-03-30T19:35:36.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15de047700 1 -- 172.21.15.87:0/1447725097 learned_addr learned my addr 172.21.15.87:0/1447725097 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:36.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15dd045700 1 --2- 172.21.15.87:0/1447725097 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80ceeb0 0x7f15d8069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:36.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15dd846700 1 --2- 172.21.15.87:0/1447725097 >> v2:172.21.15.115:3300/0 conn(0x7f15d80b8570 0x7f15d8160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:36.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15dc844700 1 -- 172.21.15.87:0/1447725097 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807571344 0 0) 0x7f15d80d09f0 con 0x7f15d806a210 2023-03-30T19:35:36.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15dc844700 1 -- 172.21.15.87:0/1447725097 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c40035d0 con 0x7f15d806a210 2023-03-30T19:35:36.084 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15dd045700 1 -- 172.21.15.87:0/1447725097 >> v2:172.21.15.115:3300/0 conn(0x7f15d80b8570 msgr2=0x7f15d8160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:36.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15dd045700 1 --2- 172.21.15.87:0/1447725097 >> v2:172.21.15.115:3300/0 conn(0x7f15d80b8570 0x7f15d8160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:36.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15dd045700 1 -- 172.21.15.87:0/1447725097 >> v1:172.21.15.87:6789/0 conn(0x7f15d806a210 legacy=0x7f15d806b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:36.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15dd045700 1 -- 172.21.15.87:0/1447725097 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d80cf300 con 0x7f15d80ceeb0 2023-03-30T19:35:36.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15dd045700 1 --2- 172.21.15.87:0/1447725097 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80ceeb0 0x7f15d8069cd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009840 tx=0x7f15c8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a57c64147d2e225d server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:36.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15dc844700 1 -- 172.21.15.87:0/1447725097 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c8005e50 con 0x7f15d80ceeb0 2023-03-30T19:35:36.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15dc844700 1 -- 172.21.15.87:0/1447725097 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c8006030 con 0x7f15d80ceeb0 2023-03-30T19:35:36.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.077+0000 7f15dc844700 1 -- 172.21.15.87:0/1447725097 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c80063c0 con 0x7f15d80ceeb0 2023-03-30T19:35:36.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.081+0000 7f15de848700 1 -- 172.21.15.87:0/1447725097 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80ceeb0 msgr2=0x7f15d8069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:36.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.081+0000 7f15de848700 1 --2- 172.21.15.87:0/1447725097 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80ceeb0 0x7f15d8069cd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009840 tx=0x7f15c8009b50 comp rx=0 tx=0).stop 2023-03-30T19:35:36.087 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.081+0000 7f15de848700 1 -- 172.21.15.87:0/1447725097 shutdown_connections 2023-03-30T19:35:36.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.081+0000 7f15de848700 1 --2- 172.21.15.87:0/1447725097 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d80ceeb0 0x7f15d8069cd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:36.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.081+0000 7f15de848700 1 --2- 172.21.15.87:0/1447725097 >> v2:172.21.15.115:3300/0 conn(0x7f15d80b8570 0x7f15d8160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:36.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.081+0000 7f15de848700 1 -- 172.21.15.87:0/1447725097 >> 172.21.15.87:0/1447725097 conn(0x7f15d80b5320 msgr2=0x7f15d80cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:36.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.085+0000 7f15de848700 1 -- 172.21.15.87:0/1447725097 shutdown_connections 2023-03-30T19:35:36.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.085+0000 7f15de848700 1 -- 172.21.15.87:0/1447725097 wait complete. 2023-03-30T19:35:36.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.085+0000 7f15de848700 1 Processor -- start 2023-03-30T19:35:36.092 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de848700 1 -- start start 2023-03-30T19:35:36.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de848700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d806a210 0x7f15d80cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:36.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de848700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d80b8570 0x7f15d80c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:36.093 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de848700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15d80ceeb0 0x7f15d8159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:36.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de848700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d81f6390 con 0x7f15d80b8570 2023-03-30T19:35:36.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15dd846700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d806a210 0x7f15d80cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:36.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de848700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d81f6670 con 0x7f15d80ceeb0 2023-03-30T19:35:36.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de047700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15d80ceeb0 0x7f15d8159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:36.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15dd045700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d80b8570 0x7f15d80c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:36.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de047700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15d80ceeb0 0x7f15d8159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:39382/0 (socket says 172.21.15.87:39382) 2023-03-30T19:35:36.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de047700 1 -- 172.21.15.87:0/3988543055 learned_addr learned my addr 172.21.15.87:0/3988543055 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:36.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de848700 1 -- 172.21.15.87:0/3988543055 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d81f6950 con 0x7f15d806a210 2023-03-30T19:35:36.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de047700 1 -- 172.21.15.87:0/3988543055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d806a210 msgr2=0x7f15d80cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:36.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de047700 1 --2- 172.21.15.87:0/3988543055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d806a210 0x7f15d80cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:36.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de047700 1 -- 172.21.15.87:0/3988543055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d80b8570 msgr2=0x7f15d80c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:36.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de047700 1 --2- 172.21.15.87:0/3988543055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d80b8570 0x7f15d80c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:36.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de047700 1 -- 172.21.15.87:0/3988543055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c8009450 con 0x7f15d80ceeb0 2023-03-30T19:35:36.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.089+0000 7f15de047700 1 --2- 172.21.15.87:0/3988543055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15d80ceeb0 0x7f15d8159750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f15d000caa0 tx=0x7f15d000cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:36.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.093+0000 7f15ce7fc700 1 -- 172.21.15.87:0/3988543055 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d0007480 con 0x7f15d80ceeb0 2023-03-30T19:35:36.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.093+0000 7f15ce7fc700 1 -- 172.21.15.87:0/3988543055 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d00075e0 con 0x7f15d80ceeb0 2023-03-30T19:35:36.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.093+0000 7f15de848700 1 -- 172.21.15.87:0/3988543055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d80d28c0 con 0x7f15d80ceeb0 2023-03-30T19:35:36.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.093+0000 7f15ce7fc700 1 -- 172.21.15.87:0/3988543055 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d0007970 con 0x7f15d80ceeb0 2023-03-30T19:35:36.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.093+0000 7f15de848700 1 -- 172.21.15.87:0/3988543055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d80cda50 con 0x7f15d80ceeb0 2023-03-30T19:35:36.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.097+0000 7f15de848700 1 -- 172.21.15.87:0/3988543055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d80cd490 con 0x7f15d80ceeb0 2023-03-30T19:35:36.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.097+0000 7f15ce7fc700 1 -- 172.21.15.87:0/3988543055 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f15d001b3b0 con 0x7f15d80ceeb0 2023-03-30T19:35:36.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.097+0000 7f15ce7fc700 1 --2- 172.21.15.87:0/3988543055 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f15bc065470 0x7f15bc067920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:36.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.097+0000 7f15ce7fc700 1 -- 172.21.15.87:0/3988543055 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f15d0082310 con 0x7f15d80ceeb0 2023-03-30T19:35:36.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.097+0000 7f15dd846700 1 --2- 172.21.15.87:0/3988543055 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f15bc065470 0x7f15bc067920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:36.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.097+0000 7f15dd846700 1 --2- 172.21.15.87:0/3988543055 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f15bc065470 0x7f15bc067920 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009b50 tx=0x7f15d4009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:36.109 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.105+0000 7f15ce7fc700 1 -- 172.21.15.87:0/3988543055 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f15d004fd90 con 0x7f15d80ceeb0 2023-03-30T19:35:36.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.433+0000 7f15de848700 1 -- 172.21.15.87:0/3988543055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15d80733a0 con 0x7f15d80ceeb0 2023-03-30T19:35:36.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.585+0000 7f15ce7fc700 1 -- 172.21.15.87:0/3988543055 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f15d00533b0 con 0x7f15d80ceeb0 2023-03-30T19:35:36.591 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:36.591 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4958,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/474261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":474261391},{"type":"v1","addr":"172.21.15.115:6833","nonce":474261391}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/2626542689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2626542689},{"type":"v1","addr":"172.21.15.87:6836","nonce":2626542689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3981806958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3981806958},{"type":"v1","addr":"172.21.15.87:6837","nonce":3981806958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-30T08:12:16.963002+0000","modified":"2023-03-30T08:12:20.012842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6835/450554084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":450554084},{"type":"v1","addr":"172.21.15.115:6835","nonce":450554084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-30T19:35:36.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.589+0000 7f15de848700 1 -- 172.21.15.87:0/3988543055 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f15bc065470 msgr2=0x7f15bc067920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:36.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.589+0000 7f15de848700 1 --2- 172.21.15.87:0/3988543055 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f15bc065470 0x7f15bc067920 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009b50 tx=0x7f15d4009240 comp rx=0 tx=0).stop 2023-03-30T19:35:36.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.589+0000 7f15de848700 1 -- 172.21.15.87:0/3988543055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15d80ceeb0 msgr2=0x7f15d8159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:36.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.589+0000 7f15de848700 1 --2- 172.21.15.87:0/3988543055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15d80ceeb0 0x7f15d8159750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f15d000caa0 tx=0x7f15d000cad0 comp rx=0 tx=0).stop 2023-03-30T19:35:36.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.589+0000 7f15de848700 1 -- 172.21.15.87:0/3988543055 shutdown_connections 2023-03-30T19:35:36.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.589+0000 7f15de848700 1 --2- 172.21.15.87:0/3988543055 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f15bc065470 0x7f15bc067920 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:36.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.589+0000 7f15de848700 1 --2- 172.21.15.87:0/3988543055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15d80ceeb0 0x7f15d8159750 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:36.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.589+0000 7f15de848700 1 --2- 172.21.15.87:0/3988543055 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15d80b8570 0x7f15d80c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:36.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.589+0000 7f15de848700 1 --2- 172.21.15.87:0/3988543055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15d806a210 0x7f15d80cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:36.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.589+0000 7f15de848700 1 -- 172.21.15.87:0/3988543055 >> 172.21.15.87:0/3988543055 conn(0x7f15d80b5320 msgr2=0x7f15d80d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:36.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.589+0000 7f15de848700 1 -- 172.21.15.87:0/3988543055 shutdown_connections 2023-03-30T19:35:36.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.589+0000 7f15de848700 1 -- 172.21.15.87:0/3988543055 wait complete. 2023-03-30T19:35:36.598 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 17 2023-03-30T19:35:36.618 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T19:35:36.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.793+0000 7ff03e9c8700 1 Processor -- start 2023-03-30T19:35:36.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.797+0000 7ff03e9c8700 1 -- start start 2023-03-30T19:35:36.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.797+0000 7ff03e9c8700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff030038560 0x7ff03003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:36.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.797+0000 7ff03d9c6700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff0300e29f0 0x7ff030055490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:50332/0 (socket says 172.21.15.87:50332) 2023-03-30T19:35:36.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.797+0000 7ff03d9c6700 1 -- 172.21.15.87:0/3854293752 learned_addr learned my addr 172.21.15.87:0/3854293752 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:36.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.797+0000 7ff03d1c5700 1 --2- 172.21.15.87:0/3854293752 >> v2:172.21.15.115:3300/0 conn(0x7ff030038560 0x7ff03003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:36.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.797+0000 7ff03e9c8700 1 -- 172.21.15.87:0/3854293752 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff030007360 con 0x7ff03003b160 2023-03-30T19:35:36.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.797+0000 7ff03e9c8700 1 -- 172.21.15.87:0/3854293752 --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff030053f70 con 0x7ff0300e29f0 2023-03-30T19:35:36.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.797+0000 7ff03e9c8700 1 -- 172.21.15.87:0/3854293752 --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0300e2dc0 con 0x7ff030038560 2023-03-30T19:35:36.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.797+0000 7ff03c9c4700 1 -- 172.21.15.87:0/3854293752 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083114205 0 0) 0x7ff030007360 con 0x7ff03003b160 2023-03-30T19:35:36.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.797+0000 7ff03c9c4700 1 -- 172.21.15.87:0/3854293752 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0240035d0 con 0x7ff03003b160 2023-03-30T19:35:36.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.797+0000 7ff03c9c4700 1 -- 172.21.15.87:0/3854293752 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273454432 0 0) 0x7ff030053f70 con 0x7ff0300e29f0 2023-03-30T19:35:36.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.797+0000 7ff03c9c4700 1 -- 172.21.15.87:0/3854293752 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff030007360 con 0x7ff0300e29f0 2023-03-30T19:35:36.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.797+0000 7ff03d1c5700 1 -- 172.21.15.87:0/3854293752 >> v1:172.21.15.115:6789/0 conn(0x7ff0300e29f0 legacy=0x7ff030055490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:36.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.797+0000 7ff03d1c5700 1 -- 172.21.15.87:0/3854293752 >> v1:172.21.15.87:6789/0 conn(0x7ff03003b160 legacy=0x7ff030057210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:36.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.797+0000 7ff03d1c5700 1 -- 172.21.15.87:0/3854293752 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03003b5a0 con 0x7ff030038560 2023-03-30T19:35:36.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.801+0000 7ff03d1c5700 1 --2- 172.21.15.87:0/3854293752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff030038560 0x7ff03003ac20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff028009850 tx=0x7ff028009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c845bc6b9396d77e server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:36.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.801+0000 7ff03c9c4700 1 -- 172.21.15.87:0/3854293752 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028011830 con 0x7ff030038560 2023-03-30T19:35:36.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.801+0000 7ff03c9c4700 1 -- 172.21.15.87:0/3854293752 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff028011990 con 0x7ff030038560 2023-03-30T19:35:36.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.801+0000 7ff03c9c4700 1 -- 172.21.15.87:0/3854293752 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028011d00 con 0x7ff030038560 2023-03-30T19:35:36.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.801+0000 7ff03e9c8700 1 -- 172.21.15.87:0/3854293752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff030038560 msgr2=0x7ff03003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:36.806 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.801+0000 7ff03e9c8700 1 --2- 172.21.15.87:0/3854293752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff030038560 0x7ff03003ac20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff028009850 tx=0x7ff028009b60 comp rx=0 tx=0).stop 2023-03-30T19:35:36.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.801+0000 7ff03e9c8700 1 -- 172.21.15.87:0/3854293752 shutdown_connections 2023-03-30T19:35:36.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.801+0000 7ff03e9c8700 1 --2- 172.21.15.87:0/3854293752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff030038560 0x7ff03003ac20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:36.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.801+0000 7ff03e9c8700 1 -- 172.21.15.87:0/3854293752 >> 172.21.15.87:0/3854293752 conn(0x7ff030055c20 msgr2=0x7ff030056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:36.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.801+0000 7ff03e9c8700 1 -- 172.21.15.87:0/3854293752 shutdown_connections 2023-03-30T19:35:36.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.801+0000 7ff03e9c8700 1 -- 172.21.15.87:0/3854293752 wait complete. 2023-03-30T19:35:36.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03e9c8700 1 Processor -- start 2023-03-30T19:35:36.809 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03e9c8700 1 -- start start 2023-03-30T19:35:36.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03e9c8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff030038560 0x7ff0300e66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:36.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03e9c8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff03003b160 0x7ff03017be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:36.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03e9c8700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0300e29f0 0x7ff0300df190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:36.810 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03e9c8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03017c3c0 con 0x7ff03003b160 2023-03-30T19:35:36.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03e9c8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300dfff0 con 0x7ff030038560 2023-03-30T19:35:36.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03e9c8700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300e0d90 con 0x7ff0300e29f0 2023-03-30T19:35:36.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03d1c5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff03003b160 0x7ff03017be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:36.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03d1c5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff03003b160 0x7ff03017be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54060/0 (socket says 172.21.15.87:54060) 2023-03-30T19:35:36.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03d1c5700 1 -- 172.21.15.87:0/530427673 learned_addr learned my addr 172.21.15.87:0/530427673 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:36.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03d1c5700 1 -- 172.21.15.87:0/530427673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0300e29f0 msgr2=0x7ff0300df190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:36.812 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03d1c5700 1 --2- 172.21.15.87:0/530427673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0300e29f0 0x7ff0300df190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:36.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03d1c5700 1 -- 172.21.15.87:0/530427673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff030038560 msgr2=0x7ff0300e66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:36.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03d1c5700 1 --2- 172.21.15.87:0/530427673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff030038560 0x7ff0300e66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:36.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03d1c5700 1 -- 172.21.15.87:0/530427673 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0280094b0 con 0x7ff03003b160 2023-03-30T19:35:36.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03d1c5700 1 --2- 172.21.15.87:0/530427673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff03003b160 0x7ff03017be80 secure :-1 s=READY pgs=3315 cs=0 l=1 rev1=1 crypto rx=0x7ff028013000 tx=0x7ff028004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:36.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff02e7fc700 1 -- 172.21.15.87:0/530427673 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0280045b0 con 0x7ff03003b160 2023-03-30T19:35:36.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff02e7fc700 1 -- 172.21.15.87:0/530427673 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02801f070 con 0x7ff03003b160 2023-03-30T19:35:36.813 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03e9c8700 1 -- 172.21.15.87:0/530427673 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff030007080 con 0x7ff03003b160 2023-03-30T19:35:36.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff02e7fc700 1 -- 172.21.15.87:0/530427673 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028003900 con 0x7ff03003b160 2023-03-30T19:35:36.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.805+0000 7ff03e9c8700 1 -- 172.21.15.87:0/530427673 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff030006dc0 con 0x7ff03003b160 2023-03-30T19:35:36.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.809+0000 7ff03e9c8700 1 -- 172.21.15.87:0/530427673 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff030053920 con 0x7ff03003b160 2023-03-30T19:35:36.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.809+0000 7ff02e7fc700 1 -- 172.21.15.87:0/530427673 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ff028021030 con 0x7ff03003b160 2023-03-30T19:35:36.815 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.809+0000 7ff02e7fc700 1 --2- 172.21.15.87:0/530427673 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff01c0653f0 0x7ff01c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:36.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.809+0000 7ff02e7fc700 1 -- 172.21.15.87:0/530427673 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff0280841f0 con 0x7ff03003b160 2023-03-30T19:35:36.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.813+0000 7ff03d9c6700 1 --2- 172.21.15.87:0/530427673 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff01c0653f0 0x7ff01c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:36.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.813+0000 7ff03d9c6700 1 --2- 172.21.15.87:0/530427673 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff01c0653f0 0x7ff01c0678a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7ff034005930 tx=0x7ff034007a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:36.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:36.817+0000 7ff02e7fc700 1 -- 172.21.15.87:0/530427673 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7ff028051e60 con 0x7ff03003b160 2023-03-30T19:35:37.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.093+0000 7ff03e9c8700 1 -- 172.21.15.87:0/530427673 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0300def70 con 0x7ff03003b160 2023-03-30T19:35:37.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.093+0000 7ff02e7fc700 1 -- 172.21.15.87:0/530427673 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+18123 (secure 0 0 0) 0x7ff028055480 con 0x7ff03003b160 2023-03-30T19:35:37.099 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:37.099 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":45,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:12:40.165947+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:12:14.871645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-03-30T08:12:15.991480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":4}]},{"pgid":"7.2a","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T19:35:37.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.097+0000 7ff03e9c8700 1 -- 172.21.15.87:0/530427673 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff01c0653f0 msgr2=0x7ff01c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:37.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.097+0000 7ff03e9c8700 1 --2- 172.21.15.87:0/530427673 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff01c0653f0 0x7ff01c0678a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7ff034005930 tx=0x7ff034007a50 comp rx=0 tx=0).stop 2023-03-30T19:35:37.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.097+0000 7ff03e9c8700 1 -- 172.21.15.87:0/530427673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff03003b160 msgr2=0x7ff03017be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:37.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.097+0000 7ff03e9c8700 1 --2- 172.21.15.87:0/530427673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff03003b160 0x7ff03017be80 secure :-1 s=READY pgs=3315 cs=0 l=1 rev1=1 crypto rx=0x7ff028013000 tx=0x7ff028004770 comp rx=0 tx=0).stop 2023-03-30T19:35:37.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.097+0000 7ff03e9c8700 1 -- 172.21.15.87:0/530427673 shutdown_connections 2023-03-30T19:35:37.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.097+0000 7ff03e9c8700 1 --2- 172.21.15.87:0/530427673 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7ff01c0653f0 0x7ff01c0678a0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.097+0000 7ff03e9c8700 1 --2- 172.21.15.87:0/530427673 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0300e29f0 0x7ff0300df190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.097+0000 7ff03e9c8700 1 --2- 172.21.15.87:0/530427673 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff03003b160 0x7ff03017be80 unknown :-1 s=CLOSED pgs=3315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.097+0000 7ff03e9c8700 1 --2- 172.21.15.87:0/530427673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff030038560 0x7ff0300e66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.097+0000 7ff03e9c8700 1 -- 172.21.15.87:0/530427673 >> 172.21.15.87:0/530427673 conn(0x7ff030055c20 msgr2=0x7ff03004ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.097+0000 7ff03e9c8700 1 -- 172.21.15.87:0/530427673 shutdown_connections 2023-03-30T19:35:37.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.097+0000 7ff03e9c8700 1 -- 172.21.15.87:0/530427673 wait complete. 2023-03-30T19:35:37.124 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-03-30T19:35:37.125 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T19:35:37.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f1588034700 1 Processor -- start 2023-03-30T19:35:37.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f1588034700 1 -- start start 2023-03-30T19:35:37.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f1588034700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15800adb80 0x7f158006cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:37.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f1588034700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f15800cd8e0 0x7f1580070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:37.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f1588034700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158006c710 con 0x7f15800cc980 2023-03-30T19:35:37.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f1588034700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158006be20 con 0x7f15800cd8e0 2023-03-30T19:35:37.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f1588034700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15800adf50 con 0x7f15800adb80 2023-03-30T19:35:37.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f15855cf700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f15800cd8e0 0x7f1580070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:37.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f15855cf700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f15800cd8e0 0x7f1580070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:39402/0 (socket says 172.21.15.87:39402) 2023-03-30T19:35:37.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f15855cf700 1 -- 172.21.15.87:0/3418454842 learned_addr learned my addr 172.21.15.87:0/3418454842 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:37.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f1585dd0700 1 --2- 172.21.15.87:0/3418454842 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15800adb80 0x7f158006cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:37.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f15855cf700 1 -- 172.21.15.87:0/3418454842 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15800adb80 msgr2=0x7f158006cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:37.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f15855cf700 1 --2- 172.21.15.87:0/3418454842 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15800adb80 0x7f158006cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f15855cf700 1 -- 172.21.15.87:0/3418454842 >> v1:172.21.15.115:6789/0 conn(0x7f15800cc980 legacy=0x7f15800c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:37.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f15855cf700 1 -- 172.21.15.87:0/3418454842 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158006c0c0 con 0x7f15800cd8e0 2023-03-30T19:35:37.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f15855cf700 1 --2- 172.21.15.87:0/3418454842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15800cd8e0 0x7f1580070420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1570009910 tx=0x7f1570009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c60108124370e6cb server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:37.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f1584dce700 1 -- 172.21.15.87:0/3418454842 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157000f8a0 con 0x7f15800cd8e0 2023-03-30T19:35:37.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f1584dce700 1 -- 172.21.15.87:0/3418454842 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157000fa00 con 0x7f15800cd8e0 2023-03-30T19:35:37.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.305+0000 7f1584dce700 1 -- 172.21.15.87:0/3418454842 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157000fdb0 con 0x7f15800cd8e0 2023-03-30T19:35:37.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.309+0000 7f1588034700 1 -- 172.21.15.87:0/3418454842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15800cd8e0 msgr2=0x7f1580070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:37.313 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.309+0000 7f1588034700 1 --2- 172.21.15.87:0/3418454842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15800cd8e0 0x7f1580070420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1570009910 tx=0x7f1570009c20 comp rx=0 tx=0).stop 2023-03-30T19:35:37.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.309+0000 7f1588034700 1 -- 172.21.15.87:0/3418454842 shutdown_connections 2023-03-30T19:35:37.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.309+0000 7f1588034700 1 --2- 172.21.15.87:0/3418454842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15800cd8e0 0x7f1580070420 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.309+0000 7f1588034700 1 --2- 172.21.15.87:0/3418454842 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15800adb80 0x7f158006cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.309+0000 7f1588034700 1 -- 172.21.15.87:0/3418454842 >> 172.21.15.87:0/3418454842 conn(0x7f15800ce960 msgr2=0x7f15800ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:37.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.309+0000 7f1588034700 1 -- 172.21.15.87:0/3418454842 shutdown_connections 2023-03-30T19:35:37.314 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.309+0000 7f1588034700 1 -- 172.21.15.87:0/3418454842 wait complete. 2023-03-30T19:35:37.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.309+0000 7f1588034700 1 Processor -- start 2023-03-30T19:35:37.315 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.309+0000 7f1588034700 1 -- start start 2023-03-30T19:35:37.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f1588034700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15800adb80 0x7f15801562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:37.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f1588034700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15800cc980 0x7f15800afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:37.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f1588034700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15800cd8e0 0x7f15800c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:37.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f1588034700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1580155ea0 con 0x7f15800cd8e0 2023-03-30T19:35:37.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f1588034700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1580155590 con 0x7f15800cc980 2023-03-30T19:35:37.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f1588034700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15800b1220 con 0x7f15800adb80 2023-03-30T19:35:37.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f15865d1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15800cd8e0 0x7f15800c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:37.317 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f15865d1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15800cd8e0 0x7f15800c7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54076/0 (socket says 172.21.15.87:54076) 2023-03-30T19:35:37.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f15865d1700 1 -- 172.21.15.87:0/2071251357 learned_addr learned my addr 172.21.15.87:0/2071251357 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:37.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f1585dd0700 1 --2- 172.21.15.87:0/2071251357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15800adb80 0x7f15801562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:37.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f15855cf700 1 --2- 172.21.15.87:0/2071251357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15800cc980 0x7f15800afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:37.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f15865d1700 1 -- 172.21.15.87:0/2071251357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15800adb80 msgr2=0x7f15801562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:37.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f15865d1700 1 --2- 172.21.15.87:0/2071251357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15800adb80 0x7f15801562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f15865d1700 1 -- 172.21.15.87:0/2071251357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15800cc980 msgr2=0x7f15800afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:37.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f15865d1700 1 --2- 172.21.15.87:0/2071251357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15800cc980 0x7f15800afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f15865d1700 1 -- 172.21.15.87:0/2071251357 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1570009570 con 0x7f15800cd8e0 2023-03-30T19:35:37.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f15855cf700 1 --2- 172.21.15.87:0/2071251357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15800cc980 0x7f15800afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T19:35:37.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f15865d1700 1 --2- 172.21.15.87:0/2071251357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15800cd8e0 0x7f15800c7c80 secure :-1 s=READY pgs=3316 cs=0 l=1 rev1=1 crypto rx=0x7f157800cb50 tx=0x7f157800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:37.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f15767fc700 1 -- 172.21.15.87:0/2071251357 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578003c20 con 0x7f15800cd8e0 2023-03-30T19:35:37.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f15767fc700 1 -- 172.21.15.87:0/2071251357 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1578003d80 con 0x7f15800cd8e0 2023-03-30T19:35:37.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.313+0000 7f15767fc700 1 -- 172.21.15.87:0/2071251357 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157800aac0 con 0x7f15800cd8e0 2023-03-30T19:35:37.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.317+0000 7f1588034700 1 -- 172.21.15.87:0/2071251357 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158006d0e0 con 0x7f15800cd8e0 2023-03-30T19:35:37.320 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.317+0000 7f1588034700 1 -- 172.21.15.87:0/2071251357 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158006c3a0 con 0x7f15800cd8e0 2023-03-30T19:35:37.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.317+0000 7f1588034700 1 -- 172.21.15.87:0/2071251357 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15800cde30 con 0x7f15800cd8e0 2023-03-30T19:35:37.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.321+0000 7f15767fc700 1 -- 172.21.15.87:0/2071251357 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f157800ac20 con 0x7f15800cd8e0 2023-03-30T19:35:37.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.325+0000 7f15767fc700 1 --2- 172.21.15.87:0/2071251357 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1564065440 0x7f15640678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:37.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.325+0000 7f15767fc700 1 -- 172.21.15.87:0/2071251357 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f15780828e0 con 0x7f15800cd8e0 2023-03-30T19:35:37.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.325+0000 7f1585dd0700 1 --2- 172.21.15.87:0/2071251357 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1564065440 0x7f15640678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:37.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.325+0000 7f1585dd0700 1 --2- 172.21.15.87:0/2071251357 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1564065440 0x7f15640678f0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f157c009b50 tx=0x7f157c009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:37.337 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.333+0000 7f15767fc700 1 -- 172.21.15.87:0/2071251357 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f1578050500 con 0x7f15800cd8e0 2023-03-30T19:35:37.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.633+0000 7f1588034700 1 -- 172.21.15.87:0/2071251357 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1580155fe0 con 0x7f15800cd8e0 2023-03-30T19:35:37.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.633+0000 7f15767fc700 1 -- 172.21.15.87:0/2071251357 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f1580155fe0 con 0x7f15800cd8e0 2023-03-30T19:35:37.643 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:37.644 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4958,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/474261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":474261391},{"type":"v1","addr":"172.21.15.115:6833","nonce":474261391}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/2626542689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2626542689},{"type":"v1","addr":"172.21.15.87:6836","nonce":2626542689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3981806958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3981806958},{"type":"v1","addr":"172.21.15.87:6837","nonce":3981806958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-30T08:12:16.963002+0000","modified":"2023-03-30T08:12:20.012842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6835/450554084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":450554084},{"type":"v1","addr":"172.21.15.115:6835","nonce":450554084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-30T19:35:37.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.641+0000 7f1588034700 1 -- 172.21.15.87:0/2071251357 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1564065440 msgr2=0x7f15640678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:37.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.641+0000 7f1588034700 1 --2- 172.21.15.87:0/2071251357 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1564065440 0x7f15640678f0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f157c009b50 tx=0x7f157c009240 comp rx=0 tx=0).stop 2023-03-30T19:35:37.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.641+0000 7f1588034700 1 -- 172.21.15.87:0/2071251357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15800cd8e0 msgr2=0x7f15800c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:37.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.641+0000 7f1588034700 1 --2- 172.21.15.87:0/2071251357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15800cd8e0 0x7f15800c7c80 secure :-1 s=READY pgs=3316 cs=0 l=1 rev1=1 crypto rx=0x7f157800cb50 tx=0x7f157800ce60 comp rx=0 tx=0).stop 2023-03-30T19:35:37.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.641+0000 7f1588034700 1 -- 172.21.15.87:0/2071251357 shutdown_connections 2023-03-30T19:35:37.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.641+0000 7f1588034700 1 --2- 172.21.15.87:0/2071251357 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1564065440 0x7f15640678f0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.641+0000 7f1588034700 1 --2- 172.21.15.87:0/2071251357 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15800cd8e0 0x7f15800c7c80 unknown :-1 s=CLOSED pgs=3316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.641+0000 7f1588034700 1 --2- 172.21.15.87:0/2071251357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15800cc980 0x7f15800afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.641+0000 7f1588034700 1 --2- 172.21.15.87:0/2071251357 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f15800adb80 0x7f15801562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.641+0000 7f1588034700 1 -- 172.21.15.87:0/2071251357 >> 172.21.15.87:0/2071251357 conn(0x7f15800ce960 msgr2=0x7f158015ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:37.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.641+0000 7f1588034700 1 -- 172.21.15.87:0/2071251357 shutdown_connections 2023-03-30T19:35:37.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.641+0000 7f1588034700 1 -- 172.21.15.87:0/2071251357 wait complete. 2023-03-30T19:35:37.647 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 17 2023-03-30T19:35:37.670 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T19:35:37.867 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.861+0000 7f25029bc700 1 Processor -- start 2023-03-30T19:35:37.868 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.865+0000 7f25029bc700 1 -- start start 2023-03-30T19:35:37.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.865+0000 7f25029bc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f24f40e29f0 0x7f24f4055490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:37.870 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.865+0000 7f25029bc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f403b330 0x7f24f4057210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:37.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.865+0000 7f25019ba700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f24f40e29f0 0x7f24f4055490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:37.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.865+0000 7f25011b9700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f24f4038560 0x7f24f403ac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:50350/0 (socket says 172.21.15.87:50350) 2023-03-30T19:35:37.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.865+0000 7f25011b9700 1 -- 172.21.15.87:0/2647555085 learned_addr learned my addr 172.21.15.87:0/2647555085 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:37.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.865+0000 7f25029bc700 1 -- 172.21.15.87:0/2647555085 --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f4007360 con 0x7f24f4038560 2023-03-30T19:35:37.871 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.865+0000 7f25029bc700 1 -- 172.21.15.87:0/2647555085 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f40e2dc0 con 0x7f24f40e29f0 2023-03-30T19:35:37.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.865+0000 7f25029bc700 1 -- 172.21.15.87:0/2647555085 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f4053f70 con 0x7f24f403b330 2023-03-30T19:35:37.872 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.865+0000 7f25021bb700 1 --2- 172.21.15.87:0/2647555085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f403b330 0x7f24f4057210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:37.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.865+0000 7f25009b8700 1 -- 172.21.15.87:0/2647555085 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479060844 0 0) 0x7f24f4007360 con 0x7f24f4038560 2023-03-30T19:35:37.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.865+0000 7f25009b8700 1 -- 172.21.15.87:0/2647555085 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24e80035d0 con 0x7f24f4038560 2023-03-30T19:35:37.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.869+0000 7f25021bb700 1 -- 172.21.15.87:0/2647555085 >> v2:172.21.15.87:3300/0 conn(0x7f24f40e29f0 msgr2=0x7f24f4055490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:37.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.869+0000 7f25021bb700 1 --2- 172.21.15.87:0/2647555085 >> v2:172.21.15.87:3300/0 conn(0x7f24f40e29f0 0x7f24f4055490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.873 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.869+0000 7f25021bb700 1 -- 172.21.15.87:0/2647555085 >> v1:172.21.15.115:6789/0 conn(0x7f24f4038560 legacy=0x7f24f403ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:37.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.869+0000 7f25021bb700 1 -- 172.21.15.87:0/2647555085 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f4006dc0 con 0x7f24f403b330 2023-03-30T19:35:37.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.869+0000 7f25021bb700 1 --2- 172.21.15.87:0/2647555085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f403b330 0x7f24f4057210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f24fc000b60 tx=0x7f24fc04e9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41c24e657049a23e server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:37.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.869+0000 7f25009b8700 1 -- 172.21.15.87:0/2647555085 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc08d070 con 0x7f24f403b330 2023-03-30T19:35:37.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.869+0000 7f25009b8700 1 -- 172.21.15.87:0/2647555085 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc067770 con 0x7f24f403b330 2023-03-30T19:35:37.874 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.869+0000 7f25009b8700 1 -- 172.21.15.87:0/2647555085 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc072420 con 0x7f24f403b330 2023-03-30T19:35:37.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.869+0000 7f25029bc700 1 -- 172.21.15.87:0/2647555085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f403b330 msgr2=0x7f24f4057210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:37.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.869+0000 7f25029bc700 1 --2- 172.21.15.87:0/2647555085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f403b330 0x7f24f4057210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f24fc000b60 tx=0x7f24fc04e9e0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.873+0000 7f25029bc700 1 -- 172.21.15.87:0/2647555085 shutdown_connections 2023-03-30T19:35:37.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.873+0000 7f25029bc700 1 --2- 172.21.15.87:0/2647555085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f403b330 0x7f24f4057210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.873+0000 7f25029bc700 1 --2- 172.21.15.87:0/2647555085 >> v2:172.21.15.87:3300/0 conn(0x7f24f40e29f0 0x7f24f4055490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.873+0000 7f25029bc700 1 -- 172.21.15.87:0/2647555085 >> 172.21.15.87:0/2647555085 conn(0x7f24f4055c20 msgr2=0x7f24f4056020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:37.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.873+0000 7f25029bc700 1 -- 172.21.15.87:0/2647555085 shutdown_connections 2023-03-30T19:35:37.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.873+0000 7f25029bc700 1 -- 172.21.15.87:0/2647555085 wait complete. 2023-03-30T19:35:37.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.877+0000 7f25029bc700 1 Processor -- start 2023-03-30T19:35:37.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.877+0000 7f25029bc700 1 -- start start 2023-03-30T19:35:37.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.877+0000 7f25029bc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f4038560 0x7f24f404e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:37.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.877+0000 7f25029bc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24f403b330 0x7f24f40dd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:37.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.877+0000 7f25029bc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f40e29f0 0x7f24f404d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:37.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.877+0000 7f25029bc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f40ddca0 con 0x7f24f403b330 2023-03-30T19:35:37.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.877+0000 7f25029bc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f404dbf0 con 0x7f24f4038560 2023-03-30T19:35:37.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.877+0000 7f25011b9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24f403b330 0x7f24f40dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:37.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.877+0000 7f25021bb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f40e29f0 0x7f24f404d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:37.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.877+0000 7f25021bb700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f40e29f0 0x7f24f404d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:41466/0 (socket says 172.21.15.87:41466) 2023-03-30T19:35:37.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.877+0000 7f25021bb700 1 -- 172.21.15.87:0/1591900279 learned_addr learned my addr 172.21.15.87:0/1591900279 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:37.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.877+0000 7f25029bc700 1 -- 172.21.15.87:0/1591900279 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f4050270 con 0x7f24f40e29f0 2023-03-30T19:35:37.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.881+0000 7f25019ba700 1 --2- 172.21.15.87:0/1591900279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f4038560 0x7f24f404e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:37.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.881+0000 7f25021bb700 1 -- 172.21.15.87:0/1591900279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f4038560 msgr2=0x7f24f404e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:37.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.881+0000 7f25021bb700 1 --2- 172.21.15.87:0/1591900279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f4038560 0x7f24f404e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.881+0000 7f25021bb700 1 -- 172.21.15.87:0/1591900279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24f403b330 msgr2=0x7f24f40dd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:37.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.881+0000 7f25021bb700 1 --2- 172.21.15.87:0/1591900279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24f403b330 0x7f24f40dd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:37.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.881+0000 7f25021bb700 1 -- 172.21.15.87:0/1591900279 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f4053920 con 0x7f24f40e29f0 2023-03-30T19:35:37.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.881+0000 7f25019ba700 1 --2- 172.21.15.87:0/1591900279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f4038560 0x7f24f404e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T19:35:37.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.881+0000 7f25011b9700 1 --2- 172.21.15.87:0/1591900279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24f403b330 0x7f24f40dd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T19:35:37.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.881+0000 7f25021bb700 1 --2- 172.21.15.87:0/1591900279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f40e29f0 0x7f24f404d6b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f24fc063a20 tx=0x7f24fc0730a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:37.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.881+0000 7f24f27fc700 1 -- 172.21.15.87:0/1591900279 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc072ce0 con 0x7f24f40e29f0 2023-03-30T19:35:37.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.881+0000 7f24f27fc700 1 -- 172.21.15.87:0/1591900279 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc06f070 con 0x7f24f40e29f0 2023-03-30T19:35:37.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.881+0000 7f25029bc700 1 -- 172.21.15.87:0/1591900279 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f4007080 con 0x7f24f40e29f0 2023-03-30T19:35:37.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.881+0000 7f24f27fc700 1 -- 172.21.15.87:0/1591900279 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc066f90 con 0x7f24f40e29f0 2023-03-30T19:35:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.881+0000 7f25029bc700 1 -- 172.21.15.87:0/1591900279 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f4053c00 con 0x7f24f40e29f0 2023-03-30T19:35:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.885+0000 7f25029bc700 1 -- 172.21.15.87:0/1591900279 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f4005570 con 0x7f24f40e29f0 2023-03-30T19:35:37.888 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.885+0000 7f24f27fc700 1 -- 172.21.15.87:0/1591900279 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f24fc0670f0 con 0x7f24f40e29f0 2023-03-30T19:35:37.889 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.885+0000 7f24f27fc700 1 --2- 172.21.15.87:0/1591900279 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24e0065440 0x7f24e00678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:37.890 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.885+0000 7f25019ba700 1 --2- 172.21.15.87:0/1591900279 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24e0065440 0x7f24e00678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:37.891 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.885+0000 7f25019ba700 1 --2- 172.21.15.87:0/1591900279 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24e0065440 0x7f24e00678f0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009b70 tx=0x7f24ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:37.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.897+0000 7f24f27fc700 1 -- 172.21.15.87:0/1591900279 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f24fc099070 con 0x7f24f40e29f0 2023-03-30T19:35:37.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:37.905+0000 7f24f27fc700 1 -- 172.21.15.87:0/1591900279 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f24fc0ca640 con 0x7f24f40e29f0 2023-03-30T19:35:38.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.217+0000 7f25029bc700 1 -- 172.21.15.87:0/1591900279 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24f40077b0 con 0x7f24f40e29f0 2023-03-30T19:35:38.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.293+0000 7f24f27fc700 1 -- 172.21.15.87:0/1591900279 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f24fc0a2090 con 0x7f24f40e29f0 2023-03-30T19:35:38.297 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:38.297 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4958,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/474261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":474261391},{"type":"v1","addr":"172.21.15.115:6833","nonce":474261391}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/2626542689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2626542689},{"type":"v1","addr":"172.21.15.87:6836","nonce":2626542689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3981806958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3981806958},{"type":"v1","addr":"172.21.15.87:6837","nonce":3981806958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-30T08:12:16.963002+0000","modified":"2023-03-30T08:12:20.012842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5346},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5346":{"gid":5346,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6835/450554084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":450554084},{"type":"v1","addr":"172.21.15.115:6835","nonce":450554084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-30T19:35:38.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.293+0000 7f25029bc700 1 -- 172.21.15.87:0/1591900279 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24e0065440 msgr2=0x7f24e00678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:38.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.293+0000 7f25029bc700 1 --2- 172.21.15.87:0/1591900279 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24e0065440 0x7f24e00678f0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009b70 tx=0x7f24ec008040 comp rx=0 tx=0).stop 2023-03-30T19:35:38.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.293+0000 7f25029bc700 1 -- 172.21.15.87:0/1591900279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f40e29f0 msgr2=0x7f24f404d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:38.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.293+0000 7f25029bc700 1 --2- 172.21.15.87:0/1591900279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f40e29f0 0x7f24f404d6b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f24fc063a20 tx=0x7f24fc0730a0 comp rx=0 tx=0).stop 2023-03-30T19:35:38.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.293+0000 7f25029bc700 1 -- 172.21.15.87:0/1591900279 shutdown_connections 2023-03-30T19:35:38.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.293+0000 7f25029bc700 1 --2- 172.21.15.87:0/1591900279 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f24e0065440 0x7f24e00678f0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:38.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.293+0000 7f25029bc700 1 --2- 172.21.15.87:0/1591900279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f24f40e29f0 0x7f24f404d6b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:38.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.293+0000 7f25029bc700 1 --2- 172.21.15.87:0/1591900279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24f403b330 0x7f24f40dd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:38.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.293+0000 7f25029bc700 1 --2- 172.21.15.87:0/1591900279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f24f4038560 0x7f24f404e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:38.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.293+0000 7f25029bc700 1 -- 172.21.15.87:0/1591900279 >> 172.21.15.87:0/1591900279 conn(0x7f24f4055c20 msgr2=0x7f24f40e0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:38.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.297+0000 7f25029bc700 1 -- 172.21.15.87:0/1591900279 shutdown_connections 2023-03-30T19:35:38.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.297+0000 7f25029bc700 1 -- 172.21.15.87:0/1591900279 wait complete. 2023-03-30T19:35:38.302 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 17 2023-03-30T19:35:38.324 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T19:35:38.503 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.497+0000 7f9bc2ac7700 1 Processor -- start 2023-03-30T19:35:38.504 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.501+0000 7f9bc2ac7700 1 -- start start 2023-03-30T19:35:38.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.501+0000 7f9bc2ac7700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9bbc0b8380 0x7f9bbc0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:38.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.501+0000 7f9bc2ac7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9bbc06a3e0 0x7f9bbc0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:38.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.501+0000 7f9bc2ac7700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc160ef0 con 0x7f9bbc0d27e0 2023-03-30T19:35:38.507 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.501+0000 7f9bc2ac7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc0cd6a0 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.508 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.501+0000 7f9bc2ac7700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc0cd3a0 con 0x7f9bbc0b8380 2023-03-30T19:35:38.508 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.501+0000 7f9bc12c4700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9bbc0d27e0 0x7f9bbc069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34270/0 (socket says 172.21.15.87:34270) 2023-03-30T19:35:38.508 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.501+0000 7f9bc12c4700 1 -- 172.21.15.87:0/3385869524 learned_addr learned my addr 172.21.15.87:0/3385869524 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:38.508 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc22c6700 1 --2- 172.21.15.87:0/3385869524 >> v2:172.21.15.87:3300/0 conn(0x7f9bbc06a3e0 0x7f9bbc0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:38.509 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc22c6700 1 -- 172.21.15.87:0/3385869524 >> v2:172.21.15.115:3300/0 conn(0x7f9bbc0b8380 msgr2=0x7f9bbc0d2200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-30T19:35:38.509 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc22c6700 1 --2- 172.21.15.87:0/3385869524 >> v2:172.21.15.115:3300/0 conn(0x7f9bbc0b8380 0x7f9bbc0d2200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:38.509 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc22c6700 1 -- 172.21.15.87:0/3385869524 >> v1:172.21.15.87:6789/0 conn(0x7f9bbc0d27e0 legacy=0x7f9bbc069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:38.509 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc22c6700 1 -- 172.21.15.87:0/3385869524 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc0cef00 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.510 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc0ac3700 1 -- 172.21.15.87:0/3385869524 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228098982 0 0) 0x7f9bbc160ef0 con 0x7f9bbc0d27e0 2023-03-30T19:35:38.510 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc22c6700 1 --2- 172.21.15.87:0/3385869524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc06a3e0 0x7f9bbc0d0880 secure :-1 s=READY pgs=3318 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4009d90 tx=0x7f9bb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1aeb08640dfd93 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:38.510 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc0ac3700 1 -- 172.21.15.87:0/3385869524 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400e070 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.510 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc0ac3700 1 -- 172.21.15.87:0/3385869524 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb400bb90 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.511 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc0ac3700 1 -- 172.21.15.87:0/3385869524 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4012430 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.511 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc2ac7700 1 -- 172.21.15.87:0/3385869524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc06a3e0 msgr2=0x7f9bbc0d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:38.511 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc2ac7700 1 --2- 172.21.15.87:0/3385869524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc06a3e0 0x7f9bbc0d0880 secure :-1 s=READY pgs=3318 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4009d90 tx=0x7f9bb400b330 comp rx=0 tx=0).stop 2023-03-30T19:35:38.512 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc2ac7700 1 -- 172.21.15.87:0/3385869524 shutdown_connections 2023-03-30T19:35:38.512 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc2ac7700 1 --2- 172.21.15.87:0/3385869524 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc06a3e0 0x7f9bbc0d0880 unknown :-1 s=CLOSED pgs=3318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:38.512 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc2ac7700 1 --2- 172.21.15.87:0/3385869524 >> v2:172.21.15.115:3300/0 conn(0x7f9bbc0b8380 0x7f9bbc0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:38.513 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc2ac7700 1 -- 172.21.15.87:0/3385869524 >> 172.21.15.87:0/3385869524 conn(0x7f9bbc0b53f0 msgr2=0x7f9bbc0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:38.513 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc2ac7700 1 -- 172.21.15.87:0/3385869524 shutdown_connections 2023-03-30T19:35:38.513 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.505+0000 7f9bc2ac7700 1 -- 172.21.15.87:0/3385869524 wait complete. 2023-03-30T19:35:38.514 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.509+0000 7f9bc2ac7700 1 Processor -- start 2023-03-30T19:35:38.514 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.509+0000 7f9bc2ac7700 1 -- start start 2023-03-30T19:35:38.515 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.509+0000 7f9bc2ac7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc06a3e0 0x7f9bbc14faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:38.515 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.509+0000 7f9bc2ac7700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bbc0b8380 0x7f9bbc0cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:38.516 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.509+0000 7f9bc2ac7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9bbc0cb310 0x7f9bbc0c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:38.516 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.509+0000 7f9bc2ac7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc0cc480 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.516 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.509+0000 7f9bc2ac7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc1f5d70 con 0x7f9bbc0cb310 2023-03-30T19:35:38.517 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.509+0000 7f9bc2ac7700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc14ffe0 con 0x7f9bbc0b8380 2023-03-30T19:35:38.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.509+0000 7f9bc1ac5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc06a3e0 0x7f9bbc14faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:38.518 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.509+0000 7f9bc1ac5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc06a3e0 0x7f9bbc14faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54094/0 (socket says 172.21.15.87:54094) 2023-03-30T19:35:38.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.509+0000 7f9bc1ac5700 1 -- 172.21.15.87:0/1598521181 learned_addr learned my addr 172.21.15.87:0/1598521181 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:38.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.509+0000 7f9bc12c4700 1 --2- 172.21.15.87:0/1598521181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bbc0b8380 0x7f9bbc0cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:38.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.513+0000 7f9bc22c6700 1 --2- 172.21.15.87:0/1598521181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9bbc0cb310 0x7f9bbc0c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:38.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.513+0000 7f9bc1ac5700 1 -- 172.21.15.87:0/1598521181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bbc0b8380 msgr2=0x7f9bbc0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:38.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.513+0000 7f9bc1ac5700 1 --2- 172.21.15.87:0/1598521181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bbc0b8380 0x7f9bbc0cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:38.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.513+0000 7f9bc1ac5700 1 -- 172.21.15.87:0/1598521181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9bbc0cb310 msgr2=0x7f9bbc0c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:38.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.513+0000 7f9bc1ac5700 1 --2- 172.21.15.87:0/1598521181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9bbc0cb310 0x7f9bbc0c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:38.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.513+0000 7f9bc1ac5700 1 -- 172.21.15.87:0/1598521181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb4009a70 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.513+0000 7f9bc1ac5700 1 --2- 172.21.15.87:0/1598521181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc06a3e0 0x7f9bbc14faa0 secure :-1 s=READY pgs=3319 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800b520 tx=0x7f9bb800b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:38.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.513+0000 7f9bb27fc700 1 -- 172.21.15.87:0/1598521181 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8011830 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.513+0000 7f9bb27fc700 1 -- 172.21.15.87:0/1598521181 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb80119b0 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.513+0000 7f9bb27fc700 1 -- 172.21.15.87:0/1598521181 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8011d60 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.513+0000 7f9bc2ac7700 1 -- 172.21.15.87:0/1598521181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc0cf480 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.513+0000 7f9bc2ac7700 1 -- 172.21.15.87:0/1598521181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc0cf1a0 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.523 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.513+0000 7f9bc2ac7700 1 -- 172.21.15.87:0/1598521181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc0b8750 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.525+0000 7f9bb27fc700 1 -- 172.21.15.87:0/1598521181 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f9bb801a400 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.529+0000 7f9bb27fc700 1 --2- 172.21.15.87:0/1598521181 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ba0065440 0x7f9ba00678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:38.533 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.529+0000 7f9bc12c4700 1 --2- 172.21.15.87:0/1598521181 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ba0065440 0x7f9ba00678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:38.534 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.529+0000 7f9bc12c4700 1 --2- 172.21.15.87:0/1598521181 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ba0065440 0x7f9ba00678f0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc15b6f0 tx=0x7f9bac007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.557+0000 7f9bb27fc700 1 -- 172.21.15.87:0/1598521181 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f9bb805c7c0 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.564 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.561+0000 7f9bb27fc700 1 -- 172.21.15.87:0/1598521181 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f9bb8050ac0 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.814 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.809+0000 7f9bc2ac7700 1 -- 172.21.15.87:0/1598521181 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bbc072cf0 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.816 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.813+0000 7f9bb27fc700 1 -- 172.21.15.87:0/1598521181 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+18123 (secure 0 0 0) 0x7f9bb8015090 con 0x7f9bbc06a3e0 2023-03-30T19:35:38.816 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:38.817 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":45,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T08:12:40.165947+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-03-30T08:12:14.871645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-03-30T08:12:15.991480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":4}]},{"pgid":"7.2a","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T19:35:38.819 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.813+0000 7f9bc2ac7700 1 -- 172.21.15.87:0/1598521181 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ba0065440 msgr2=0x7f9ba00678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:38.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.813+0000 7f9bc2ac7700 1 --2- 172.21.15.87:0/1598521181 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ba0065440 0x7f9ba00678f0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc15b6f0 tx=0x7f9bac007e90 comp rx=0 tx=0).stop 2023-03-30T19:35:38.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.813+0000 7f9bc2ac7700 1 -- 172.21.15.87:0/1598521181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc06a3e0 msgr2=0x7f9bbc14faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:38.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.813+0000 7f9bc2ac7700 1 --2- 172.21.15.87:0/1598521181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc06a3e0 0x7f9bbc14faa0 secure :-1 s=READY pgs=3319 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800b520 tx=0x7f9bb800b830 comp rx=0 tx=0).stop 2023-03-30T19:35:38.820 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.817+0000 7f9bc2ac7700 1 -- 172.21.15.87:0/1598521181 shutdown_connections 2023-03-30T19:35:38.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.817+0000 7f9bc2ac7700 1 --2- 172.21.15.87:0/1598521181 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9ba0065440 0x7f9ba00678f0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:38.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.817+0000 7f9bc2ac7700 1 --2- 172.21.15.87:0/1598521181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9bbc0cb310 0x7f9bbc0c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:38.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.817+0000 7f9bc2ac7700 1 --2- 172.21.15.87:0/1598521181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9bbc0b8380 0x7f9bbc0cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:38.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.817+0000 7f9bc2ac7700 1 --2- 172.21.15.87:0/1598521181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9bbc06a3e0 0x7f9bbc14faa0 unknown :-1 s=CLOSED pgs=3319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:38.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.817+0000 7f9bc2ac7700 1 -- 172.21.15.87:0/1598521181 >> 172.21.15.87:0/1598521181 conn(0x7f9bbc0b53f0 msgr2=0x7f9bbc0b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:38.821 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.817+0000 7f9bc2ac7700 1 -- 172.21.15.87:0/1598521181 shutdown_connections 2023-03-30T19:35:38.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:38.817+0000 7f9bc2ac7700 1 -- 172.21.15.87:0/1598521181 wait complete. 2023-03-30T19:35:38.848 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-03-30T19:35:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.041+0000 7f67629b4700 1 Processor -- start 2023-03-30T19:35:39.046 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.041+0000 7f67629b4700 1 -- start start 2023-03-30T19:35:39.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.041+0000 7f67629b4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f675c15cec0 0x7f675c0cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67611b1700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f675c0b5330 0x7f675c15d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:50362/0 (socket says 172.21.15.87:50362) 2023-03-30T19:35:39.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67611b1700 1 -- 172.21.15.87:0/2694574102 learned_addr learned my addr 172.21.15.87:0/2694574102 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:39.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67629b4700 1 -- 172.21.15.87:0/2694574102 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675c15d9a0 con 0x7f675c0b46b0 2023-03-30T19:35:39.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67629b4700 1 -- 172.21.15.87:0/2694574102 --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675c0cd280 con 0x7f675c0b5330 2023-03-30T19:35:39.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67629b4700 1 -- 172.21.15.87:0/2694574102 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0cd520 con 0x7f675c15cec0 2023-03-30T19:35:39.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445051742 0 0) 0x7f675c0cd280 con 0x7f675c0b5330 2023-03-30T19:35:39.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67480035d0 con 0x7f675c0b5330 2023-03-30T19:35:39.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527682586 0 0) 0x7f675c15d9a0 con 0x7f675c0b46b0 2023-03-30T19:35:39.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f675c0cd280 con 0x7f675c0b46b0 2023-03-30T19:35:39.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 <== mon.1 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1728909231 0 0) 0x7f67480035d0 con 0x7f675c0b5330 2023-03-30T19:35:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f675c15cec0 msgr2=0x7f675c0cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 --2- 172.21.15.87:0/2694574102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f675c15cec0 0x7f675c0cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 >> v1:172.21.15.87:6789/0 conn(0x7f675c0b46b0 legacy=0x7f675c0d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c0cd800 con 0x7f675c0b5330 2023-03-30T19:35:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 <== mon.1 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f674c001670 con 0x7f675c0b5330 2023-03-30T19:35:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 >> v1:172.21.15.115:6789/0 conn(0x7f675c0b5330 legacy=0x7f675c15d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 --2- 172.21.15.87:0/2694574102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6748003bb0 0x7f6748003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 --2- 172.21.15.87:0/2694574102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f675c15cec0 0x7f6748004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 --2- 172.21.15.87:0/2694574102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6748004e20 0x7f6748005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0cd520 con 0x7f6748003bb0 2023-03-30T19:35:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674800bcd0 con 0x7f6748004e20 2023-03-30T19:35:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67480146a0 con 0x7f675c15cec0 2023-03-30T19:35:39.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67619b2700 1 --2- 172.21.15.87:0/2694574102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6748003bb0 0x7f6748003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:39.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67621b3700 1 --2- 172.21.15.87:0/2694574102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6748004e20 0x7f6748005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:39.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67619b2700 1 -- 172.21.15.87:0/2694574102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f675c15cec0 msgr2=0x7f6748004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:39.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67619b2700 1 --2- 172.21.15.87:0/2694574102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f675c15cec0 0x7f6748004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67619b2700 1 -- 172.21.15.87:0/2694574102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6748004e20 msgr2=0x7f6748005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:39.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67619b2700 1 --2- 172.21.15.87:0/2694574102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6748004e20 0x7f6748005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.045+0000 7f67619b2700 1 -- 172.21.15.87:0/2694574102 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67480035d0 con 0x7f6748003bb0 2023-03-30T19:35:39.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.049+0000 7f67619b2700 1 --2- 172.21.15.87:0/2694574102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6748003bb0 0x7f6748003fa0 secure :-1 s=READY pgs=3321 cs=0 l=1 rev1=1 crypto rx=0x7f6758009930 tx=0x7f67480058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0534aa63783d05 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:39.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.049+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580093a0 con 0x7f6748003bb0 2023-03-30T19:35:39.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.049+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6758011620 con 0x7f6748003bb0 2023-03-30T19:35:39.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.049+0000 7f67609b0700 1 -- 172.21.15.87:0/2694574102 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580119b0 con 0x7f6748003bb0 2023-03-30T19:35:39.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.049+0000 7f67629b4700 1 -- 172.21.15.87:0/2694574102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6748003bb0 msgr2=0x7f6748003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:39.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.049+0000 7f67629b4700 1 --2- 172.21.15.87:0/2694574102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6748003bb0 0x7f6748003fa0 secure :-1 s=READY pgs=3321 cs=0 l=1 rev1=1 crypto rx=0x7f6758009930 tx=0x7f67480058a0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.049+0000 7f67621b3700 1 -- 172.21.15.87:0/2694574102 reap_dead start 2023-03-30T19:35:39.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.049+0000 7f67629b4700 1 -- 172.21.15.87:0/2694574102 shutdown_connections 2023-03-30T19:35:39.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.049+0000 7f67629b4700 1 -- 172.21.15.87:0/2694574102 >> 172.21.15.87:0/2694574102 conn(0x7f675c06b1b0 msgr2=0x7f675c06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:39.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.049+0000 7f67629b4700 1 -- 172.21.15.87:0/2694574102 shutdown_connections 2023-03-30T19:35:39.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.049+0000 7f67629b4700 1 -- 172.21.15.87:0/2694574102 wait complete. 2023-03-30T19:35:39.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67629b4700 1 Processor -- start 2023-03-30T19:35:39.057 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67629b4700 1 -- start start 2023-03-30T19:35:39.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67629b4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6748003bb0 0x7f675c14f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.058 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67629b4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f675c151c90 0x7f675c152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67629b4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f675c0b6930 0x7f675c0b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67629b4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c0cb350 con 0x7f6748003bb0 2023-03-30T19:35:39.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67629b4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c152710 con 0x7f675c0b6930 2023-03-30T19:35:39.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67629b4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c1529f0 con 0x7f675c151c90 2023-03-30T19:35:39.059 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67619b2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6748003bb0 0x7f675c14f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:39.060 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67619b2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6748003bb0 0x7f675c14f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54114/0 (socket says 172.21.15.87:54114) 2023-03-30T19:35:39.060 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67619b2700 1 -- 172.21.15.87:0/2492737342 learned_addr learned my addr 172.21.15.87:0/2492737342 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:39.060 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67621b3700 1 --2- 172.21.15.87:0/2492737342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f675c0b6930 0x7f675c0b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:39.060 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67619b2700 1 -- 172.21.15.87:0/2492737342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f675c151c90 msgr2=0x7f675c152100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-30T19:35:39.060 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67619b2700 1 --2- 172.21.15.87:0/2492737342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f675c151c90 0x7f675c152100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.060 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67619b2700 1 -- 172.21.15.87:0/2492737342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f675c0b6930 msgr2=0x7f675c0b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:39.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67619b2700 1 --2- 172.21.15.87:0/2492737342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f675c0b6930 0x7f675c0b6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.053+0000 7f67619b2700 1 -- 172.21.15.87:0/2492737342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c0cf490 con 0x7f6748003bb0 2023-03-30T19:35:39.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.057+0000 7f67619b2700 1 --2- 172.21.15.87:0/2492737342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6748003bb0 0x7f675c14f300 secure :-1 s=READY pgs=3322 cs=0 l=1 rev1=1 crypto rx=0x7f67580090b0 tx=0x7f6758004880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:39.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.057+0000 7f67527fc700 1 -- 172.21.15.87:0/2492737342 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580093a0 con 0x7f6748003bb0 2023-03-30T19:35:39.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.057+0000 7f67527fc700 1 -- 172.21.15.87:0/2492737342 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6758024420 con 0x7f6748003bb0 2023-03-30T19:35:39.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.057+0000 7f67527fc700 1 -- 172.21.15.87:0/2492737342 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580247d0 con 0x7f6748003bb0 2023-03-30T19:35:39.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.057+0000 7f67629b4700 1 -- 172.21.15.87:0/2492737342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675c0cf1b0 con 0x7f6748003bb0 2023-03-30T19:35:39.062 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.057+0000 7f67629b4700 1 -- 172.21.15.87:0/2492737342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675c0cee80 con 0x7f6748003bb0 2023-03-30T19:35:39.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.061+0000 7f67629b4700 1 -- 172.21.15.87:0/2492737342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675c0733a0 con 0x7f6748003bb0 2023-03-30T19:35:39.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.061+0000 7f67527fc700 1 -- 172.21.15.87:0/2492737342 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6758022070 con 0x7f6748003bb0 2023-03-30T19:35:39.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.065+0000 7f67527fc700 1 --2- 172.21.15.87:0/2492737342 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f67400654f0 0x7f67400679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.065+0000 7f67527fc700 1 -- 172.21.15.87:0/2492737342 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f67580833e0 con 0x7f6748003bb0 2023-03-30T19:35:39.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.065+0000 7f67611b1700 1 --2- 172.21.15.87:0/2492737342 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f67400654f0 0x7f67400679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:39.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.065+0000 7f67611b1700 1 --2- 172.21.15.87:0/2492737342 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f67400654f0 0x7f67400679a0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f675c0b2790 tx=0x7f674c001470 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:39.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.069+0000 7f67527fc700 1 -- 172.21.15.87:0/2492737342 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f6758054980 con 0x7f6748003bb0 2023-03-30T19:35:39.390 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.385+0000 7f67629b4700 1 -- 172.21.15.87:0/2492737342 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f675c06a7e0 con 0x7f6748003bb0 2023-03-30T19:35:39.731 INFO:tasks.ceph.mon.a.smithi087.stderr:2023-03-30T19:35:39.725+0000 7f988c1f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-03-30T19:35:39.776 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.773+0000 7f67527fc700 1 -- 172.21.15.87:0/2492737342 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6758054570 con 0x7f6748003bb0 2023-03-30T19:35:39.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.773+0000 7f67629b4700 1 -- 172.21.15.87:0/2492737342 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f67400654f0 msgr2=0x7f67400679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:39.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.773+0000 7f67629b4700 1 --2- 172.21.15.87:0/2492737342 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f67400654f0 0x7f67400679a0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f675c0b2790 tx=0x7f674c001470 comp rx=0 tx=0).stop 2023-03-30T19:35:39.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.773+0000 7f67629b4700 1 -- 172.21.15.87:0/2492737342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6748003bb0 msgr2=0x7f675c14f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:39.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.773+0000 7f67629b4700 1 --2- 172.21.15.87:0/2492737342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6748003bb0 0x7f675c14f300 secure :-1 s=READY pgs=3322 cs=0 l=1 rev1=1 crypto rx=0x7f67580090b0 tx=0x7f6758004880 comp rx=0 tx=0).stop 2023-03-30T19:35:39.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.773+0000 7f67629b4700 1 -- 172.21.15.87:0/2492737342 shutdown_connections 2023-03-30T19:35:39.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.773+0000 7f67629b4700 1 --2- 172.21.15.87:0/2492737342 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f67400654f0 0x7f67400679a0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.773+0000 7f67629b4700 1 --2- 172.21.15.87:0/2492737342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f675c0b6930 0x7f675c0b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.773+0000 7f67629b4700 1 --2- 172.21.15.87:0/2492737342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f675c151c90 0x7f675c152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.773+0000 7f67629b4700 1 --2- 172.21.15.87:0/2492737342 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6748003bb0 0x7f675c14f300 unknown :-1 s=CLOSED pgs=3322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.773+0000 7f67629b4700 1 -- 172.21.15.87:0/2492737342 >> 172.21.15.87:0/2492737342 conn(0x7f675c06b1b0 msgr2=0x7f675c15f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:39.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.773+0000 7f67629b4700 1 -- 172.21.15.87:0/2492737342 shutdown_connections 2023-03-30T19:35:39.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.773+0000 7f67629b4700 1 -- 172.21.15.87:0/2492737342 wait complete. 2023-03-30T19:35:39.781 INFO:teuthology.orchestra.run.smithi087.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-03-30T19:35:39.799 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-03-30T19:35:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.949+0000 7f8ef71a1700 1 Processor -- start 2023-03-30T19:35:39.953 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.949+0000 7f8ef71a1700 1 -- start start 2023-03-30T19:35:39.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.949+0000 7f8ef71a1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8ef00cf6a0 0x7f8ef00cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.949+0000 7f8ef71a1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef015fec0 con 0x7f8ef0071350 2023-03-30T19:35:39.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef71a1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef00ceca0 con 0x7f8ef015c2e0 2023-03-30T19:35:39.956 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef71a1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef00cc970 con 0x7f8ef00cf6a0 2023-03-30T19:35:39.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef599e700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8ef0071350 0x7f8ef00cef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58616/0 (socket says 172.21.15.87:58616) 2023-03-30T19:35:39.957 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef599e700 1 -- 172.21.15.87:0/2109496217 learned_addr learned my addr 172.21.15.87:0/2109496217 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:39.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef519d700 1 -- 172.21.15.87:0/2109496217 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521575132 0 0) 0x7f8ef015fec0 con 0x7f8ef0071350 2023-03-30T19:35:39.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef519d700 1 -- 172.21.15.87:0/2109496217 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8edc0035d0 con 0x7f8ef0071350 2023-03-30T19:35:39.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef519d700 1 -- 172.21.15.87:0/2109496217 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2620626029 0 0) 0x7f8edc0035d0 con 0x7f8ef0071350 2023-03-30T19:35:39.958 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef519d700 1 -- 172.21.15.87:0/2109496217 >> v2:172.21.15.115:3300/0 conn(0x7f8ef00cf6a0 msgr2=0x7f8ef00cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:39.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef519d700 1 --2- 172.21.15.87:0/2109496217 >> v2:172.21.15.115:3300/0 conn(0x7f8ef00cf6a0 0x7f8ef00cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef519d700 1 -- 172.21.15.87:0/2109496217 >> v1:172.21.15.115:6789/0 conn(0x7f8ef015c2e0 legacy=0x7f8ef00c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:39.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef519d700 1 -- 172.21.15.87:0/2109496217 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef0071830 con 0x7f8ef0071350 2023-03-30T19:35:39.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef519d700 1 -- 172.21.15.87:0/2109496217 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f8ee0001670 con 0x7f8ef0071350 2023-03-30T19:35:39.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef519d700 1 -- 172.21.15.87:0/2109496217 >> v1:172.21.15.87:6789/0 conn(0x7f8ef0071350 legacy=0x7f8ef00cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:39.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef519d700 1 --2- 172.21.15.87:0/2109496217 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8edc003a20 0x7f8edc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.959 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef519d700 1 --2- 172.21.15.87:0/2109496217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc004870 0x7f8edc004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef519d700 1 --2- 172.21.15.87:0/2109496217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc005370 0x7f8edc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef519d700 1 -- 172.21.15.87:0/2109496217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc00c270 con 0x7f8edc005370 2023-03-30T19:35:39.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef519d700 1 -- 172.21.15.87:0/2109496217 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc00c3e0 con 0x7f8edc004870 2023-03-30T19:35:39.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef519d700 1 -- 172.21.15.87:0/2109496217 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc00c5a0 con 0x7f8edc003a20 2023-03-30T19:35:39.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef69a0700 1 --2- 172.21.15.87:0/2109496217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc005370 0x7f8edc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:39.960 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef619f700 1 --2- 172.21.15.87:0/2109496217 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8edc003a20 0x7f8edc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:39.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef69a0700 1 -- 172.21.15.87:0/2109496217 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8edc003a20 msgr2=0x7f8edc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:39.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef69a0700 1 --2- 172.21.15.87:0/2109496217 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8edc003a20 0x7f8edc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef69a0700 1 -- 172.21.15.87:0/2109496217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc004870 msgr2=0x7f8edc004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:39.961 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef69a0700 1 --2- 172.21.15.87:0/2109496217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc004870 0x7f8edc004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef69a0700 1 -- 172.21.15.87:0/2109496217 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc0035d0 con 0x7f8edc005370 2023-03-30T19:35:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.953+0000 7f8ef69a0700 1 -- 172.21.15.87:0/2109496217 reap_dead start 2023-03-30T19:35:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.965+0000 7f8ef69a0700 1 --2- 172.21.15.87:0/2109496217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc005370 0x7f8edc00ba30 secure :-1 s=READY pgs=3324 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00cfac0 tx=0x7f8edc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60dc0afa9979167 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.965+0000 7f8ef519d700 1 -- 172.21.15.87:0/2109496217 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80098b0 con 0x7f8edc005370 2023-03-30T19:35:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.965+0000 7f8ef519d700 1 -- 172.21.15.87:0/2109496217 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee8003c40 con 0x7f8edc005370 2023-03-30T19:35:39.968 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.965+0000 7f8ef519d700 1 -- 172.21.15.87:0/2109496217 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8009e50 con 0x7f8edc005370 2023-03-30T19:35:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.965+0000 7f8ef71a1700 1 -- 172.21.15.87:0/2109496217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc005370 msgr2=0x7f8edc00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:39.969 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.965+0000 7f8ef71a1700 1 --2- 172.21.15.87:0/2109496217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc005370 0x7f8edc00ba30 secure :-1 s=READY pgs=3324 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00cfac0 tx=0x7f8edc0058a0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.965+0000 7f8ef71a1700 1 -- 172.21.15.87:0/2109496217 shutdown_connections 2023-03-30T19:35:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.965+0000 7f8ef71a1700 1 --2- 172.21.15.87:0/2109496217 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8edc005370 0x7f8edc00ba30 unknown :-1 s=CLOSED pgs=3324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.965+0000 7f8ef71a1700 1 -- 172.21.15.87:0/2109496217 >> 172.21.15.87:0/2109496217 conn(0x7f8ef00b0b80 msgr2=0x7f8ef00b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.965+0000 7f8ef71a1700 1 -- 172.21.15.87:0/2109496217 shutdown_connections 2023-03-30T19:35:39.970 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.965+0000 7f8ef71a1700 1 -- 172.21.15.87:0/2109496217 wait complete. 2023-03-30T19:35:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.965+0000 7f8ef71a1700 1 Processor -- start 2023-03-30T19:35:39.971 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.965+0000 7f8ef71a1700 1 -- start start 2023-03-30T19:35:39.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef71a1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc005370 0x7f8ef014fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.972 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef71a1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ef0150b30 0x7f8ef015d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef71a1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ef00c4bf0 0x7f8ef015b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef71a1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef00c4760 con 0x7f8ef00c4bf0 2023-03-30T19:35:39.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef71a1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef00c3e30 con 0x7f8edc005370 2023-03-30T19:35:39.973 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef71a1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef00c4110 con 0x7f8ef0150b30 2023-03-30T19:35:39.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef69a0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ef00c4bf0 0x7f8ef015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:39.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef69a0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ef00c4bf0 0x7f8ef015b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44448/0 (socket says 172.21.15.87:44448) 2023-03-30T19:35:39.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef69a0700 1 -- 172.21.15.87:0/3111001075 learned_addr learned my addr 172.21.15.87:0/3111001075 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:39.974 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef599e700 1 --2- 172.21.15.87:0/3111001075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ef0150b30 0x7f8ef015d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:39.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef69a0700 1 -- 172.21.15.87:0/3111001075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ef0150b30 msgr2=0x7f8ef015d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:39.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef69a0700 1 --2- 172.21.15.87:0/3111001075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ef0150b30 0x7f8ef015d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef69a0700 1 -- 172.21.15.87:0/3111001075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc005370 msgr2=0x7f8ef014fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:39.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef69a0700 1 --2- 172.21.15.87:0/3111001075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc005370 0x7f8ef014fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:39.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef69a0700 1 -- 172.21.15.87:0/3111001075 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef00ccf80 con 0x7f8ef00c4bf0 2023-03-30T19:35:39.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef69a0700 1 --2- 172.21.15.87:0/3111001075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ef00c4bf0 0x7f8ef015b080 secure :-1 s=READY pgs=3325 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00ccb20 tx=0x7f8ee8004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:39.975 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ee6ffd700 1 -- 172.21.15.87:0/3111001075 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8004220 con 0x7f8ef00c4bf0 2023-03-30T19:35:39.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ee6ffd700 1 -- 172.21.15.87:0/3111001075 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee8004380 con 0x7f8ef00c4bf0 2023-03-30T19:35:39.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ee6ffd700 1 -- 172.21.15.87:0/3111001075 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8004730 con 0x7f8ef00c4bf0 2023-03-30T19:35:39.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef71a1700 1 -- 172.21.15.87:0/3111001075 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef00ccca0 con 0x7f8ef00c4bf0 2023-03-30T19:35:39.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.969+0000 7f8ef71a1700 1 -- 172.21.15.87:0/3111001075 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef00cd260 con 0x7f8ef00c4bf0 2023-03-30T19:35:39.976 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.973+0000 7f8ef71a1700 1 -- 172.21.15.87:0/3111001075 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef00733a0 con 0x7f8ef00c4bf0 2023-03-30T19:35:39.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.973+0000 7f8ee6ffd700 1 -- 172.21.15.87:0/3111001075 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f8ee8015420 con 0x7f8ef00c4bf0 2023-03-30T19:35:39.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.973+0000 7f8ee6ffd700 1 --2- 172.21.15.87:0/3111001075 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8ed4065420 0x7f8ed40678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:39.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.973+0000 7f8ee6ffd700 1 -- 172.21.15.87:0/3111001075 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f8ee8011070 con 0x7f8ef00c4bf0 2023-03-30T19:35:39.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.973+0000 7f8ef619f700 1 --2- 172.21.15.87:0/3111001075 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8ed4065420 0x7f8ed40678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:39.979 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.973+0000 7f8ef619f700 1 --2- 172.21.15.87:0/3111001075 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8ed4065420 0x7f8ed40678d0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f8eec007fd0 tx=0x7f8eec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:39.985 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:39.981+0000 7f8ee6ffd700 1 -- 172.21.15.87:0/3111001075 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f8ee8051460 con 0x7f8ef00c4bf0 2023-03-30T19:35:40.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.221+0000 7f8ef71a1700 1 -- 172.21.15.87:0/3111001075 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8ef0071130 con 0x7f8ef00c4bf0 2023-03-30T19:35:40.771 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.765+0000 7f8ee6ffd700 1 -- 172.21.15.87:0/3111001075 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8ee8054a80 con 0x7f8ef00c4bf0 2023-03-30T19:35:40.777 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.773+0000 7f8ef71a1700 1 -- 172.21.15.87:0/3111001075 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8ed4065420 msgr2=0x7f8ed40678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:40.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.773+0000 7f8ef71a1700 1 --2- 172.21.15.87:0/3111001075 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8ed4065420 0x7f8ed40678d0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f8eec007fd0 tx=0x7f8eec009040 comp rx=0 tx=0).stop 2023-03-30T19:35:40.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.773+0000 7f8ef71a1700 1 -- 172.21.15.87:0/3111001075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ef00c4bf0 msgr2=0x7f8ef015b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:40.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.773+0000 7f8ef71a1700 1 --2- 172.21.15.87:0/3111001075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ef00c4bf0 0x7f8ef015b080 secure :-1 s=READY pgs=3325 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00ccb20 tx=0x7f8ee8004c00 comp rx=0 tx=0).stop 2023-03-30T19:35:40.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.773+0000 7f8ef71a1700 1 -- 172.21.15.87:0/3111001075 shutdown_connections 2023-03-30T19:35:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.773+0000 7f8ef71a1700 1 --2- 172.21.15.87:0/3111001075 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f8ed4065420 0x7f8ed40678d0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.773+0000 7f8ef71a1700 1 --2- 172.21.15.87:0/3111001075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8ef00c4bf0 0x7f8ef015b080 unknown :-1 s=CLOSED pgs=3325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.773+0000 7f8ef71a1700 1 --2- 172.21.15.87:0/3111001075 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ef0150b30 0x7f8ef015d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.773+0000 7f8ef71a1700 1 --2- 172.21.15.87:0/3111001075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8edc005370 0x7f8ef014fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:40.779 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.773+0000 7f8ef71a1700 1 -- 172.21.15.87:0/3111001075 >> 172.21.15.87:0/3111001075 conn(0x7f8ef00b0b80 msgr2=0x7f8ef015a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:40.780 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.773+0000 7f8ef71a1700 1 -- 172.21.15.87:0/3111001075 shutdown_connections 2023-03-30T19:35:40.781 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.773+0000 7f8ef71a1700 1 -- 172.21.15.87:0/3111001075 wait complete. 2023-03-30T19:35:40.802 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-03-30T19:35:40.977 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.973+0000 7f3334def700 1 Processor -- start 2023-03-30T19:35:40.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.973+0000 7f3334def700 1 -- start start 2023-03-30T19:35:40.980 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f3334def700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3330163dc0 0x7f33300c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:40.980 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f3334def700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3330164190 0x7f33300c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:40.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f3334def700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333006b3a0 con 0x7f33300aea30 2023-03-30T19:35:40.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f3334def700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333006d810 con 0x7f3330163dc0 2023-03-30T19:35:40.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f3334def700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33300cc1d0 con 0x7f3330164190 2023-03-30T19:35:40.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f332effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3330164190 0x7f33300c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:40.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f332ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f33300aea30 0x7f3330164600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:47158/0 (socket says 172.21.15.87:47158) 2023-03-30T19:35:40.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f332ffff700 1 -- 172.21.15.87:0/2629488786 learned_addr learned my addr 172.21.15.87:0/2629488786 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:40.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f332f7fe700 1 --2- 172.21.15.87:0/2629488786 >> v2:172.21.15.87:3300/0 conn(0x7f3330163dc0 0x7f33300c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:40.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f332effd700 1 -- 172.21.15.87:0/2629488786 >> v2:172.21.15.87:3300/0 conn(0x7f3330163dc0 msgr2=0x7f33300c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:40.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f332effd700 1 --2- 172.21.15.87:0/2629488786 >> v2:172.21.15.87:3300/0 conn(0x7f3330163dc0 0x7f33300c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:40.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f332effd700 1 -- 172.21.15.87:0/2629488786 >> v1:172.21.15.115:6789/0 conn(0x7f33300aea30 legacy=0x7f3330164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:40.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f332effd700 1 -- 172.21.15.87:0/2629488786 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3330069f00 con 0x7f3330164190 2023-03-30T19:35:40.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f332e7fc700 1 -- 172.21.15.87:0/2629488786 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327965300 0 0) 0x7f3328001490 con 0x7f33300aea30 2023-03-30T19:35:40.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f332effd700 1 --2- 172.21.15.87:0/2629488786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3330164190 0x7f33300c9b00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f333006c020 tx=0x7f3324009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=569df008db7d5d0c server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:40.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f332e7fc700 1 -- 172.21.15.87:0/2629488786 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324011830 con 0x7f3330164190 2023-03-30T19:35:40.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f332e7fc700 1 -- 172.21.15.87:0/2629488786 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3324011990 con 0x7f3330164190 2023-03-30T19:35:40.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.977+0000 7f332e7fc700 1 -- 172.21.15.87:0/2629488786 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324011d20 con 0x7f3330164190 2023-03-30T19:35:40.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.981+0000 7f3334def700 1 -- 172.21.15.87:0/2629488786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3330164190 msgr2=0x7f33300c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:40.985 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.981+0000 7f3334def700 1 --2- 172.21.15.87:0/2629488786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3330164190 0x7f33300c9b00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f333006c020 tx=0x7f3324009b30 comp rx=0 tx=0).stop 2023-03-30T19:35:40.985 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.981+0000 7f3334def700 1 -- 172.21.15.87:0/2629488786 shutdown_connections 2023-03-30T19:35:40.985 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.981+0000 7f3334def700 1 --2- 172.21.15.87:0/2629488786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3330164190 0x7f33300c9b00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:40.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.981+0000 7f3334def700 1 --2- 172.21.15.87:0/2629488786 >> v2:172.21.15.87:3300/0 conn(0x7f3330163dc0 0x7f33300c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:40.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.981+0000 7f3334def700 1 -- 172.21.15.87:0/2629488786 >> 172.21.15.87:0/2629488786 conn(0x7f33300cf410 msgr2=0x7f33300cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:40.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.981+0000 7f3334def700 1 -- 172.21.15.87:0/2629488786 shutdown_connections 2023-03-30T19:35:40.986 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.981+0000 7f3334def700 1 -- 172.21.15.87:0/2629488786 wait complete. 2023-03-30T19:35:40.988 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.985+0000 7f3334def700 1 Processor -- start 2023-03-30T19:35:40.989 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.985+0000 7f3334def700 1 -- start start 2023-03-30T19:35:40.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.985+0000 7f3334def700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33300aea30 0x7f3330158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:40.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.985+0000 7f3334def700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3330163dc0 0x7f333015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:40.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.985+0000 7f3334def700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3330164190 0x7f33300c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:40.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.985+0000 7f3334def700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33301592e0 con 0x7f33300aea30 2023-03-30T19:35:40.990 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.985+0000 7f3334def700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3330159860 con 0x7f3330164190 2023-03-30T19:35:40.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.985+0000 7f3334def700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3330159b00 con 0x7f3330163dc0 2023-03-30T19:35:40.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.985+0000 7f332ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3330164190 0x7f33300c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:40.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.985+0000 7f332effd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3330163dc0 0x7f333015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:40.991 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.985+0000 7f332ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3330164190 0x7f33300c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:42066/0 (socket says 172.21.15.87:42066) 2023-03-30T19:35:40.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.985+0000 7f332ffff700 1 -- 172.21.15.87:0/2189739563 learned_addr learned my addr 172.21.15.87:0/2189739563 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:40.992 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.985+0000 7f332ffff700 1 -- 172.21.15.87:0/2189739563 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3330163dc0 msgr2=0x7f333015a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:40.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.985+0000 7f332ffff700 1 --2- 172.21.15.87:0/2189739563 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3330163dc0 0x7f333015a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:40.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.989+0000 7f332ffff700 1 -- 172.21.15.87:0/2189739563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33300aea30 msgr2=0x7f3330158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:40.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.989+0000 7f332ffff700 1 --2- 172.21.15.87:0/2189739563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33300aea30 0x7f3330158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:40.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.989+0000 7f332ffff700 1 -- 172.21.15.87:0/2189739563 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33240094b0 con 0x7f3330164190 2023-03-30T19:35:40.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.989+0000 7f332effd700 1 --2- 172.21.15.87:0/2189739563 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3330163dc0 0x7f333015a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T19:35:40.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.989+0000 7f332ffff700 1 --2- 172.21.15.87:0/2189739563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3330164190 0x7f33300c4210 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f332800cba0 tx=0x7f332800ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:40.993 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.989+0000 7f3317fff700 1 -- 172.21.15.87:0/2189739563 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332800aad0 con 0x7f3330164190 2023-03-30T19:35:40.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.989+0000 7f3317fff700 1 -- 172.21.15.87:0/2189739563 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332800ac30 con 0x7f3330164190 2023-03-30T19:35:40.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.989+0000 7f3317fff700 1 -- 172.21.15.87:0/2189739563 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33280070d0 con 0x7f3330164190 2023-03-30T19:35:40.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.989+0000 7f3334def700 1 -- 172.21.15.87:0/2189739563 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333006d250 con 0x7f3330164190 2023-03-30T19:35:40.994 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.989+0000 7f3334def700 1 -- 172.21.15.87:0/2189739563 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333006cf70 con 0x7f3330164190 2023-03-30T19:35:40.995 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.989+0000 7f3334def700 1 -- 172.21.15.87:0/2189739563 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333006d530 con 0x7f3330164190 2023-03-30T19:35:40.996 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.993+0000 7f3317fff700 1 -- 172.21.15.87:0/2189739563 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f3328007230 con 0x7f3330164190 2023-03-30T19:35:40.997 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.993+0000 7f3317fff700 1 --2- 172.21.15.87:0/2189739563 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f331c0653f0 0x7f331c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:40.997 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.993+0000 7f3317fff700 1 -- 172.21.15.87:0/2189739563 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f3328082350 con 0x7f3330164190 2023-03-30T19:35:40.998 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.993+0000 7f332f7fe700 1 --2- 172.21.15.87:0/2189739563 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f331c0653f0 0x7f331c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:40.999 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:40.993+0000 7f332f7fe700 1 --2- 172.21.15.87:0/2189739563 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f331c0653f0 0x7f331c0678a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f3320006b40 tx=0x7f3320006ad0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:41.004 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:41.001+0000 7f3317fff700 1 -- 172.21.15.87:0/2189739563 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f332804fdf0 con 0x7f3330164190 2023-03-30T19:35:41.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:41.173+0000 7f3334def700 1 -- 172.21.15.87:0/2189739563 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f33300733a0 con 0x7f3330164190 2023-03-30T19:35:41.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:41.833+0000 7f3317fff700 1 -- 172.21.15.87:0/2189739563 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v47) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3328053410 con 0x7f3330164190 2023-03-30T19:35:41.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:41.837+0000 7f3334def700 1 -- 172.21.15.87:0/2189739563 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f331c0653f0 msgr2=0x7f331c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:41.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:41.837+0000 7f3334def700 1 --2- 172.21.15.87:0/2189739563 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f331c0653f0 0x7f331c0678a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f3320006b40 tx=0x7f3320006ad0 comp rx=0 tx=0).stop 2023-03-30T19:35:41.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:41.837+0000 7f3334def700 1 -- 172.21.15.87:0/2189739563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3330164190 msgr2=0x7f33300c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:41.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:41.837+0000 7f3334def700 1 --2- 172.21.15.87:0/2189739563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3330164190 0x7f33300c4210 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f332800cba0 tx=0x7f332800ceb0 comp rx=0 tx=0).stop 2023-03-30T19:35:41.841 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:41.837+0000 7f3334def700 1 -- 172.21.15.87:0/2189739563 shutdown_connections 2023-03-30T19:35:41.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:41.837+0000 7f3334def700 1 --2- 172.21.15.87:0/2189739563 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f331c0653f0 0x7f331c0678a0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:41.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:41.837+0000 7f3334def700 1 --2- 172.21.15.87:0/2189739563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3330164190 0x7f33300c4210 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:41.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:41.837+0000 7f3334def700 1 --2- 172.21.15.87:0/2189739563 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3330163dc0 0x7f333015a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:41.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:41.837+0000 7f3334def700 1 --2- 172.21.15.87:0/2189739563 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f33300aea30 0x7f3330158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:41.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:41.837+0000 7f3334def700 1 -- 172.21.15.87:0/2189739563 >> 172.21.15.87:0/2189739563 conn(0x7f33300cf410 msgr2=0x7f3330070260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:41.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:41.837+0000 7f3334def700 1 -- 172.21.15.87:0/2189739563 shutdown_connections 2023-03-30T19:35:41.842 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:41.837+0000 7f3334def700 1 -- 172.21.15.87:0/2189739563 wait complete. 2023-03-30T19:35:41.843 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' removed 2023-03-30T19:35:41.861 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-03-30T19:35:42.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.033+0000 7efea105b700 1 Processor -- start 2023-03-30T19:35:42.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.033+0000 7efea105b700 1 -- start start 2023-03-30T19:35:42.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efea105b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efe9c158820 0x7efe9c15c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:42.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efea105b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe9c0cf470 0x7efe9c0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:42.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efea105b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9c15c740 con 0x7efe9c06c250 2023-03-30T19:35:42.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efea105b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe9c158e00 con 0x7efe9c158820 2023-03-30T19:35:42.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efea105b700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c15ca20 con 0x7efe9c0cf470 2023-03-30T19:35:42.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efe9b59e700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7efe9c06c250 0x7efe9c159220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:47172/0 (socket says 172.21.15.87:47172) 2023-03-30T19:35:42.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efe9b59e700 1 -- 172.21.15.87:0/1422583238 learned_addr learned my addr 172.21.15.87:0/1422583238 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:42.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efe9ad9d700 1 --2- 172.21.15.87:0/1422583238 >> v2:172.21.15.115:3300/0 conn(0x7efe9c158820 0x7efe9c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:42.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efe9a59c700 1 --2- 172.21.15.87:0/1422583238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe9c0cf470 0x7efe9c0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:42.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efe9ad9d700 1 -- 172.21.15.87:0/1422583238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe9c0cf470 msgr2=0x7efe9c0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:42.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efe9ad9d700 1 --2- 172.21.15.87:0/1422583238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe9c0cf470 0x7efe9c0cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:42.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efe99d9b700 1 -- 172.21.15.87:0/1422583238 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757593469 0 0) 0x7efe9c15c740 con 0x7efe9c06c250 2023-03-30T19:35:42.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efe9ad9d700 1 -- 172.21.15.87:0/1422583238 >> v1:172.21.15.115:6789/0 conn(0x7efe9c06c250 legacy=0x7efe9c159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:42.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efe9ad9d700 1 -- 172.21.15.87:0/1422583238 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c15cd00 con 0x7efe9c158820 2023-03-30T19:35:42.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efe9ad9d700 1 --2- 172.21.15.87:0/1422583238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe9c158820 0x7efe9c15c160 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009850 tx=0x7efe8c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=816103638ac93584 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:42.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efe99d9b700 1 -- 172.21.15.87:0/1422583238 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c011830 con 0x7efe9c158820 2023-03-30T19:35:42.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efe99d9b700 1 -- 172.21.15.87:0/1422583238 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8c011990 con 0x7efe9c158820 2023-03-30T19:35:42.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.037+0000 7efe99d9b700 1 -- 172.21.15.87:0/1422583238 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c011d40 con 0x7efe9c158820 2023-03-30T19:35:42.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.041+0000 7efea105b700 1 -- 172.21.15.87:0/1422583238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe9c158820 msgr2=0x7efe9c15c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:42.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.041+0000 7efea105b700 1 --2- 172.21.15.87:0/1422583238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe9c158820 0x7efe9c15c160 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009850 tx=0x7efe8c009b60 comp rx=0 tx=0).stop 2023-03-30T19:35:42.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.041+0000 7efea105b700 1 -- 172.21.15.87:0/1422583238 shutdown_connections 2023-03-30T19:35:42.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.041+0000 7efea105b700 1 --2- 172.21.15.87:0/1422583238 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe9c0cf470 0x7efe9c0cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:42.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.041+0000 7efea105b700 1 --2- 172.21.15.87:0/1422583238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe9c158820 0x7efe9c15c160 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:42.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.041+0000 7efea105b700 1 -- 172.21.15.87:0/1422583238 >> 172.21.15.87:0/1422583238 conn(0x7efe9c0ce960 msgr2=0x7efe9c0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:42.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.041+0000 7efea105b700 1 -- 172.21.15.87:0/1422583238 shutdown_connections 2023-03-30T19:35:42.047 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.041+0000 7efea105b700 1 -- 172.21.15.87:0/1422583238 wait complete. 2023-03-30T19:35:42.048 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.045+0000 7efea105b700 1 Processor -- start 2023-03-30T19:35:42.049 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.045+0000 7efea105b700 1 -- start start 2023-03-30T19:35:42.050 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.045+0000 7efea105b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe9c06c250 0x7efe9c158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:42.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.045+0000 7efea105b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe9c0cf470 0x7efe9c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:42.051 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.045+0000 7efea105b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe9c158820 0x7efe9c0c1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:42.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.045+0000 7efe9ad9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe9c06c250 0x7efe9c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:42.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.045+0000 7efe9ad9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe9c06c250 0x7efe9c158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:38100/0 (socket says 172.21.15.87:38100) 2023-03-30T19:35:42.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.045+0000 7efe9a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe9c0cf470 0x7efe9c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:42.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.045+0000 7efe9a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe9c0cf470 0x7efe9c0c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:42084/0 (socket says 172.21.15.87:42084) 2023-03-30T19:35:42.052 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efe9b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe9c158820 0x7efe9c0c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:42.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efe9b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe9c158820 0x7efe9c0c1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44480/0 (socket says 172.21.15.87:44480) 2023-03-30T19:35:42.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efe9ad9d700 1 -- 172.21.15.87:0/1307831254 learned_addr learned my addr 172.21.15.87:0/1307831254 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:42.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efea105b700 1 -- 172.21.15.87:0/1307831254 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0c8d90 con 0x7efe9c158820 2023-03-30T19:35:42.053 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efea105b700 1 -- 172.21.15.87:0/1307831254 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0c4da0 con 0x7efe9c0cf470 2023-03-30T19:35:42.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efea105b700 1 -- 172.21.15.87:0/1307831254 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c15bb60 con 0x7efe9c06c250 2023-03-30T19:35:42.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efe9ad9d700 1 -- 172.21.15.87:0/1307831254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe9c0cf470 msgr2=0x7efe9c0c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:42.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efe9ad9d700 1 --2- 172.21.15.87:0/1307831254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe9c0cf470 0x7efe9c0c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:42.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efe9ad9d700 1 -- 172.21.15.87:0/1307831254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe9c158820 msgr2=0x7efe9c0c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:42.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efe9ad9d700 1 --2- 172.21.15.87:0/1307831254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe9c158820 0x7efe9c0c1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:42.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efe9ad9d700 1 -- 172.21.15.87:0/1307831254 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c0094b0 con 0x7efe9c06c250 2023-03-30T19:35:42.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efe9ad9d700 1 --2- 172.21.15.87:0/1307831254 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe9c06c250 0x7efe9c158000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0090b0 tx=0x7efe8c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:42.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efe837fe700 1 -- 172.21.15.87:0/1307831254 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c01a990 con 0x7efe9c06c250 2023-03-30T19:35:42.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efe837fe700 1 -- 172.21.15.87:0/1307831254 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8c01f070 con 0x7efe9c06c250 2023-03-30T19:35:42.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efe837fe700 1 -- 172.21.15.87:0/1307831254 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c01ad10 con 0x7efe9c06c250 2023-03-30T19:35:42.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efea105b700 1 -- 172.21.15.87:0/1307831254 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe9c0cd0d0 con 0x7efe9c06c250 2023-03-30T19:35:42.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.049+0000 7efea105b700 1 -- 172.21.15.87:0/1307831254 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9c15cfe0 con 0x7efe9c06c250 2023-03-30T19:35:42.068 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.065+0000 7efe837fe700 1 -- 172.21.15.87:0/1307831254 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7efe8c01b430 con 0x7efe9c06c250 2023-03-30T19:35:42.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.065+0000 7efe837fe700 1 --2- 172.21.15.87:0/1307831254 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efe880654c0 0x7efe88067970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:42.069 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.065+0000 7efe837fe700 1 -- 172.21.15.87:0/1307831254 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6088+0+0 (secure 0 0 0) 0x7efe8c0839c0 con 0x7efe9c06c250 2023-03-30T19:35:42.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.065+0000 7efe817fa700 1 -- 172.21.15.87:0/1307831254 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe9c0cd260 con 0x7efe9c06c250 2023-03-30T19:35:42.075 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.069+0000 7efe9a59c700 1 --2- 172.21.15.87:0/1307831254 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efe880654c0 0x7efe88067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:42.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.073+0000 7efe9a59c700 1 --2- 172.21.15.87:0/1307831254 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efe880654c0 0x7efe88067970 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0c9210 tx=0x7efe90009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:42.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.073+0000 7efe837fe700 1 -- 172.21.15.87:0/1307831254 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7efe8c081e60 con 0x7efe9c06c250 2023-03-30T19:35:42.293 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:42.289+0000 7efe817fa700 1 -- 172.21.15.87:0/1307831254 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efe9c0c4b70 con 0x7efe9c06c250 2023-03-30T19:35:42.852 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-03-30T19:35:43.061 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.057+0000 7efe837fe700 1 -- 172.21.15.87:0/1307831254 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v48) v1 ==== 169+0+0 (secure 0 0 0) 0x7efe8c021030 con 0x7efe9c06c250 2023-03-30T19:35:43.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.057+0000 7efe817fa700 1 -- 172.21.15.87:0/1307831254 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efe880654c0 msgr2=0x7efe88067970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:43.063 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.057+0000 7efe817fa700 1 --2- 172.21.15.87:0/1307831254 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efe880654c0 0x7efe88067970 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0c9210 tx=0x7efe90009240 comp rx=0 tx=0).stop 2023-03-30T19:35:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.057+0000 7efe817fa700 1 -- 172.21.15.87:0/1307831254 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe9c06c250 msgr2=0x7efe9c158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.057+0000 7efe817fa700 1 --2- 172.21.15.87:0/1307831254 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe9c06c250 0x7efe9c158000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0090b0 tx=0x7efe8c004770 comp rx=0 tx=0).stop 2023-03-30T19:35:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.057+0000 7efe817fa700 1 -- 172.21.15.87:0/1307831254 shutdown_connections 2023-03-30T19:35:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.057+0000 7efe817fa700 1 --2- 172.21.15.87:0/1307831254 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7efe880654c0 0x7efe88067970 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.057+0000 7efe817fa700 1 --2- 172.21.15.87:0/1307831254 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe9c158820 0x7efe9c0c1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.057+0000 7efe817fa700 1 --2- 172.21.15.87:0/1307831254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe9c0cf470 0x7efe9c0c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.057+0000 7efe817fa700 1 --2- 172.21.15.87:0/1307831254 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe9c06c250 0x7efe9c158000 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:43.064 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.057+0000 7efe817fa700 1 -- 172.21.15.87:0/1307831254 >> 172.21.15.87:0/1307831254 conn(0x7efe9c0ce960 msgr2=0x7efe9c0cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.057+0000 7efe817fa700 1 -- 172.21.15.87:0/1307831254 shutdown_connections 2023-03-30T19:35:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.057+0000 7efe817fa700 1 -- 172.21.15.87:0/1307831254 wait complete. 2023-03-30T19:35:43.065 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' removed 2023-03-30T19:35:43.080 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-03-30T19:35:43.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.289+0000 7f75e8e8a700 1 Processor -- start 2023-03-30T19:35:43.295 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.289+0000 7f75e8e8a700 1 -- start start 2023-03-30T19:35:43.296 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e8e8a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75e406bf70 0x7f75e40ca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:43.297 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e8e8a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e40cd200 con 0x7f75e406ec70 2023-03-30T19:35:43.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e8e8a700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e406deb0 con 0x7f75e40cbb60 2023-03-30T19:35:43.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e359e700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f75e406ec70 0x7f75e40ca590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58628/0 (socket says 172.21.15.87:58628) 2023-03-30T19:35:43.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e359e700 1 -- 172.21.15.87:0/3574707133 learned_addr learned my addr 172.21.15.87:0/3574707133 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:43.298 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3574707133 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e40cbf30 con 0x7f75e406bf70 2023-03-30T19:35:43.299 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e1d9b700 1 --2- 172.21.15.87:0/3574707133 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75e406bf70 0x7f75e40ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:43.299 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e159a700 1 -- 172.21.15.87:0/3574707133 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600036848 0 0) 0x7f75e40cd200 con 0x7f75e406ec70 2023-03-30T19:35:43.299 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e159a700 1 -- 172.21.15.87:0/3574707133 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75cc0035d0 con 0x7f75e406ec70 2023-03-30T19:35:43.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e159a700 1 -- 172.21.15.87:0/3574707133 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746359333 0 0) 0x7f75e406deb0 con 0x7f75e40cbb60 2023-03-30T19:35:43.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e1d9b700 1 -- 172.21.15.87:0/3574707133 >> v1:172.21.15.115:6789/0 conn(0x7f75e40cbb60 legacy=0x7f75e406b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:43.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e1d9b700 1 -- 172.21.15.87:0/3574707133 >> v1:172.21.15.87:6789/0 conn(0x7f75e406ec70 legacy=0x7f75e40ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:43.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e1d9b700 1 -- 172.21.15.87:0/3574707133 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e406e190 con 0x7f75e406bf70 2023-03-30T19:35:43.300 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e1d9b700 1 --2- 172.21.15.87:0/3574707133 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75e406bf70 0x7f75e40ca050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f75d800bb20 tx=0x7f75d800be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88617d854f6baee1 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:43.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e159a700 1 -- 172.21.15.87:0/3574707133 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d800dc70 con 0x7f75e406bf70 2023-03-30T19:35:43.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e159a700 1 -- 172.21.15.87:0/3574707133 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d800ddd0 con 0x7f75e406bf70 2023-03-30T19:35:43.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.293+0000 7f75e159a700 1 -- 172.21.15.87:0/3574707133 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8010690 con 0x7f75e406bf70 2023-03-30T19:35:43.301 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.297+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3574707133 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75e406bf70 msgr2=0x7f75e40ca050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:43.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.297+0000 7f75e8e8a700 1 --2- 172.21.15.87:0/3574707133 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75e406bf70 0x7f75e40ca050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f75d800bb20 tx=0x7f75d800be30 comp rx=0 tx=0).stop 2023-03-30T19:35:43.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.297+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3574707133 shutdown_connections 2023-03-30T19:35:43.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.297+0000 7f75e8e8a700 1 --2- 172.21.15.87:0/3574707133 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75e406bf70 0x7f75e40ca050 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:43.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.297+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3574707133 >> 172.21.15.87:0/3574707133 conn(0x7f75e40b2950 msgr2=0x7f75e40b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:43.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.297+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3574707133 shutdown_connections 2023-03-30T19:35:43.302 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.297+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3574707133 wait complete. 2023-03-30T19:35:43.303 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.301+0000 7f75e8e8a700 1 Processor -- start 2023-03-30T19:35:43.304 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.301+0000 7f75e8e8a700 1 -- start start 2023-03-30T19:35:43.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.301+0000 7f75e8e8a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e406bf70 0x7f75e4150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:43.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.301+0000 7f75e8e8a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75e406ec70 0x7f75e40c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:43.306 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.301+0000 7f75e8e8a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75e40cbb60 0x7f75e40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:43.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.301+0000 7f75e8e8a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e40c4300 con 0x7f75e40cbb60 2023-03-30T19:35:43.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.301+0000 7f75e359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75e40cbb60 0x7f75e40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:43.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.301+0000 7f75e259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e406bf70 0x7f75e4150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:43.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.301+0000 7f75e359e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75e40cbb60 0x7f75e40b4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44494/0 (socket says 172.21.15.87:44494) 2023-03-30T19:35:43.307 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.301+0000 7f75e359e700 1 -- 172.21.15.87:0/3016943917 learned_addr learned my addr 172.21.15.87:0/3016943917 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:43.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.301+0000 7f75e1d9b700 1 --2- 172.21.15.87:0/3016943917 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75e406ec70 0x7f75e40c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:43.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.301+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3016943917 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e40c45e0 con 0x7f75e406bf70 2023-03-30T19:35:43.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.301+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3016943917 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e40c48c0 con 0x7f75e406ec70 2023-03-30T19:35:43.308 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.305+0000 7f75e359e700 1 -- 172.21.15.87:0/3016943917 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75e406ec70 msgr2=0x7f75e40c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:43.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.305+0000 7f75e359e700 1 --2- 172.21.15.87:0/3016943917 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75e406ec70 0x7f75e40c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:43.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.305+0000 7f75e359e700 1 -- 172.21.15.87:0/3016943917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e406bf70 msgr2=0x7f75e4150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:43.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.305+0000 7f75e359e700 1 --2- 172.21.15.87:0/3016943917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e406bf70 0x7f75e4150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:43.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.305+0000 7f75e359e700 1 -- 172.21.15.87:0/3016943917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d800b750 con 0x7f75e40cbb60 2023-03-30T19:35:43.309 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.305+0000 7f75e359e700 1 --2- 172.21.15.87:0/3016943917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75e40cbb60 0x7f75e40b4eb0 secure :-1 s=READY pgs=3327 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00d900 tx=0x7f75dc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:43.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.305+0000 7f75d2ffd700 1 -- 172.21.15.87:0/3016943917 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc017070 con 0x7f75e40cbb60 2023-03-30T19:35:43.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.305+0000 7f75d2ffd700 1 -- 172.21.15.87:0/3016943917 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75dc00c040 con 0x7f75e40cbb60 2023-03-30T19:35:43.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.305+0000 7f75d2ffd700 1 -- 172.21.15.87:0/3016943917 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc00b8f0 con 0x7f75e40cbb60 2023-03-30T19:35:43.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.305+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3016943917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e406e750 con 0x7f75e40cbb60 2023-03-30T19:35:43.310 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.305+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3016943917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e406e470 con 0x7f75e40cbb60 2023-03-30T19:35:43.312 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.305+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3016943917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e406b4b0 con 0x7f75e40cbb60 2023-03-30T19:35:43.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.593+0000 7f75d2ffd700 1 -- 172.21.15.87:0/3016943917 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f75dc00ba50 con 0x7f75e40cbb60 2023-03-30T19:35:43.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.593+0000 7f75d2ffd700 1 --2- 172.21.15.87:0/3016943917 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75c4065470 0x7f75c4067920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:43.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.593+0000 7f75e259c700 1 --2- 172.21.15.87:0/3016943917 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75c4065470 0x7f75c4067920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:43.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.597+0000 7f75e259c700 1 --2- 172.21.15.87:0/3016943917 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75c4065470 0x7f75c4067920 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f75d4001820 tx=0x7f75d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:43.657 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.653+0000 7f75d2ffd700 1 -- 172.21.15.87:0/3016943917 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f75dc05cb10 con 0x7f75e40cbb60 2023-03-30T19:35:43.662 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.657+0000 7f75d2ffd700 1 -- 172.21.15.87:0/3016943917 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f75dc050e70 con 0x7f75e40cbb60 2023-03-30T19:35:43.926 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:43.921+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3016943917 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f75e41556d0 con 0x7f75e40cbb60 2023-03-30T19:35:44.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.029+0000 7f75d2ffd700 1 -- 172.21.15.87:0/3016943917 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f75e41556d0 con 0x7f75e40cbb60 2023-03-30T19:35:44.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.049+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3016943917 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75c4065470 msgr2=0x7f75c4067920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:44.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.049+0000 7f75e8e8a700 1 --2- 172.21.15.87:0/3016943917 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75c4065470 0x7f75c4067920 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f75d4001820 tx=0x7f75d4009040 comp rx=0 tx=0).stop 2023-03-30T19:35:44.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.049+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3016943917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75e40cbb60 msgr2=0x7f75e40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:44.054 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.049+0000 7f75e8e8a700 1 --2- 172.21.15.87:0/3016943917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75e40cbb60 0x7f75e40b4eb0 secure :-1 s=READY pgs=3327 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00d900 tx=0x7f75dc00dc10 comp rx=0 tx=0).stop 2023-03-30T19:35:44.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.049+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3016943917 shutdown_connections 2023-03-30T19:35:44.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.049+0000 7f75e8e8a700 1 --2- 172.21.15.87:0/3016943917 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f75c4065470 0x7f75c4067920 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:44.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.049+0000 7f75e8e8a700 1 --2- 172.21.15.87:0/3016943917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f75e40cbb60 0x7f75e40b4eb0 unknown :-1 s=CLOSED pgs=3327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:44.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.049+0000 7f75e8e8a700 1 --2- 172.21.15.87:0/3016943917 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75e406ec70 0x7f75e40c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:44.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.049+0000 7f75e8e8a700 1 --2- 172.21.15.87:0/3016943917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75e406bf70 0x7f75e4150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:44.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.049+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3016943917 >> 172.21.15.87:0/3016943917 conn(0x7f75e40b2950 msgr2=0x7f75e40ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:44.055 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.049+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3016943917 shutdown_connections 2023-03-30T19:35:44.056 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.049+0000 7f75e8e8a700 1 -- 172.21.15.87:0/3016943917 wait complete. 2023-03-30T19:35:44.085 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-03-30T19:35:44.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.309+0000 7f0e680d1700 1 Processor -- start 2023-03-30T19:35:44.316 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.313+0000 7f0e680d1700 1 -- start start 2023-03-30T19:35:44.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.313+0000 7f0e680d1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0e600713c0 0x7f0e6015cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:44.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.313+0000 7f0e680d1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6015d480 con 0x7f0e60158bf0 2023-03-30T19:35:44.318 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.313+0000 7f0e680d1700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6006c4f0 con 0x7f0e60158820 2023-03-30T19:35:44.319 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.313+0000 7f0e680d1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e6006c190 con 0x7f0e600713c0 2023-03-30T19:35:44.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.317+0000 7f0e65e6d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0e60158820 0x7f0e600c9190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:47188/0 (socket says 172.21.15.87:47188) 2023-03-30T19:35:44.323 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.317+0000 7f0e65e6d700 1 -- 172.21.15.87:0/2826398013 learned_addr learned my addr 172.21.15.87:0/2826398013 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:35:44.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.317+0000 7f0e6666e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0e600713c0 0x7f0e6015cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:44.324 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.317+0000 7f0e6566c700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f0e60158bf0 0x7f0e60070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:58632/0 (socket says 172.21.15.87:58632) 2023-03-30T19:35:44.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e64e6b700 1 -- 172.21.15.87:0/2826398013 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059059891 0 0) 0x7f0e5c001110 con 0x7f0e60158bf0 2023-03-30T19:35:44.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e64e6b700 1 -- 172.21.15.87:0/2826398013 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e4c0035d0 con 0x7f0e60158bf0 2023-03-30T19:35:44.325 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e64e6b700 1 -- 172.21.15.87:0/2826398013 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2793897258 0 0) 0x7f0e4c0035d0 con 0x7f0e60158bf0 2023-03-30T19:35:44.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e64e6b700 1 -- 172.21.15.87:0/2826398013 >> v2:172.21.15.115:3300/0 conn(0x7f0e600713c0 msgr2=0x7f0e6015cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:44.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e64e6b700 1 --2- 172.21.15.87:0/2826398013 >> v2:172.21.15.115:3300/0 conn(0x7f0e600713c0 0x7f0e6015cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:44.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e64e6b700 1 -- 172.21.15.87:0/2826398013 >> v1:172.21.15.115:6789/0 conn(0x7f0e60158820 legacy=0x7f0e600c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:44.326 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e64e6b700 1 -- 172.21.15.87:0/2826398013 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6006cd90 con 0x7f0e60158bf0 2023-03-30T19:35:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e64e6b700 1 -- 172.21.15.87:0/2826398013 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f0e5c001800 con 0x7f0e60158bf0 2023-03-30T19:35:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e64e6b700 1 -- 172.21.15.87:0/2826398013 >> v1:172.21.15.87:6789/0 conn(0x7f0e60158bf0 legacy=0x7f0e60070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e64e6b700 1 --2- 172.21.15.87:0/2826398013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e4c003a20 0x7f0e4c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:44.327 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e64e6b700 1 --2- 172.21.15.87:0/2826398013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e4c004870 0x7f0e4c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:44.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e64e6b700 1 --2- 172.21.15.87:0/2826398013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e4c005220 0x7f0e4c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:44.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e64e6b700 1 -- 172.21.15.87:0/2826398013 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c00c100 con 0x7f0e4c004870 2023-03-30T19:35:44.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e64e6b700 1 -- 172.21.15.87:0/2826398013 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c00c270 con 0x7f0e4c003a20 2023-03-30T19:35:44.329 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e64e6b700 1 -- 172.21.15.87:0/2826398013 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c00c430 con 0x7f0e4c005220 2023-03-30T19:35:44.330 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e6566c700 1 --2- 172.21.15.87:0/2826398013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e4c004870 0x7f0e4c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:44.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e6566c700 1 -- 172.21.15.87:0/2826398013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e4c005220 msgr2=0x7f0e4c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:44.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e6566c700 1 --2- 172.21.15.87:0/2826398013 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e4c005220 0x7f0e4c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:44.331 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e6566c700 1 -- 172.21.15.87:0/2826398013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e4c003a20 msgr2=0x7f0e4c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:44.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e6566c700 1 --2- 172.21.15.87:0/2826398013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e4c003a20 0x7f0e4c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:44.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e6566c700 1 -- 172.21.15.87:0/2826398013 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6006cd90 con 0x7f0e4c004870 2023-03-30T19:35:44.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e6666e700 1 -- 172.21.15.87:0/2826398013 reap_dead start 2023-03-30T19:35:44.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.321+0000 7f0e6566c700 1 --2- 172.21.15.87:0/2826398013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e4c004870 0x7f0e4c004ce0 secure :-1 s=READY pgs=3329 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c00c290 tx=0x7f0e4c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1f3ee68a3b925b server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:44.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.325+0000 7f0e64e6b700 1 -- 172.21.15.87:0/2826398013 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c007d30 con 0x7f0e4c004870 2023-03-30T19:35:44.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.325+0000 7f0e64e6b700 1 -- 172.21.15.87:0/2826398013 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c00cdd0 con 0x7f0e4c004870 2023-03-30T19:35:44.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.325+0000 7f0e64e6b700 1 -- 172.21.15.87:0/2826398013 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c005ae0 con 0x7f0e4c004870 2023-03-30T19:35:44.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.325+0000 7f0e680d1700 1 -- 172.21.15.87:0/2826398013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e4c004870 msgr2=0x7f0e4c004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:44.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.325+0000 7f0e680d1700 1 --2- 172.21.15.87:0/2826398013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e4c004870 0x7f0e4c004ce0 secure :-1 s=READY pgs=3329 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c00c290 tx=0x7f0e4c0058a0 comp rx=0 tx=0).stop 2023-03-30T19:35:44.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.325+0000 7f0e680d1700 1 -- 172.21.15.87:0/2826398013 shutdown_connections 2023-03-30T19:35:44.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.325+0000 7f0e680d1700 1 --2- 172.21.15.87:0/2826398013 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e4c004870 0x7f0e4c004ce0 unknown :-1 s=CLOSED pgs=3329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:44.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.325+0000 7f0e680d1700 1 -- 172.21.15.87:0/2826398013 >> 172.21.15.87:0/2826398013 conn(0x7f0e600ce960 msgr2=0x7f0e600ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:44.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.325+0000 7f0e680d1700 1 -- 172.21.15.87:0/2826398013 shutdown_connections 2023-03-30T19:35:44.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.325+0000 7f0e680d1700 1 -- 172.21.15.87:0/2826398013 wait complete. 2023-03-30T19:35:44.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.329+0000 7f0e680d1700 1 Processor -- start 2023-03-30T19:35:44.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.329+0000 7f0e680d1700 1 -- start start 2023-03-30T19:35:44.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.329+0000 7f0e680d1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e4c004870 0x7f0e600c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:44.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.329+0000 7f0e680d1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e600c5040 0x7f0e600c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:44.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.329+0000 7f0e680d1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e600b3cf0 0x7f0e600c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:44.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.329+0000 7f0e680d1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600c4dc0 con 0x7f0e600b3cf0 2023-03-30T19:35:44.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.329+0000 7f0e680d1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600c3b80 con 0x7f0e4c004870 2023-03-30T19:35:44.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.329+0000 7f0e680d1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600c2c90 con 0x7f0e600c5040 2023-03-30T19:35:44.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e6666e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e600b3cf0 0x7f0e600c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:44.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e6666e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e600b3cf0 0x7f0e600c18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44516/0 (socket says 172.21.15.87:44516) 2023-03-30T19:35:44.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e6666e700 1 -- 172.21.15.87:0/4193194124 learned_addr learned my addr 172.21.15.87:0/4193194124 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:44.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e6566c700 1 --2- 172.21.15.87:0/4193194124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e600c5040 0x7f0e600c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:44.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e65e6d700 1 --2- 172.21.15.87:0/4193194124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e4c004870 0x7f0e600c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:44.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e6666e700 1 -- 172.21.15.87:0/4193194124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e600c5040 msgr2=0x7f0e600c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:44.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e6666e700 1 --2- 172.21.15.87:0/4193194124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e600c5040 0x7f0e600c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:44.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e6666e700 1 -- 172.21.15.87:0/4193194124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e4c004870 msgr2=0x7f0e600c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:44.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e6666e700 1 --2- 172.21.15.87:0/4193194124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e4c004870 0x7f0e600c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:44.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e6666e700 1 -- 172.21.15.87:0/4193194124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6006c740 con 0x7f0e600b3cf0 2023-03-30T19:35:44.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e6666e700 1 --2- 172.21.15.87:0/4193194124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e600b3cf0 0x7f0e600c18b0 secure :-1 s=READY pgs=3330 cs=0 l=1 rev1=1 crypto rx=0x7f0e6006e8c0 tx=0x7f0e58004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:44.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e567fc700 1 -- 172.21.15.87:0/4193194124 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e58010070 con 0x7f0e600b3cf0 2023-03-30T19:35:44.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e567fc700 1 -- 172.21.15.87:0/4193194124 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5800a650 con 0x7f0e600b3cf0 2023-03-30T19:35:44.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e567fc700 1 -- 172.21.15.87:0/4193194124 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5800aa00 con 0x7f0e600b3cf0 2023-03-30T19:35:44.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e680d1700 1 -- 172.21.15.87:0/4193194124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e600cd430 con 0x7f0e600b3cf0 2023-03-30T19:35:44.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.337+0000 7f0e680d1700 1 -- 172.21.15.87:0/4193194124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6006ca20 con 0x7f0e600b3cf0 2023-03-30T19:35:44.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.341+0000 7f0e680d1700 1 -- 172.21.15.87:0/4193194124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e60073ee0 con 0x7f0e600b3cf0 2023-03-30T19:35:44.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.341+0000 7f0e567fc700 1 -- 172.21.15.87:0/4193194124 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f0e5800ab60 con 0x7f0e600b3cf0 2023-03-30T19:35:44.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.345+0000 7f0e567fc700 1 --2- 172.21.15.87:0/4193194124 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0e44065470 0x7f0e44067920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:44.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.345+0000 7f0e65e6d700 1 --2- 172.21.15.87:0/4193194124 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0e44065470 0x7f0e44067920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:44.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.345+0000 7f0e65e6d700 1 --2- 172.21.15.87:0/4193194124 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0e44065470 0x7f0e44067920 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0e50004920 tx=0x7f0e50009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:44.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.465+0000 7f0e567fc700 1 -- 172.21.15.87:0/4193194124 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0e5805b910 con 0x7f0e600b3cf0 2023-03-30T19:35:44.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.469+0000 7f0e567fc700 1 -- 172.21.15.87:0/4193194124 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f0e5804fbc0 con 0x7f0e600b3cf0 2023-03-30T19:35:44.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:44.801+0000 7f0e680d1700 1 -- 172.21.15.87:0/4193194124 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f0e600c3cc0 con 0x7f0e600b3cf0 2023-03-30T19:35:45.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:45.069+0000 7f0e567fc700 1 -- 172.21.15.87:0/4193194124 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v20639) v1 ==== 144+0+0 (secure 0 0 0) 0x7f0e580531e0 con 0x7f0e600b3cf0 2023-03-30T19:35:45.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:45.069+0000 7f0e680d1700 1 -- 172.21.15.87:0/4193194124 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0e44065470 msgr2=0x7f0e44067920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:45.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:45.069+0000 7f0e680d1700 1 --2- 172.21.15.87:0/4193194124 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0e44065470 0x7f0e44067920 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0e50004920 tx=0x7f0e50009040 comp rx=0 tx=0).stop 2023-03-30T19:35:45.076 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:45.069+0000 7f0e680d1700 1 -- 172.21.15.87:0/4193194124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e600b3cf0 msgr2=0x7f0e600c18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:45.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:45.069+0000 7f0e680d1700 1 --2- 172.21.15.87:0/4193194124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e600b3cf0 0x7f0e600c18b0 secure :-1 s=READY pgs=3330 cs=0 l=1 rev1=1 crypto rx=0x7f0e6006e8c0 tx=0x7f0e58004600 comp rx=0 tx=0).stop 2023-03-30T19:35:45.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:45.069+0000 7f0e680d1700 1 -- 172.21.15.87:0/4193194124 shutdown_connections 2023-03-30T19:35:45.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:45.069+0000 7f0e680d1700 1 --2- 172.21.15.87:0/4193194124 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0e44065470 0x7f0e44067920 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:45.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:45.069+0000 7f0e680d1700 1 --2- 172.21.15.87:0/4193194124 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0e600b3cf0 0x7f0e600c18b0 unknown :-1 s=CLOSED pgs=3330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:45.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:45.069+0000 7f0e680d1700 1 --2- 172.21.15.87:0/4193194124 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e600c5040 0x7f0e600c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:45.077 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:45.069+0000 7f0e680d1700 1 --2- 172.21.15.87:0/4193194124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e4c004870 0x7f0e600c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:45.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:45.069+0000 7f0e680d1700 1 -- 172.21.15.87:0/4193194124 >> 172.21.15.87:0/4193194124 conn(0x7f0e600ce960 msgr2=0x7f0e60159030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:45.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:45.069+0000 7f0e680d1700 1 -- 172.21.15.87:0/4193194124 shutdown_connections 2023-03-30T19:35:45.078 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:45.069+0000 7f0e680d1700 1 -- 172.21.15.87:0/4193194124 wait complete. 2023-03-30T19:35:45.090 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2023-03-30T19:35:45.091 INFO:tasks.cephfs_test_runner: 2023-03-30T19:35:45.091 INFO:tasks.cephfs_test_runner:====================================================================== 2023-03-30T19:35:45.092 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-03-30T19:35:45.092 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-03-30T19:35:45.092 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-03-30T19:35:45.093 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f03d69a8741c605ae6711afe2c9991ac46095f7d/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-03-30T19:35:45.093 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f03d69a8741c605ae6711afe2c9991ac46095f7d/qa/tasks/cephfs/xfstests_dev.py", line 385, in run_generic_tests 2023-03-30T19:35:45.093 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f03d69a8741c605ae6711afe2c9991ac46095f7d/qa/tasks/cephfs/xfstests_dev.py", line 377, in run_testdir 2023-03-30T19:35:45.093 INFO:tasks.cephfs_test_runner:AssertionError: 4 != 0 2023-03-30T19:35:45.094 INFO:tasks.cephfs_test_runner: 2023-03-30T19:35:45.094 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-03-30T19:35:45.094 INFO:tasks.cephfs_test_runner:Ran 1 test in 41039.836s 2023-03-30T19:35:45.094 INFO:tasks.cephfs_test_runner: 2023-03-30T19:35:45.095 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-03-30T19:35:45.095 INFO:tasks.cephfs_test_runner: 2023-03-30T19:35:45.095 INFO:tasks.cephfs_test_runner:====================================================================== 2023-03-30T19:35:45.095 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-03-30T19:35:45.096 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-03-30T19:35:45.096 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-03-30T19:35:45.096 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f03d69a8741c605ae6711afe2c9991ac46095f7d/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-03-30T19:35:45.096 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f03d69a8741c605ae6711afe2c9991ac46095f7d/qa/tasks/cephfs/xfstests_dev.py", line 385, in run_generic_tests 2023-03-30T19:35:45.096 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f03d69a8741c605ae6711afe2c9991ac46095f7d/qa/tasks/cephfs/xfstests_dev.py", line 377, in run_testdir 2023-03-30T19:35:45.097 INFO:tasks.cephfs_test_runner:AssertionError: 4 != 0 2023-03-30T19:35:45.097 INFO:tasks.cephfs_test_runner: 2023-03-30T19:35:45.098 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e3729161eecf8e6d09a4069acbb883cdcd5e9f50/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_f03d69a8741c605ae6711afe2c9991ac46095f7d/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-03-30T19:35:46.166 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=eb7008b811ab4926a9fb273f5682d013 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e3729161eecf8e6d09a4069acbb883cdcd5e9f50/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_f03d69a8741c605ae6711afe2c9991ac46095f7d/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-03-30T19:35:46.183 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-03-30T19:35:46.193 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-03-30T19:35:46.228 INFO:tasks.kclient:Unmounting kernel clients... 2023-03-30T19:35:46.229 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T19:35:46.230 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T19:35:46.258 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352416k,nr_inodes=4088104,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12641 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-03-30T19:35:46.259 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2023-03-30T19:35:46.259 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T19:35:46.314 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352416k,nr_inodes=4088104,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12641 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-03-30T19:35:46.315 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T19:35:46.315 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T19:35:46.340 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352432k,nr_inodes=4088108,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13290 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-03-30T19:35:46.341 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-03-30T19:35:46.341 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-30T19:35:46.420 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352432k,nr_inodes=4088108,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13290 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-03-30T19:35:46.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:46.421 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2023-03-30T19:35:46.436 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-03-30T19:35:46.437 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-03-30T19:35:46.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:46.438 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-03-30T19:35:46.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:46.511 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-30T19:35:46.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:46.575 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2023-03-30T19:35:46.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:46.774 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2023-03-30T19:35:46.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:46.785 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2023-03-30T19:35:46.979 INFO:teuthology.orchestra.run.smithi087.stderr:Cannot find device "ceph-brx" 2023-03-30T19:35:46.981 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T19:35:46.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:46.982 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-03-30T19:35:46.996 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-03-30T19:35:46.997 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-03-30T19:35:46.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:46.999 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-03-30T19:35:47.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:47.072 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-03-30T19:35:47.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:47.136 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-03-30T19:35:47.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:47.329 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-03-30T19:35:47.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-30T19:35:47.341 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-03-30T19:35:48.424 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2023-03-30T19:35:48.426 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-30T19:35:48.427 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-03-30T19:35:48.437 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-03-30T19:35:48.437 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-30T19:35:48.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.577+0000 7fe2474b5700 1 Processor -- start 2023-03-30T19:35:48.584 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.577+0000 7fe2474b5700 1 -- start start 2023-03-30T19:35:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe2474b5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe240159050 0x7fe240069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe2474b5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe24015cba0 0x7fe2400cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:48.585 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe2474b5700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe2400ca4b0 0x7fe2400ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:48.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe2474b5700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2400afb10 con 0x7fe240159050 2023-03-30T19:35:48.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe2474b5700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2400cae70 con 0x7fe2400ca4b0 2023-03-30T19:35:48.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe2474b5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2400afca0 con 0x7fe24015cba0 2023-03-30T19:35:48.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe245251700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe240159050 0x7fe240069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:48.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe245251700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe240159050 0x7fe240069cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44518/0 (socket says 172.21.15.87:44518) 2023-03-30T19:35:48.586 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe245251700 1 -- 172.21.15.87:0/2608179279 learned_addr learned my addr 172.21.15.87:0/2608179279 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:48.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe244a50700 1 --2- 172.21.15.87:0/2608179279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe24015cba0 0x7fe2400cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:48.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe245a52700 1 --2- 172.21.15.87:0/2608179279 >> v2:172.21.15.115:3300/0 conn(0x7fe2400ca4b0 0x7fe2400ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:48.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe245251700 1 -- 172.21.15.87:0/2608179279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe24015cba0 msgr2=0x7fe2400cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:48.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe245251700 1 --2- 172.21.15.87:0/2608179279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe24015cba0 0x7fe2400cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe245251700 1 -- 172.21.15.87:0/2608179279 >> v2:172.21.15.115:3300/0 conn(0x7fe2400ca4b0 msgr2=0x7fe2400ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe245251700 1 --2- 172.21.15.87:0/2608179279 >> v2:172.21.15.115:3300/0 conn(0x7fe2400ca4b0 0x7fe2400ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe245251700 1 -- 172.21.15.87:0/2608179279 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24015d110 con 0x7fe240159050 2023-03-30T19:35:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe245251700 1 --2- 172.21.15.87:0/2608179279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe240159050 0x7fe240069cd0 secure :-1 s=READY pgs=3331 cs=0 l=1 rev1=1 crypto rx=0x7fe24006d930 tx=0x7fe23c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6eaa1b690967ec8 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:48.589 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe237fff700 1 -- 172.21.15.87:0/2608179279 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00b8a0 con 0x7fe240159050 2023-03-30T19:35:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe237fff700 1 -- 172.21.15.87:0/2608179279 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c00ba00 con 0x7fe240159050 2023-03-30T19:35:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe237fff700 1 -- 172.21.15.87:0/2608179279 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00bd90 con 0x7fe240159050 2023-03-30T19:35:48.590 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe2474b5700 1 -- 172.21.15.87:0/2608179279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe240159050 msgr2=0x7fe240069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe2474b5700 1 --2- 172.21.15.87:0/2608179279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe240159050 0x7fe240069cd0 secure :-1 s=READY pgs=3331 cs=0 l=1 rev1=1 crypto rx=0x7fe24006d930 tx=0x7fe23c009bf0 comp rx=0 tx=0).stop 2023-03-30T19:35:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe2474b5700 1 -- 172.21.15.87:0/2608179279 shutdown_connections 2023-03-30T19:35:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe2474b5700 1 --2- 172.21.15.87:0/2608179279 >> v2:172.21.15.115:3300/0 conn(0x7fe2400ca4b0 0x7fe2400ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe2474b5700 1 --2- 172.21.15.87:0/2608179279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe24015cba0 0x7fe2400cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe2474b5700 1 --2- 172.21.15.87:0/2608179279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe240159050 0x7fe240069cd0 unknown :-1 s=CLOSED pgs=3331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:48.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe2474b5700 1 -- 172.21.15.87:0/2608179279 >> 172.21.15.87:0/2608179279 conn(0x7fe2400cf410 msgr2=0x7fe2400cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe2474b5700 1 -- 172.21.15.87:0/2608179279 shutdown_connections 2023-03-30T19:35:48.592 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.581+0000 7fe2474b5700 1 -- 172.21.15.87:0/2608179279 wait complete. 2023-03-30T19:35:48.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe2474b5700 1 Processor -- start 2023-03-30T19:35:48.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe2474b5700 1 -- start start 2023-03-30T19:35:48.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe2474b5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2400ca4b0 0x7fe2400c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:48.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe2474b5700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe240159050 0x7fe2400b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:48.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe2474b5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe24015cba0 0x7fe2400b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:48.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe2474b5700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2400b1e90 con 0x7fe24015cba0 2023-03-30T19:35:48.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe2474b5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2400b2170 con 0x7fe2400ca4b0 2023-03-30T19:35:48.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe2474b5700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2400b2450 con 0x7fe240159050 2023-03-30T19:35:48.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe245251700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2400ca4b0 0x7fe2400c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:48.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe245251700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2400ca4b0 0x7fe2400c4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:42148/0 (socket says 172.21.15.87:42148) 2023-03-30T19:35:48.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe245251700 1 -- 172.21.15.87:0/2447156221 learned_addr learned my addr 172.21.15.87:0/2447156221 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:48.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe245a52700 1 --2- 172.21.15.87:0/2447156221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe24015cba0 0x7fe2400b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:48.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe244a50700 1 --2- 172.21.15.87:0/2447156221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe240159050 0x7fe2400b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:48.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe245251700 1 -- 172.21.15.87:0/2447156221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe240159050 msgr2=0x7fe2400b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:48.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe245251700 1 --2- 172.21.15.87:0/2447156221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe240159050 0x7fe2400b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:48.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe245251700 1 -- 172.21.15.87:0/2447156221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe24015cba0 msgr2=0x7fe2400b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:48.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe245251700 1 --2- 172.21.15.87:0/2447156221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe24015cba0 0x7fe2400b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:48.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe245251700 1 -- 172.21.15.87:0/2447156221 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c009570 con 0x7fe2400ca4b0 2023-03-30T19:35:48.597 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe245251700 1 --2- 172.21.15.87:0/2447156221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2400ca4b0 0x7fe2400c4b80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe24006ff40 tx=0x7fe23c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:48.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe235ffb700 1 -- 172.21.15.87:0/2447156221 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00bee0 con 0x7fe2400ca4b0 2023-03-30T19:35:48.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe235ffb700 1 -- 172.21.15.87:0/2447156221 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c01f070 con 0x7fe2400ca4b0 2023-03-30T19:35:48.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe235ffb700 1 -- 172.21.15.87:0/2447156221 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c003900 con 0x7fe2400ca4b0 2023-03-30T19:35:48.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.585+0000 7fe2474b5700 1 -- 172.21.15.87:0/2447156221 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24015d6d0 con 0x7fe2400ca4b0 2023-03-30T19:35:48.598 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.589+0000 7fe2474b5700 1 -- 172.21.15.87:0/2447156221 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24015d3f0 con 0x7fe2400ca4b0 2023-03-30T19:35:48.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.589+0000 7fe2474b5700 1 -- 172.21.15.87:0/2447156221 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24015d9b0 con 0x7fe2400ca4b0 2023-03-30T19:35:48.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.589+0000 7fe235ffb700 1 -- 172.21.15.87:0/2447156221 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fe23c021030 con 0x7fe2400ca4b0 2023-03-30T19:35:48.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.589+0000 7fe235ffb700 1 --2- 172.21.15.87:0/2447156221 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe2240653f0 0x7fe2240678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:48.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.589+0000 7fe244a50700 1 --2- 172.21.15.87:0/2447156221 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe2240653f0 0x7fe2240678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:48.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.589+0000 7fe244a50700 1 --2- 172.21.15.87:0/2447156221 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe2240653f0 0x7fe2240678a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fe24006ac80 tx=0x7fe230008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:48.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.601+0000 7fe235ffb700 1 -- 172.21.15.87:0/2447156221 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe23c05d6f0 con 0x7fe2400ca4b0 2023-03-30T19:35:48.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.605+0000 7fe235ffb700 1 -- 172.21.15.87:0/2447156221 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fe23c0519a0 con 0x7fe2400ca4b0 2023-03-30T19:35:48.758 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:48.753+0000 7fe2474b5700 1 -- 172.21.15.87:0/2447156221 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2400733a0 con 0x7fe2240653f0 2023-03-30T19:35:50.273 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.269+0000 7fe235ffb700 1 -- 172.21.15.87:0/2447156221 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71412 (secure 0 0 0) 0x7fe2400733a0 con 0x7fe2240653f0 2023-03-30T19:35:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:50.276 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.273+0000 7fe2474b5700 1 -- 172.21.15.87:0/2447156221 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe2240653f0 msgr2=0x7fe2240678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:50.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.273+0000 7fe2474b5700 1 --2- 172.21.15.87:0/2447156221 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe2240653f0 0x7fe2240678a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fe24006ac80 tx=0x7fe230008040 comp rx=0 tx=0).stop 2023-03-30T19:35:50.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.273+0000 7fe2474b5700 1 -- 172.21.15.87:0/2447156221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2400ca4b0 msgr2=0x7fe2400c4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:50.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.273+0000 7fe2474b5700 1 --2- 172.21.15.87:0/2447156221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2400ca4b0 0x7fe2400c4b80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe24006ff40 tx=0x7fe23c004770 comp rx=0 tx=0).stop 2023-03-30T19:35:50.277 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.273+0000 7fe2474b5700 1 -- 172.21.15.87:0/2447156221 shutdown_connections 2023-03-30T19:35:50.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.273+0000 7fe2474b5700 1 --2- 172.21.15.87:0/2447156221 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fe2240653f0 0x7fe2240678a0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:50.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.273+0000 7fe2474b5700 1 --2- 172.21.15.87:0/2447156221 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe24015cba0 0x7fe2400b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:50.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.273+0000 7fe2474b5700 1 --2- 172.21.15.87:0/2447156221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe240159050 0x7fe2400b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:50.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.273+0000 7fe2474b5700 1 --2- 172.21.15.87:0/2447156221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2400ca4b0 0x7fe2400c4b80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:50.278 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.273+0000 7fe2474b5700 1 -- 172.21.15.87:0/2447156221 >> 172.21.15.87:0/2447156221 conn(0x7fe2400cf410 msgr2=0x7fe2400cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:50.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.273+0000 7fe2474b5700 1 -- 172.21.15.87:0/2447156221 shutdown_connections 2023-03-30T19:35:50.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.273+0000 7fe2474b5700 1 -- 172.21.15.87:0/2447156221 wait complete. 2023-03-30T19:35:50.279 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-03-30T19:35:50.293 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":20583,"stamp":"2023-03-30T19:35:47.043484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":29045864,"kb_used_data":21816552,"kb_used_omap":31256,"kb_used_meta":7197991,"kb_avail":725928856,"statfs":{"total":773094113280,"available":743351148544,"internally_reserved":0,"allocated":22340149248,"data_stored":22335383625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32006444,"internal_metadata":7370743508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,3,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12957887921,"num_objects":-11558,"num_object_clones":0,"num_object_copies":-23116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11558,"num_whiteouts":0,"num_read":-1443946,"num_read_kb":-415178615,"num_write":-6053433,"num_write_kb":-586470328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-743,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.475017"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":349,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:16.471996+0000","last_change":"2023-03-30T08:10:52.871133+0000","last_active":"2023-03-30T19:34:16.471996+0000","last_peered":"2023-03-30T19:34:16.471996+0000","last_clean":"2023-03-30T19:34:16.471996+0000","last_became_active":"2023-03-30T08:10:52.870678+0000","last_became_peered":"2023-03-30T08:10:52.870678+0000","last_unstale":"2023-03-30T19:34:16.471996+0000","last_undegraded":"2023-03-30T19:34:16.471996+0000","last_fullsized":"2023-03-30T19:34:16.471996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:51.162618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":352,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:25.725081+0000","last_change":"2023-03-30T08:10:52.871548+0000","last_active":"2023-03-30T19:34:25.725081+0000","last_peered":"2023-03-30T19:34:25.725081+0000","last_clean":"2023-03-30T19:34:25.725081+0000","last_became_active":"2023-03-30T08:10:52.871152+0000","last_became_peered":"2023-03-30T08:10:52.871152+0000","last_unstale":"2023-03-30T19:34:25.725081+0000","last_undegraded":"2023-03-30T19:34:25.725081+0000","last_fullsized":"2023-03-30T19:34:25.725081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":357,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:33:45.710496+0000","last_change":"2023-03-30T08:10:52.921525+0000","last_active":"2023-03-30T19:33:45.710496+0000","last_peered":"2023-03-30T19:33:45.710496+0000","last_clean":"2023-03-30T19:33:45.710496+0000","last_became_active":"2023-03-30T08:10:52.920885+0000","last_became_peered":"2023-03-30T08:10:52.920885+0000","last_unstale":"2023-03-30T19:33:45.710496+0000","last_undegraded":"2023-03-30T19:33:45.710496+0000","last_fullsized":"2023-03-30T19:33:45.710496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:38:27.041880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":363,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:25.725034+0000","last_change":"2023-03-30T08:10:52.921563+0000","last_active":"2023-03-30T19:34:25.725034+0000","last_peered":"2023-03-30T19:34:25.725034+0000","last_clean":"2023-03-30T19:34:25.725034+0000","last_became_active":"2023-03-30T08:10:52.921234+0000","last_became_peered":"2023-03-30T08:10:52.921234+0000","last_unstale":"2023-03-30T19:34:25.725034+0000","last_undegraded":"2023-03-30T19:34:25.725034+0000","last_fullsized":"2023-03-30T19:34:25.725034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":359,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:35:25.957548+0000","last_change":"2023-03-30T08:10:52.866272+0000","last_active":"2023-03-30T19:35:25.957548+0000","last_peered":"2023-03-30T19:35:25.957548+0000","last_clean":"2023-03-30T19:35:25.957548+0000","last_became_active":"2023-03-30T08:10:52.865919+0000","last_became_peered":"2023-03-30T08:10:52.865919+0000","last_unstale":"2023-03-30T19:35:25.957548+0000","last_undegraded":"2023-03-30T19:35:25.957548+0000","last_fullsized":"2023-03-30T19:35:25.957548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":361,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:40.595186+0000","last_change":"2023-03-30T08:10:52.920796+0000","last_active":"2023-03-30T19:34:40.595186+0000","last_peered":"2023-03-30T19:34:40.595186+0000","last_clean":"2023-03-30T19:34:40.595186+0000","last_became_active":"2023-03-30T08:10:52.920327+0000","last_became_peered":"2023-03-30T08:10:52.920327+0000","last_unstale":"2023-03-30T19:34:40.595186+0000","last_undegraded":"2023-03-30T19:34:40.595186+0000","last_fullsized":"2023-03-30T19:34:40.595186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:17.416386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":371,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:35.754874+0000","last_change":"2023-03-30T08:10:52.866412+0000","last_active":"2023-03-30T19:34:35.754874+0000","last_peered":"2023-03-30T19:34:35.754874+0000","last_clean":"2023-03-30T19:34:35.754874+0000","last_became_active":"2023-03-30T08:10:52.866055+0000","last_became_peered":"2023-03-30T08:10:52.866055+0000","last_unstale":"2023-03-30T19:34:35.754874+0000","last_undegraded":"2023-03-30T19:34:35.754874+0000","last_fullsized":"2023-03-30T19:34:35.754874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:39.045010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":359,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-03-30T19:35:40.186624+0000","last_change":"2023-03-30T08:10:52.868170+0000","last_active":"2023-03-30T19:35:40.186624+0000","last_peered":"2023-03-30T19:35:40.186624+0000","last_clean":"2023-03-30T19:35:40.186624+0000","last_became_active":"2023-03-30T08:10:52.867790+0000","last_became_peered":"2023-03-30T08:10:52.867790+0000","last_unstale":"2023-03-30T19:35:40.186624+0000","last_undegraded":"2023-03-30T19:35:40.186624+0000","last_fullsized":"2023-03-30T19:35:40.186624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":524,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:30.754284+0000","last_change":"2023-03-30T08:10:45.713084+0000","last_active":"2023-03-30T19:34:30.754284+0000","last_peered":"2023-03-30T19:34:30.754284+0000","last_clean":"2023-03-30T19:34:30.754284+0000","last_became_active":"2023-03-30T08:10:45.711645+0000","last_became_peered":"2023-03-30T08:10:45.711645+0000","last_unstale":"2023-03-30T19:34:30.754284+0000","last_undegraded":"2023-03-30T19:34:30.754284+0000","last_fullsized":"2023-03-30T19:34:30.754284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_clean_scrub_stamp":"2023-03-30T08:10:44.620691+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:58:12.738262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424517648,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4543776,"kb_used_data":3551832,"kb_used_omap":4629,"kb_used_meta":987306,"kb_avail":89828064,"statfs":{"total":96636764160,"available":91983937536,"internally_reserved":0,"allocated":3637075968,"data_stored":3636403579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4740435,"internal_metadata":1011002029},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.91900000000000004,"15min":0.79900000000000004},"min":{"1min":0.34200000000000003,"5min":0.311,"15min":0.311},"max":{"1min":3.5720000000000001,"5min":8.6210000000000004,"15min":8.6210000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.92400000000000004,"15min":0.89300000000000002},"min":{"1min":0.38500000000000001,"5min":0.36699999999999999,"15min":0.34599999999999997},"max":{"1min":1.5269999999999999,"5min":6.4669999999999996,"15min":6.4669999999999996},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.0529999999999999,"15min":0.96399999999999997},"min":{"1min":0.39500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":10.169,"5min":10.169,"15min":10.169},"last":0.504},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.081,"15min":0.90600000000000003},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.34999999999999998},"max":{"1min":4.2430000000000003,"5min":8.5220000000000002,"15min":8.5220000000000002},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.095,"15min":0.999},"min":{"1min":0.47399999999999998,"5min":0.38700000000000001,"15min":0.35899999999999999},"max":{"1min":11.26,"5min":11.26,"15min":11.26},"last":4.2999999999999998},{"interface":"front","average":{"1min":1.597,"5min":1.125,"15min":1.042},"min":{"1min":0.44,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":10.236000000000001,"5min":10.236000000000001,"15min":10.236000000000001},"last":5.6180000000000003}]},{"osd":3,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.1559999999999999,"15min":1.425},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.4619999999999997,"5min":9.1280000000000001,"15min":113.637},"last":4.3730000000000002},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.1319999999999999,"15min":1.4650000000000001},"min":{"1min":0.52500000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.6059999999999999,"5min":6.5199999999999996,"15min":113.90600000000001},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":1.1259999999999999,"15min":0.96899999999999997},"min":{"1min":0.45400000000000001,"5min":0.38700000000000001,"15min":0.36599999999999999},"max":{"1min":2.04,"5min":8.6590000000000007,"15min":8.6590000000000007},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.1519999999999999,"15min":1.02},"min":{"1min":0.46300000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.613,"5min":6.5819999999999999,"15min":6.5819999999999999},"last":0.628}]},{"osd":5,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.167,"15min":1.0820000000000001},"min":{"1min":0.439,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":3.1600000000000001,"5min":6.6079999999999997,"15min":9.1270000000000007},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.341,"15min":1.1339999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.435},"max":{"1min":3.3220000000000001,"5min":9.0079999999999991,"15min":9.3379999999999992},"last":1.101}]},{"osd":7,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.194,"15min":1.1299999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.49099999999999999},"max":{"1min":2.6720000000000002,"5min":6.6109999999999998,"15min":6.6109999999999998},"last":1.25},{"interface":"front","average":{"1min":2.4489999999999998,"5min":1.5209999999999999,"15min":1.204},"min":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.48599999999999999},"max":{"1min":22.887,"5min":22.887,"15min":22.887},"last":0.59499999999999997}]}]},{"osd":7,"up_from":14,"seq":60129550360,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2558872,"kb_used_data":2281104,"kb_used_omap":4609,"kb_used_meta":273150,"kb_avail":91812968,"statfs":{"total":96636764160,"available":94016479232,"internally_reserved":0,"allocated":2335850496,"data_stored":2335280120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4719691,"internal_metadata":279706549},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.94299999999999995,"15min":0.876},"min":{"1min":0.36199999999999999,"5min":0.34000000000000002,"15min":0.29399999999999998},"max":{"1min":1.349,"5min":6.3419999999999996,"15min":7.5529999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.92500000000000004,"15min":0.877},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.647,"5min":5.2569999999999997,"15min":5.819},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.97399999999999998,"15min":0.95799999999999996},"min":{"1min":0.50800000000000001,"5min":0.498,"15min":0.437},"max":{"1min":4.0590000000000002,"5min":5.1349999999999998,"15min":5.54},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.89900000000000002,"5min":1.0649999999999999,"15min":1.008},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.1470000000000002,"5min":6.3929999999999998,"15min":7.6550000000000002},"last":1.272}]},{"osd":2,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":1.208,"15min":1.0620000000000001},"min":{"1min":0.41599999999999998,"5min":0.40200000000000002,"15min":0.39400000000000002},"max":{"1min":6.782,"5min":6.782,"15min":6.782},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.087,"15min":1.012},"min":{"1min":0.52900000000000003,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":7.3300000000000001,"5min":7.3300000000000001,"15min":7.3300000000000001},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.1719999999999999,"15min":1.4950000000000001},"min":{"1min":0.495,"5min":0.44600000000000001,"15min":0.43099999999999999},"max":{"1min":5.04,"5min":6.3849999999999998,"15min":111.13800000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.111,"15min":1.472},"min":{"1min":0.66600000000000004,"5min":0.495,"15min":0.45700000000000002},"max":{"1min":3.7509999999999999,"5min":5.3259999999999996,"15min":109.63800000000001},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.246,"15min":1.1759999999999999},"min":{"1min":0.46300000000000002,"5min":0.45800000000000002,"15min":0.34799999999999998},"max":{"1min":5.141,"5min":8.7940000000000005,"15min":9.3409999999999993},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.627,"5min":1.27,"15min":1.1759999999999999},"min":{"1min":0.53900000000000003,"5min":0.434,"15min":0.36399999999999999},"max":{"1min":7.3090000000000002,"5min":7.3090000000000002,"15min":7.3090000000000002},"last":1.927}]},{"osd":5,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.6739999999999999,"5min":1.3080000000000001,"15min":1.1739999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.41299999999999998},"max":{"1min":7.2599999999999998,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":1.968},{"interface":"front","average":{"1min":1.319,"5min":1.327,"15min":1.2330000000000001},"min":{"1min":0.503,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":5.2939999999999996,"5min":8.532,"15min":8.532},"last":1.3540000000000001}]},{"osd":6,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.3779999999999999,"15min":1.2569999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":5.8040000000000003,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.9970000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.117,"15min":1.077},"min":{"1min":0.67700000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.82399999999999995}]}]},{"osd":5,"up_from":14,"seq":60129550358,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3196484,"kb_used_data":2117628,"kb_used_omap":1498,"kb_used_meta":1077349,"kb_avail":91175356,"statfs":{"total":96636764160,"available":93363564544,"internally_reserved":0,"allocated":2168451072,"data_stored":2167909286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1534458,"internal_metadata":1103205894},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":1.1779999999999999,"15min":0.96499999999999997},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.956,"5min":12.332000000000001,"15min":12.332000000000001},"last":1.288},{"interface":"front","average":{"1min":1.407,"5min":1.1519999999999999,"15min":0.96299999999999997},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":8.4359999999999999,"5min":12.897,"15min":12.897},"last":0.90800000000000003}]},{"osd":1,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":3.4329999999999998,"5min":1.46,"15min":1.1679999999999999},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.373},"max":{"1min":30.469000000000001,"5min":30.469000000000001,"15min":30.469000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.623,"5min":1.2789999999999999,"15min":1.044},"min":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.40899999999999997},"max":{"1min":14.49,"5min":14.49,"15min":14.49},"last":1.0860000000000001}]},{"osd":2,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":1.3799999999999999,"15min":1.204},"min":{"1min":0.45000000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":30.507999999999999,"5min":30.507999999999999,"15min":30.507999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.379,"5min":1.2669999999999999,"15min":1.1060000000000001},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":8.4849999999999994,"5min":12.944000000000001,"15min":12.944000000000001},"last":1.228}]},{"osd":3,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.3640000000000001,"15min":1.145},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":8.5139999999999993,"5min":13.007,"15min":13.007},"last":1.4350000000000001},{"interface":"front","average":{"1min":2.6459999999999999,"5min":1.512,"15min":1.282},"min":{"1min":0.55500000000000005,"5min":0.503,"15min":0.46300000000000002},"max":{"1min":30.402999999999999,"5min":30.402999999999999,"15min":30.402999999999999},"last":1.167}]},{"osd":4,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":2.9380000000000002,"5min":1.5169999999999999,"15min":1.2410000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.38800000000000001},"max":{"1min":30.547999999999998,"5min":30.547999999999998,"15min":30.547999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.3069999999999999,"15min":1.153},"min":{"1min":0.46400000000000002,"5min":0.441,"15min":0.438},"max":{"1min":3.1739999999999999,"5min":7.3079999999999998,"15min":9.2870000000000008},"last":1.506}]},{"osd":6,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":1.6599999999999999,"15min":1.284},"min":{"1min":0.51200000000000001,"5min":0.501,"15min":0.501},"max":{"1min":33.402000000000001,"5min":33.402000000000001,"15min":33.402000000000001},"last":1.351},{"interface":"front","average":{"1min":3.4630000000000001,"5min":1.8069999999999999,"15min":1.327},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":33.673999999999999,"5min":33.673999999999999,"15min":33.673999999999999},"last":1.373}]},{"osd":7,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.5529999999999999,"15min":1.3089999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.496},"max":{"1min":8.5419999999999998,"5min":12.976000000000001,"15min":12.976000000000001},"last":1.4810000000000001},{"interface":"front","average":{"1min":2.681,"5min":1.621,"15min":1.343},"min":{"1min":0.59899999999999998,"5min":0.504,"15min":0.47799999999999998},"max":{"1min":24.754000000000001,"5min":24.754000000000001,"15min":24.754000000000001},"last":1.024}]}]},{"osd":4,"up_from":14,"seq":60129550352,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3307484,"kb_used_data":2192084,"kb_used_omap":3500,"kb_used_meta":1111891,"kb_avail":91064356,"statfs":{"total":96636764160,"available":93249900544,"internally_reserved":0,"allocated":2244694016,"data_stored":2244109560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3584019,"internal_metadata":1138577389},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":1.0740000000000001,"15min":0.96699999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.313},"max":{"1min":1.3720000000000001,"5min":5.8579999999999997,"15min":5.8579999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.0069999999999999,"15min":0.995},"min":{"1min":0.39800000000000002,"5min":0.36499999999999999,"15min":0.34300000000000003},"max":{"1min":6.4989999999999997,"5min":6.4989999999999997,"15min":7.2930000000000001},"last":1.0389999999999999}]},{"osd":1,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.96399999999999997,"15min":0.94699999999999995},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":5.141,"5min":5.141,"15min":5.141},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.3149999999999999,"15min":1.133},"min":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.376},"max":{"1min":2.6389999999999998,"5min":5.7889999999999997,"15min":8.8740000000000006},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":1.2190000000000001,"15min":1.113},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":1.728,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":0.879},{"interface":"front","average":{"1min":1.28,"5min":1.159,"15min":1.117},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.41899999999999998},"max":{"1min":6.4009999999999998,"5min":7.1639999999999997,"15min":7.3869999999999996},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":2.5499999999999998,"15min":1.5700000000000001},"min":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.434},"max":{"1min":2.214,"5min":116.221,"15min":116.221},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.3160000000000001,"5min":2.4460000000000002,"15min":1.5649999999999999},"min":{"1min":0.56899999999999995,"5min":0.436,"15min":0.436},"max":{"1min":6.5339999999999998,"5min":116.306,"15min":116.306},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":4.484,"5min":1.6040000000000001,"15min":1.1879999999999999},"min":{"1min":0.45600000000000002,"5min":0.42299999999999999,"15min":0.39400000000000002},"max":{"1min":69.498000000000005,"5min":69.498000000000005,"15min":69.498000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.278,"15min":1.179},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.42299999999999999},"max":{"1min":2.0470000000000002,"5min":6.024,"15min":10.057},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.109,"15min":1.1799999999999999},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.42399999999999999},"max":{"1min":1.6719999999999999,"5min":6.1879999999999997,"15min":15.928000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.3400000000000001,"15min":1.2929999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46000000000000002},"max":{"1min":1.583,"5min":5.9260000000000002,"15min":15.566000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.238,"15min":1.204},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.4589999999999996,"5min":6.4589999999999996,"15min":7.3460000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.032,"5min":1.093,"15min":1.1679999999999999},"min":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.47599999999999998},"max":{"1min":1.9059999999999999,"5min":6.7160000000000002,"15min":6.7160000000000002},"last":0.60599999999999998}]}]},{"osd":3,"up_from":14,"seq":60129550328,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3977400,"kb_used_data":2888752,"kb_used_omap":7240,"kb_used_meta":1081399,"kb_avail":90394440,"statfs":{"total":96636764160,"available":92563906560,"internally_reserved":0,"allocated":2958082048,"data_stored":2957452620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7414054,"internal_metadata":1107353306},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.73999999999999999,"15min":0.77500000000000002},"min":{"1min":0.38100000000000001,"5min":0.27500000000000002,"15min":0.25900000000000001},"max":{"1min":2.976,"5min":2.976,"15min":8.0690000000000008},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.244,"5min":0.878,"15min":0.93500000000000005},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.27800000000000002},"max":{"1min":4.5380000000000003,"5min":4.5380000000000003,"15min":6.7160000000000002},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.88300000000000001,"15min":0.95499999999999996},"min":{"1min":0.434,"5min":0.31,"15min":0.31},"max":{"1min":5.7549999999999999,"5min":5.7549999999999999,"15min":8.7319999999999993},"last":1.5049999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.86899999999999999,"15min":0.88800000000000001},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.315},"max":{"1min":2.9710000000000001,"5min":3.109,"15min":4.1879999999999997},"last":0.623}]},{"osd":2,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.2829999999999999,"15min":1.1060000000000001},"min":{"1min":0.56299999999999994,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6459999999999999,"5min":25.440999999999999,"15min":25.440999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.2,"15min":1.179},"min":{"1min":0.56899999999999995,"5min":0.41699999999999998,"15min":0.41599999999999998},"max":{"1min":2.641,"5min":25.34,"15min":25.34},"last":1.546}]},{"osd":4,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.1779999999999999,"15min":1.05},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.42799999999999999},"max":{"1min":8.4390000000000001,"5min":8.4390000000000001,"15min":8.4390000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.383,"5min":1.0900000000000001,"15min":1.0249999999999999},"min":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.45700000000000002},"max":{"1min":4.4119999999999999,"5min":4.6699999999999999,"15min":4.71},"last":0.82999999999999996}]},{"osd":5,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":2.3839999999999999,"5min":1.4850000000000001,"15min":1.331},"min":{"1min":0.55500000000000005,"5min":0.51200000000000001,"15min":0.46999999999999997},"max":{"1min":23.702999999999999,"5min":23.702999999999999,"15min":23.702999999999999},"last":1.615},{"interface":"front","average":{"1min":2.0680000000000001,"5min":1.4159999999999999,"15min":1.2230000000000001},"min":{"1min":0.67900000000000005,"5min":0.56599999999999995,"15min":0.495},"max":{"1min":13.728999999999999,"5min":13.728999999999999,"15min":18.079999999999998},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.292,"15min":1.3240000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":4.6130000000000004,"5min":4.6349999999999998,"15min":57.677999999999997},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.294,"15min":1.361},"min":{"1min":0.66900000000000004,"5min":0.51700000000000002,"15min":0.50800000000000001},"max":{"1min":4.4980000000000002,"5min":5.4269999999999996,"15min":57.828000000000003},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":2.399,"5min":1.4770000000000001,"15min":1.276},"min":{"1min":0.60599999999999998,"5min":0.56200000000000006,"15min":0.52600000000000002},"max":{"1min":5.4649999999999999,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.575,"5min":1.258,"15min":1.2330000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":5.681,"5min":5.681,"15min":7.0529999999999999},"last":1.645}]}]},{"osd":2,"up_from":14,"seq":60129550340,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3376340,"kb_used_data":2418188,"kb_used_omap":2179,"kb_used_meta":955964,"kb_avail":90995500,"statfs":{"total":96636764160,"available":93179392000,"internally_reserved":0,"allocated":2476224512,"data_stored":2475655731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2231691,"internal_metadata":978907765},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.80800000000000005,"15min":1.258},"min":{"1min":0.28399999999999997,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":2.3239999999999998,"5min":4.0259999999999998,"15min":97.593999999999994},"last":2.3519999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88900000000000001,"15min":1.3280000000000001},"min":{"1min":0.38800000000000001,"5min":0.29899999999999999,"15min":0.27500000000000002},"max":{"1min":2.2250000000000001,"5min":5.1900000000000004,"15min":97.484999999999999},"last":0.751}]},{"osd":1,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84399999999999997,"15min":1.367},"min":{"1min":0.45900000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.6339999999999999,"5min":5.9059999999999997,"15min":139.036},"last":0.35699999999999998},{"interface":"front","average":{"1min":1.1859999999999999,"5min":0.96799999999999997,"15min":1.4359999999999999},"min":{"1min":0.436,"5min":0.34200000000000003,"15min":0.33500000000000002},"max":{"1min":4.673,"5min":4.673,"15min":139.107},"last":0.629}]},{"osd":3,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.93899999999999995,"15min":1.8089999999999999},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":1.8200000000000001,"5min":3.9420000000000002,"15min":142.262},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0249999999999999,"15min":1.8440000000000001},"min":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.36399999999999999},"max":{"1min":2.585,"5min":5.8280000000000003,"15min":141.92599999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.1899999999999999,"15min":1.1539999999999999},"min":{"1min":0.53000000000000003,"5min":0.42899999999999999,"15min":0.39200000000000002},"max":{"1min":3.8809999999999998,"5min":7.6879999999999997,"15min":10.942},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.224,"15min":1.208},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":2.653,"5min":7.6719999999999997,"15min":9.5009999999999994},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.077,"15min":1.1699999999999999},"min":{"1min":0.59899999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.7400000000000002,"5min":5.9429999999999996,"15min":24.672000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2450000000000001,"15min":1.244},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.44900000000000001},"max":{"1min":3.9239999999999999,"5min":5.6870000000000003,"15min":13.996},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2849999999999999,"15min":1.3069999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.49199999999999999},"max":{"1min":3.96,"5min":3.9769999999999999,"15min":15.323},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.2190000000000001,"15min":1.216},"min":{"1min":0.68899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":2.6669999999999998,"5min":5.9809999999999999,"15min":18.489000000000001},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":1.982,"5min":1.5529999999999999,"15min":1.3839999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.44900000000000001},"max":{"1min":20.303999999999998,"5min":20.303999999999998,"15min":20.303999999999998},"last":0.873},{"interface":"front","average":{"1min":2.2629999999999999,"5min":1.496,"15min":1.4470000000000001},"min":{"1min":0.627,"5min":0.56799999999999995,"15min":0.56100000000000005},"max":{"1min":21.478999999999999,"5min":21.478999999999999,"15min":24.937000000000001},"last":0.60099999999999998}]}]},{"osd":1,"up_from":14,"seq":60129550348,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3793068,"kb_used_data":2789732,"kb_used_omap":4451,"kb_used_meta":998876,"kb_avail":90578772,"statfs":{"total":96636764160,"available":92752662528,"internally_reserved":0,"allocated":2856685568,"data_stored":2856153816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558838,"internal_metadata":1022849034},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":0.97399999999999998,"15min":1.0469999999999999},"min":{"1min":0.33800000000000002,"5min":0.26800000000000002,"15min":0.252},"max":{"1min":12.628,"5min":12.628,"15min":25.765000000000001},"last":1.9990000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.93000000000000005,"15min":1.075},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28000000000000003},"max":{"1min":7.4470000000000001,"5min":7.4470000000000001,"15min":25.527999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.8879999999999999,"5min":1.0509999999999999,"15min":1.0740000000000001},"min":{"1min":0.36699999999999999,"5min":0.313,"15min":0.313},"max":{"1min":15.252000000000001,"5min":15.252000000000001,"15min":15.252000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":2.177,"5min":1.117,"15min":1.0740000000000001},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.34499999999999997},"max":{"1min":15.206,"5min":15.206,"15min":15.206},"last":1.9370000000000001}]},{"osd":3,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.0029999999999999,"15min":1.1100000000000001},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":8.1920000000000002,"5min":8.1920000000000002,"15min":18.219000000000001},"last":2.4409999999999998},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.044,"15min":1.1739999999999999},"min":{"1min":0.438,"5min":0.378,"15min":0.36599999999999999},"max":{"1min":7.7439999999999998,"5min":7.7439999999999998,"15min":25.456},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Mar 30 19:35:38 2023","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":1.0920000000000001,"15min":1.135},"min":{"1min":0.50600000000000001,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":6.0220000000000002,"5min":6.0220000000000002,"15min":13.728},"last":2.0369999999999999},{"interface":"front","average":{"1min":1.466,"5min":1.105,"15min":1.1140000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":8.2230000000000008,"5min":8.2230000000000008,"15min":10.217000000000001},"last":2.1429999999999998}]},{"osd":5,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.746,"5min":1.242,"15min":1.423},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":7.6749999999999998,"5min":7.6749999999999998,"15min":81.075999999999993},"last":1.212},{"interface":"front","average":{"1min":1.8340000000000001,"5min":1.2889999999999999,"15min":1.5109999999999999},"min":{"1min":0.54200000000000004,"5min":0.48899999999999999,"15min":0.44800000000000001},"max":{"1min":6.093,"5min":6.093,"15min":81.012},"last":1.962}]},{"osd":6,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":2.8410000000000002,"5min":1.5049999999999999,"15min":1.284},"min":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.51400000000000001},"max":{"1min":26.280999999999999,"5min":26.280999999999999,"15min":26.280999999999999},"last":1.5009999999999999},{"interface":"front","average":{"1min":2.661,"5min":1.5309999999999999,"15min":1.3480000000000001},"min":{"1min":0.57099999999999995,"5min":0.52300000000000002,"15min":0.47999999999999998},"max":{"1min":26.742999999999999,"5min":26.742999999999999,"15min":26.742999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.361,"15min":1.26},"min":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.53000000000000003},"max":{"1min":7.7119999999999997,"5min":7.7119999999999997,"15min":8.9290000000000003},"last":1.552},{"interface":"front","average":{"1min":2.2509999999999999,"5min":1.4970000000000001,"15min":1.365},"min":{"1min":0.64100000000000001,"5min":0.54700000000000004,"15min":0.50900000000000001},"max":{"1min":16.645,"5min":16.645,"15min":16.645},"last":0.90500000000000003}]}]},{"osd":0,"up_from":14,"seq":60129550317,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4292440,"kb_used_data":3577232,"kb_used_omap":3147,"kb_used_meta":712052,"kb_avail":90079400,"statfs":{"total":96636764160,"available":92241305600,"internally_reserved":0,"allocated":3663085568,"data_stored":3662418913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3223258,"internal_metadata":729141542},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":0.91900000000000004,"15min":0.86599999999999999},"min":{"1min":0.32500000000000001,"5min":0.29899999999999999,"15min":0.23400000000000001},"max":{"1min":10.074,"5min":10.074,"15min":12.294},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.177,"5min":0.95199999999999996,"15min":0.97099999999999997},"min":{"1min":0.442,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":10.473000000000001,"5min":10.473000000000001,"15min":10.473000000000001},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":3.3029999999999999,"5min":1.3959999999999999,"15min":1.117},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":46.451999999999998,"5min":46.451999999999998,"15min":46.451999999999998},"last":1.081},{"interface":"front","average":{"1min":2.3530000000000002,"5min":1.159,"15min":1.056},"min":{"1min":0.44600000000000001,"5min":0.34799999999999998,"15min":0.32200000000000001},"max":{"1min":33.904000000000003,"5min":33.904000000000003,"15min":33.904000000000003},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":3.5760000000000001,"5min":1.4910000000000001,"15min":1.2110000000000001},"min":{"1min":0.41899999999999998,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":50.244999999999997,"5min":50.244999999999997,"15min":50.244999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0940000000000001,"5min":0.95999999999999996,"15min":0.96799999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.6280000000000001,"5min":4.5270000000000001,"15min":12.481999999999999},"last":1.1359999999999999}]},{"osd":4,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.2290000000000001,"15min":1.397},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.46100000000000002},"max":{"1min":10.550000000000001,"5min":10.550000000000001,"15min":77.847999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":3.8540000000000001,"5min":1.76,"15min":1.573},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":61.817,"5min":61.817,"15min":77.653999999999996},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":3.613,"5min":1.855,"15min":1.3700000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":55.627000000000002,"5min":55.627000000000002,"15min":55.627000000000002},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.0700000000000001,"15min":1.032},"min":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.44800000000000001},"max":{"1min":3.71,"5min":4.4880000000000004,"15min":12.173999999999999},"last":1.1759999999999999}]},{"osd":6,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":4.7460000000000004,"5min":1.98,"15min":2.581},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":52.380000000000003,"5min":52.380000000000003,"15min":211.46600000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":2.0489999999999999,"5min":1.5680000000000001,"15min":2.3759999999999999},"min":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.50600000000000001},"max":{"1min":20.934999999999999,"5min":20.934999999999999,"15min":210.86699999999999},"last":1.026}]},{"osd":7,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.401,"15min":1.3100000000000001},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":10.84,"5min":10.84,"15min":10.84},"last":0.85299999999999998},{"interface":"front","average":{"1min":3.73,"5min":1.8320000000000001,"15min":1.4770000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":50.421999999999997,"5min":50.421999999999997,"15min":50.421999999999997},"last":1.0549999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-30T19:35:50.297 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-30T19:35:50.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.421+0000 7f0b24e84700 1 Processor -- start 2023-03-30T19:35:50.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.421+0000 7f0b24e84700 1 -- start start 2023-03-30T19:35:50.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.421+0000 7f0b24e84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b200b2440 0x7f0b200b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:50.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b24e84700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0b200cd030 0x7f0b200cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:50.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b24e84700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b20146280 con 0x7f0b20145eb0 2023-03-30T19:35:50.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b24e84700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b200b2df0 con 0x7f0b200cd030 2023-03-30T19:35:50.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b24e84700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2006ade0 con 0x7f0b200b2440 2023-03-30T19:35:50.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b1ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0b200cd030 0x7f0b200cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:50.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b1ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0b200cd030 0x7f0b200cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34114/0 (socket says 172.21.15.87:34114) 2023-03-30T19:35:50.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b1ffff700 1 -- 172.21.15.87:0/3111588446 learned_addr learned my addr 172.21.15.87:0/3111588446 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:50.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b17fff700 1 --2- 172.21.15.87:0/3111588446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b200b2440 0x7f0b200b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:50.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b1ffff700 1 -- 172.21.15.87:0/3111588446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b200b2440 msgr2=0x7f0b200b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:50.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b1ffff700 1 --2- 172.21.15.87:0/3111588446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b200b2440 0x7f0b200b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:50.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b1ffff700 1 -- 172.21.15.87:0/3111588446 >> v1:172.21.15.115:6789/0 conn(0x7f0b20145eb0 legacy=0x7f0b20160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:50.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b1ffff700 1 -- 172.21.15.87:0/3111588446 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2006b3a0 con 0x7f0b200cd030 2023-03-30T19:35:50.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b1ffff700 1 --2- 172.21.15.87:0/3111588446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b200cd030 0x7f0b200cd470 secure :-1 s=READY pgs=3332 cs=0 l=1 rev1=1 crypto rx=0x7f0b18009e50 tx=0x7f0b1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1821b7e23eac86 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:50.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b1effd700 1 -- 172.21.15.87:0/3111588446 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1800e070 con 0x7f0b200cd030 2023-03-30T19:35:50.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b1effd700 1 -- 172.21.15.87:0/3111588446 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1800b910 con 0x7f0b200cd030 2023-03-30T19:35:50.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b1effd700 1 -- 172.21.15.87:0/3111588446 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1800bcc0 con 0x7f0b200cd030 2023-03-30T19:35:50.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b24e84700 1 -- 172.21.15.87:0/3111588446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b200cd030 msgr2=0x7f0b200cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:50.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b24e84700 1 --2- 172.21.15.87:0/3111588446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b200cd030 0x7f0b200cd470 secure :-1 s=READY pgs=3332 cs=0 l=1 rev1=1 crypto rx=0x7f0b18009e50 tx=0x7f0b1800b330 comp rx=0 tx=0).stop 2023-03-30T19:35:50.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b24e84700 1 -- 172.21.15.87:0/3111588446 shutdown_connections 2023-03-30T19:35:50.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b24e84700 1 --2- 172.21.15.87:0/3111588446 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b200cd030 0x7f0b200cd470 unknown :-1 s=CLOSED pgs=3332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:50.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b24e84700 1 --2- 172.21.15.87:0/3111588446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b200b2440 0x7f0b200b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:50.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b24e84700 1 -- 172.21.15.87:0/3111588446 >> 172.21.15.87:0/3111588446 conn(0x7f0b2006e560 msgr2=0x7f0b2006e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:50.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b24e84700 1 -- 172.21.15.87:0/3111588446 shutdown_connections 2023-03-30T19:35:50.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b24e84700 1 -- 172.21.15.87:0/3111588446 wait complete. 2023-03-30T19:35:50.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b24e84700 1 Processor -- start 2023-03-30T19:35:50.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.425+0000 7f0b24e84700 1 -- start start 2023-03-30T19:35:50.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b24e84700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b200b2440 0x7f0b201f1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:50.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b24e84700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b200cd030 0x7f0b200c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:50.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b24e84700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b20145eb0 0x7f0b2015ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:50.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b24e84700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200c8d60 con 0x7f0b200b2440 2023-03-30T19:35:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b24e84700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200c9040 con 0x7f0b200cd030 2023-03-30T19:35:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b24e84700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200c9320 con 0x7f0b20145eb0 2023-03-30T19:35:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b1ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b20145eb0 0x7f0b2015ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b17fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b200cd030 0x7f0b200c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:50.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b1ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b20145eb0 0x7f0b2015ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:48048/0 (socket says 172.21.15.87:48048) 2023-03-30T19:35:50.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b1ffff700 1 -- 172.21.15.87:0/3456748653 learned_addr learned my addr 172.21.15.87:0/3456748653 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:50.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b1ffff700 1 -- 172.21.15.87:0/3456748653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b200cd030 msgr2=0x7f0b200c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:50.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b1ffff700 1 --2- 172.21.15.87:0/3456748653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b200cd030 0x7f0b200c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:50.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b1ffff700 1 -- 172.21.15.87:0/3456748653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b200b2440 msgr2=0x7f0b201f1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:50.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b1ffff700 1 --2- 172.21.15.87:0/3456748653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b200b2440 0x7f0b201f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:50.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b1ffff700 1 -- 172.21.15.87:0/3456748653 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b18009b30 con 0x7f0b20145eb0 2023-03-30T19:35:50.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b1ffff700 1 --2- 172.21.15.87:0/3456748653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b20145eb0 0x7f0b2015ec50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0b2006fac0 tx=0x7f0b18004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:50.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b1cff9700 1 -- 172.21.15.87:0/3456748653 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b180048b0 con 0x7f0b20145eb0 2023-03-30T19:35:50.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b1cff9700 1 -- 172.21.15.87:0/3456748653 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b180099b0 con 0x7f0b20145eb0 2023-03-30T19:35:50.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b1cff9700 1 -- 172.21.15.87:0/3456748653 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1801b670 con 0x7f0b20145eb0 2023-03-30T19:35:50.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b24e84700 1 -- 172.21.15.87:0/3456748653 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b20160c30 con 0x7f0b20145eb0 2023-03-30T19:35:50.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b24e84700 1 -- 172.21.15.87:0/3456748653 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2015da70 con 0x7f0b20145eb0 2023-03-30T19:35:50.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.429+0000 7f0b24e84700 1 -- 172.21.15.87:0/3456748653 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b20160f10 con 0x7f0b20145eb0 2023-03-30T19:35:50.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.433+0000 7f0b1cff9700 1 -- 172.21.15.87:0/3456748653 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f0b1801b7d0 con 0x7f0b20145eb0 2023-03-30T19:35:50.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.433+0000 7f0b1cff9700 1 --2- 172.21.15.87:0/3456748653 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0b000653f0 0x7f0b000678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:50.441 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.433+0000 7f0b1cff9700 1 -- 172.21.15.87:0/3456748653 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0b18083f30 con 0x7f0b20145eb0 2023-03-30T19:35:50.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.433+0000 7f0b1f7fe700 1 --2- 172.21.15.87:0/3456748653 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0b000653f0 0x7f0b000678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:50.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.433+0000 7f0b1f7fe700 1 --2- 172.21.15.87:0/3456748653 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0b000653f0 0x7f0b000678a0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f0b10000f60 tx=0x7f0b10007a60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:50.442 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.437+0000 7f0b1cff9700 1 -- 172.21.15.87:0/3456748653 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f0b18051d80 con 0x7f0b20145eb0 2023-03-30T19:35:50.588 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.585+0000 7f0b24e84700 1 -- 172.21.15.87:0/3456748653 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b200c91b0 con 0x7f0b000653f0 2023-03-30T19:35:50.591 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.585+0000 7f0b1cff9700 1 -- 172.21.15.87:0/3456748653 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71412 (secure 0 0 0) 0x7f0b200c91b0 con 0x7f0b000653f0 2023-03-30T19:35:50.592 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:50.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.589+0000 7f0b24e84700 1 -- 172.21.15.87:0/3456748653 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0b000653f0 msgr2=0x7f0b000678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:50.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.589+0000 7f0b24e84700 1 --2- 172.21.15.87:0/3456748653 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0b000653f0 0x7f0b000678a0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f0b10000f60 tx=0x7f0b10007a60 comp rx=0 tx=0).stop 2023-03-30T19:35:50.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.589+0000 7f0b24e84700 1 -- 172.21.15.87:0/3456748653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b20145eb0 msgr2=0x7f0b2015ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:50.594 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.589+0000 7f0b24e84700 1 --2- 172.21.15.87:0/3456748653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b20145eb0 0x7f0b2015ec50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0b2006fac0 tx=0x7f0b18004af0 comp rx=0 tx=0).stop 2023-03-30T19:35:50.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.589+0000 7f0b24e84700 1 -- 172.21.15.87:0/3456748653 shutdown_connections 2023-03-30T19:35:50.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.589+0000 7f0b24e84700 1 --2- 172.21.15.87:0/3456748653 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0b000653f0 0x7f0b000678a0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:50.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.589+0000 7f0b24e84700 1 --2- 172.21.15.87:0/3456748653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0b20145eb0 0x7f0b2015ec50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:50.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.589+0000 7f0b24e84700 1 --2- 172.21.15.87:0/3456748653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b200cd030 0x7f0b200c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:50.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.589+0000 7f0b24e84700 1 --2- 172.21.15.87:0/3456748653 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b200b2440 0x7f0b201f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:50.595 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.589+0000 7f0b24e84700 1 -- 172.21.15.87:0/3456748653 >> 172.21.15.87:0/3456748653 conn(0x7f0b2006e560 msgr2=0x7f0b2015ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:50.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.589+0000 7f0b24e84700 1 -- 172.21.15.87:0/3456748653 shutdown_connections 2023-03-30T19:35:50.596 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.589+0000 7f0b24e84700 1 -- 172.21.15.87:0/3456748653 wait complete. 2023-03-30T19:35:50.596 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-03-30T19:35:50.614 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":20584,"stamp":"2023-03-30T19:35:50.272199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":29045864,"kb_used_data":21816552,"kb_used_omap":31256,"kb_used_meta":7197991,"kb_avail":725928856,"statfs":{"total":773094113280,"available":743351148544,"internally_reserved":0,"allocated":22340149248,"data_stored":22335383625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32006444,"internal_metadata":7370743508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,3,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12913179304,"num_objects":-11538,"num_object_clones":0,"num_object_copies":-23076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11538,"num_whiteouts":0,"num_read":-1443946,"num_read_kb":-415178615,"num_write":-6053453,"num_write_kb":-586470328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-742,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.230038"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":349,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:16.471996+0000","last_change":"2023-03-30T08:10:52.871133+0000","last_active":"2023-03-30T19:34:16.471996+0000","last_peered":"2023-03-30T19:34:16.471996+0000","last_clean":"2023-03-30T19:34:16.471996+0000","last_became_active":"2023-03-30T08:10:52.870678+0000","last_became_peered":"2023-03-30T08:10:52.870678+0000","last_unstale":"2023-03-30T19:34:16.471996+0000","last_undegraded":"2023-03-30T19:34:16.471996+0000","last_fullsized":"2023-03-30T19:34:16.471996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:51.162618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":352,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:25.725081+0000","last_change":"2023-03-30T08:10:52.871548+0000","last_active":"2023-03-30T19:34:25.725081+0000","last_peered":"2023-03-30T19:34:25.725081+0000","last_clean":"2023-03-30T19:34:25.725081+0000","last_became_active":"2023-03-30T08:10:52.871152+0000","last_became_peered":"2023-03-30T08:10:52.871152+0000","last_unstale":"2023-03-30T19:34:25.725081+0000","last_undegraded":"2023-03-30T19:34:25.725081+0000","last_fullsized":"2023-03-30T19:34:25.725081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":357,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:33:45.710496+0000","last_change":"2023-03-30T08:10:52.921525+0000","last_active":"2023-03-30T19:33:45.710496+0000","last_peered":"2023-03-30T19:33:45.710496+0000","last_clean":"2023-03-30T19:33:45.710496+0000","last_became_active":"2023-03-30T08:10:52.920885+0000","last_became_peered":"2023-03-30T08:10:52.920885+0000","last_unstale":"2023-03-30T19:33:45.710496+0000","last_undegraded":"2023-03-30T19:33:45.710496+0000","last_fullsized":"2023-03-30T19:33:45.710496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:38:27.041880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":363,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:25.725034+0000","last_change":"2023-03-30T08:10:52.921563+0000","last_active":"2023-03-30T19:34:25.725034+0000","last_peered":"2023-03-30T19:34:25.725034+0000","last_clean":"2023-03-30T19:34:25.725034+0000","last_became_active":"2023-03-30T08:10:52.921234+0000","last_became_peered":"2023-03-30T08:10:52.921234+0000","last_unstale":"2023-03-30T19:34:25.725034+0000","last_undegraded":"2023-03-30T19:34:25.725034+0000","last_fullsized":"2023-03-30T19:34:25.725034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":359,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:35:25.957548+0000","last_change":"2023-03-30T08:10:52.866272+0000","last_active":"2023-03-30T19:35:25.957548+0000","last_peered":"2023-03-30T19:35:25.957548+0000","last_clean":"2023-03-30T19:35:25.957548+0000","last_became_active":"2023-03-30T08:10:52.865919+0000","last_became_peered":"2023-03-30T08:10:52.865919+0000","last_unstale":"2023-03-30T19:35:25.957548+0000","last_undegraded":"2023-03-30T19:35:25.957548+0000","last_fullsized":"2023-03-30T19:35:25.957548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":361,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:40.595186+0000","last_change":"2023-03-30T08:10:52.920796+0000","last_active":"2023-03-30T19:34:40.595186+0000","last_peered":"2023-03-30T19:34:40.595186+0000","last_clean":"2023-03-30T19:34:40.595186+0000","last_became_active":"2023-03-30T08:10:52.920327+0000","last_became_peered":"2023-03-30T08:10:52.920327+0000","last_unstale":"2023-03-30T19:34:40.595186+0000","last_undegraded":"2023-03-30T19:34:40.595186+0000","last_fullsized":"2023-03-30T19:34:40.595186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:17.416386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":371,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:35.754874+0000","last_change":"2023-03-30T08:10:52.866412+0000","last_active":"2023-03-30T19:34:35.754874+0000","last_peered":"2023-03-30T19:34:35.754874+0000","last_clean":"2023-03-30T19:34:35.754874+0000","last_became_active":"2023-03-30T08:10:52.866055+0000","last_became_peered":"2023-03-30T08:10:52.866055+0000","last_unstale":"2023-03-30T19:34:35.754874+0000","last_undegraded":"2023-03-30T19:34:35.754874+0000","last_fullsized":"2023-03-30T19:34:35.754874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:39.045010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":359,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-03-30T19:35:40.186624+0000","last_change":"2023-03-30T08:10:52.868170+0000","last_active":"2023-03-30T19:35:40.186624+0000","last_peered":"2023-03-30T19:35:40.186624+0000","last_clean":"2023-03-30T19:35:40.186624+0000","last_became_active":"2023-03-30T08:10:52.867790+0000","last_became_peered":"2023-03-30T08:10:52.867790+0000","last_unstale":"2023-03-30T19:35:40.186624+0000","last_undegraded":"2023-03-30T19:35:40.186624+0000","last_fullsized":"2023-03-30T19:35:40.186624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":524,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:30.754284+0000","last_change":"2023-03-30T08:10:45.713084+0000","last_active":"2023-03-30T19:34:30.754284+0000","last_peered":"2023-03-30T19:34:30.754284+0000","last_clean":"2023-03-30T19:34:30.754284+0000","last_became_active":"2023-03-30T08:10:45.711645+0000","last_became_peered":"2023-03-30T08:10:45.711645+0000","last_unstale":"2023-03-30T19:34:30.754284+0000","last_undegraded":"2023-03-30T19:34:30.754284+0000","last_fullsized":"2023-03-30T19:34:30.754284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_clean_scrub_stamp":"2023-03-30T08:10:44.620691+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:58:12.738262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424517648,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4543776,"kb_used_data":3551832,"kb_used_omap":4629,"kb_used_meta":987306,"kb_avail":89828064,"statfs":{"total":96636764160,"available":91983937536,"internally_reserved":0,"allocated":3637075968,"data_stored":3636403579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4740435,"internal_metadata":1011002029},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.91900000000000004,"15min":0.79900000000000004},"min":{"1min":0.34200000000000003,"5min":0.311,"15min":0.311},"max":{"1min":3.5720000000000001,"5min":8.6210000000000004,"15min":8.6210000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.92400000000000004,"15min":0.89300000000000002},"min":{"1min":0.38500000000000001,"5min":0.36699999999999999,"15min":0.34599999999999997},"max":{"1min":1.5269999999999999,"5min":6.4669999999999996,"15min":6.4669999999999996},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.0529999999999999,"15min":0.96399999999999997},"min":{"1min":0.39500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":10.169,"5min":10.169,"15min":10.169},"last":0.504},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.081,"15min":0.90600000000000003},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.34999999999999998},"max":{"1min":4.2430000000000003,"5min":8.5220000000000002,"15min":8.5220000000000002},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.095,"15min":0.999},"min":{"1min":0.47399999999999998,"5min":0.38700000000000001,"15min":0.35899999999999999},"max":{"1min":11.26,"5min":11.26,"15min":11.26},"last":4.2999999999999998},{"interface":"front","average":{"1min":1.597,"5min":1.125,"15min":1.042},"min":{"1min":0.44,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":10.236000000000001,"5min":10.236000000000001,"15min":10.236000000000001},"last":5.6180000000000003}]},{"osd":3,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.1559999999999999,"15min":1.425},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.4619999999999997,"5min":9.1280000000000001,"15min":113.637},"last":4.3730000000000002},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.1319999999999999,"15min":1.4650000000000001},"min":{"1min":0.52500000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.6059999999999999,"5min":6.5199999999999996,"15min":113.90600000000001},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":1.1259999999999999,"15min":0.96899999999999997},"min":{"1min":0.45400000000000001,"5min":0.38700000000000001,"15min":0.36599999999999999},"max":{"1min":2.04,"5min":8.6590000000000007,"15min":8.6590000000000007},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.1519999999999999,"15min":1.02},"min":{"1min":0.46300000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.613,"5min":6.5819999999999999,"15min":6.5819999999999999},"last":0.628}]},{"osd":5,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.167,"15min":1.0820000000000001},"min":{"1min":0.439,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":3.1600000000000001,"5min":6.6079999999999997,"15min":9.1270000000000007},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.341,"15min":1.1339999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.435},"max":{"1min":3.3220000000000001,"5min":9.0079999999999991,"15min":9.3379999999999992},"last":1.101}]},{"osd":7,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.194,"15min":1.1299999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.49099999999999999},"max":{"1min":2.6720000000000002,"5min":6.6109999999999998,"15min":6.6109999999999998},"last":1.25},{"interface":"front","average":{"1min":2.4489999999999998,"5min":1.5209999999999999,"15min":1.204},"min":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.48599999999999999},"max":{"1min":22.887,"5min":22.887,"15min":22.887},"last":0.59499999999999997}]}]},{"osd":7,"up_from":14,"seq":60129550360,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2558872,"kb_used_data":2281104,"kb_used_omap":4609,"kb_used_meta":273150,"kb_avail":91812968,"statfs":{"total":96636764160,"available":94016479232,"internally_reserved":0,"allocated":2335850496,"data_stored":2335280120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4719691,"internal_metadata":279706549},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.94299999999999995,"15min":0.876},"min":{"1min":0.36199999999999999,"5min":0.34000000000000002,"15min":0.29399999999999998},"max":{"1min":1.349,"5min":6.3419999999999996,"15min":7.5529999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.92500000000000004,"15min":0.877},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.647,"5min":5.2569999999999997,"15min":5.819},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.97399999999999998,"15min":0.95799999999999996},"min":{"1min":0.50800000000000001,"5min":0.498,"15min":0.437},"max":{"1min":4.0590000000000002,"5min":5.1349999999999998,"15min":5.54},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.89900000000000002,"5min":1.0649999999999999,"15min":1.008},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.1470000000000002,"5min":6.3929999999999998,"15min":7.6550000000000002},"last":1.272}]},{"osd":2,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":1.208,"15min":1.0620000000000001},"min":{"1min":0.41599999999999998,"5min":0.40200000000000002,"15min":0.39400000000000002},"max":{"1min":6.782,"5min":6.782,"15min":6.782},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.087,"15min":1.012},"min":{"1min":0.52900000000000003,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":7.3300000000000001,"5min":7.3300000000000001,"15min":7.3300000000000001},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.1719999999999999,"15min":1.4950000000000001},"min":{"1min":0.495,"5min":0.44600000000000001,"15min":0.43099999999999999},"max":{"1min":5.04,"5min":6.3849999999999998,"15min":111.13800000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.111,"15min":1.472},"min":{"1min":0.66600000000000004,"5min":0.495,"15min":0.45700000000000002},"max":{"1min":3.7509999999999999,"5min":5.3259999999999996,"15min":109.63800000000001},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.246,"15min":1.1759999999999999},"min":{"1min":0.46300000000000002,"5min":0.45800000000000002,"15min":0.34799999999999998},"max":{"1min":5.141,"5min":8.7940000000000005,"15min":9.3409999999999993},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.627,"5min":1.27,"15min":1.1759999999999999},"min":{"1min":0.53900000000000003,"5min":0.434,"15min":0.36399999999999999},"max":{"1min":7.3090000000000002,"5min":7.3090000000000002,"15min":7.3090000000000002},"last":1.927}]},{"osd":5,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.6739999999999999,"5min":1.3080000000000001,"15min":1.1739999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.41299999999999998},"max":{"1min":7.2599999999999998,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":1.968},{"interface":"front","average":{"1min":1.319,"5min":1.327,"15min":1.2330000000000001},"min":{"1min":0.503,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":5.2939999999999996,"5min":8.532,"15min":8.532},"last":1.3540000000000001}]},{"osd":6,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.3779999999999999,"15min":1.2569999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":5.8040000000000003,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.9970000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.117,"15min":1.077},"min":{"1min":0.67700000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.82399999999999995}]}]},{"osd":5,"up_from":14,"seq":60129550358,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3196484,"kb_used_data":2117628,"kb_used_omap":1498,"kb_used_meta":1077349,"kb_avail":91175356,"statfs":{"total":96636764160,"available":93363564544,"internally_reserved":0,"allocated":2168451072,"data_stored":2167909286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1534458,"internal_metadata":1103205894},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":1.1779999999999999,"15min":0.96499999999999997},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.956,"5min":12.332000000000001,"15min":12.332000000000001},"last":1.288},{"interface":"front","average":{"1min":1.407,"5min":1.1519999999999999,"15min":0.96299999999999997},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":8.4359999999999999,"5min":12.897,"15min":12.897},"last":0.90800000000000003}]},{"osd":1,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":3.4329999999999998,"5min":1.46,"15min":1.1679999999999999},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.373},"max":{"1min":30.469000000000001,"5min":30.469000000000001,"15min":30.469000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.623,"5min":1.2789999999999999,"15min":1.044},"min":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.40899999999999997},"max":{"1min":14.49,"5min":14.49,"15min":14.49},"last":1.0860000000000001}]},{"osd":2,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":1.3799999999999999,"15min":1.204},"min":{"1min":0.45000000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":30.507999999999999,"5min":30.507999999999999,"15min":30.507999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.379,"5min":1.2669999999999999,"15min":1.1060000000000001},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":8.4849999999999994,"5min":12.944000000000001,"15min":12.944000000000001},"last":1.228}]},{"osd":3,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.3640000000000001,"15min":1.145},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":8.5139999999999993,"5min":13.007,"15min":13.007},"last":1.4350000000000001},{"interface":"front","average":{"1min":2.6459999999999999,"5min":1.512,"15min":1.282},"min":{"1min":0.55500000000000005,"5min":0.503,"15min":0.46300000000000002},"max":{"1min":30.402999999999999,"5min":30.402999999999999,"15min":30.402999999999999},"last":1.167}]},{"osd":4,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":2.9380000000000002,"5min":1.5169999999999999,"15min":1.2410000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.38800000000000001},"max":{"1min":30.547999999999998,"5min":30.547999999999998,"15min":30.547999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.3069999999999999,"15min":1.153},"min":{"1min":0.46400000000000002,"5min":0.441,"15min":0.438},"max":{"1min":3.1739999999999999,"5min":7.3079999999999998,"15min":9.2870000000000008},"last":1.506}]},{"osd":6,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":1.6599999999999999,"15min":1.284},"min":{"1min":0.51200000000000001,"5min":0.501,"15min":0.501},"max":{"1min":33.402000000000001,"5min":33.402000000000001,"15min":33.402000000000001},"last":1.351},{"interface":"front","average":{"1min":3.4630000000000001,"5min":1.8069999999999999,"15min":1.327},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":33.673999999999999,"5min":33.673999999999999,"15min":33.673999999999999},"last":1.373}]},{"osd":7,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.5529999999999999,"15min":1.3089999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.496},"max":{"1min":8.5419999999999998,"5min":12.976000000000001,"15min":12.976000000000001},"last":1.4810000000000001},{"interface":"front","average":{"1min":2.681,"5min":1.621,"15min":1.343},"min":{"1min":0.59899999999999998,"5min":0.504,"15min":0.47799999999999998},"max":{"1min":24.754000000000001,"5min":24.754000000000001,"15min":24.754000000000001},"last":1.024}]}]},{"osd":4,"up_from":14,"seq":60129550352,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3307484,"kb_used_data":2192084,"kb_used_omap":3500,"kb_used_meta":1111891,"kb_avail":91064356,"statfs":{"total":96636764160,"available":93249900544,"internally_reserved":0,"allocated":2244694016,"data_stored":2244109560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3584019,"internal_metadata":1138577389},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":1.0740000000000001,"15min":0.96699999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.313},"max":{"1min":1.3720000000000001,"5min":5.8579999999999997,"15min":5.8579999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.0069999999999999,"15min":0.995},"min":{"1min":0.39800000000000002,"5min":0.36499999999999999,"15min":0.34300000000000003},"max":{"1min":6.4989999999999997,"5min":6.4989999999999997,"15min":7.2930000000000001},"last":1.0389999999999999}]},{"osd":1,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.96399999999999997,"15min":0.94699999999999995},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":5.141,"5min":5.141,"15min":5.141},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.3149999999999999,"15min":1.133},"min":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.376},"max":{"1min":2.6389999999999998,"5min":5.7889999999999997,"15min":8.8740000000000006},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":1.2190000000000001,"15min":1.113},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":1.728,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":0.879},{"interface":"front","average":{"1min":1.28,"5min":1.159,"15min":1.117},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.41899999999999998},"max":{"1min":6.4009999999999998,"5min":7.1639999999999997,"15min":7.3869999999999996},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":2.5499999999999998,"15min":1.5700000000000001},"min":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.434},"max":{"1min":2.214,"5min":116.221,"15min":116.221},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.3160000000000001,"5min":2.4460000000000002,"15min":1.5649999999999999},"min":{"1min":0.56899999999999995,"5min":0.436,"15min":0.436},"max":{"1min":6.5339999999999998,"5min":116.306,"15min":116.306},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":4.484,"5min":1.6040000000000001,"15min":1.1879999999999999},"min":{"1min":0.45600000000000002,"5min":0.42299999999999999,"15min":0.39400000000000002},"max":{"1min":69.498000000000005,"5min":69.498000000000005,"15min":69.498000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.278,"15min":1.179},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.42299999999999999},"max":{"1min":2.0470000000000002,"5min":6.024,"15min":10.057},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.109,"15min":1.1799999999999999},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.42399999999999999},"max":{"1min":1.6719999999999999,"5min":6.1879999999999997,"15min":15.928000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.3400000000000001,"15min":1.2929999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46000000000000002},"max":{"1min":1.583,"5min":5.9260000000000002,"15min":15.566000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.238,"15min":1.204},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.4589999999999996,"5min":6.4589999999999996,"15min":7.3460000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.032,"5min":1.093,"15min":1.1679999999999999},"min":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.47599999999999998},"max":{"1min":1.9059999999999999,"5min":6.7160000000000002,"15min":6.7160000000000002},"last":0.60599999999999998}]}]},{"osd":3,"up_from":14,"seq":60129550328,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3977400,"kb_used_data":2888752,"kb_used_omap":7240,"kb_used_meta":1081399,"kb_avail":90394440,"statfs":{"total":96636764160,"available":92563906560,"internally_reserved":0,"allocated":2958082048,"data_stored":2957452620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7414054,"internal_metadata":1107353306},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.73999999999999999,"15min":0.77500000000000002},"min":{"1min":0.38100000000000001,"5min":0.27500000000000002,"15min":0.25900000000000001},"max":{"1min":2.976,"5min":2.976,"15min":8.0690000000000008},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.244,"5min":0.878,"15min":0.93500000000000005},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.27800000000000002},"max":{"1min":4.5380000000000003,"5min":4.5380000000000003,"15min":6.7160000000000002},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.88300000000000001,"15min":0.95499999999999996},"min":{"1min":0.434,"5min":0.31,"15min":0.31},"max":{"1min":5.7549999999999999,"5min":5.7549999999999999,"15min":8.7319999999999993},"last":1.5049999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.86899999999999999,"15min":0.88800000000000001},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.315},"max":{"1min":2.9710000000000001,"5min":3.109,"15min":4.1879999999999997},"last":0.623}]},{"osd":2,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.2829999999999999,"15min":1.1060000000000001},"min":{"1min":0.56299999999999994,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6459999999999999,"5min":25.440999999999999,"15min":25.440999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.2,"15min":1.179},"min":{"1min":0.56899999999999995,"5min":0.41699999999999998,"15min":0.41599999999999998},"max":{"1min":2.641,"5min":25.34,"15min":25.34},"last":1.546}]},{"osd":4,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.1779999999999999,"15min":1.05},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.42799999999999999},"max":{"1min":8.4390000000000001,"5min":8.4390000000000001,"15min":8.4390000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.383,"5min":1.0900000000000001,"15min":1.0249999999999999},"min":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.45700000000000002},"max":{"1min":4.4119999999999999,"5min":4.6699999999999999,"15min":4.71},"last":0.82999999999999996}]},{"osd":5,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":2.3839999999999999,"5min":1.4850000000000001,"15min":1.331},"min":{"1min":0.55500000000000005,"5min":0.51200000000000001,"15min":0.46999999999999997},"max":{"1min":23.702999999999999,"5min":23.702999999999999,"15min":23.702999999999999},"last":1.615},{"interface":"front","average":{"1min":2.0680000000000001,"5min":1.4159999999999999,"15min":1.2230000000000001},"min":{"1min":0.67900000000000005,"5min":0.56599999999999995,"15min":0.495},"max":{"1min":13.728999999999999,"5min":13.728999999999999,"15min":18.079999999999998},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.292,"15min":1.3240000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":4.6130000000000004,"5min":4.6349999999999998,"15min":57.677999999999997},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.294,"15min":1.361},"min":{"1min":0.66900000000000004,"5min":0.51700000000000002,"15min":0.50800000000000001},"max":{"1min":4.4980000000000002,"5min":5.4269999999999996,"15min":57.828000000000003},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":2.399,"5min":1.4770000000000001,"15min":1.276},"min":{"1min":0.60599999999999998,"5min":0.56200000000000006,"15min":0.52600000000000002},"max":{"1min":5.4649999999999999,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.575,"5min":1.258,"15min":1.2330000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":5.681,"5min":5.681,"15min":7.0529999999999999},"last":1.645}]}]},{"osd":2,"up_from":14,"seq":60129550340,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3376340,"kb_used_data":2418188,"kb_used_omap":2179,"kb_used_meta":955964,"kb_avail":90995500,"statfs":{"total":96636764160,"available":93179392000,"internally_reserved":0,"allocated":2476224512,"data_stored":2475655731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2231691,"internal_metadata":978907765},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.80800000000000005,"15min":1.258},"min":{"1min":0.28399999999999997,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":2.3239999999999998,"5min":4.0259999999999998,"15min":97.593999999999994},"last":2.3519999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88900000000000001,"15min":1.3280000000000001},"min":{"1min":0.38800000000000001,"5min":0.29899999999999999,"15min":0.27500000000000002},"max":{"1min":2.2250000000000001,"5min":5.1900000000000004,"15min":97.484999999999999},"last":0.751}]},{"osd":1,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84399999999999997,"15min":1.367},"min":{"1min":0.45900000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.6339999999999999,"5min":5.9059999999999997,"15min":139.036},"last":0.35699999999999998},{"interface":"front","average":{"1min":1.1859999999999999,"5min":0.96799999999999997,"15min":1.4359999999999999},"min":{"1min":0.436,"5min":0.34200000000000003,"15min":0.33500000000000002},"max":{"1min":4.673,"5min":4.673,"15min":139.107},"last":0.629}]},{"osd":3,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.93899999999999995,"15min":1.8089999999999999},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":1.8200000000000001,"5min":3.9420000000000002,"15min":142.262},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0249999999999999,"15min":1.8440000000000001},"min":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.36399999999999999},"max":{"1min":2.585,"5min":5.8280000000000003,"15min":141.92599999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.1899999999999999,"15min":1.1539999999999999},"min":{"1min":0.53000000000000003,"5min":0.42899999999999999,"15min":0.39200000000000002},"max":{"1min":3.8809999999999998,"5min":7.6879999999999997,"15min":10.942},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.224,"15min":1.208},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":2.653,"5min":7.6719999999999997,"15min":9.5009999999999994},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.077,"15min":1.1699999999999999},"min":{"1min":0.59899999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.7400000000000002,"5min":5.9429999999999996,"15min":24.672000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2450000000000001,"15min":1.244},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.44900000000000001},"max":{"1min":3.9239999999999999,"5min":5.6870000000000003,"15min":13.996},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2849999999999999,"15min":1.3069999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.49199999999999999},"max":{"1min":3.96,"5min":3.9769999999999999,"15min":15.323},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.2190000000000001,"15min":1.216},"min":{"1min":0.68899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":2.6669999999999998,"5min":5.9809999999999999,"15min":18.489000000000001},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":1.982,"5min":1.5529999999999999,"15min":1.3839999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.44900000000000001},"max":{"1min":20.303999999999998,"5min":20.303999999999998,"15min":20.303999999999998},"last":0.873},{"interface":"front","average":{"1min":2.2629999999999999,"5min":1.496,"15min":1.4470000000000001},"min":{"1min":0.627,"5min":0.56799999999999995,"15min":0.56100000000000005},"max":{"1min":21.478999999999999,"5min":21.478999999999999,"15min":24.937000000000001},"last":0.60099999999999998}]}]},{"osd":1,"up_from":14,"seq":60129550348,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3793068,"kb_used_data":2789732,"kb_used_omap":4451,"kb_used_meta":998876,"kb_avail":90578772,"statfs":{"total":96636764160,"available":92752662528,"internally_reserved":0,"allocated":2856685568,"data_stored":2856153816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558838,"internal_metadata":1022849034},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":0.97399999999999998,"15min":1.0469999999999999},"min":{"1min":0.33800000000000002,"5min":0.26800000000000002,"15min":0.252},"max":{"1min":12.628,"5min":12.628,"15min":25.765000000000001},"last":1.9990000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.93000000000000005,"15min":1.075},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28000000000000003},"max":{"1min":7.4470000000000001,"5min":7.4470000000000001,"15min":25.527999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.8879999999999999,"5min":1.0509999999999999,"15min":1.0740000000000001},"min":{"1min":0.36699999999999999,"5min":0.313,"15min":0.313},"max":{"1min":15.252000000000001,"5min":15.252000000000001,"15min":15.252000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":2.177,"5min":1.117,"15min":1.0740000000000001},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.34499999999999997},"max":{"1min":15.206,"5min":15.206,"15min":15.206},"last":1.9370000000000001}]},{"osd":3,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.0029999999999999,"15min":1.1100000000000001},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":8.1920000000000002,"5min":8.1920000000000002,"15min":18.219000000000001},"last":2.4409999999999998},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.044,"15min":1.1739999999999999},"min":{"1min":0.438,"5min":0.378,"15min":0.36599999999999999},"max":{"1min":7.7439999999999998,"5min":7.7439999999999998,"15min":25.456},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Mar 30 19:35:38 2023","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":1.0920000000000001,"15min":1.135},"min":{"1min":0.50600000000000001,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":6.0220000000000002,"5min":6.0220000000000002,"15min":13.728},"last":2.0369999999999999},{"interface":"front","average":{"1min":1.466,"5min":1.105,"15min":1.1140000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":8.2230000000000008,"5min":8.2230000000000008,"15min":10.217000000000001},"last":2.1429999999999998}]},{"osd":5,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.746,"5min":1.242,"15min":1.423},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":7.6749999999999998,"5min":7.6749999999999998,"15min":81.075999999999993},"last":1.212},{"interface":"front","average":{"1min":1.8340000000000001,"5min":1.2889999999999999,"15min":1.5109999999999999},"min":{"1min":0.54200000000000004,"5min":0.48899999999999999,"15min":0.44800000000000001},"max":{"1min":6.093,"5min":6.093,"15min":81.012},"last":1.962}]},{"osd":6,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":2.8410000000000002,"5min":1.5049999999999999,"15min":1.284},"min":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.51400000000000001},"max":{"1min":26.280999999999999,"5min":26.280999999999999,"15min":26.280999999999999},"last":1.5009999999999999},{"interface":"front","average":{"1min":2.661,"5min":1.5309999999999999,"15min":1.3480000000000001},"min":{"1min":0.57099999999999995,"5min":0.52300000000000002,"15min":0.47999999999999998},"max":{"1min":26.742999999999999,"5min":26.742999999999999,"15min":26.742999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.361,"15min":1.26},"min":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.53000000000000003},"max":{"1min":7.7119999999999997,"5min":7.7119999999999997,"15min":8.9290000000000003},"last":1.552},{"interface":"front","average":{"1min":2.2509999999999999,"5min":1.4970000000000001,"15min":1.365},"min":{"1min":0.64100000000000001,"5min":0.54700000000000004,"15min":0.50900000000000001},"max":{"1min":16.645,"5min":16.645,"15min":16.645},"last":0.90500000000000003}]}]},{"osd":0,"up_from":14,"seq":60129550317,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4292440,"kb_used_data":3577232,"kb_used_omap":3147,"kb_used_meta":712052,"kb_avail":90079400,"statfs":{"total":96636764160,"available":92241305600,"internally_reserved":0,"allocated":3663085568,"data_stored":3662418913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3223258,"internal_metadata":729141542},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":0.91900000000000004,"15min":0.86599999999999999},"min":{"1min":0.32500000000000001,"5min":0.29899999999999999,"15min":0.23400000000000001},"max":{"1min":10.074,"5min":10.074,"15min":12.294},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.177,"5min":0.95199999999999996,"15min":0.97099999999999997},"min":{"1min":0.442,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":10.473000000000001,"5min":10.473000000000001,"15min":10.473000000000001},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":3.3029999999999999,"5min":1.3959999999999999,"15min":1.117},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":46.451999999999998,"5min":46.451999999999998,"15min":46.451999999999998},"last":1.081},{"interface":"front","average":{"1min":2.3530000000000002,"5min":1.159,"15min":1.056},"min":{"1min":0.44600000000000001,"5min":0.34799999999999998,"15min":0.32200000000000001},"max":{"1min":33.904000000000003,"5min":33.904000000000003,"15min":33.904000000000003},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":3.5760000000000001,"5min":1.4910000000000001,"15min":1.2110000000000001},"min":{"1min":0.41899999999999998,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":50.244999999999997,"5min":50.244999999999997,"15min":50.244999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0940000000000001,"5min":0.95999999999999996,"15min":0.96799999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.6280000000000001,"5min":4.5270000000000001,"15min":12.481999999999999},"last":1.1359999999999999}]},{"osd":4,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.2290000000000001,"15min":1.397},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.46100000000000002},"max":{"1min":10.550000000000001,"5min":10.550000000000001,"15min":77.847999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":3.8540000000000001,"5min":1.76,"15min":1.573},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":61.817,"5min":61.817,"15min":77.653999999999996},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":3.613,"5min":1.855,"15min":1.3700000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":55.627000000000002,"5min":55.627000000000002,"15min":55.627000000000002},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.0700000000000001,"15min":1.032},"min":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.44800000000000001},"max":{"1min":3.71,"5min":4.4880000000000004,"15min":12.173999999999999},"last":1.1759999999999999}]},{"osd":6,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":4.7460000000000004,"5min":1.98,"15min":2.581},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":52.380000000000003,"5min":52.380000000000003,"15min":211.46600000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":2.0489999999999999,"5min":1.5680000000000001,"15min":2.3759999999999999},"min":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.50600000000000001},"max":{"1min":20.934999999999999,"5min":20.934999999999999,"15min":210.86699999999999},"last":1.026}]},{"osd":7,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.401,"15min":1.3100000000000001},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":10.84,"5min":10.84,"15min":10.84},"last":0.85299999999999998},{"interface":"front","average":{"1min":3.73,"5min":1.8320000000000001,"15min":1.4770000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":50.421999999999997,"5min":50.421999999999997,"15min":50.421999999999997},"last":1.0549999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-30T19:35:50.617 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-03-30T19:35:50.617 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-30T19:35:50.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.741+0000 7f52caff9700 1 Processor -- start 2023-03-30T19:35:50.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.741+0000 7f52caff9700 1 -- start start 2023-03-30T19:35:50.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.741+0000 7f52caff9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f52bc0e12a0 0x7f52bc037b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:50.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.741+0000 7f52caff9700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f52bc0e1670 0x7f52bc0e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:50.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.745+0000 7f52caff9700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc0e0af0 con 0x7f52bc0e4f50 2023-03-30T19:35:50.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.745+0000 7f52caff9700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52bc0e45f0 con 0x7f52bc0e12a0 2023-03-30T19:35:50.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.745+0000 7f52caff9700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52bc038080 con 0x7f52bc0e1670 2023-03-30T19:35:50.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.745+0000 7f52c8d95700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f52bc0e12a0 0x7f52bc037b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:50.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.745+0000 7f52c8d95700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f52bc0e12a0 0x7f52bc037b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34138/0 (socket says 172.21.15.87:34138) 2023-03-30T19:35:50.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.745+0000 7f52c8d95700 1 -- 172.21.15.87:0/942130767 learned_addr learned my addr 172.21.15.87:0/942130767 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:50.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.745+0000 7f52c3fff700 1 --2- 172.21.15.87:0/942130767 >> v2:172.21.15.115:3300/0 conn(0x7f52bc0e1670 0x7f52bc0e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:50.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.745+0000 7f52c8d95700 1 -- 172.21.15.87:0/942130767 >> v2:172.21.15.115:3300/0 conn(0x7f52bc0e1670 msgr2=0x7f52bc0e4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:50.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.745+0000 7f52c8d95700 1 --2- 172.21.15.87:0/942130767 >> v2:172.21.15.115:3300/0 conn(0x7f52bc0e1670 0x7f52bc0e4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:50.750 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.745+0000 7f52c8d95700 1 -- 172.21.15.87:0/942130767 >> v1:172.21.15.115:6789/0 conn(0x7f52bc0e4f50 legacy=0x7f52bc036770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:50.751 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:50.745+0000 7f52c8d95700 1 -- 172.21.15.87:0/942130767 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc050f00 con 0x7f52bc0e12a0 2023-03-30T19:35:51.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.021+0000 7f52c8d95700 1 --2- 172.21.15.87:0/942130767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52bc0e12a0 0x7f52bc037b40 secure :-1 s=READY pgs=3333 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0079f0 tx=0x7f52b8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f0505a9c96d5f2 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:51.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.021+0000 7f52c37fe700 1 -- 172.21.15.87:0/942130767 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8004230 con 0x7f52bc0e12a0 2023-03-30T19:35:51.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.025+0000 7f52c37fe700 1 -- 172.21.15.87:0/942130767 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b8004390 con 0x7f52bc0e12a0 2023-03-30T19:35:51.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.025+0000 7f52c37fe700 1 -- 172.21.15.87:0/942130767 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b80036c0 con 0x7f52bc0e12a0 2023-03-30T19:35:51.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.025+0000 7f52caff9700 1 -- 172.21.15.87:0/942130767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52bc0e12a0 msgr2=0x7f52bc037b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:51.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.025+0000 7f52caff9700 1 --2- 172.21.15.87:0/942130767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52bc0e12a0 0x7f52bc037b40 secure :-1 s=READY pgs=3333 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0079f0 tx=0x7f52b8009bf0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.025+0000 7f52caff9700 1 -- 172.21.15.87:0/942130767 shutdown_connections 2023-03-30T19:35:51.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.025+0000 7f52caff9700 1 --2- 172.21.15.87:0/942130767 >> v2:172.21.15.115:3300/0 conn(0x7f52bc0e1670 0x7f52bc0e4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.025+0000 7f52caff9700 1 --2- 172.21.15.87:0/942130767 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52bc0e12a0 0x7f52bc037b40 unknown :-1 s=CLOSED pgs=3333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.025+0000 7f52caff9700 1 -- 172.21.15.87:0/942130767 >> 172.21.15.87:0/942130767 conn(0x7f52bc051770 msgr2=0x7f52bc051b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:51.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.025+0000 7f52caff9700 1 -- 172.21.15.87:0/942130767 shutdown_connections 2023-03-30T19:35:51.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.025+0000 7f52caff9700 1 -- 172.21.15.87:0/942130767 wait complete. 2023-03-30T19:35:51.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.025+0000 7f52caff9700 1 Processor -- start 2023-03-30T19:35:51.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.025+0000 7f52caff9700 1 -- start start 2023-03-30T19:35:51.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52caff9700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f52bc0e1670 0x7f52bc0541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:51.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52caff9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52bc0e4f50 0x7f52bc0ddc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:51.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52caff9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52bc17f8d0 0x7f52bc17fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:51.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52caff9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0cfca0 con 0x7f52bc0e4f50 2023-03-30T19:35:51.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52caff9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0cfeb0 con 0x7f52bc17f8d0 2023-03-30T19:35:51.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52caff9700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0d0190 con 0x7f52bc0e1670 2023-03-30T19:35:51.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52c9596700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52bc17f8d0 0x7f52bc17fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:51.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52c9596700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52bc17f8d0 0x7f52bc17fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:48556/0 (socket says 172.21.15.87:48556) 2023-03-30T19:35:51.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52c9596700 1 -- 172.21.15.87:0/4136095575 learned_addr learned my addr 172.21.15.87:0/4136095575 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:51.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52c3fff700 1 --2- 172.21.15.87:0/4136095575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52bc0e4f50 0x7f52bc0ddc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:51.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52c8d95700 1 --2- 172.21.15.87:0/4136095575 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f52bc0e1670 0x7f52bc0541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:51.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52c9596700 1 -- 172.21.15.87:0/4136095575 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f52bc0e1670 msgr2=0x7f52bc0541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:51.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52c9596700 1 --2- 172.21.15.87:0/4136095575 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f52bc0e1670 0x7f52bc0541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52c9596700 1 -- 172.21.15.87:0/4136095575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52bc0e4f50 msgr2=0x7f52bc0ddc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:51.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52c9596700 1 --2- 172.21.15.87:0/4136095575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52bc0e4f50 0x7f52bc0ddc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52c9596700 1 -- 172.21.15.87:0/4136095575 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b8009570 con 0x7f52bc17f8d0 2023-03-30T19:35:51.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52c9596700 1 --2- 172.21.15.87:0/4136095575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52bc17f8d0 0x7f52bc17fd70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f52c40727f0 tx=0x7f52c4073f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:51.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52c17fa700 1 -- 172.21.15.87:0/4136095575 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c408d070 con 0x7f52bc17f8d0 2023-03-30T19:35:51.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52c17fa700 1 -- 172.21.15.87:0/4136095575 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c40723d0 con 0x7f52bc17f8d0 2023-03-30T19:35:51.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52c17fa700 1 -- 172.21.15.87:0/4136095575 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4066fb0 con 0x7f52bc17f8d0 2023-03-30T19:35:51.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52caff9700 1 -- 172.21.15.87:0/4136095575 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc051430 con 0x7f52bc17f8d0 2023-03-30T19:35:51.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.029+0000 7f52caff9700 1 -- 172.21.15.87:0/4136095575 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc051150 con 0x7f52bc17f8d0 2023-03-30T19:35:51.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.033+0000 7f52caff9700 1 -- 172.21.15.87:0/4136095575 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc0e4210 con 0x7f52bc17f8d0 2023-03-30T19:35:51.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.033+0000 7f52c17fa700 1 -- 172.21.15.87:0/4136095575 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f52c4067110 con 0x7f52bc17f8d0 2023-03-30T19:35:51.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.033+0000 7f52c17fa700 1 --2- 172.21.15.87:0/4136095575 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f52b00653f0 0x7f52b00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:51.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.033+0000 7f52c17fa700 1 -- 172.21.15.87:0/4136095575 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f52c40fb7a0 con 0x7f52bc17f8d0 2023-03-30T19:35:51.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.033+0000 7f52c8d95700 1 --2- 172.21.15.87:0/4136095575 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f52b00653f0 0x7f52b00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:51.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.037+0000 7f52c8d95700 1 --2- 172.21.15.87:0/4136095575 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f52b00653f0 0x7f52b00678a0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0079f0 tx=0x7f52b8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:51.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.037+0000 7f52c17fa700 1 -- 172.21.15.87:0/4136095575 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f52c40c9590 con 0x7f52bc17f8d0 2023-03-30T19:35:51.197 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.193+0000 7f52caff9700 1 -- 172.21.15.87:0/4136095575 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52bc005570 con 0x7f52b00653f0 2023-03-30T19:35:51.204 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.201+0000 7f52c17fa700 1 -- 172.21.15.87:0/4136095575 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71412 (secure 0 0 0) 0x7f52bc005570 con 0x7f52b00653f0 2023-03-30T19:35:51.206 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:51.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.201+0000 7f52caff9700 1 -- 172.21.15.87:0/4136095575 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f52b00653f0 msgr2=0x7f52b00678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:51.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.201+0000 7f52caff9700 1 --2- 172.21.15.87:0/4136095575 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f52b00653f0 0x7f52b00678a0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0079f0 tx=0x7f52b8008030 comp rx=0 tx=0).stop 2023-03-30T19:35:51.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.201+0000 7f52caff9700 1 -- 172.21.15.87:0/4136095575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52bc17f8d0 msgr2=0x7f52bc17fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:51.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.201+0000 7f52caff9700 1 --2- 172.21.15.87:0/4136095575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52bc17f8d0 0x7f52bc17fd70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f52c40727f0 tx=0x7f52c4073f60 comp rx=0 tx=0).stop 2023-03-30T19:35:51.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.201+0000 7f52caff9700 1 -- 172.21.15.87:0/4136095575 shutdown_connections 2023-03-30T19:35:51.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.201+0000 7f52caff9700 1 --2- 172.21.15.87:0/4136095575 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f52b00653f0 0x7f52b00678a0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.201+0000 7f52caff9700 1 --2- 172.21.15.87:0/4136095575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52bc17f8d0 0x7f52bc17fd70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.201+0000 7f52caff9700 1 --2- 172.21.15.87:0/4136095575 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52bc0e4f50 0x7f52bc0ddc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.201+0000 7f52caff9700 1 --2- 172.21.15.87:0/4136095575 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f52bc0e1670 0x7f52bc0541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.201+0000 7f52caff9700 1 -- 172.21.15.87:0/4136095575 >> 172.21.15.87:0/4136095575 conn(0x7f52bc051770 msgr2=0x7f52bc0dee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:51.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.201+0000 7f52caff9700 1 -- 172.21.15.87:0/4136095575 shutdown_connections 2023-03-30T19:35:51.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.201+0000 7f52caff9700 1 -- 172.21.15.87:0/4136095575 wait complete. 2023-03-30T19:35:51.211 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-03-30T19:35:51.222 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":20584,"stamp":"2023-03-30T19:35:50.272199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":29045864,"kb_used_data":21816552,"kb_used_omap":31256,"kb_used_meta":7197991,"kb_avail":725928856,"statfs":{"total":773094113280,"available":743351148544,"internally_reserved":0,"allocated":22340149248,"data_stored":22335383625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32006444,"internal_metadata":7370743508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,3,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12913179304,"num_objects":-11538,"num_object_clones":0,"num_object_copies":-23076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11538,"num_whiteouts":0,"num_read":-1443946,"num_read_kb":-415178615,"num_write":-6053453,"num_write_kb":-586470328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-742,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.230038"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":349,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:16.471996+0000","last_change":"2023-03-30T08:10:52.871133+0000","last_active":"2023-03-30T19:34:16.471996+0000","last_peered":"2023-03-30T19:34:16.471996+0000","last_clean":"2023-03-30T19:34:16.471996+0000","last_became_active":"2023-03-30T08:10:52.870678+0000","last_became_peered":"2023-03-30T08:10:52.870678+0000","last_unstale":"2023-03-30T19:34:16.471996+0000","last_undegraded":"2023-03-30T19:34:16.471996+0000","last_fullsized":"2023-03-30T19:34:16.471996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:51.162618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":352,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:25.725081+0000","last_change":"2023-03-30T08:10:52.871548+0000","last_active":"2023-03-30T19:34:25.725081+0000","last_peered":"2023-03-30T19:34:25.725081+0000","last_clean":"2023-03-30T19:34:25.725081+0000","last_became_active":"2023-03-30T08:10:52.871152+0000","last_became_peered":"2023-03-30T08:10:52.871152+0000","last_unstale":"2023-03-30T19:34:25.725081+0000","last_undegraded":"2023-03-30T19:34:25.725081+0000","last_fullsized":"2023-03-30T19:34:25.725081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":357,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:33:45.710496+0000","last_change":"2023-03-30T08:10:52.921525+0000","last_active":"2023-03-30T19:33:45.710496+0000","last_peered":"2023-03-30T19:33:45.710496+0000","last_clean":"2023-03-30T19:33:45.710496+0000","last_became_active":"2023-03-30T08:10:52.920885+0000","last_became_peered":"2023-03-30T08:10:52.920885+0000","last_unstale":"2023-03-30T19:33:45.710496+0000","last_undegraded":"2023-03-30T19:33:45.710496+0000","last_fullsized":"2023-03-30T19:33:45.710496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:38:27.041880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":363,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:25.725034+0000","last_change":"2023-03-30T08:10:52.921563+0000","last_active":"2023-03-30T19:34:25.725034+0000","last_peered":"2023-03-30T19:34:25.725034+0000","last_clean":"2023-03-30T19:34:25.725034+0000","last_became_active":"2023-03-30T08:10:52.921234+0000","last_became_peered":"2023-03-30T08:10:52.921234+0000","last_unstale":"2023-03-30T19:34:25.725034+0000","last_undegraded":"2023-03-30T19:34:25.725034+0000","last_fullsized":"2023-03-30T19:34:25.725034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":359,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:35:25.957548+0000","last_change":"2023-03-30T08:10:52.866272+0000","last_active":"2023-03-30T19:35:25.957548+0000","last_peered":"2023-03-30T19:35:25.957548+0000","last_clean":"2023-03-30T19:35:25.957548+0000","last_became_active":"2023-03-30T08:10:52.865919+0000","last_became_peered":"2023-03-30T08:10:52.865919+0000","last_unstale":"2023-03-30T19:35:25.957548+0000","last_undegraded":"2023-03-30T19:35:25.957548+0000","last_fullsized":"2023-03-30T19:35:25.957548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":361,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:40.595186+0000","last_change":"2023-03-30T08:10:52.920796+0000","last_active":"2023-03-30T19:34:40.595186+0000","last_peered":"2023-03-30T19:34:40.595186+0000","last_clean":"2023-03-30T19:34:40.595186+0000","last_became_active":"2023-03-30T08:10:52.920327+0000","last_became_peered":"2023-03-30T08:10:52.920327+0000","last_unstale":"2023-03-30T19:34:40.595186+0000","last_undegraded":"2023-03-30T19:34:40.595186+0000","last_fullsized":"2023-03-30T19:34:40.595186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:17.416386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":371,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:35.754874+0000","last_change":"2023-03-30T08:10:52.866412+0000","last_active":"2023-03-30T19:34:35.754874+0000","last_peered":"2023-03-30T19:34:35.754874+0000","last_clean":"2023-03-30T19:34:35.754874+0000","last_became_active":"2023-03-30T08:10:52.866055+0000","last_became_peered":"2023-03-30T08:10:52.866055+0000","last_unstale":"2023-03-30T19:34:35.754874+0000","last_undegraded":"2023-03-30T19:34:35.754874+0000","last_fullsized":"2023-03-30T19:34:35.754874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:39.045010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":359,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-03-30T19:35:40.186624+0000","last_change":"2023-03-30T08:10:52.868170+0000","last_active":"2023-03-30T19:35:40.186624+0000","last_peered":"2023-03-30T19:35:40.186624+0000","last_clean":"2023-03-30T19:35:40.186624+0000","last_became_active":"2023-03-30T08:10:52.867790+0000","last_became_peered":"2023-03-30T08:10:52.867790+0000","last_unstale":"2023-03-30T19:35:40.186624+0000","last_undegraded":"2023-03-30T19:35:40.186624+0000","last_fullsized":"2023-03-30T19:35:40.186624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":524,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-03-30T19:34:30.754284+0000","last_change":"2023-03-30T08:10:45.713084+0000","last_active":"2023-03-30T19:34:30.754284+0000","last_peered":"2023-03-30T19:34:30.754284+0000","last_clean":"2023-03-30T19:34:30.754284+0000","last_became_active":"2023-03-30T08:10:45.711645+0000","last_became_peered":"2023-03-30T08:10:45.711645+0000","last_unstale":"2023-03-30T19:34:30.754284+0000","last_undegraded":"2023-03-30T19:34:30.754284+0000","last_fullsized":"2023-03-30T19:34:30.754284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_clean_scrub_stamp":"2023-03-30T08:10:44.620691+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:58:12.738262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424517648,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4543776,"kb_used_data":3551832,"kb_used_omap":4629,"kb_used_meta":987306,"kb_avail":89828064,"statfs":{"total":96636764160,"available":91983937536,"internally_reserved":0,"allocated":3637075968,"data_stored":3636403579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4740435,"internal_metadata":1011002029},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.91900000000000004,"15min":0.79900000000000004},"min":{"1min":0.34200000000000003,"5min":0.311,"15min":0.311},"max":{"1min":3.5720000000000001,"5min":8.6210000000000004,"15min":8.6210000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.92400000000000004,"15min":0.89300000000000002},"min":{"1min":0.38500000000000001,"5min":0.36699999999999999,"15min":0.34599999999999997},"max":{"1min":1.5269999999999999,"5min":6.4669999999999996,"15min":6.4669999999999996},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.0529999999999999,"15min":0.96399999999999997},"min":{"1min":0.39500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":10.169,"5min":10.169,"15min":10.169},"last":0.504},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.081,"15min":0.90600000000000003},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.34999999999999998},"max":{"1min":4.2430000000000003,"5min":8.5220000000000002,"15min":8.5220000000000002},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.095,"15min":0.999},"min":{"1min":0.47399999999999998,"5min":0.38700000000000001,"15min":0.35899999999999999},"max":{"1min":11.26,"5min":11.26,"15min":11.26},"last":4.2999999999999998},{"interface":"front","average":{"1min":1.597,"5min":1.125,"15min":1.042},"min":{"1min":0.44,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":10.236000000000001,"5min":10.236000000000001,"15min":10.236000000000001},"last":5.6180000000000003}]},{"osd":3,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.1559999999999999,"15min":1.425},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.4619999999999997,"5min":9.1280000000000001,"15min":113.637},"last":4.3730000000000002},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.1319999999999999,"15min":1.4650000000000001},"min":{"1min":0.52500000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.6059999999999999,"5min":6.5199999999999996,"15min":113.90600000000001},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":1.1259999999999999,"15min":0.96899999999999997},"min":{"1min":0.45400000000000001,"5min":0.38700000000000001,"15min":0.36599999999999999},"max":{"1min":2.04,"5min":8.6590000000000007,"15min":8.6590000000000007},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.1519999999999999,"15min":1.02},"min":{"1min":0.46300000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.613,"5min":6.5819999999999999,"15min":6.5819999999999999},"last":0.628}]},{"osd":5,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.167,"15min":1.0820000000000001},"min":{"1min":0.439,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":3.1600000000000001,"5min":6.6079999999999997,"15min":9.1270000000000007},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.341,"15min":1.1339999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.435},"max":{"1min":3.3220000000000001,"5min":9.0079999999999991,"15min":9.3379999999999992},"last":1.101}]},{"osd":7,"last update":"Thu Mar 30 19:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.194,"15min":1.1299999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.49099999999999999},"max":{"1min":2.6720000000000002,"5min":6.6109999999999998,"15min":6.6109999999999998},"last":1.25},{"interface":"front","average":{"1min":2.4489999999999998,"5min":1.5209999999999999,"15min":1.204},"min":{"1min":0.66300000000000003,"5min":0.55500000000000005,"15min":0.48599999999999999},"max":{"1min":22.887,"5min":22.887,"15min":22.887},"last":0.59499999999999997}]}]},{"osd":7,"up_from":14,"seq":60129550360,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2558872,"kb_used_data":2281104,"kb_used_omap":4609,"kb_used_meta":273150,"kb_avail":91812968,"statfs":{"total":96636764160,"available":94016479232,"internally_reserved":0,"allocated":2335850496,"data_stored":2335280120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4719691,"internal_metadata":279706549},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.94299999999999995,"15min":0.876},"min":{"1min":0.36199999999999999,"5min":0.34000000000000002,"15min":0.29399999999999998},"max":{"1min":1.349,"5min":6.3419999999999996,"15min":7.5529999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.92500000000000004,"15min":0.877},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.647,"5min":5.2569999999999997,"15min":5.819},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.97399999999999998,"15min":0.95799999999999996},"min":{"1min":0.50800000000000001,"5min":0.498,"15min":0.437},"max":{"1min":4.0590000000000002,"5min":5.1349999999999998,"15min":5.54},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.89900000000000002,"5min":1.0649999999999999,"15min":1.008},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.1470000000000002,"5min":6.3929999999999998,"15min":7.6550000000000002},"last":1.272}]},{"osd":2,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":1.208,"15min":1.0620000000000001},"min":{"1min":0.41599999999999998,"5min":0.40200000000000002,"15min":0.39400000000000002},"max":{"1min":6.782,"5min":6.782,"15min":6.782},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.087,"15min":1.012},"min":{"1min":0.52900000000000003,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":7.3300000000000001,"5min":7.3300000000000001,"15min":7.3300000000000001},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.1719999999999999,"15min":1.4950000000000001},"min":{"1min":0.495,"5min":0.44600000000000001,"15min":0.43099999999999999},"max":{"1min":5.04,"5min":6.3849999999999998,"15min":111.13800000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.111,"15min":1.472},"min":{"1min":0.66600000000000004,"5min":0.495,"15min":0.45700000000000002},"max":{"1min":3.7509999999999999,"5min":5.3259999999999996,"15min":109.63800000000001},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.246,"15min":1.1759999999999999},"min":{"1min":0.46300000000000002,"5min":0.45800000000000002,"15min":0.34799999999999998},"max":{"1min":5.141,"5min":8.7940000000000005,"15min":9.3409999999999993},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.627,"5min":1.27,"15min":1.1759999999999999},"min":{"1min":0.53900000000000003,"5min":0.434,"15min":0.36399999999999999},"max":{"1min":7.3090000000000002,"5min":7.3090000000000002,"15min":7.3090000000000002},"last":1.927}]},{"osd":5,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.6739999999999999,"5min":1.3080000000000001,"15min":1.1739999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.41299999999999998},"max":{"1min":7.2599999999999998,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":1.968},{"interface":"front","average":{"1min":1.319,"5min":1.327,"15min":1.2330000000000001},"min":{"1min":0.503,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":5.2939999999999996,"5min":8.532,"15min":8.532},"last":1.3540000000000001}]},{"osd":6,"last update":"Thu Mar 30 19:35:00 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.3779999999999999,"15min":1.2569999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":5.8040000000000003,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.9970000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.117,"15min":1.077},"min":{"1min":0.67700000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.82399999999999995}]}]},{"osd":5,"up_from":14,"seq":60129550358,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3196484,"kb_used_data":2117628,"kb_used_omap":1498,"kb_used_meta":1077349,"kb_avail":91175356,"statfs":{"total":96636764160,"available":93363564544,"internally_reserved":0,"allocated":2168451072,"data_stored":2167909286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1534458,"internal_metadata":1103205894},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":1.1779999999999999,"15min":0.96499999999999997},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.956,"5min":12.332000000000001,"15min":12.332000000000001},"last":1.288},{"interface":"front","average":{"1min":1.407,"5min":1.1519999999999999,"15min":0.96299999999999997},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":8.4359999999999999,"5min":12.897,"15min":12.897},"last":0.90800000000000003}]},{"osd":1,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":3.4329999999999998,"5min":1.46,"15min":1.1679999999999999},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.373},"max":{"1min":30.469000000000001,"5min":30.469000000000001,"15min":30.469000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.623,"5min":1.2789999999999999,"15min":1.044},"min":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.40899999999999997},"max":{"1min":14.49,"5min":14.49,"15min":14.49},"last":1.0860000000000001}]},{"osd":2,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":1.3799999999999999,"15min":1.204},"min":{"1min":0.45000000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":30.507999999999999,"5min":30.507999999999999,"15min":30.507999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.379,"5min":1.2669999999999999,"15min":1.1060000000000001},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":8.4849999999999994,"5min":12.944000000000001,"15min":12.944000000000001},"last":1.228}]},{"osd":3,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.3640000000000001,"15min":1.145},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":8.5139999999999993,"5min":13.007,"15min":13.007},"last":1.4350000000000001},{"interface":"front","average":{"1min":2.6459999999999999,"5min":1.512,"15min":1.282},"min":{"1min":0.55500000000000005,"5min":0.503,"15min":0.46300000000000002},"max":{"1min":30.402999999999999,"5min":30.402999999999999,"15min":30.402999999999999},"last":1.167}]},{"osd":4,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":2.9380000000000002,"5min":1.5169999999999999,"15min":1.2410000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.38800000000000001},"max":{"1min":30.547999999999998,"5min":30.547999999999998,"15min":30.547999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.3069999999999999,"15min":1.153},"min":{"1min":0.46400000000000002,"5min":0.441,"15min":0.438},"max":{"1min":3.1739999999999999,"5min":7.3079999999999998,"15min":9.2870000000000008},"last":1.506}]},{"osd":6,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":1.6599999999999999,"15min":1.284},"min":{"1min":0.51200000000000001,"5min":0.501,"15min":0.501},"max":{"1min":33.402000000000001,"5min":33.402000000000001,"15min":33.402000000000001},"last":1.351},{"interface":"front","average":{"1min":3.4630000000000001,"5min":1.8069999999999999,"15min":1.327},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":33.673999999999999,"5min":33.673999999999999,"15min":33.673999999999999},"last":1.373}]},{"osd":7,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.5529999999999999,"15min":1.3089999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.496},"max":{"1min":8.5419999999999998,"5min":12.976000000000001,"15min":12.976000000000001},"last":1.4810000000000001},{"interface":"front","average":{"1min":2.681,"5min":1.621,"15min":1.343},"min":{"1min":0.59899999999999998,"5min":0.504,"15min":0.47799999999999998},"max":{"1min":24.754000000000001,"5min":24.754000000000001,"15min":24.754000000000001},"last":1.024}]}]},{"osd":4,"up_from":14,"seq":60129550352,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3307484,"kb_used_data":2192084,"kb_used_omap":3500,"kb_used_meta":1111891,"kb_avail":91064356,"statfs":{"total":96636764160,"available":93249900544,"internally_reserved":0,"allocated":2244694016,"data_stored":2244109560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3584019,"internal_metadata":1138577389},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":1.0740000000000001,"15min":0.96699999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.313},"max":{"1min":1.3720000000000001,"5min":5.8579999999999997,"15min":5.8579999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.0069999999999999,"15min":0.995},"min":{"1min":0.39800000000000002,"5min":0.36499999999999999,"15min":0.34300000000000003},"max":{"1min":6.4989999999999997,"5min":6.4989999999999997,"15min":7.2930000000000001},"last":1.0389999999999999}]},{"osd":1,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.96399999999999997,"15min":0.94699999999999995},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":5.141,"5min":5.141,"15min":5.141},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.3149999999999999,"15min":1.133},"min":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.376},"max":{"1min":2.6389999999999998,"5min":5.7889999999999997,"15min":8.8740000000000006},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":1.2190000000000001,"15min":1.113},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":1.728,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":0.879},{"interface":"front","average":{"1min":1.28,"5min":1.159,"15min":1.117},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.41899999999999998},"max":{"1min":6.4009999999999998,"5min":7.1639999999999997,"15min":7.3869999999999996},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":2.5499999999999998,"15min":1.5700000000000001},"min":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.434},"max":{"1min":2.214,"5min":116.221,"15min":116.221},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.3160000000000001,"5min":2.4460000000000002,"15min":1.5649999999999999},"min":{"1min":0.56899999999999995,"5min":0.436,"15min":0.436},"max":{"1min":6.5339999999999998,"5min":116.306,"15min":116.306},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":4.484,"5min":1.6040000000000001,"15min":1.1879999999999999},"min":{"1min":0.45600000000000002,"5min":0.42299999999999999,"15min":0.39400000000000002},"max":{"1min":69.498000000000005,"5min":69.498000000000005,"15min":69.498000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.278,"15min":1.179},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.42299999999999999},"max":{"1min":2.0470000000000002,"5min":6.024,"15min":10.057},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.109,"15min":1.1799999999999999},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.42399999999999999},"max":{"1min":1.6719999999999999,"5min":6.1879999999999997,"15min":15.928000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.3400000000000001,"15min":1.2929999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46000000000000002},"max":{"1min":1.583,"5min":5.9260000000000002,"15min":15.566000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.238,"15min":1.204},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.4589999999999996,"5min":6.4589999999999996,"15min":7.3460000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.032,"5min":1.093,"15min":1.1679999999999999},"min":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.47599999999999998},"max":{"1min":1.9059999999999999,"5min":6.7160000000000002,"15min":6.7160000000000002},"last":0.60599999999999998}]}]},{"osd":3,"up_from":14,"seq":60129550328,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3977400,"kb_used_data":2888752,"kb_used_omap":7240,"kb_used_meta":1081399,"kb_avail":90394440,"statfs":{"total":96636764160,"available":92563906560,"internally_reserved":0,"allocated":2958082048,"data_stored":2957452620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7414054,"internal_metadata":1107353306},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.73999999999999999,"15min":0.77500000000000002},"min":{"1min":0.38100000000000001,"5min":0.27500000000000002,"15min":0.25900000000000001},"max":{"1min":2.976,"5min":2.976,"15min":8.0690000000000008},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.244,"5min":0.878,"15min":0.93500000000000005},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.27800000000000002},"max":{"1min":4.5380000000000003,"5min":4.5380000000000003,"15min":6.7160000000000002},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.88300000000000001,"15min":0.95499999999999996},"min":{"1min":0.434,"5min":0.31,"15min":0.31},"max":{"1min":5.7549999999999999,"5min":5.7549999999999999,"15min":8.7319999999999993},"last":1.5049999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.86899999999999999,"15min":0.88800000000000001},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.315},"max":{"1min":2.9710000000000001,"5min":3.109,"15min":4.1879999999999997},"last":0.623}]},{"osd":2,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.2829999999999999,"15min":1.1060000000000001},"min":{"1min":0.56299999999999994,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6459999999999999,"5min":25.440999999999999,"15min":25.440999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.2,"15min":1.179},"min":{"1min":0.56899999999999995,"5min":0.41699999999999998,"15min":0.41599999999999998},"max":{"1min":2.641,"5min":25.34,"15min":25.34},"last":1.546}]},{"osd":4,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.1779999999999999,"15min":1.05},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.42799999999999999},"max":{"1min":8.4390000000000001,"5min":8.4390000000000001,"15min":8.4390000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.383,"5min":1.0900000000000001,"15min":1.0249999999999999},"min":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.45700000000000002},"max":{"1min":4.4119999999999999,"5min":4.6699999999999999,"15min":4.71},"last":0.82999999999999996}]},{"osd":5,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":2.3839999999999999,"5min":1.4850000000000001,"15min":1.331},"min":{"1min":0.55500000000000005,"5min":0.51200000000000001,"15min":0.46999999999999997},"max":{"1min":23.702999999999999,"5min":23.702999999999999,"15min":23.702999999999999},"last":1.615},{"interface":"front","average":{"1min":2.0680000000000001,"5min":1.4159999999999999,"15min":1.2230000000000001},"min":{"1min":0.67900000000000005,"5min":0.56599999999999995,"15min":0.495},"max":{"1min":13.728999999999999,"5min":13.728999999999999,"15min":18.079999999999998},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.292,"15min":1.3240000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":4.6130000000000004,"5min":4.6349999999999998,"15min":57.677999999999997},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.294,"15min":1.361},"min":{"1min":0.66900000000000004,"5min":0.51700000000000002,"15min":0.50800000000000001},"max":{"1min":4.4980000000000002,"5min":5.4269999999999996,"15min":57.828000000000003},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":2.399,"5min":1.4770000000000001,"15min":1.276},"min":{"1min":0.60599999999999998,"5min":0.56200000000000006,"15min":0.52600000000000002},"max":{"1min":5.4649999999999999,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.575,"5min":1.258,"15min":1.2330000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":5.681,"5min":5.681,"15min":7.0529999999999999},"last":1.645}]}]},{"osd":2,"up_from":14,"seq":60129550340,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3376340,"kb_used_data":2418188,"kb_used_omap":2179,"kb_used_meta":955964,"kb_avail":90995500,"statfs":{"total":96636764160,"available":93179392000,"internally_reserved":0,"allocated":2476224512,"data_stored":2475655731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2231691,"internal_metadata":978907765},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.80800000000000005,"15min":1.258},"min":{"1min":0.28399999999999997,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":2.3239999999999998,"5min":4.0259999999999998,"15min":97.593999999999994},"last":2.3519999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88900000000000001,"15min":1.3280000000000001},"min":{"1min":0.38800000000000001,"5min":0.29899999999999999,"15min":0.27500000000000002},"max":{"1min":2.2250000000000001,"5min":5.1900000000000004,"15min":97.484999999999999},"last":0.751}]},{"osd":1,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84399999999999997,"15min":1.367},"min":{"1min":0.45900000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.6339999999999999,"5min":5.9059999999999997,"15min":139.036},"last":0.35699999999999998},{"interface":"front","average":{"1min":1.1859999999999999,"5min":0.96799999999999997,"15min":1.4359999999999999},"min":{"1min":0.436,"5min":0.34200000000000003,"15min":0.33500000000000002},"max":{"1min":4.673,"5min":4.673,"15min":139.107},"last":0.629}]},{"osd":3,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.93899999999999995,"15min":1.8089999999999999},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":1.8200000000000001,"5min":3.9420000000000002,"15min":142.262},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0249999999999999,"15min":1.8440000000000001},"min":{"1min":0.41899999999999998,"5min":0.40799999999999997,"15min":0.36399999999999999},"max":{"1min":2.585,"5min":5.8280000000000003,"15min":141.92599999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.1899999999999999,"15min":1.1539999999999999},"min":{"1min":0.53000000000000003,"5min":0.42899999999999999,"15min":0.39200000000000002},"max":{"1min":3.8809999999999998,"5min":7.6879999999999997,"15min":10.942},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.224,"15min":1.208},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.47699999999999998},"max":{"1min":2.653,"5min":7.6719999999999997,"15min":9.5009999999999994},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.077,"15min":1.1699999999999999},"min":{"1min":0.59899999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.7400000000000002,"5min":5.9429999999999996,"15min":24.672000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2450000000000001,"15min":1.244},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.44900000000000001},"max":{"1min":3.9239999999999999,"5min":5.6870000000000003,"15min":13.996},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2849999999999999,"15min":1.3069999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.49199999999999999},"max":{"1min":3.96,"5min":3.9769999999999999,"15min":15.323},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.2190000000000001,"15min":1.216},"min":{"1min":0.68899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":2.6669999999999998,"5min":5.9809999999999999,"15min":18.489000000000001},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Mar 30 19:34:51 2023","interfaces":[{"interface":"back","average":{"1min":1.982,"5min":1.5529999999999999,"15min":1.3839999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.44900000000000001},"max":{"1min":20.303999999999998,"5min":20.303999999999998,"15min":20.303999999999998},"last":0.873},{"interface":"front","average":{"1min":2.2629999999999999,"5min":1.496,"15min":1.4470000000000001},"min":{"1min":0.627,"5min":0.56799999999999995,"15min":0.56100000000000005},"max":{"1min":21.478999999999999,"5min":21.478999999999999,"15min":24.937000000000001},"last":0.60099999999999998}]}]},{"osd":1,"up_from":14,"seq":60129550348,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3793068,"kb_used_data":2789732,"kb_used_omap":4451,"kb_used_meta":998876,"kb_avail":90578772,"statfs":{"total":96636764160,"available":92752662528,"internally_reserved":0,"allocated":2856685568,"data_stored":2856153816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558838,"internal_metadata":1022849034},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":0.97399999999999998,"15min":1.0469999999999999},"min":{"1min":0.33800000000000002,"5min":0.26800000000000002,"15min":0.252},"max":{"1min":12.628,"5min":12.628,"15min":25.765000000000001},"last":1.9990000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.93000000000000005,"15min":1.075},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28000000000000003},"max":{"1min":7.4470000000000001,"5min":7.4470000000000001,"15min":25.527999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.8879999999999999,"5min":1.0509999999999999,"15min":1.0740000000000001},"min":{"1min":0.36699999999999999,"5min":0.313,"15min":0.313},"max":{"1min":15.252000000000001,"5min":15.252000000000001,"15min":15.252000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":2.177,"5min":1.117,"15min":1.0740000000000001},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.34499999999999997},"max":{"1min":15.206,"5min":15.206,"15min":15.206},"last":1.9370000000000001}]},{"osd":3,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.0029999999999999,"15min":1.1100000000000001},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":8.1920000000000002,"5min":8.1920000000000002,"15min":18.219000000000001},"last":2.4409999999999998},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.044,"15min":1.1739999999999999},"min":{"1min":0.438,"5min":0.378,"15min":0.36599999999999999},"max":{"1min":7.7439999999999998,"5min":7.7439999999999998,"15min":25.456},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Mar 30 19:35:38 2023","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":1.0920000000000001,"15min":1.135},"min":{"1min":0.50600000000000001,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":6.0220000000000002,"5min":6.0220000000000002,"15min":13.728},"last":2.0369999999999999},{"interface":"front","average":{"1min":1.466,"5min":1.105,"15min":1.1140000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":8.2230000000000008,"5min":8.2230000000000008,"15min":10.217000000000001},"last":2.1429999999999998}]},{"osd":5,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.746,"5min":1.242,"15min":1.423},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":7.6749999999999998,"5min":7.6749999999999998,"15min":81.075999999999993},"last":1.212},{"interface":"front","average":{"1min":1.8340000000000001,"5min":1.2889999999999999,"15min":1.5109999999999999},"min":{"1min":0.54200000000000004,"5min":0.48899999999999999,"15min":0.44800000000000001},"max":{"1min":6.093,"5min":6.093,"15min":81.012},"last":1.962}]},{"osd":6,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":2.8410000000000002,"5min":1.5049999999999999,"15min":1.284},"min":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.51400000000000001},"max":{"1min":26.280999999999999,"5min":26.280999999999999,"15min":26.280999999999999},"last":1.5009999999999999},{"interface":"front","average":{"1min":2.661,"5min":1.5309999999999999,"15min":1.3480000000000001},"min":{"1min":0.57099999999999995,"5min":0.52300000000000002,"15min":0.47999999999999998},"max":{"1min":26.742999999999999,"5min":26.742999999999999,"15min":26.742999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.361,"15min":1.26},"min":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.53000000000000003},"max":{"1min":7.7119999999999997,"5min":7.7119999999999997,"15min":8.9290000000000003},"last":1.552},{"interface":"front","average":{"1min":2.2509999999999999,"5min":1.4970000000000001,"15min":1.365},"min":{"1min":0.64100000000000001,"5min":0.54700000000000004,"15min":0.50900000000000001},"max":{"1min":16.645,"5min":16.645,"15min":16.645},"last":0.90500000000000003}]}]},{"osd":0,"up_from":14,"seq":60129550317,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4292440,"kb_used_data":3577232,"kb_used_omap":3147,"kb_used_meta":712052,"kb_avail":90079400,"statfs":{"total":96636764160,"available":92241305600,"internally_reserved":0,"allocated":3663085568,"data_stored":3662418913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3223258,"internal_metadata":729141542},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":0.91900000000000004,"15min":0.86599999999999999},"min":{"1min":0.32500000000000001,"5min":0.29899999999999999,"15min":0.23400000000000001},"max":{"1min":10.074,"5min":10.074,"15min":12.294},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.177,"5min":0.95199999999999996,"15min":0.97099999999999997},"min":{"1min":0.442,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":10.473000000000001,"5min":10.473000000000001,"15min":10.473000000000001},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":3.3029999999999999,"5min":1.3959999999999999,"15min":1.117},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":46.451999999999998,"5min":46.451999999999998,"15min":46.451999999999998},"last":1.081},{"interface":"front","average":{"1min":2.3530000000000002,"5min":1.159,"15min":1.056},"min":{"1min":0.44600000000000001,"5min":0.34799999999999998,"15min":0.32200000000000001},"max":{"1min":33.904000000000003,"5min":33.904000000000003,"15min":33.904000000000003},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":3.5760000000000001,"5min":1.4910000000000001,"15min":1.2110000000000001},"min":{"1min":0.41899999999999998,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":50.244999999999997,"5min":50.244999999999997,"15min":50.244999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0940000000000001,"5min":0.95999999999999996,"15min":0.96799999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.6280000000000001,"5min":4.5270000000000001,"15min":12.481999999999999},"last":1.1359999999999999}]},{"osd":4,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.2290000000000001,"15min":1.397},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.46100000000000002},"max":{"1min":10.550000000000001,"5min":10.550000000000001,"15min":77.847999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":3.8540000000000001,"5min":1.76,"15min":1.573},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":61.817,"5min":61.817,"15min":77.653999999999996},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":3.613,"5min":1.855,"15min":1.3700000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":55.627000000000002,"5min":55.627000000000002,"15min":55.627000000000002},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.0700000000000001,"15min":1.032},"min":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.44800000000000001},"max":{"1min":3.71,"5min":4.4880000000000004,"15min":12.173999999999999},"last":1.1759999999999999}]},{"osd":6,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":4.7460000000000004,"5min":1.98,"15min":2.581},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":52.380000000000003,"5min":52.380000000000003,"15min":211.46600000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":2.0489999999999999,"5min":1.5680000000000001,"15min":2.3759999999999999},"min":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.50600000000000001},"max":{"1min":20.934999999999999,"5min":20.934999999999999,"15min":210.86699999999999},"last":1.026}]},{"osd":7,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.401,"15min":1.3100000000000001},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":10.84,"5min":10.84,"15min":10.84},"last":0.85299999999999998},{"interface":"front","average":{"1min":3.73,"5min":1.8320000000000001,"15min":1.4770000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":50.421999999999997,"5min":50.421999999999997,"15min":50.421999999999997},"last":1.0549999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-30T19:35:51.226 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-30T19:35:51.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.341+0000 7f9d214dc700 1 Processor -- start 2023-03-30T19:35:51.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.341+0000 7f9d214dc700 1 -- start start 2023-03-30T19:35:51.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d214dc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9d1c0b8380 0x7f9d1c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:51.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d214dc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d1c0d27e0 0x7f9d1c069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:51.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d214dc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9d1c1609f0 0x7f9d1c06a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:51.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d214dc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1c160ef0 con 0x7f9d1c0b8380 2023-03-30T19:35:51.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d214dc700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1c0cd6a0 con 0x7f9d1c1609f0 2023-03-30T19:35:51.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d214dc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0cd3a0 con 0x7f9d1c0d27e0 2023-03-30T19:35:51.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d1bfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9d1c0b8380 0x7f9d1c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:51.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d1bfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9d1c0b8380 0x7f9d1c0d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34152/0 (socket says 172.21.15.87:34152) 2023-03-30T19:35:51.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d1bfff700 1 -- 172.21.15.87:0/2290686258 learned_addr learned my addr 172.21.15.87:0/2290686258 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:51.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d20cdb700 1 --2- 172.21.15.87:0/2290686258 >> v2:172.21.15.115:3300/0 conn(0x7f9d1c1609f0 0x7f9d1c06a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:51.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d1b7fe700 1 --2- 172.21.15.87:0/2290686258 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d1c0d27e0 0x7f9d1c069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:51.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d1bfff700 1 -- 172.21.15.87:0/2290686258 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d1c0d27e0 msgr2=0x7f9d1c069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:51.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d1bfff700 1 --2- 172.21.15.87:0/2290686258 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d1c0d27e0 0x7f9d1c069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d1bfff700 1 -- 172.21.15.87:0/2290686258 >> v2:172.21.15.115:3300/0 conn(0x7f9d1c1609f0 msgr2=0x7f9d1c06a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:51.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d1bfff700 1 --2- 172.21.15.87:0/2290686258 >> v2:172.21.15.115:3300/0 conn(0x7f9d1c1609f0 0x7f9d1c06a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d1bfff700 1 -- 172.21.15.87:0/2290686258 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c0cef00 con 0x7f9d1c0b8380 2023-03-30T19:35:51.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d1bfff700 1 --2- 172.21.15.87:0/2290686258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0b8380 0x7f9d1c0d2200 secure :-1 s=READY pgs=3334 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c08c0d0 tx=0x7f9d0c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f747b8d6ae5542ef server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:51.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d1affd700 1 -- 172.21.15.87:0/2290686258 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c011830 con 0x7f9d1c0b8380 2023-03-30T19:35:51.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d1affd700 1 -- 172.21.15.87:0/2290686258 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c011990 con 0x7f9d1c0b8380 2023-03-30T19:35:51.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d1affd700 1 -- 172.21.15.87:0/2290686258 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c011d20 con 0x7f9d1c0b8380 2023-03-30T19:35:51.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d214dc700 1 -- 172.21.15.87:0/2290686258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0b8380 msgr2=0x7f9d1c0d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:51.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d214dc700 1 --2- 172.21.15.87:0/2290686258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0b8380 0x7f9d1c0d2200 secure :-1 s=READY pgs=3334 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c08c0d0 tx=0x7f9d0c009bf0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d214dc700 1 -- 172.21.15.87:0/2290686258 shutdown_connections 2023-03-30T19:35:51.355 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d214dc700 1 --2- 172.21.15.87:0/2290686258 >> v2:172.21.15.115:3300/0 conn(0x7f9d1c1609f0 0x7f9d1c06a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d214dc700 1 --2- 172.21.15.87:0/2290686258 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d1c0d27e0 0x7f9d1c069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d214dc700 1 --2- 172.21.15.87:0/2290686258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0b8380 0x7f9d1c0d2200 unknown :-1 s=CLOSED pgs=3334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d214dc700 1 -- 172.21.15.87:0/2290686258 >> 172.21.15.87:0/2290686258 conn(0x7f9d1c0b53f0 msgr2=0x7f9d1c0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:51.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d214dc700 1 -- 172.21.15.87:0/2290686258 shutdown_connections 2023-03-30T19:35:51.356 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.345+0000 7f9d214dc700 1 -- 172.21.15.87:0/2290686258 wait complete. 2023-03-30T19:35:51.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d214dc700 1 Processor -- start 2023-03-30T19:35:51.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d214dc700 1 -- start start 2023-03-30T19:35:51.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d214dc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0b8380 0x7f9d1c15b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:51.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d214dc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d1c1609f0 0x7f9d1c15e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:51.357 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d214dc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d1c0ca740 0x7f9d1c06b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:51.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d214dc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0cad00 con 0x7f9d1c0b8380 2023-03-30T19:35:51.358 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d214dc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0cafe0 con 0x7f9d1c0ca740 2023-03-30T19:35:51.359 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d214dc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0cb2c0 con 0x7f9d1c1609f0 2023-03-30T19:35:51.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d1bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0b8380 0x7f9d1c15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:51.362 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d1bfff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0b8380 0x7f9d1c15b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34166/0 (socket says 172.21.15.87:34166) 2023-03-30T19:35:51.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d1bfff700 1 -- 172.21.15.87:0/1100830980 learned_addr learned my addr 172.21.15.87:0/1100830980 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:51.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d20cdb700 1 --2- 172.21.15.87:0/1100830980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d1c0ca740 0x7f9d1c06b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:51.363 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d1b7fe700 1 --2- 172.21.15.87:0/1100830980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d1c1609f0 0x7f9d1c15e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:51.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d1bfff700 1 -- 172.21.15.87:0/1100830980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d1c1609f0 msgr2=0x7f9d1c15e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:51.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d1bfff700 1 --2- 172.21.15.87:0/1100830980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d1c1609f0 0x7f9d1c15e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d1bfff700 1 -- 172.21.15.87:0/1100830980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d1c0ca740 msgr2=0x7f9d1c06b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:51.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d1bfff700 1 --2- 172.21.15.87:0/1100830980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d1c0ca740 0x7f9d1c06b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d1bfff700 1 -- 172.21.15.87:0/1100830980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c009570 con 0x7f9d1c0b8380 2023-03-30T19:35:51.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d20cdb700 1 --2- 172.21.15.87:0/1100830980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d1c0ca740 0x7f9d1c06b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T19:35:51.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d1bfff700 1 --2- 172.21.15.87:0/1100830980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0b8380 0x7f9d1c15b790 secure :-1 s=READY pgs=3335 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c08bd10 tx=0x7f9d0c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:51.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d18ff9700 1 -- 172.21.15.87:0/1100830980 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c004240 con 0x7f9d1c0b8380 2023-03-30T19:35:51.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d18ff9700 1 -- 172.21.15.87:0/1100830980 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c01f070 con 0x7f9d1c0b8380 2023-03-30T19:35:51.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d18ff9700 1 -- 172.21.15.87:0/1100830980 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c0045e0 con 0x7f9d1c0b8380 2023-03-30T19:35:51.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.349+0000 7f9d214dc700 1 -- 172.21.15.87:0/1100830980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1c0cf480 con 0x7f9d1c0b8380 2023-03-30T19:35:51.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.353+0000 7f9d214dc700 1 -- 172.21.15.87:0/1100830980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1c0cf1a0 con 0x7f9d1c0b8380 2023-03-30T19:35:51.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.353+0000 7f9d214dc700 1 -- 172.21.15.87:0/1100830980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1c0b8750 con 0x7f9d1c0b8380 2023-03-30T19:35:51.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.353+0000 7f9d18ff9700 1 -- 172.21.15.87:0/1100830980 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f9d0c021030 con 0x7f9d1c0b8380 2023-03-30T19:35:51.369 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.353+0000 7f9d18ff9700 1 --2- 172.21.15.87:0/1100830980 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9d080653f0 0x7f9d080678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:51.369 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.353+0000 7f9d18ff9700 1 -- 172.21.15.87:0/1100830980 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f9d0c083720 con 0x7f9d1c0b8380 2023-03-30T19:35:51.369 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.353+0000 7f9d1b7fe700 1 --2- 172.21.15.87:0/1100830980 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9d080653f0 0x7f9d080678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:51.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.357+0000 7f9d1b7fe700 1 --2- 172.21.15.87:0/1100830980 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9d080653f0 0x7f9d080678a0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c15c640 tx=0x7f9d10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:51.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.357+0000 7f9d18ff9700 1 -- 172.21.15.87:0/1100830980 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f9d0c0515b0 con 0x7f9d1c0b8380 2023-03-30T19:35:51.542 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.537+0000 7f9d214dc700 1 -- 172.21.15.87:0/1100830980 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d1c072cf0 con 0x7f9d1c0b8380 2023-03-30T19:35:51.572 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.565+0000 7f9d18ff9700 1 -- 172.21.15.87:0/1100830980 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+14505 (secure 0 0 0) 0x7f9d0c015090 con 0x7f9d1c0b8380 2023-03-30T19:35:51.573 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:35:51.573 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":48,"fsid":"936aee23-1888-4f7e-bc67-7a45e372f20a","created":"2023-03-30T08:10:32.188898+0000","modified":"2023-03-30T19:35:43.033373+0000","last_up_change":"2023-03-30T08:10:44.620691+0000","last_in_change":"2023-03-30T08:10:35.124293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-30T08:10:43.966262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-30T08:10:51.233222+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2fe6d6c-96ab-4206-a397-c72fefa24d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":33774},{"type":"v1","addr":"172.21.15.87:6801","nonce":33774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":33774},{"type":"v1","addr":"172.21.15.87:6803","nonce":33774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":33774},{"type":"v1","addr":"172.21.15.87:6807","nonce":33774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":33774},{"type":"v1","addr":"172.21.15.87:6805","nonce":33774}]},"public_addr":"172.21.15.87:6801/33774","cluster_addr":"172.21.15.87:6803/33774","heartbeat_back_addr":"172.21.15.87:6807/33774","heartbeat_front_addr":"172.21.15.87:6805/33774","state":["exists","up"]},{"osd":1,"uuid":"dbdda5bb-e5db-4a9f-a7e6-05d15a90f745","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":33776},{"type":"v1","addr":"172.21.15.87:6825","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":33776},{"type":"v1","addr":"172.21.15.87:6827","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":33776},{"type":"v1","addr":"172.21.15.87:6831","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":33776},{"type":"v1","addr":"172.21.15.87:6829","nonce":33776}]},"public_addr":"172.21.15.87:6825/33776","cluster_addr":"172.21.15.87:6827/33776","heartbeat_back_addr":"172.21.15.87:6831/33776","heartbeat_front_addr":"172.21.15.87:6829/33776","state":["exists","up"]},{"osd":2,"uuid":"c6166fcf-17fa-4fc7-92a8-bdc9f4bf14f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":33775},{"type":"v1","addr":"172.21.15.87:6810","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":33775},{"type":"v1","addr":"172.21.15.87:6814","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":33775},{"type":"v1","addr":"172.21.15.87:6822","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6817","nonce":33775},{"type":"v1","addr":"172.21.15.87:6819","nonce":33775}]},"public_addr":"172.21.15.87:6810/33775","cluster_addr":"172.21.15.87:6814/33775","heartbeat_back_addr":"172.21.15.87:6822/33775","heartbeat_front_addr":"172.21.15.87:6819/33775","state":["exists","up"]},{"osd":3,"uuid":"63d8c669-4920-4af1-a5a3-d770d0127a1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6809","nonce":33777},{"type":"v1","addr":"172.21.15.87:6811","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6813","nonce":33777},{"type":"v1","addr":"172.21.15.87:6815","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6821","nonce":33777},{"type":"v1","addr":"172.21.15.87:6823","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":33777},{"type":"v1","addr":"172.21.15.87:6818","nonce":33777}]},"public_addr":"172.21.15.87:6811/33777","cluster_addr":"172.21.15.87:6815/33777","heartbeat_back_addr":"172.21.15.87:6823/33777","heartbeat_front_addr":"172.21.15.87:6818/33777","state":["exists","up"]},{"osd":4,"uuid":"03113f49-ad8c-4918-8126-7aa02cc000c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":33985},{"type":"v1","addr":"172.21.15.115:6801","nonce":33985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":33985},{"type":"v1","addr":"172.21.15.115:6803","nonce":33985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":33985},{"type":"v1","addr":"172.21.15.115:6807","nonce":33985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":33985},{"type":"v1","addr":"172.21.15.115:6805","nonce":33985}]},"public_addr":"172.21.15.115:6801/33985","cluster_addr":"172.21.15.115:6803/33985","heartbeat_back_addr":"172.21.15.115:6807/33985","heartbeat_front_addr":"172.21.15.115:6805/33985","state":["exists","up"]},{"osd":5,"uuid":"bec65318-4382-41ca-9166-283b1a2eed45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":33989},{"type":"v1","addr":"172.21.15.115:6817","nonce":33989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":33989},{"type":"v1","addr":"172.21.15.115:6819","nonce":33989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":33989},{"type":"v1","addr":"172.21.15.115:6823","nonce":33989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":33989},{"type":"v1","addr":"172.21.15.115:6821","nonce":33989}]},"public_addr":"172.21.15.115:6817/33989","cluster_addr":"172.21.15.115:6819/33989","heartbeat_back_addr":"172.21.15.115:6823/33989","heartbeat_front_addr":"172.21.15.115:6821/33989","state":["exists","up"]},{"osd":6,"uuid":"15e69056-187e-42c4-9812-7afef76b243f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":33987},{"type":"v1","addr":"172.21.15.115:6825","nonce":33987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":33987},{"type":"v1","addr":"172.21.15.115:6827","nonce":33987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":33987},{"type":"v1","addr":"172.21.15.115:6831","nonce":33987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":33987},{"type":"v1","addr":"172.21.15.115:6829","nonce":33987}]},"public_addr":"172.21.15.115:6825/33987","cluster_addr":"172.21.15.115:6827/33987","heartbeat_back_addr":"172.21.15.115:6831/33987","heartbeat_front_addr":"172.21.15.115:6829/33987","state":["exists","up"]},{"osd":7,"uuid":"e0ab3933-1c98-42e1-862d-59633365c20e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":33986},{"type":"v1","addr":"172.21.15.115:6809","nonce":33986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":33986},{"type":"v1","addr":"172.21.15.115:6811","nonce":33986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":33986},{"type":"v1","addr":"172.21.15.115:6815","nonce":33986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":33986},{"type":"v1","addr":"172.21.15.115:6813","nonce":33986}]},"public_addr":"172.21.15.115:6809/33986","cluster_addr":"172.21.15.115:6811/33986","heartbeat_back_addr":"172.21.15.115:6815/33986","heartbeat_front_addr":"172.21.15.115:6813/33986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.793507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.810505+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.811499+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.812319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.012613+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.863535+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:41.101109+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-30T08:10:40.761228+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:6835/450554084":"2023-03-31T19:35:39.406918+0000","172.21.15.115:6834/450554084":"2023-03-31T19:35:39.406918+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-30T19:35:51.574 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.569+0000 7f9d214dc700 1 -- 172.21.15.87:0/1100830980 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9d080653f0 msgr2=0x7f9d080678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:51.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.569+0000 7f9d214dc700 1 --2- 172.21.15.87:0/1100830980 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9d080653f0 0x7f9d080678a0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c15c640 tx=0x7f9d10008040 comp rx=0 tx=0).stop 2023-03-30T19:35:51.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.569+0000 7f9d214dc700 1 -- 172.21.15.87:0/1100830980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0b8380 msgr2=0x7f9d1c15b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:51.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.569+0000 7f9d214dc700 1 --2- 172.21.15.87:0/1100830980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0b8380 0x7f9d1c15b790 secure :-1 s=READY pgs=3335 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c08bd10 tx=0x7f9d0c004770 comp rx=0 tx=0).stop 2023-03-30T19:35:51.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.569+0000 7f9d214dc700 1 -- 172.21.15.87:0/1100830980 shutdown_connections 2023-03-30T19:35:51.575 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.569+0000 7f9d214dc700 1 --2- 172.21.15.87:0/1100830980 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9d080653f0 0x7f9d080678a0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.569+0000 7f9d214dc700 1 --2- 172.21.15.87:0/1100830980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d1c0ca740 0x7f9d1c06b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.577 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.569+0000 7f9d214dc700 1 --2- 172.21.15.87:0/1100830980 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d1c1609f0 0x7f9d1c15e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.569+0000 7f9d214dc700 1 --2- 172.21.15.87:0/1100830980 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9d1c0b8380 0x7f9d1c15b790 unknown :-1 s=CLOSED pgs=3335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:51.578 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.569+0000 7f9d214dc700 1 -- 172.21.15.87:0/1100830980 >> 172.21.15.87:0/1100830980 conn(0x7f9d1c0b53f0 msgr2=0x7f9d1c0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:51.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.569+0000 7f9d214dc700 1 -- 172.21.15.87:0/1100830980 shutdown_connections 2023-03-30T19:35:51.579 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:51.569+0000 7f9d214dc700 1 -- 172.21.15.87:0/1100830980 wait complete. 2023-03-30T19:35:52.595 INFO:tasks.ceph:Scrubbing osd.0 2023-03-30T19:35:52.596 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-03-30T19:35:52.733 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.729+0000 7fb006c6f700 1 Processor -- start 2023-03-30T19:35:52.734 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.729+0000 7fb006c6f700 1 -- start start 2023-03-30T19:35:52.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.729+0000 7fb006c6f700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb000164190 0x7fb0000c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:52.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.729+0000 7fb006c6f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb000069f00 con 0x7fb0000aea30 2023-03-30T19:35:52.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb006c6f700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00006cf70 con 0x7fb000163dc0 2023-03-30T19:35:52.736 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb006c6f700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00006d810 con 0x7fb000164190 2023-03-30T19:35:52.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb00546c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb000164190 0x7fb0000c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:52.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb00546c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb000164190 0x7fb0000c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34178/0 (socket says 172.21.15.87:34178) 2023-03-30T19:35:52.737 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb00546c700 1 -- 172.21.15.87:0/498438525 learned_addr learned my addr 172.21.15.87:0/498438525 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:52.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb00546c700 1 -- 172.21.15.87:0/498438525 >> v1:172.21.15.115:6789/0 conn(0x7fb000163dc0 legacy=0x7fb0000c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:52.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb00546c700 1 -- 172.21.15.87:0/498438525 >> v1:172.21.15.87:6789/0 conn(0x7fb0000aea30 legacy=0x7fb00006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:35:52.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb00546c700 1 -- 172.21.15.87:0/498438525 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00006d250 con 0x7fb000164190 2023-03-30T19:35:52.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb00546c700 1 --2- 172.21.15.87:0/498438525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb000164190 0x7fb0000c9cd0 secure :-1 s=READY pgs=3336 cs=0 l=1 rev1=1 crypto rx=0x7faff0009910 tx=0x7faff0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e007b5beb441d05 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:52.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb004c6b700 1 -- 172.21.15.87:0/498438525 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0004230 con 0x7fb000164190 2023-03-30T19:35:52.739 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb004c6b700 1 -- 172.21.15.87:0/498438525 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff0004390 con 0x7fb000164190 2023-03-30T19:35:52.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb004c6b700 1 -- 172.21.15.87:0/498438525 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0009e60 con 0x7fb000164190 2023-03-30T19:35:52.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb006c6f700 1 -- 172.21.15.87:0/498438525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb000164190 msgr2=0x7fb0000c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:52.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb006c6f700 1 --2- 172.21.15.87:0/498438525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb000164190 0x7fb0000c9cd0 secure :-1 s=READY pgs=3336 cs=0 l=1 rev1=1 crypto rx=0x7faff0009910 tx=0x7faff0009c20 comp rx=0 tx=0).stop 2023-03-30T19:35:52.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb006c6f700 1 -- 172.21.15.87:0/498438525 shutdown_connections 2023-03-30T19:35:52.740 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb006c6f700 1 --2- 172.21.15.87:0/498438525 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb000164190 0x7fb0000c9cd0 unknown :-1 s=CLOSED pgs=3336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:52.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb006c6f700 1 -- 172.21.15.87:0/498438525 >> 172.21.15.87:0/498438525 conn(0x7fb0000cf410 msgr2=0x7fb0000cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:35:52.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb006c6f700 1 -- 172.21.15.87:0/498438525 shutdown_connections 2023-03-30T19:35:52.741 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.733+0000 7fb006c6f700 1 -- 172.21.15.87:0/498438525 wait complete. 2023-03-30T19:35:52.743 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb006c6f700 1 Processor -- start 2023-03-30T19:35:52.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb006c6f700 1 -- start start 2023-03-30T19:35:52.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb006c6f700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0000aea30 0x7fb00015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:52.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb006c6f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb000163dc0 0x7fb0001f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:52.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb006c6f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb000164190 0x7fb0000c3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:52.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb006c6f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0000c2ea0 con 0x7fb000163dc0 2023-03-30T19:35:52.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb006c6f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0001f7340 con 0x7fb000164190 2023-03-30T19:35:52.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb006c6f700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0000c4860 con 0x7fb0000aea30 2023-03-30T19:35:52.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb00546c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb000163dc0 0x7fb0001f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:52.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb00546c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb000163dc0 0x7fb0001f6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34190/0 (socket says 172.21.15.87:34190) 2023-03-30T19:35:52.745 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb00546c700 1 -- 172.21.15.87:0/3219111315 learned_addr learned my addr 172.21.15.87:0/3219111315 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:35:52.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb00646e700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb000164190 0x7fb0000c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:52.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb005c6d700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0000aea30 0x7fb00015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:52.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb00546c700 1 -- 172.21.15.87:0/3219111315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0000aea30 msgr2=0x7fb00015cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:52.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb00546c700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0000aea30 0x7fb00015cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:52.746 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb00546c700 1 -- 172.21.15.87:0/3219111315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb000164190 msgr2=0x7fb0000c3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:35:52.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb00546c700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb000164190 0x7fb0000c3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:35:52.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb00546c700 1 -- 172.21.15.87:0/3219111315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff0009570 con 0x7fb000163dc0 2023-03-30T19:35:52.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb00646e700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb000164190 0x7fb0000c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T19:35:52.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb005c6d700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0000aea30 0x7fb00015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T19:35:52.747 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb00546c700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb000163dc0 0x7fb0001f6e00 secure :-1 s=READY pgs=3337 cs=0 l=1 rev1=1 crypto rx=0x7faff0008000 tx=0x7faff0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:52.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7faff67fc700 1 -- 172.21.15.87:0/3219111315 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff00038c0 con 0x7fb000163dc0 2023-03-30T19:35:52.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7faff67fc700 1 -- 172.21.15.87:0/3219111315 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff0003a20 con 0x7fb000163dc0 2023-03-30T19:35:52.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7faff67fc700 1 -- 172.21.15.87:0/3219111315 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0003dd0 con 0x7fb000163dc0 2023-03-30T19:35:52.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb006c6f700 1 -- 172.21.15.87:0/3219111315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00006cc40 con 0x7fb000163dc0 2023-03-30T19:35:52.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb006c6f700 1 -- 172.21.15.87:0/3219111315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00006d530 con 0x7fb000163dc0 2023-03-30T19:35:52.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7fb006c6f700 1 -- 172.21.15.87:0/3219111315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb0000ca210 con 0x7fb000163dc0 2023-03-30T19:35:52.749 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.737+0000 7faff67fc700 1 -- 172.21.15.87:0/3219111315 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7faff0024460 con 0x7fb000163dc0 2023-03-30T19:35:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.741+0000 7faff67fc700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fafe4065420 0x7fafe40678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.741+0000 7faff67fc700 1 -- 172.21.15.87:0/3219111315 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7faff0084090 con 0x7fb000163dc0 2023-03-30T19:35:52.751 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.741+0000 7faff67fc700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] conn(0x7fafe406bd30 0x7fafe406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:35:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.741+0000 7faff67fc700 1 -- 172.21.15.87:0/3219111315 --> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fafe406e830 con 0x7fafe406bd30 2023-03-30T19:35:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.741+0000 7faff67fc700 1 -- 172.21.15.87:0/3219111315 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7faff0086670 con 0x7fb000163dc0 2023-03-30T19:35:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.741+0000 7fb005c6d700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fafe4065420 0x7fafe40678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.741+0000 7fb00646e700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] conn(0x7fafe406bd30 0x7fafe406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:35:52.752 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.741+0000 7fb00646e700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] conn(0x7fafe406bd30 0x7fafe406e160 crc :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:52.753 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:52.741+0000 7fb005c6d700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fafe4065420 0x7fafe40678d0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fb0000c8c60 tx=0x7faffc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:35:57.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:57.741+0000 7faff6ffd700 1 -- 172.21.15.87:0/3219111315 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=49}) v3 -- 0x7fafe0003580 con 0x7fb000163dc0 2023-03-30T19:35:57.744 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:35:57.741+0000 7faff6ffd700 1 -- 172.21.15.87:0/3219111315 --> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] -- ping magic: 0 v1 -- 0x7fafe0003910 con 0x7fafe406bd30 2023-03-30T19:36:02.748 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:02.745+0000 7faff6ffd700 1 -- 172.21.15.87:0/3219111315 --> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] -- ping magic: 0 v1 -- 0x7fafe0003580 con 0x7fafe406bd30 2023-03-30T19:36:04.839 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:04.833+0000 7faff67fc700 1 -- 172.21.15.87:0/3219111315 <== osd.0 v2:172.21.15.87:6800/33774 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fafe406e830 con 0x7fafe406bd30 2023-03-30T19:36:04.852 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:04.849+0000 7fb006c6f700 1 -- 172.21.15.87:0/3219111315 --> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb0000733a0 con 0x7fafe406bd30 2023-03-30T19:36:05.067 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.061+0000 7faff67fc700 1 -- 172.21.15.87:0/3219111315 <== osd.0 v2:172.21.15.87:6800/33774 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb0000733a0 con 0x7fafe406bd30 2023-03-30T19:36:05.068 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-03-30T19:36:05.068 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-03-30T19:36:05.069 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-03-30T19:36:05.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.061+0000 7fb006c6f700 1 -- 172.21.15.87:0/3219111315 >> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] conn(0x7fafe406bd30 msgr2=0x7fafe406e160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:05.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.061+0000 7fb006c6f700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.87:6800/33774,v1:172.21.15.87:6801/33774] conn(0x7fafe406bd30 0x7fafe406e160 crc :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.065+0000 7fb006c6f700 1 -- 172.21.15.87:0/3219111315 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fafe4065420 msgr2=0x7fafe40678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:05.070 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.065+0000 7fb006c6f700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fafe4065420 0x7fafe40678d0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fb0000c8c60 tx=0x7faffc009040 comp rx=0 tx=0).stop 2023-03-30T19:36:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.065+0000 7fb006c6f700 1 -- 172.21.15.87:0/3219111315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb000163dc0 msgr2=0x7fb0001f6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.065+0000 7fb006c6f700 1 --2- 172.21.15.87:0/3219111315 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb000163dc0 0x7fb0001f6e00 secure :-1 s=READY pgs=3337 cs=0 l=1 rev1=1 crypto rx=0x7faff0008000 tx=0x7faff0004770 comp rx=0 tx=0).stop 2023-03-30T19:36:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.065+0000 7fb00646e700 1 -- 172.21.15.87:0/3219111315 reap_dead start 2023-03-30T19:36:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.065+0000 7fb006c6f700 1 -- 172.21.15.87:0/3219111315 shutdown_connections 2023-03-30T19:36:05.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.065+0000 7fb006c6f700 1 -- 172.21.15.87:0/3219111315 >> 172.21.15.87:0/3219111315 conn(0x7fb0000cf410 msgr2=0x7fb0000b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.065+0000 7fb006c6f700 1 -- 172.21.15.87:0/3219111315 shutdown_connections 2023-03-30T19:36:05.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.065+0000 7fb006c6f700 1 -- 172.21.15.87:0/3219111315 wait complete. 2023-03-30T19:36:05.084 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-03-30T19:36:05.208 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585f59e700 1 Processor -- start 2023-03-30T19:36:05.209 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585f59e700 1 -- start start 2023-03-30T19:36:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f586015c9b0 0x7f586006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585f59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f58600b61e0 0x7f586006b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585f59e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58600ceb70 con 0x7f586006c3d0 2023-03-30T19:36:05.210 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585f59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58600cee50 con 0x7f58600b61e0 2023-03-30T19:36:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585f59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58600b49d0 con 0x7f586015c9b0 2023-03-30T19:36:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585ed9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f58600b61e0 0x7f586006b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585ed9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f58600b61e0 0x7f586006b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55370/0 (socket says 172.21.15.87:55370) 2023-03-30T19:36:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585ed9d700 1 -- 172.21.15.87:0/207048660 learned_addr learned my addr 172.21.15.87:0/207048660 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:05.211 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585dd9b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f586006c3d0 0x7f58600b3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53480/0 (socket says 172.21.15.87:53480) 2023-03-30T19:36:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585e59c700 1 --2- 172.21.15.87:0/207048660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f586015c9b0 0x7f586006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585ed9d700 1 -- 172.21.15.87:0/207048660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f586015c9b0 msgr2=0x7f586006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585ed9d700 1 --2- 172.21.15.87:0/207048660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f586015c9b0 0x7f586006ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585ed9d700 1 -- 172.21.15.87:0/207048660 >> v1:172.21.15.87:6789/0 conn(0x7f586006c3d0 legacy=0x7f58600b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:05.213 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585ed9d700 1 -- 172.21.15.87:0/207048660 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58600b4cb0 con 0x7f58600b61e0 2023-03-30T19:36:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585d59a700 1 -- 172.21.15.87:0/207048660 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755095738 0 0) 0x7f58600ceb70 con 0x7f586006c3d0 2023-03-30T19:36:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585ed9d700 1 --2- 172.21.15.87:0/207048660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58600b61e0 0x7f586006b320 secure :-1 s=READY pgs=3339 cs=0 l=1 rev1=1 crypto rx=0x7f5858009e50 tx=0x7f585800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5026cd97866d4d1b server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585d59a700 1 -- 172.21.15.87:0/207048660 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585800e070 con 0x7f58600b61e0 2023-03-30T19:36:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585d59a700 1 -- 172.21.15.87:0/207048660 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585800b9c0 con 0x7f58600b61e0 2023-03-30T19:36:05.214 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.205+0000 7f585d59a700 1 -- 172.21.15.87:0/207048660 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585800bd70 con 0x7f58600b61e0 2023-03-30T19:36:05.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.209+0000 7f585f59e700 1 -- 172.21.15.87:0/207048660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58600b61e0 msgr2=0x7f586006b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:05.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.209+0000 7f585f59e700 1 --2- 172.21.15.87:0/207048660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58600b61e0 0x7f586006b320 secure :-1 s=READY pgs=3339 cs=0 l=1 rev1=1 crypto rx=0x7f5858009e50 tx=0x7f585800b330 comp rx=0 tx=0).stop 2023-03-30T19:36:05.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.209+0000 7f585f59e700 1 -- 172.21.15.87:0/207048660 shutdown_connections 2023-03-30T19:36:05.215 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.209+0000 7f585f59e700 1 --2- 172.21.15.87:0/207048660 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58600b61e0 0x7f586006b320 unknown :-1 s=CLOSED pgs=3339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.209+0000 7f585f59e700 1 --2- 172.21.15.87:0/207048660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f586015c9b0 0x7f586006ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.209+0000 7f585f59e700 1 -- 172.21.15.87:0/207048660 >> 172.21.15.87:0/207048660 conn(0x7f5860099dc0 msgr2=0x7f58600d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:05.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.209+0000 7f585f59e700 1 -- 172.21.15.87:0/207048660 shutdown_connections 2023-03-30T19:36:05.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.209+0000 7f585f59e700 1 -- 172.21.15.87:0/207048660 wait complete. 2023-03-30T19:36:05.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.209+0000 7f585f59e700 1 Processor -- start 2023-03-30T19:36:05.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.209+0000 7f585f59e700 1 -- start start 2023-03-30T19:36:05.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585f59e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f586006c3d0 0x7f58601e64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585f59e700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58600b61e0 0x7f586006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585f59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f586015c9b0 0x7f586014aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585f59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58601e4340 con 0x7f586015c9b0 2023-03-30T19:36:05.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585f59e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58601e4030 con 0x7f586006c3d0 2023-03-30T19:36:05.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585f59e700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58600c6a00 con 0x7f58600b61e0 2023-03-30T19:36:05.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585ed9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f586015c9b0 0x7f586014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585dd9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58600b61e0 0x7f586006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585ed9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f586015c9b0 0x7f586014aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55378/0 (socket says 172.21.15.87:55378) 2023-03-30T19:36:05.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585ed9d700 1 -- 172.21.15.87:0/1918339990 learned_addr learned my addr 172.21.15.87:0/1918339990 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:05.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585e59c700 1 --2- 172.21.15.87:0/1918339990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f586006c3d0 0x7f58601e64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585ed9d700 1 -- 172.21.15.87:0/1918339990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58600b61e0 msgr2=0x7f586006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:05.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585ed9d700 1 --2- 172.21.15.87:0/1918339990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58600b61e0 0x7f586006fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585ed9d700 1 -- 172.21.15.87:0/1918339990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f586006c3d0 msgr2=0x7f58601e64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:05.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585ed9d700 1 --2- 172.21.15.87:0/1918339990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f586006c3d0 0x7f58601e64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585ed9d700 1 -- 172.21.15.87:0/1918339990 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5858009b30 con 0x7f586015c9b0 2023-03-30T19:36:05.221 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585ed9d700 1 --2- 172.21.15.87:0/1918339990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f586015c9b0 0x7f586014aa70 secure :-1 s=READY pgs=3340 cs=0 l=1 rev1=1 crypto rx=0x7f585800b730 tx=0x7f5858004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:05.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f584effd700 1 -- 172.21.15.87:0/1918339990 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58580099b0 con 0x7f586015c9b0 2023-03-30T19:36:05.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f584effd700 1 -- 172.21.15.87:0/1918339990 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58580092e0 con 0x7f586015c9b0 2023-03-30T19:36:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f584effd700 1 -- 172.21.15.87:0/1918339990 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585801c640 con 0x7f586015c9b0 2023-03-30T19:36:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585f59e700 1 -- 172.21.15.87:0/1918339990 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58600cf130 con 0x7f586015c9b0 2023-03-30T19:36:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.213+0000 7f585f59e700 1 -- 172.21.15.87:0/1918339990 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586009a2c0 con 0x7f586015c9b0 2023-03-30T19:36:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.217+0000 7f585f59e700 1 -- 172.21.15.87:0/1918339990 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586006c920 con 0x7f586015c9b0 2023-03-30T19:36:05.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.217+0000 7f584effd700 1 -- 172.21.15.87:0/1918339990 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f585801c7a0 con 0x7f586015c9b0 2023-03-30T19:36:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.217+0000 7f584effd700 1 --2- 172.21.15.87:0/1918339990 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f58400653f0 0x7f58400678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.217+0000 7f584effd700 1 -- 172.21.15.87:0/1918339990 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f5858084370 con 0x7f586015c9b0 2023-03-30T19:36:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.217+0000 7f585e59c700 1 --2- 172.21.15.87:0/1918339990 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f58400653f0 0x7f58400678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.217+0000 7f585e59c700 1 --2- 172.21.15.87:0/1918339990 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f58400653f0 0x7f58400678a0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5850006fd0 tx=0x7f5850008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:05.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.221+0000 7f584effd700 1 -- 172.21.15.87:0/1918339990 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f5858052240 con 0x7f586015c9b0 2023-03-30T19:36:05.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.369+0000 7f585f59e700 1 -- 172.21.15.87:0/1918339990 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f5860072cf0 con 0x7f58400653f0 2023-03-30T19:36:05.446 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.441+0000 7f584effd700 1 -- 172.21.15.87:0/1918339990 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5860072cf0 con 0x7f58400653f0 2023-03-30T19:36:05.448 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.445+0000 7f585f59e700 1 -- 172.21.15.87:0/1918339990 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f58400653f0 msgr2=0x7f58400678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:05.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.445+0000 7f585f59e700 1 --2- 172.21.15.87:0/1918339990 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f58400653f0 0x7f58400678a0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5850006fd0 tx=0x7f5850008040 comp rx=0 tx=0).stop 2023-03-30T19:36:05.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.445+0000 7f585f59e700 1 -- 172.21.15.87:0/1918339990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f586015c9b0 msgr2=0x7f586014aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:05.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.445+0000 7f585f59e700 1 --2- 172.21.15.87:0/1918339990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f586015c9b0 0x7f586014aa70 secure :-1 s=READY pgs=3340 cs=0 l=1 rev1=1 crypto rx=0x7f585800b730 tx=0x7f5858004af0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.449 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.445+0000 7f585f59e700 1 -- 172.21.15.87:0/1918339990 shutdown_connections 2023-03-30T19:36:05.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.445+0000 7f585f59e700 1 --2- 172.21.15.87:0/1918339990 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f58400653f0 0x7f58400678a0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.445+0000 7f585f59e700 1 --2- 172.21.15.87:0/1918339990 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f586015c9b0 0x7f586014aa70 unknown :-1 s=CLOSED pgs=3340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.445+0000 7f585f59e700 1 --2- 172.21.15.87:0/1918339990 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58600b61e0 0x7f586006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.445+0000 7f585f59e700 1 --2- 172.21.15.87:0/1918339990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f586006c3d0 0x7f58601e64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.450 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.445+0000 7f585f59e700 1 -- 172.21.15.87:0/1918339990 >> 172.21.15.87:0/1918339990 conn(0x7f5860099dc0 msgr2=0x7f586006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:05.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.445+0000 7f585f59e700 1 -- 172.21.15.87:0/1918339990 shutdown_connections 2023-03-30T19:36:05.451 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.445+0000 7f585f59e700 1 -- 172.21.15.87:0/1918339990 wait complete. 2023-03-30T19:36:05.451 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 0 to deep-scrub 2023-03-30T19:36:05.466 INFO:tasks.ceph:Scrubbing osd.1 2023-03-30T19:36:05.467 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-03-30T19:36:05.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.601+0000 7f9b55fe4700 1 Processor -- start 2023-03-30T19:36:05.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.601+0000 7f9b55fe4700 1 -- start start 2023-03-30T19:36:05.607 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.601+0000 7f9b55fe4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9b500adc30 0x7f9b5015c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.601+0000 7f9b55fe4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b5006b1b0 0x7f9b50069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.601+0000 7f9b55fe4700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5006c790 con 0x7f9b5015c340 2023-03-30T19:36:05.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.601+0000 7f9b55fe4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b500ac790 con 0x7f9b500adc30 2023-03-30T19:36:05.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.601+0000 7f9b55fe4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b500c9ee0 con 0x7f9b5006b1b0 2023-03-30T19:36:05.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.601+0000 7f9b54fe2700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9b5015c340 0x7f9b500ac080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53490/0 (socket says 172.21.15.87:53490) 2023-03-30T19:36:05.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.601+0000 7f9b54fe2700 1 -- 172.21.15.87:0/2174538941 learned_addr learned my addr 172.21.15.87:0/2174538941 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:36:05.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b557e3700 1 --2- 172.21.15.87:0/2174538941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b5006b1b0 0x7f9b50069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 -- 172.21.15.87:0/2174538941 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780825005 0 0) 0x7f9b5006c790 con 0x7f9b5015c340 2023-03-30T19:36:05.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4ffff700 1 --2- 172.21.15.87:0/2174538941 >> v2:172.21.15.115:3300/0 conn(0x7f9b500adc30 0x7f9b5015c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 -- 172.21.15.87:0/2174538941 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b400035d0 con 0x7f9b5015c340 2023-03-30T19:36:05.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 -- 172.21.15.87:0/2174538941 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 430339856 0 0) 0x7f9b400035d0 con 0x7f9b5015c340 2023-03-30T19:36:05.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 -- 172.21.15.87:0/2174538941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b5006b1b0 msgr2=0x7f9b50069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:05.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 --2- 172.21.15.87:0/2174538941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b5006b1b0 0x7f9b50069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 -- 172.21.15.87:0/2174538941 >> v2:172.21.15.115:3300/0 conn(0x7f9b500adc30 msgr2=0x7f9b5015c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:05.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 --2- 172.21.15.87:0/2174538941 >> v2:172.21.15.115:3300/0 conn(0x7f9b500adc30 0x7f9b5015c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 -- 172.21.15.87:0/2174538941 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5006b630 con 0x7f9b5015c340 2023-03-30T19:36:05.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 -- 172.21.15.87:0/2174538941 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4166169620 0 0) 0x7f9b44001670 con 0x7f9b5015c340 2023-03-30T19:36:05.612 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 -- 172.21.15.87:0/2174538941 >> v1:172.21.15.87:6789/0 conn(0x7f9b5015c340 legacy=0x7f9b500ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 --2- 172.21.15.87:0/2174538941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b40003a20 0x7f9b40003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 --2- 172.21.15.87:0/2174538941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b5006b1b0 0x7f9b40004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 --2- 172.21.15.87:0/2174538941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b40004db0 0x7f9b40005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 -- 172.21.15.87:0/2174538941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b500ac790 con 0x7f9b40004db0 2023-03-30T19:36:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 -- 172.21.15.87:0/2174538941 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b500c9ee0 con 0x7f9b40003a20 2023-03-30T19:36:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4f7fe700 1 -- 172.21.15.87:0/2174538941 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4000bab0 con 0x7f9b5006b1b0 2023-03-30T19:36:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b557e3700 1 --2- 172.21.15.87:0/2174538941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b40004db0 0x7f9b40005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b54fe2700 1 --2- 172.21.15.87:0/2174538941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b40003a20 0x7f9b40003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b4ffff700 1 --2- 172.21.15.87:0/2174538941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b5006b1b0 0x7f9b40004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b557e3700 1 -- 172.21.15.87:0/2174538941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b5006b1b0 msgr2=0x7f9b40004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b557e3700 1 --2- 172.21.15.87:0/2174538941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b5006b1b0 0x7f9b40004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b557e3700 1 -- 172.21.15.87:0/2174538941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b40003a20 msgr2=0x7f9b40003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b557e3700 1 --2- 172.21.15.87:0/2174538941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b40003a20 0x7f9b40003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.605+0000 7f9b557e3700 1 -- 172.21.15.87:0/2174538941 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b400035d0 con 0x7f9b40004db0 2023-03-30T19:36:05.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.613+0000 7f9b557e3700 1 --2- 172.21.15.87:0/2174538941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b40004db0 0x7f9b40005220 secure :-1 s=READY pgs=3342 cs=0 l=1 rev1=1 crypto rx=0x7f9b48009fc0 tx=0x7f9b400058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2172d89970098cd5 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:05.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.613+0000 7f9b4f7fe700 1 -- 172.21.15.87:0/2174538941 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4800ec30 con 0x7f9b40004db0 2023-03-30T19:36:05.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.613+0000 7f9b4f7fe700 1 -- 172.21.15.87:0/2174538941 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4800f040 con 0x7f9b40004db0 2023-03-30T19:36:05.619 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.613+0000 7f9b4f7fe700 1 -- 172.21.15.87:0/2174538941 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48014480 con 0x7f9b40004db0 2023-03-30T19:36:05.620 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.613+0000 7f9b55fe4700 1 -- 172.21.15.87:0/2174538941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b40004db0 msgr2=0x7f9b40005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:05.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.613+0000 7f9b55fe4700 1 --2- 172.21.15.87:0/2174538941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b40004db0 0x7f9b40005220 secure :-1 s=READY pgs=3342 cs=0 l=1 rev1=1 crypto rx=0x7f9b48009fc0 tx=0x7f9b400058a0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.613+0000 7f9b557e3700 1 -- 172.21.15.87:0/2174538941 reap_dead start 2023-03-30T19:36:05.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b55fe4700 1 -- 172.21.15.87:0/2174538941 shutdown_connections 2023-03-30T19:36:05.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b55fe4700 1 -- 172.21.15.87:0/2174538941 >> 172.21.15.87:0/2174538941 conn(0x7f9b500cf410 msgr2=0x7f9b500cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:05.621 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b55fe4700 1 -- 172.21.15.87:0/2174538941 shutdown_connections 2023-03-30T19:36:05.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b55fe4700 1 -- 172.21.15.87:0/2174538941 wait complete. 2023-03-30T19:36:05.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b55fe4700 1 Processor -- start 2023-03-30T19:36:05.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b55fe4700 1 -- start start 2023-03-30T19:36:05.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b55fe4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b40004db0 0x7f9b50147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b55fe4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b500c2390 0x7f9b50159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.623 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b55fe4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b501599d0 0x7f9b50159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b55fe4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b500aeee0 con 0x7f9b501599d0 2023-03-30T19:36:05.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b55fe4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b500ae5f0 con 0x7f9b500c2390 2023-03-30T19:36:05.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b55fe4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b500c5460 con 0x7f9b40004db0 2023-03-30T19:36:05.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b557e3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b501599d0 0x7f9b50159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.624 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b557e3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b501599d0 0x7f9b50159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55404/0 (socket says 172.21.15.87:55404) 2023-03-30T19:36:05.625 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b557e3700 1 -- 172.21.15.87:0/971422675 learned_addr learned my addr 172.21.15.87:0/971422675 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:05.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b54fe2700 1 --2- 172.21.15.87:0/971422675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b40004db0 0x7f9b50147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b4ffff700 1 --2- 172.21.15.87:0/971422675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b500c2390 0x7f9b50159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b557e3700 1 -- 172.21.15.87:0/971422675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b40004db0 msgr2=0x7f9b50147b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:05.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b557e3700 1 --2- 172.21.15.87:0/971422675 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9b40004db0 0x7f9b50147b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b557e3700 1 -- 172.21.15.87:0/971422675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b500c2390 msgr2=0x7f9b50159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:05.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b557e3700 1 --2- 172.21.15.87:0/971422675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b500c2390 0x7f9b50159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:05.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b557e3700 1 -- 172.21.15.87:0/971422675 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b500ca460 con 0x7f9b501599d0 2023-03-30T19:36:05.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.617+0000 7f9b557e3700 1 --2- 172.21.15.87:0/971422675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b501599d0 0x7f9b50159e50 secure :-1 s=READY pgs=3343 cs=0 l=1 rev1=1 crypto rx=0x7f9b48017040 tx=0x7f9b48009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:05.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.621+0000 7f9b4d7fa700 1 -- 172.21.15.87:0/971422675 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48007000 con 0x7f9b501599d0 2023-03-30T19:36:05.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.621+0000 7f9b4d7fa700 1 -- 172.21.15.87:0/971422675 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b48003e70 con 0x7f9b501599d0 2023-03-30T19:36:05.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.621+0000 7f9b55fe4700 1 -- 172.21.15.87:0/971422675 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b500ca180 con 0x7f9b501599d0 2023-03-30T19:36:05.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.621+0000 7f9b4d7fa700 1 -- 172.21.15.87:0/971422675 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48014b30 con 0x7f9b501599d0 2023-03-30T19:36:05.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.621+0000 7f9b55fe4700 1 -- 172.21.15.87:0/971422675 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5006c420 con 0x7f9b501599d0 2023-03-30T19:36:05.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.621+0000 7f9b55fe4700 1 -- 172.21.15.87:0/971422675 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b500733a0 con 0x7f9b501599d0 2023-03-30T19:36:05.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.621+0000 7f9b4d7fa700 1 -- 172.21.15.87:0/971422675 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f9b48023020 con 0x7f9b501599d0 2023-03-30T19:36:05.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.621+0000 7f9b4d7fa700 1 --2- 172.21.15.87:0/971422675 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9b340653f0 0x7f9b340678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.621+0000 7f9b4d7fa700 1 -- 172.21.15.87:0/971422675 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f9b48083ba0 con 0x7f9b501599d0 2023-03-30T19:36:05.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.621+0000 7f9b54fe2700 1 --2- 172.21.15.87:0/971422675 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9b340653f0 0x7f9b340678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.621+0000 7f9b4d7fa700 1 --2- 172.21.15.87:0/971422675 >> [v2:172.21.15.87:6824/33776,v1:172.21.15.87:6825/33776] conn(0x7f9b3406bd00 0x7f9b3406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:05.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.621+0000 7f9b4d7fa700 1 -- 172.21.15.87:0/971422675 --> [v2:172.21.15.87:6824/33776,v1:172.21.15.87:6825/33776] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b3406e800 con 0x7f9b3406bd00 2023-03-30T19:36:05.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.621+0000 7f9b4d7fa700 1 -- 172.21.15.87:0/971422675 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b480882a0 con 0x7f9b501599d0 2023-03-30T19:36:05.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.621+0000 7f9b4ffff700 1 --2- 172.21.15.87:0/971422675 >> [v2:172.21.15.87:6824/33776,v1:172.21.15.87:6825/33776] conn(0x7f9b3406bd00 0x7f9b3406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:05.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.625+0000 7f9b54fe2700 1 --2- 172.21.15.87:0/971422675 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9b340653f0 0x7f9b340678a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f9b44000c00 tx=0x7f9b44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:05.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:05.625+0000 7f9b4ffff700 1 --2- 172.21.15.87:0/971422675 >> [v2:172.21.15.87:6824/33776,v1:172.21.15.87:6825/33776] conn(0x7f9b3406bd00 0x7f9b3406e130 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:06.778 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:06.773+0000 7f9b4d7fa700 1 -- 172.21.15.87:0/971422675 <== osd.1 v2:172.21.15.87:6824/33776 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9b3406e800 con 0x7f9b3406bd00 2023-03-30T19:36:06.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:06.789+0000 7f9b55fe4700 1 -- 172.21.15.87:0/971422675 --> [v2:172.21.15.87:6824/33776,v1:172.21.15.87:6825/33776] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9b500af020 con 0x7f9b3406bd00 2023-03-30T19:36:06.853 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:06.849+0000 7f9b4d7fa700 1 -- 172.21.15.87:0/971422675 <== osd.1 v2:172.21.15.87:6824/33776 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9b500af020 con 0x7f9b3406bd00 2023-03-30T19:36:06.854 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-03-30T19:36:06.854 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-03-30T19:36:06.856 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-03-30T19:36:06.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:06.849+0000 7f9b55fe4700 1 -- 172.21.15.87:0/971422675 >> [v2:172.21.15.87:6824/33776,v1:172.21.15.87:6825/33776] conn(0x7f9b3406bd00 msgr2=0x7f9b3406e130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:06.857 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:06.849+0000 7f9b55fe4700 1 --2- 172.21.15.87:0/971422675 >> [v2:172.21.15.87:6824/33776,v1:172.21.15.87:6825/33776] conn(0x7f9b3406bd00 0x7f9b3406e130 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:06.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:06.849+0000 7f9b55fe4700 1 -- 172.21.15.87:0/971422675 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9b340653f0 msgr2=0x7f9b340678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:06.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:06.849+0000 7f9b55fe4700 1 --2- 172.21.15.87:0/971422675 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f9b340653f0 0x7f9b340678a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f9b44000c00 tx=0x7f9b44009040 comp rx=0 tx=0).stop 2023-03-30T19:36:06.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:06.849+0000 7f9b55fe4700 1 -- 172.21.15.87:0/971422675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b501599d0 msgr2=0x7f9b50159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:06.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:06.849+0000 7f9b55fe4700 1 --2- 172.21.15.87:0/971422675 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9b501599d0 0x7f9b50159e50 secure :-1 s=READY pgs=3343 cs=0 l=1 rev1=1 crypto rx=0x7f9b48017040 tx=0x7f9b48009750 comp rx=0 tx=0).stop 2023-03-30T19:36:06.858 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:06.849+0000 7f9b557e3700 1 -- 172.21.15.87:0/971422675 reap_dead start 2023-03-30T19:36:06.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:06.849+0000 7f9b55fe4700 1 -- 172.21.15.87:0/971422675 shutdown_connections 2023-03-30T19:36:06.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:06.849+0000 7f9b55fe4700 1 -- 172.21.15.87:0/971422675 >> 172.21.15.87:0/971422675 conn(0x7f9b500cf410 msgr2=0x7f9b500b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:06.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:06.849+0000 7f9b55fe4700 1 -- 172.21.15.87:0/971422675 shutdown_connections 2023-03-30T19:36:06.859 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:06.849+0000 7f9b55fe4700 1 -- 172.21.15.87:0/971422675 wait complete. 2023-03-30T19:36:06.879 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-03-30T19:36:07.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.021+0000 7fb1ce543700 1 Processor -- start 2023-03-30T19:36:07.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.021+0000 7fb1ce543700 1 -- start start 2023-03-30T19:36:07.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.021+0000 7fb1ce543700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb1c80b3f30 0x7fb1c80b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.021+0000 7fb1ce543700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c80af350 0x7fb1c806c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.021+0000 7fb1ce543700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c806b670 con 0x7fb1c806a6e0 2023-03-30T19:36:07.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.021+0000 7fb1ce543700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c806b0b0 con 0x7fb1c80b3f30 2023-03-30T19:36:07.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.021+0000 7fb1ce543700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c806b390 con 0x7fb1c80af350 2023-03-30T19:36:07.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.021+0000 7fb1cd541700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb1c80b3f30 0x7fb1c80b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.021+0000 7fb1cd541700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb1c80b3f30 0x7fb1c80b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55418/0 (socket says 172.21.15.87:55418) 2023-03-30T19:36:07.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.021+0000 7fb1cd541700 1 -- 172.21.15.87:0/973409016 learned_addr learned my addr 172.21.15.87:0/973409016 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:07.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.021+0000 7fb1cdd42700 1 --2- 172.21.15.87:0/973409016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c80af350 0x7fb1c806c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1cd541700 1 -- 172.21.15.87:0/973409016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c80af350 msgr2=0x7fb1c806c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:07.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1cd541700 1 --2- 172.21.15.87:0/973409016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c80af350 0x7fb1c806c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1cd541700 1 -- 172.21.15.87:0/973409016 >> v1:172.21.15.115:6789/0 conn(0x7fb1c806a6e0 legacy=0x7fb1c80aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:07.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1cd541700 1 -- 172.21.15.87:0/973409016 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c80aded0 con 0x7fb1c80b3f30 2023-03-30T19:36:07.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1cd541700 1 --2- 172.21.15.87:0/973409016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1c80b3f30 0x7fb1c80b0c10 secure :-1 s=READY pgs=3344 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009910 tx=0x7fb1c4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bce1c8fe247884 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:07.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1bffff700 1 -- 172.21.15.87:0/973409016 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4011830 con 0x7fb1c80b3f30 2023-03-30T19:36:07.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1bffff700 1 -- 172.21.15.87:0/973409016 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c4011990 con 0x7fb1c80b3f30 2023-03-30T19:36:07.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1bffff700 1 -- 172.21.15.87:0/973409016 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4011d40 con 0x7fb1c80b3f30 2023-03-30T19:36:07.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1ce543700 1 -- 172.21.15.87:0/973409016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1c80b3f30 msgr2=0x7fb1c80b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:07.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1ce543700 1 --2- 172.21.15.87:0/973409016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1c80b3f30 0x7fb1c80b0c10 secure :-1 s=READY pgs=3344 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009910 tx=0x7fb1c4009c20 comp rx=0 tx=0).stop 2023-03-30T19:36:07.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1ce543700 1 -- 172.21.15.87:0/973409016 shutdown_connections 2023-03-30T19:36:07.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1ce543700 1 --2- 172.21.15.87:0/973409016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c80af350 0x7fb1c806c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1ce543700 1 --2- 172.21.15.87:0/973409016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1c80b3f30 0x7fb1c80b0c10 unknown :-1 s=CLOSED pgs=3344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1ce543700 1 -- 172.21.15.87:0/973409016 >> 172.21.15.87:0/973409016 conn(0x7fb1c80cf410 msgr2=0x7fb1c80cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:07.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1ce543700 1 -- 172.21.15.87:0/973409016 shutdown_connections 2023-03-30T19:36:07.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.025+0000 7fb1ce543700 1 -- 172.21.15.87:0/973409016 wait complete. 2023-03-30T19:36:07.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ce543700 1 Processor -- start 2023-03-30T19:36:07.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ce543700 1 -- start start 2023-03-30T19:36:07.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ce543700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c806a6e0 0x7fb1c8157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ce543700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1c80af350 0x7fb1c80c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ce543700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c80b3f30 0x7fb1c815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ce543700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c8157550 con 0x7fb1c80af350 2023-03-30T19:36:07.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ce543700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80c5d90 con 0x7fb1c806a6e0 2023-03-30T19:36:07.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ce543700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c815cdd0 con 0x7fb1c80b3f30 2023-03-30T19:36:07.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1cd541700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c806a6e0 0x7fb1c8157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ccd40700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1c80af350 0x7fb1c80c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ccd40700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1c80af350 0x7fb1c80c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55424/0 (socket says 172.21.15.87:55424) 2023-03-30T19:36:07.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1cd541700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c806a6e0 0x7fb1c8157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:54358/0 (socket says 172.21.15.87:54358) 2023-03-30T19:36:07.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ccd40700 1 -- 172.21.15.87:0/1349904616 learned_addr learned my addr 172.21.15.87:0/1349904616 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:07.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1cdd42700 1 --2- 172.21.15.87:0/1349904616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c80b3f30 0x7fb1c815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ccd40700 1 -- 172.21.15.87:0/1349904616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c80b3f30 msgr2=0x7fb1c815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:07.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ccd40700 1 --2- 172.21.15.87:0/1349904616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c80b3f30 0x7fb1c815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ccd40700 1 -- 172.21.15.87:0/1349904616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c806a6e0 msgr2=0x7fb1c8157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:07.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ccd40700 1 --2- 172.21.15.87:0/1349904616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c806a6e0 0x7fb1c8157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ccd40700 1 -- 172.21.15.87:0/1349904616 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c4009570 con 0x7fb1c80af350 2023-03-30T19:36:07.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ccd40700 1 --2- 172.21.15.87:0/1349904616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1c80af350 0x7fb1c80c5850 secure :-1 s=READY pgs=3345 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800c500 tx=0x7fb1b800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:07.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1bdffb700 1 -- 172.21.15.87:0/1349904616 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80052d0 con 0x7fb1c80af350 2023-03-30T19:36:07.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1bdffb700 1 -- 172.21.15.87:0/1349904616 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b8005430 con 0x7fb1c80af350 2023-03-30T19:36:07.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1bdffb700 1 -- 172.21.15.87:0/1349904616 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80055a0 con 0x7fb1c80af350 2023-03-30T19:36:07.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.029+0000 7fb1ce543700 1 -- 172.21.15.87:0/1349904616 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c80b4300 con 0x7fb1c80af350 2023-03-30T19:36:07.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.033+0000 7fb1ce543700 1 -- 172.21.15.87:0/1349904616 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c80ae1b0 con 0x7fb1c80af350 2023-03-30T19:36:07.042 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.033+0000 7fb1ce543700 1 -- 172.21.15.87:0/1349904616 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c806ab60 con 0x7fb1c80af350 2023-03-30T19:36:07.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.033+0000 7fb1bdffb700 1 -- 172.21.15.87:0/1349904616 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fb1b80038e0 con 0x7fb1c80af350 2023-03-30T19:36:07.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.037+0000 7fb1bdffb700 1 --2- 172.21.15.87:0/1349904616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb1ac0653f0 0x7fb1ac0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.043 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.037+0000 7fb1bdffb700 1 -- 172.21.15.87:0/1349904616 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fb1b8081a20 con 0x7fb1c80af350 2023-03-30T19:36:07.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.037+0000 7fb1cd541700 1 --2- 172.21.15.87:0/1349904616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb1ac0653f0 0x7fb1ac0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.037+0000 7fb1cd541700 1 --2- 172.21.15.87:0/1349904616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb1ac0653f0 0x7fb1ac0678a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4000c00 tx=0x7fb1c4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:07.044 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.041+0000 7fb1bdffb700 1 -- 172.21.15.87:0/1349904616 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fb1b804f870 con 0x7fb1c80af350 2023-03-30T19:36:07.311 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.305+0000 7fb1ce543700 1 -- 172.21.15.87:0/1349904616 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1c80733a0 con 0x7fb1ac0653f0 2023-03-30T19:36:07.328 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.325+0000 7fb1bdffb700 1 -- 172.21.15.87:0/1349904616 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb1c80733a0 con 0x7fb1ac0653f0 2023-03-30T19:36:07.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.325+0000 7fb1ce543700 1 -- 172.21.15.87:0/1349904616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb1ac0653f0 msgr2=0x7fb1ac0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:07.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.325+0000 7fb1ce543700 1 --2- 172.21.15.87:0/1349904616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb1ac0653f0 0x7fb1ac0678a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4000c00 tx=0x7fb1c4008030 comp rx=0 tx=0).stop 2023-03-30T19:36:07.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.325+0000 7fb1ce543700 1 -- 172.21.15.87:0/1349904616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1c80af350 msgr2=0x7fb1c80c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:07.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.325+0000 7fb1ce543700 1 --2- 172.21.15.87:0/1349904616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1c80af350 0x7fb1c80c5850 secure :-1 s=READY pgs=3345 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800c500 tx=0x7fb1b800c810 comp rx=0 tx=0).stop 2023-03-30T19:36:07.332 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.329+0000 7fb1ce543700 1 -- 172.21.15.87:0/1349904616 shutdown_connections 2023-03-30T19:36:07.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.329+0000 7fb1ce543700 1 --2- 172.21.15.87:0/1349904616 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb1ac0653f0 0x7fb1ac0678a0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.329+0000 7fb1ce543700 1 --2- 172.21.15.87:0/1349904616 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c80b3f30 0x7fb1c815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.329+0000 7fb1ce543700 1 --2- 172.21.15.87:0/1349904616 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb1c80af350 0x7fb1c80c5850 unknown :-1 s=CLOSED pgs=3345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.333 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.329+0000 7fb1ce543700 1 --2- 172.21.15.87:0/1349904616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c806a6e0 0x7fb1c8157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.329+0000 7fb1ce543700 1 -- 172.21.15.87:0/1349904616 >> 172.21.15.87:0/1349904616 conn(0x7fb1c80cf410 msgr2=0x7fb1c80c91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:07.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.329+0000 7fb1ce543700 1 -- 172.21.15.87:0/1349904616 shutdown_connections 2023-03-30T19:36:07.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.329+0000 7fb1ce543700 1 -- 172.21.15.87:0/1349904616 wait complete. 2023-03-30T19:36:07.334 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 1 to deep-scrub 2023-03-30T19:36:07.356 INFO:tasks.ceph:Scrubbing osd.2 2023-03-30T19:36:07.357 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-03-30T19:36:07.508 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.501+0000 7f3c1d625700 1 Processor -- start 2023-03-30T19:36:07.508 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c1d625700 1 -- start start 2023-03-30T19:36:07.510 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c1d625700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3c180b8380 0x7f3c180d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.511 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c1d625700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3c180d27e0 0x7f3c18069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.511 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c1d625700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c18160ef0 con 0x7f3c181609f0 2023-03-30T19:36:07.511 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c1d625700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c180cd6a0 con 0x7f3c180b8380 2023-03-30T19:36:07.511 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c1d625700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c180cd3a0 con 0x7f3c180d27e0 2023-03-30T19:36:07.512 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c16ffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3c180b8380 0x7f3c180d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.512 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c177fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3c181609f0 0x7f3c1806b1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:53500/0 (socket says 172.21.15.87:53500) 2023-03-30T19:36:07.512 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c177fe700 1 -- 172.21.15.87:0/2698659983 learned_addr learned my addr 172.21.15.87:0/2698659983 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:36:07.512 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c0ffff700 1 --2- 172.21.15.87:0/2698659983 >> v2:172.21.15.115:3300/0 conn(0x7f3c180d27e0 0x7f3c18069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.512 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c167fc700 1 -- 172.21.15.87:0/2698659983 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726063109 0 0) 0x7f3c18160ef0 con 0x7f3c181609f0 2023-03-30T19:36:07.513 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c167fc700 1 -- 172.21.15.87:0/2698659983 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c040035d0 con 0x7f3c181609f0 2023-03-30T19:36:07.513 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c16ffd700 1 -- 172.21.15.87:0/2698659983 >> v2:172.21.15.115:3300/0 conn(0x7f3c180d27e0 msgr2=0x7f3c18069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:07.514 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c16ffd700 1 --2- 172.21.15.87:0/2698659983 >> v2:172.21.15.115:3300/0 conn(0x7f3c180d27e0 0x7f3c18069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.514 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c16ffd700 1 -- 172.21.15.87:0/2698659983 >> v1:172.21.15.87:6789/0 conn(0x7f3c181609f0 legacy=0x7f3c1806b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:07.515 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c16ffd700 1 -- 172.21.15.87:0/2698659983 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c180cef00 con 0x7f3c180b8380 2023-03-30T19:36:07.519 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c16ffd700 1 --2- 172.21.15.87:0/2698659983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c180b8380 0x7f3c180d2200 secure :-1 s=READY pgs=3347 cs=0 l=1 rev1=1 crypto rx=0x7f3c180d3d10 tx=0x7f3c08009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40503aaf2539cc27 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:07.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c167fc700 1 -- 172.21.15.87:0/2698659983 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08011830 con 0x7f3c180b8380 2023-03-30T19:36:07.520 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c167fc700 1 -- 172.21.15.87:0/2698659983 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c08011990 con 0x7f3c180b8380 2023-03-30T19:36:07.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.505+0000 7f3c167fc700 1 -- 172.21.15.87:0/2698659983 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08011d20 con 0x7f3c180b8380 2023-03-30T19:36:07.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.509+0000 7f3c1d625700 1 -- 172.21.15.87:0/2698659983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c180b8380 msgr2=0x7f3c180d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:07.521 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.509+0000 7f3c1d625700 1 --2- 172.21.15.87:0/2698659983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c180b8380 0x7f3c180d2200 secure :-1 s=READY pgs=3347 cs=0 l=1 rev1=1 crypto rx=0x7f3c180d3d10 tx=0x7f3c08009b30 comp rx=0 tx=0).stop 2023-03-30T19:36:07.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.509+0000 7f3c1d625700 1 -- 172.21.15.87:0/2698659983 shutdown_connections 2023-03-30T19:36:07.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.509+0000 7f3c1d625700 1 --2- 172.21.15.87:0/2698659983 >> v2:172.21.15.115:3300/0 conn(0x7f3c180d27e0 0x7f3c18069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.522 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.509+0000 7f3c1d625700 1 --2- 172.21.15.87:0/2698659983 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c180b8380 0x7f3c180d2200 unknown :-1 s=CLOSED pgs=3347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.523 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.509+0000 7f3c1d625700 1 -- 172.21.15.87:0/2698659983 >> 172.21.15.87:0/2698659983 conn(0x7f3c180b53f0 msgr2=0x7f3c180cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:07.523 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.509+0000 7f3c1d625700 1 -- 172.21.15.87:0/2698659983 shutdown_connections 2023-03-30T19:36:07.524 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.509+0000 7f3c1d625700 1 -- 172.21.15.87:0/2698659983 wait complete. 2023-03-30T19:36:07.524 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.509+0000 7f3c1d625700 1 Processor -- start 2023-03-30T19:36:07.524 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.509+0000 7f3c1d625700 1 -- start start 2023-03-30T19:36:07.524 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c1d625700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c180b8380 0x7f3c180ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.524 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c1d625700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c181609f0 0x7f3c18143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.525 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c1d625700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c180b6a40 0x7f3c180b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.525 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c1d625700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c181f2d50 con 0x7f3c180b8380 2023-03-30T19:36:07.525 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c1d625700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c180b65b0 con 0x7f3c180b6a40 2023-03-30T19:36:07.525 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c1d625700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c180b7420 con 0x7f3c181609f0 2023-03-30T19:36:07.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c16ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c180b8380 0x7f3c180ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c16ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c180b8380 0x7f3c180ca540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55444/0 (socket says 172.21.15.87:55444) 2023-03-30T19:36:07.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c16ffd700 1 -- 172.21.15.87:0/893194208 learned_addr learned my addr 172.21.15.87:0/893194208 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:07.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c177fe700 1 --2- 172.21.15.87:0/893194208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c180b6a40 0x7f3c180b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.526 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c0ffff700 1 --2- 172.21.15.87:0/893194208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c181609f0 0x7f3c18143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c16ffd700 1 -- 172.21.15.87:0/893194208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c181609f0 msgr2=0x7f3c18143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:07.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c16ffd700 1 --2- 172.21.15.87:0/893194208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c181609f0 0x7f3c18143870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c16ffd700 1 -- 172.21.15.87:0/893194208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c180b6a40 msgr2=0x7f3c180b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:07.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c16ffd700 1 --2- 172.21.15.87:0/893194208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c180b6a40 0x7f3c180b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c16ffd700 1 -- 172.21.15.87:0/893194208 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c080094b0 con 0x7f3c180b8380 2023-03-30T19:36:07.527 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c16ffd700 1 --2- 172.21.15.87:0/893194208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c180b8380 0x7f3c180ca540 secure :-1 s=READY pgs=3348 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009b70 tx=0x7f3c08004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:07.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c0f7fe700 1 -- 172.21.15.87:0/893194208 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08004480 con 0x7f3c180b8380 2023-03-30T19:36:07.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c1d625700 1 -- 172.21.15.87:0/893194208 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c180cf480 con 0x7f3c180b8380 2023-03-30T19:36:07.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c1d625700 1 -- 172.21.15.87:0/893194208 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c180cf1a0 con 0x7f3c180b8380 2023-03-30T19:36:07.528 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c0f7fe700 1 -- 172.21.15.87:0/893194208 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0801f070 con 0x7f3c180b8380 2023-03-30T19:36:07.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c0f7fe700 1 -- 172.21.15.87:0/893194208 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c080038c0 con 0x7f3c180b8380 2023-03-30T19:36:07.529 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.513+0000 7f3c1d625700 1 -- 172.21.15.87:0/893194208 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3bfc000fc0 con 0x7f3c180b8380 2023-03-30T19:36:07.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.517+0000 7f3c0f7fe700 1 -- 172.21.15.87:0/893194208 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f3c08021030 con 0x7f3c180b8380 2023-03-30T19:36:07.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.517+0000 7f3c0f7fe700 1 --2- 172.21.15.87:0/893194208 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3bf80653f0 0x7f3bf80678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.530 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.517+0000 7f3c0f7fe700 1 -- 172.21.15.87:0/893194208 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f3c08084070 con 0x7f3c180b8380 2023-03-30T19:36:07.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.517+0000 7f3c0f7fe700 1 --2- 172.21.15.87:0/893194208 >> [v2:172.21.15.87:6808/33775,v1:172.21.15.87:6810/33775] conn(0x7f3bf806bd00 0x7f3bf806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.517+0000 7f3c0ffff700 1 --2- 172.21.15.87:0/893194208 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3bf80653f0 0x7f3bf80678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.517+0000 7f3c0f7fe700 1 -- 172.21.15.87:0/893194208 --> [v2:172.21.15.87:6808/33775,v1:172.21.15.87:6810/33775] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3bf806e800 con 0x7f3bf806bd00 2023-03-30T19:36:07.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.517+0000 7f3c0f7fe700 1 -- 172.21.15.87:0/893194208 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c080844a0 con 0x7f3c180b8380 2023-03-30T19:36:07.531 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.517+0000 7f3c177fe700 1 --2- 172.21.15.87:0/893194208 >> [v2:172.21.15.87:6808/33775,v1:172.21.15.87:6810/33775] conn(0x7f3bf806bd00 0x7f3bf806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.517+0000 7f3c0ffff700 1 --2- 172.21.15.87:0/893194208 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3bf80653f0 0x7f3bf80678a0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f3c1815a7f0 tx=0x7f3c00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:07.532 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.521+0000 7f3c177fe700 1 --2- 172.21.15.87:0/893194208 >> [v2:172.21.15.87:6808/33775,v1:172.21.15.87:6810/33775] conn(0x7f3bf806bd00 0x7f3bf806e130 crc :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:07.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.657+0000 7f3c0f7fe700 1 -- 172.21.15.87:0/893194208 <== osd.2 v2:172.21.15.87:6808/33775 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3bf806e800 con 0x7f3bf806bd00 2023-03-30T19:36:07.681 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.677+0000 7f3c1d625700 1 -- 172.21.15.87:0/893194208 --> [v2:172.21.15.87:6808/33775,v1:172.21.15.87:6810/33775] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3bfc002d80 con 0x7f3bf806bd00 2023-03-30T19:36:07.711 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.705+0000 7f3c0f7fe700 1 -- 172.21.15.87:0/893194208 <== osd.2 v2:172.21.15.87:6808/33775 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3bfc002d80 con 0x7f3bf806bd00 2023-03-30T19:36:07.711 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-03-30T19:36:07.712 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-03-30T19:36:07.712 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-03-30T19:36:07.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.705+0000 7f3c1d625700 1 -- 172.21.15.87:0/893194208 >> [v2:172.21.15.87:6808/33775,v1:172.21.15.87:6810/33775] conn(0x7f3bf806bd00 msgr2=0x7f3bf806e130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:07.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.705+0000 7f3c1d625700 1 --2- 172.21.15.87:0/893194208 >> [v2:172.21.15.87:6808/33775,v1:172.21.15.87:6810/33775] conn(0x7f3bf806bd00 0x7f3bf806e130 crc :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.705+0000 7f3c1d625700 1 -- 172.21.15.87:0/893194208 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3bf80653f0 msgr2=0x7f3bf80678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:07.713 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.705+0000 7f3c1d625700 1 --2- 172.21.15.87:0/893194208 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f3bf80653f0 0x7f3bf80678a0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f3c1815a7f0 tx=0x7f3c00008040 comp rx=0 tx=0).stop 2023-03-30T19:36:07.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.705+0000 7f3c1d625700 1 -- 172.21.15.87:0/893194208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c180b8380 msgr2=0x7f3c180ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:07.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.705+0000 7f3c1d625700 1 --2- 172.21.15.87:0/893194208 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3c180b8380 0x7f3c180ca540 secure :-1 s=READY pgs=3348 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009b70 tx=0x7f3c08004770 comp rx=0 tx=0).stop 2023-03-30T19:36:07.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.709+0000 7f3c177fe700 1 -- 172.21.15.87:0/893194208 reap_dead start 2023-03-30T19:36:07.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.709+0000 7f3c1d625700 1 -- 172.21.15.87:0/893194208 shutdown_connections 2023-03-30T19:36:07.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.709+0000 7f3c1d625700 1 -- 172.21.15.87:0/893194208 >> 172.21.15.87:0/893194208 conn(0x7f3c180b53f0 msgr2=0x7f3c180cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:07.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.709+0000 7f3c1d625700 1 -- 172.21.15.87:0/893194208 shutdown_connections 2023-03-30T19:36:07.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.709+0000 7f3c1d625700 1 -- 172.21.15.87:0/893194208 wait complete. 2023-03-30T19:36:07.736 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-03-30T19:36:07.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.881+0000 7f7f9ebef700 1 Processor -- start 2023-03-30T19:36:07.888 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9ebef700 1 -- start start 2023-03-30T19:36:07.889 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9ebef700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7f98163dc0 0x7f7f980c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.889 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9ebef700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f98164190 0x7f7f980c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.889 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9ebef700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f9806b3a0 con 0x7f7f980aea30 2023-03-30T19:36:07.890 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9ebef700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f9806d810 con 0x7f7f98163dc0 2023-03-30T19:36:07.890 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9ebef700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980cc1d0 con 0x7f7f98164190 2023-03-30T19:36:07.891 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9dbed700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7f98163dc0 0x7f7f980c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.891 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9dbed700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7f98163dc0 0x7f7f980c95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55452/0 (socket says 172.21.15.87:55452) 2023-03-30T19:36:07.891 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9dbed700 1 -- 172.21.15.87:0/1877869349 learned_addr learned my addr 172.21.15.87:0/1877869349 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:07.891 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9d3ec700 1 --2- 172.21.15.87:0/1877869349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f98164190 0x7f7f980c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.892 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9dbed700 1 -- 172.21.15.87:0/1877869349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f98164190 msgr2=0x7f7f980c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:07.892 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9dbed700 1 --2- 172.21.15.87:0/1877869349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f98164190 0x7f7f980c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.892 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9dbed700 1 -- 172.21.15.87:0/1877869349 >> v1:172.21.15.87:6789/0 conn(0x7f7f980aea30 legacy=0x7f7f98164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:07.892 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9dbed700 1 -- 172.21.15.87:0/1877869349 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f98069f00 con 0x7f7f98163dc0 2023-03-30T19:36:07.892 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9dbed700 1 --2- 172.21.15.87:0/1877869349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f98163dc0 0x7f7f980c95c0 secure :-1 s=READY pgs=3350 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009910 tx=0x7f7f88009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27536e3f0f88c6d9 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:07.893 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9cbeb700 1 -- 172.21.15.87:0/1877869349 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88004230 con 0x7f7f98163dc0 2023-03-30T19:36:07.893 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9cbeb700 1 -- 172.21.15.87:0/1877869349 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f88004390 con 0x7f7f98163dc0 2023-03-30T19:36:07.893 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9cbeb700 1 -- 172.21.15.87:0/1877869349 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f880036c0 con 0x7f7f98163dc0 2023-03-30T19:36:07.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9ebef700 1 -- 172.21.15.87:0/1877869349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f98163dc0 msgr2=0x7f7f980c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:07.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.885+0000 7f7f9ebef700 1 --2- 172.21.15.87:0/1877869349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f98163dc0 0x7f7f980c95c0 secure :-1 s=READY pgs=3350 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009910 tx=0x7f7f88009c20 comp rx=0 tx=0).stop 2023-03-30T19:36:07.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.889+0000 7f7f9ebef700 1 -- 172.21.15.87:0/1877869349 shutdown_connections 2023-03-30T19:36:07.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.889+0000 7f7f9ebef700 1 --2- 172.21.15.87:0/1877869349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f98164190 0x7f7f980c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.895 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.889+0000 7f7f9ebef700 1 --2- 172.21.15.87:0/1877869349 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f98163dc0 0x7f7f980c95c0 unknown :-1 s=CLOSED pgs=3350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.895 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.889+0000 7f7f9ebef700 1 -- 172.21.15.87:0/1877869349 >> 172.21.15.87:0/1877869349 conn(0x7f7f980cf410 msgr2=0x7f7f980cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:07.895 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.889+0000 7f7f9ebef700 1 -- 172.21.15.87:0/1877869349 shutdown_connections 2023-03-30T19:36:07.895 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.889+0000 7f7f9ebef700 1 -- 172.21.15.87:0/1877869349 wait complete. 2023-03-30T19:36:07.896 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.889+0000 7f7f9ebef700 1 Processor -- start 2023-03-30T19:36:07.896 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.889+0000 7f7f9ebef700 1 -- start start 2023-03-30T19:36:07.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9ebef700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f980aea30 0x7f7f98153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9ebef700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f98163dc0 0x7f7f980bef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9ebef700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f98164190 0x7f7f980c02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9ebef700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980c49a0 con 0x7f7f98164190 2023-03-30T19:36:07.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9ebef700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f981607a0 con 0x7f7f98163dc0 2023-03-30T19:36:07.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9ebef700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f98154120 con 0x7f7f980aea30 2023-03-30T19:36:07.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9e3ee700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f98164190 0x7f7f980c02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9e3ee700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f98164190 0x7f7f980c02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55462/0 (socket says 172.21.15.87:55462) 2023-03-30T19:36:07.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9e3ee700 1 -- 172.21.15.87:0/3627995276 learned_addr learned my addr 172.21.15.87:0/3627995276 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:07.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9d3ec700 1 --2- 172.21.15.87:0/3627995276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f98163dc0 0x7f7f980bef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9dbed700 1 --2- 172.21.15.87:0/3627995276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f980aea30 0x7f7f98153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.900 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9e3ee700 1 -- 172.21.15.87:0/3627995276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f980aea30 msgr2=0x7f7f98153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:07.900 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9e3ee700 1 --2- 172.21.15.87:0/3627995276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f980aea30 0x7f7f98153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9e3ee700 1 -- 172.21.15.87:0/3627995276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f98163dc0 msgr2=0x7f7f980bef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:07.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9e3ee700 1 --2- 172.21.15.87:0/3627995276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f98163dc0 0x7f7f980bef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:07.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9e3ee700 1 -- 172.21.15.87:0/3627995276 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f88009570 con 0x7f7f98164190 2023-03-30T19:36:07.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9e3ee700 1 --2- 172.21.15.87:0/3627995276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f98164190 0x7f7f980c02e0 secure :-1 s=READY pgs=3351 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000cba0 tx=0x7f7f9000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:07.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f967fc700 1 -- 172.21.15.87:0/3627995276 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9000aaa0 con 0x7f7f98164190 2023-03-30T19:36:07.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f967fc700 1 -- 172.21.15.87:0/3627995276 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9000ac00 con 0x7f7f98164190 2023-03-30T19:36:07.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f967fc700 1 -- 172.21.15.87:0/3627995276 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90012420 con 0x7f7f98164190 2023-03-30T19:36:07.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9ebef700 1 -- 172.21.15.87:0/3627995276 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9806d250 con 0x7f7f98164190 2023-03-30T19:36:07.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.893+0000 7f7f9ebef700 1 -- 172.21.15.87:0/3627995276 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9806cf70 con 0x7f7f98164190 2023-03-30T19:36:07.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.897+0000 7f7f9ebef700 1 -- 172.21.15.87:0/3627995276 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f9806d530 con 0x7f7f98164190 2023-03-30T19:36:07.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.897+0000 7f7f967fc700 1 -- 172.21.15.87:0/3627995276 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f7f90012580 con 0x7f7f98164190 2023-03-30T19:36:07.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.897+0000 7f7f967fc700 1 --2- 172.21.15.87:0/3627995276 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7f840653f0 0x7f7f840678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:07.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.897+0000 7f7f967fc700 1 -- 172.21.15.87:0/3627995276 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f7f90082d10 con 0x7f7f98164190 2023-03-30T19:36:07.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.897+0000 7f7f9dbed700 1 --2- 172.21.15.87:0/3627995276 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7f840653f0 0x7f7f840678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:07.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.901+0000 7f7f9dbed700 1 --2- 172.21.15.87:0/3627995276 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7f840653f0 0x7f7f840678a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009910 tx=0x7f7f88008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:07.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:07.905+0000 7f7f967fc700 1 -- 172.21.15.87:0/3627995276 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f7f90088020 con 0x7f7f98164190 2023-03-30T19:36:08.142 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.137+0000 7f7f9ebef700 1 -- 172.21.15.87:0/3627995276 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f980733a0 con 0x7f7f840653f0 2023-03-30T19:36:08.154 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.149+0000 7f7f967fc700 1 -- 172.21.15.87:0/3627995276 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7f980733a0 con 0x7f7f840653f0 2023-03-30T19:36:08.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.153+0000 7f7f9ebef700 1 -- 172.21.15.87:0/3627995276 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7f840653f0 msgr2=0x7f7f840678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:08.156 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.153+0000 7f7f9ebef700 1 --2- 172.21.15.87:0/3627995276 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7f840653f0 0x7f7f840678a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009910 tx=0x7f7f88008030 comp rx=0 tx=0).stop 2023-03-30T19:36:08.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.153+0000 7f7f9ebef700 1 -- 172.21.15.87:0/3627995276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f98164190 msgr2=0x7f7f980c02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:08.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.153+0000 7f7f9ebef700 1 --2- 172.21.15.87:0/3627995276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f98164190 0x7f7f980c02e0 secure :-1 s=READY pgs=3351 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000cba0 tx=0x7f7f9000ceb0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.153+0000 7f7f9ebef700 1 -- 172.21.15.87:0/3627995276 shutdown_connections 2023-03-30T19:36:08.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.153+0000 7f7f9ebef700 1 --2- 172.21.15.87:0/3627995276 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f7f840653f0 0x7f7f840678a0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.157 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.153+0000 7f7f9ebef700 1 --2- 172.21.15.87:0/3627995276 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f98164190 0x7f7f980c02e0 unknown :-1 s=CLOSED pgs=3351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.153+0000 7f7f9ebef700 1 --2- 172.21.15.87:0/3627995276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f98163dc0 0x7f7f980bef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.153+0000 7f7f9ebef700 1 --2- 172.21.15.87:0/3627995276 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f980aea30 0x7f7f98153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.158 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.153+0000 7f7f9ebef700 1 -- 172.21.15.87:0/3627995276 >> 172.21.15.87:0/3627995276 conn(0x7f7f980cf410 msgr2=0x7f7f980af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:08.159 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.153+0000 7f7f9ebef700 1 -- 172.21.15.87:0/3627995276 shutdown_connections 2023-03-30T19:36:08.160 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.153+0000 7f7f9ebef700 1 -- 172.21.15.87:0/3627995276 wait complete. 2023-03-30T19:36:08.160 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 2 to deep-scrub 2023-03-30T19:36:08.174 INFO:tasks.ceph:Scrubbing osd.3 2023-03-30T19:36:08.174 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-03-30T19:36:08.334 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.329+0000 7fcb76b13700 1 Processor -- start 2023-03-30T19:36:08.335 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.329+0000 7fcb76b13700 1 -- start start 2023-03-30T19:36:08.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.333+0000 7fcb76b13700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcb700d27e0 0x7fcb700d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:08.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.333+0000 7fcb76b13700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb70160ef0 con 0x7fcb7006a3e0 2023-03-30T19:36:08.338 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.333+0000 7fcb76b13700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb700cd6a0 con 0x7fcb700b8380 2023-03-30T19:36:08.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.333+0000 7fcb76b13700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb700cd3a0 con 0x7fcb700d27e0 2023-03-30T19:36:08.339 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.333+0000 7fcb75310700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcb700d27e0 0x7fcb700d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:08.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.333+0000 7fcb75310700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcb700d27e0 0x7fcb700d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55464/0 (socket says 172.21.15.87:55464) 2023-03-30T19:36:08.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.333+0000 7fcb75310700 1 -- 172.21.15.87:0/3749893141 learned_addr learned my addr 172.21.15.87:0/3749893141 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:08.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.333+0000 7fcb75b11700 1 --1- 172.21.15.87:0/3749893141 >> v1:172.21.15.115:6789/0 conn(0x7fcb700b8380 0x7fcb70069cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:50082/0 (socket says 172.21.15.87:50082) 2023-03-30T19:36:08.340 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.333+0000 7fcb75310700 1 -- 172.21.15.87:0/3749893141 >> v1:172.21.15.115:6789/0 conn(0x7fcb700b8380 legacy=0x7fcb70069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:08.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.333+0000 7fcb75310700 1 -- 172.21.15.87:0/3749893141 >> v1:172.21.15.87:6789/0 conn(0x7fcb7006a3e0 legacy=0x7fcb700d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:08.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.333+0000 7fcb75310700 1 -- 172.21.15.87:0/3749893141 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700cef00 con 0x7fcb700d27e0 2023-03-30T19:36:08.341 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.337+0000 7fcb75310700 1 --2- 172.21.15.87:0/3749893141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb700d27e0 0x7fcb700d2200 secure :-1 s=READY pgs=3353 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009940 tx=0x7fcb60009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567f9ec9cf26a3b7 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:08.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.337+0000 7fcb74b0f700 1 -- 172.21.15.87:0/3749893141 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6000ba20 con 0x7fcb700d27e0 2023-03-30T19:36:08.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.337+0000 7fcb74b0f700 1 -- 172.21.15.87:0/3749893141 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb60009e90 con 0x7fcb700d27e0 2023-03-30T19:36:08.342 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.337+0000 7fcb74b0f700 1 -- 172.21.15.87:0/3749893141 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6000bda0 con 0x7fcb700d27e0 2023-03-30T19:36:08.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.337+0000 7fcb76b13700 1 -- 172.21.15.87:0/3749893141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb700d27e0 msgr2=0x7fcb700d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:08.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.337+0000 7fcb76b13700 1 --2- 172.21.15.87:0/3749893141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb700d27e0 0x7fcb700d2200 secure :-1 s=READY pgs=3353 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009940 tx=0x7fcb60009c50 comp rx=0 tx=0).stop 2023-03-30T19:36:08.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.337+0000 7fcb76b13700 1 -- 172.21.15.87:0/3749893141 shutdown_connections 2023-03-30T19:36:08.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.337+0000 7fcb76b13700 1 --2- 172.21.15.87:0/3749893141 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb700d27e0 0x7fcb700d2200 unknown :-1 s=CLOSED pgs=3353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.343 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.337+0000 7fcb76b13700 1 -- 172.21.15.87:0/3749893141 >> 172.21.15.87:0/3749893141 conn(0x7fcb700b53f0 msgr2=0x7fcb700cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:08.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.337+0000 7fcb76b13700 1 -- 172.21.15.87:0/3749893141 shutdown_connections 2023-03-30T19:36:08.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.337+0000 7fcb76b13700 1 -- 172.21.15.87:0/3749893141 wait complete. 2023-03-30T19:36:08.344 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb76b13700 1 Processor -- start 2023-03-30T19:36:08.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb76b13700 1 -- start start 2023-03-30T19:36:08.345 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb76b13700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb7006a3e0 0x7fcb7015f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:08.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb76b13700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb700b8380 0x7fcb700cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:08.346 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb76b13700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb700cca50 0x7fcb700c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:08.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb76b13700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700c9490 con 0x7fcb7006a3e0 2023-03-30T19:36:08.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb76b13700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700ccef0 con 0x7fcb700cca50 2023-03-30T19:36:08.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb76b13700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700c8880 con 0x7fcb700b8380 2023-03-30T19:36:08.347 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb75b11700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb7006a3e0 0x7fcb7015f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:08.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb75b11700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb7006a3e0 0x7fcb7015f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55468/0 (socket says 172.21.15.87:55468) 2023-03-30T19:36:08.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb75b11700 1 -- 172.21.15.87:0/4203500792 learned_addr learned my addr 172.21.15.87:0/4203500792 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:08.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb76312700 1 --2- 172.21.15.87:0/4203500792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb700cca50 0x7fcb700c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:08.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb75310700 1 --2- 172.21.15.87:0/4203500792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb700b8380 0x7fcb700cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:08.348 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb75b11700 1 -- 172.21.15.87:0/4203500792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb700b8380 msgr2=0x7fcb700cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:08.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb75b11700 1 --2- 172.21.15.87:0/4203500792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcb700b8380 0x7fcb700cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb75b11700 1 -- 172.21.15.87:0/4203500792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb700cca50 msgr2=0x7fcb700c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:08.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb75b11700 1 --2- 172.21.15.87:0/4203500792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb700cca50 0x7fcb700c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.349 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb75b11700 1 -- 172.21.15.87:0/4203500792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb60009570 con 0x7fcb7006a3e0 2023-03-30T19:36:08.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb75b11700 1 --2- 172.21.15.87:0/4203500792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb7006a3e0 0x7fcb7015f0e0 secure :-1 s=READY pgs=3354 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00c700 tx=0x7fcb6c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:08.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb667fc700 1 -- 172.21.15.87:0/4203500792 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c005cd0 con 0x7fcb7006a3e0 2023-03-30T19:36:08.350 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb667fc700 1 -- 172.21.15.87:0/4203500792 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6c005e30 con 0x7fcb7006a3e0 2023-03-30T19:36:08.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb76b13700 1 -- 172.21.15.87:0/4203500792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb700cf480 con 0x7fcb7006a3e0 2023-03-30T19:36:08.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.341+0000 7fcb667fc700 1 -- 172.21.15.87:0/4203500792 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c0072d0 con 0x7fcb7006a3e0 2023-03-30T19:36:08.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.345+0000 7fcb76b13700 1 -- 172.21.15.87:0/4203500792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb700cf1a0 con 0x7fcb7006a3e0 2023-03-30T19:36:08.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.345+0000 7fcb76b13700 1 -- 172.21.15.87:0/4203500792 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb700b8750 con 0x7fcb7006a3e0 2023-03-30T19:36:08.351 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.345+0000 7fcb667fc700 1 -- 172.21.15.87:0/4203500792 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fcb6c007430 con 0x7fcb7006a3e0 2023-03-30T19:36:08.352 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.345+0000 7fcb667fc700 1 --2- 172.21.15.87:0/4203500792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcb540653f0 0x7fcb540678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:08.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.345+0000 7fcb667fc700 1 -- 172.21.15.87:0/4203500792 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fcb6c0819c0 con 0x7fcb7006a3e0 2023-03-30T19:36:08.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.345+0000 7fcb667fc700 1 --2- 172.21.15.87:0/4203500792 >> [v2:172.21.15.87:6809/33777,v1:172.21.15.87:6811/33777] conn(0x7fcb5406bd00 0x7fcb5406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:08.353 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.345+0000 7fcb667fc700 1 -- 172.21.15.87:0/4203500792 --> [v2:172.21.15.87:6809/33777,v1:172.21.15.87:6811/33777] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb5406e800 con 0x7fcb5406bd00 2023-03-30T19:36:08.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.345+0000 7fcb75310700 1 --2- 172.21.15.87:0/4203500792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcb540653f0 0x7fcb540678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:08.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.345+0000 7fcb667fc700 1 -- 172.21.15.87:0/4203500792 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb6c0862a0 con 0x7fcb7006a3e0 2023-03-30T19:36:08.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.345+0000 7fcb76312700 1 --2- 172.21.15.87:0/4203500792 >> [v2:172.21.15.87:6809/33777,v1:172.21.15.87:6811/33777] conn(0x7fcb5406bd00 0x7fcb5406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:08.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.349+0000 7fcb75310700 1 --2- 172.21.15.87:0/4203500792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcb540653f0 0x7fcb540678a0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009940 tx=0x7fcb60008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:08.354 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.349+0000 7fcb76312700 1 --2- 172.21.15.87:0/4203500792 >> [v2:172.21.15.87:6809/33777,v1:172.21.15.87:6811/33777] conn(0x7fcb5406bd00 0x7fcb5406e130 crc :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:08.563 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.557+0000 7fcb667fc700 1 -- 172.21.15.87:0/4203500792 <== osd.3 v2:172.21.15.87:6809/33777 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcb5406e800 con 0x7fcb5406bd00 2023-03-30T19:36:08.583 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.577+0000 7fcb76b13700 1 -- 172.21.15.87:0/4203500792 --> [v2:172.21.15.87:6809/33777,v1:172.21.15.87:6811/33777] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcb700c95d0 con 0x7fcb5406bd00 2023-03-30T19:36:08.606 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.601+0000 7fcb667fc700 1 -- 172.21.15.87:0/4203500792 <== osd.3 v2:172.21.15.87:6809/33777 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcb68001f20 con 0x7fcb5406bd00 2023-03-30T19:36:08.606 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-03-30T19:36:08.607 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-03-30T19:36:08.607 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-03-30T19:36:08.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.601+0000 7fcb76b13700 1 -- 172.21.15.87:0/4203500792 >> [v2:172.21.15.87:6809/33777,v1:172.21.15.87:6811/33777] conn(0x7fcb5406bd00 msgr2=0x7fcb5406e130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:08.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.601+0000 7fcb76b13700 1 --2- 172.21.15.87:0/4203500792 >> [v2:172.21.15.87:6809/33777,v1:172.21.15.87:6811/33777] conn(0x7fcb5406bd00 0x7fcb5406e130 crc :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.601+0000 7fcb76b13700 1 -- 172.21.15.87:0/4203500792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcb540653f0 msgr2=0x7fcb540678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:08.608 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.601+0000 7fcb76b13700 1 --2- 172.21.15.87:0/4203500792 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcb540653f0 0x7fcb540678a0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009940 tx=0x7fcb60008030 comp rx=0 tx=0).stop 2023-03-30T19:36:08.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.601+0000 7fcb76b13700 1 -- 172.21.15.87:0/4203500792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb7006a3e0 msgr2=0x7fcb7015f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:08.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.601+0000 7fcb76b13700 1 --2- 172.21.15.87:0/4203500792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb7006a3e0 0x7fcb7015f0e0 secure :-1 s=READY pgs=3354 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00c700 tx=0x7fcb6c00ca10 comp rx=0 tx=0).stop 2023-03-30T19:36:08.609 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.601+0000 7fcb76312700 1 -- 172.21.15.87:0/4203500792 reap_dead start 2023-03-30T19:36:08.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.601+0000 7fcb76b13700 1 -- 172.21.15.87:0/4203500792 shutdown_connections 2023-03-30T19:36:08.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.601+0000 7fcb76b13700 1 -- 172.21.15.87:0/4203500792 >> 172.21.15.87:0/4203500792 conn(0x7fcb700b53f0 msgr2=0x7fcb700b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:08.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.601+0000 7fcb76b13700 1 -- 172.21.15.87:0/4203500792 shutdown_connections 2023-03-30T19:36:08.610 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.601+0000 7fcb76b13700 1 -- 172.21.15.87:0/4203500792 wait complete. 2023-03-30T19:36:08.628 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-03-30T19:36:08.788 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.785+0000 7fdbd9fdc700 1 Processor -- start 2023-03-30T19:36:08.788 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.785+0000 7fdbd9fdc700 1 -- start start 2023-03-30T19:36:08.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.785+0000 7fdbd9fdc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbd4163dc0 0x7fdbd40c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:08.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.785+0000 7fdbd9fdc700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd4069f00 con 0x7fdbd4164190 2023-03-30T19:36:08.791 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.785+0000 7fdbd9fdc700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd406cf70 con 0x7fdbd40aea30 2023-03-30T19:36:08.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.785+0000 7fdbd9fdc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd406d810 con 0x7fdbd4163dc0 2023-03-30T19:36:08.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd8fda700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbd4163dc0 0x7fdbd40c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:08.792 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd8fda700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbd4163dc0 0x7fdbd40c95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:40140/0 (socket says 172.21.15.87:40140) 2023-03-30T19:36:08.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd8fda700 1 -- 172.21.15.87:0/4256244213 learned_addr learned my addr 172.21.15.87:0/4256244213 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:08.793 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd8fda700 1 -- 172.21.15.87:0/4256244213 >> v1:172.21.15.115:6789/0 conn(0x7fdbd40aea30 legacy=0x7fdbd406a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:08.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd8fda700 1 -- 172.21.15.87:0/4256244213 >> v1:172.21.15.87:6789/0 conn(0x7fdbd4164190 legacy=0x7fdbd40c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:08.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd8fda700 1 -- 172.21.15.87:0/4256244213 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd406d250 con 0x7fdbd4163dc0 2023-03-30T19:36:08.794 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd8fda700 1 --2- 172.21.15.87:0/4256244213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbd4163dc0 0x7fdbd40c95c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009940 tx=0x7fdbc8009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f19c9ad8fa8597b2 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:08.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd37fe700 1 -- 172.21.15.87:0/4256244213 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8004230 con 0x7fdbd4163dc0 2023-03-30T19:36:08.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd37fe700 1 -- 172.21.15.87:0/4256244213 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc8009e90 con 0x7fdbd4163dc0 2023-03-30T19:36:08.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd37fe700 1 -- 172.21.15.87:0/4256244213 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc80045b0 con 0x7fdbd4163dc0 2023-03-30T19:36:08.795 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd9fdc700 1 -- 172.21.15.87:0/4256244213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbd4163dc0 msgr2=0x7fdbd40c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:08.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd9fdc700 1 --2- 172.21.15.87:0/4256244213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbd4163dc0 0x7fdbd40c95c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009940 tx=0x7fdbc8009c50 comp rx=0 tx=0).stop 2023-03-30T19:36:08.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd9fdc700 1 -- 172.21.15.87:0/4256244213 shutdown_connections 2023-03-30T19:36:08.796 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd9fdc700 1 --2- 172.21.15.87:0/4256244213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbd4163dc0 0x7fdbd40c95c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd9fdc700 1 -- 172.21.15.87:0/4256244213 >> 172.21.15.87:0/4256244213 conn(0x7fdbd40cf410 msgr2=0x7fdbd40cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:08.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd9fdc700 1 -- 172.21.15.87:0/4256244213 shutdown_connections 2023-03-30T19:36:08.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.789+0000 7fdbd9fdc700 1 -- 172.21.15.87:0/4256244213 wait complete. 2023-03-30T19:36:08.797 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.793+0000 7fdbd9fdc700 1 Processor -- start 2023-03-30T19:36:08.798 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.793+0000 7fdbd9fdc700 1 -- start start 2023-03-30T19:36:08.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.793+0000 7fdbd9fdc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbd40aea30 0x7fdbd41fa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:08.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.793+0000 7fdbd9fdc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbd4163dc0 0x7fdbd40c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:08.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.793+0000 7fdbd9fdc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbd4164190 0x7fdbd41f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:08.799 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.793+0000 7fdbd9fdc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40c5050 con 0x7fdbd4163dc0 2023-03-30T19:36:08.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.793+0000 7fdbd9fdc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40b3100 con 0x7fdbd4164190 2023-03-30T19:36:08.800 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.793+0000 7fdbd9fdc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40b27d0 con 0x7fdbd40aea30 2023-03-30T19:36:08.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.797+0000 7fdbd8fda700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbd40aea30 0x7fdbd41fa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:08.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.797+0000 7fdbd8fda700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbd40aea30 0x7fdbd41fa400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.87:40148/0 (socket says 172.21.15.87:40148) 2023-03-30T19:36:08.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.797+0000 7fdbd8fda700 1 -- 172.21.15.87:0/3897522790 learned_addr learned my addr 172.21.15.87:0/3897522790 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:08.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.797+0000 7fdbd8fda700 1 -- 172.21.15.87:0/3897522790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbd4164190 msgr2=0x7fdbd41f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:08.801 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.797+0000 7fdbd8fda700 1 --2- 172.21.15.87:0/3897522790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbd4164190 0x7fdbd41f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.797+0000 7fdbd8fda700 1 -- 172.21.15.87:0/3897522790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbd4163dc0 msgr2=0x7fdbd40c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:08.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.797+0000 7fdbd8fda700 1 --2- 172.21.15.87:0/3897522790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbd4163dc0 0x7fdbd40c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.802 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.797+0000 7fdbd8fda700 1 -- 172.21.15.87:0/3897522790 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8009570 con 0x7fdbd40aea30 2023-03-30T19:36:08.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.797+0000 7fdbd8fda700 1 --2- 172.21.15.87:0/3897522790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbd40aea30 0x7fdbd41fa400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdbd406ff40 tx=0x7fdbc8004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:08.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.797+0000 7fdbd17fa700 1 -- 172.21.15.87:0/3897522790 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc80036c0 con 0x7fdbd40aea30 2023-03-30T19:36:08.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.797+0000 7fdbd17fa700 1 -- 172.21.15.87:0/3897522790 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc8003820 con 0x7fdbd40aea30 2023-03-30T19:36:08.803 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.797+0000 7fdbd17fa700 1 -- 172.21.15.87:0/3897522790 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8003bd0 con 0x7fdbd40aea30 2023-03-30T19:36:08.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.797+0000 7fdbd9fdc700 1 -- 172.21.15.87:0/3897522790 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd406cc40 con 0x7fdbd40aea30 2023-03-30T19:36:08.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.797+0000 7fdbd9fdc700 1 -- 172.21.15.87:0/3897522790 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd406d530 con 0x7fdbd40aea30 2023-03-30T19:36:08.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.797+0000 7fdbd9fdc700 1 -- 172.21.15.87:0/3897522790 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd40ca210 con 0x7fdbd40aea30 2023-03-30T19:36:08.805 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.801+0000 7fdbd17fa700 1 -- 172.21.15.87:0/3897522790 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fdbc8022070 con 0x7fdbd40aea30 2023-03-30T19:36:08.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.801+0000 7fdbd17fa700 1 --2- 172.21.15.87:0/3897522790 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdbb8065470 0x7fdbb8067920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:08.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.801+0000 7fdbd17fa700 1 -- 172.21.15.87:0/3897522790 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fdbc8084310 con 0x7fdbd40aea30 2023-03-30T19:36:08.807 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.801+0000 7fdbd3fff700 1 --2- 172.21.15.87:0/3897522790 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdbb8065470 0x7fdbb8067920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:08.808 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.805+0000 7fdbd3fff700 1 --2- 172.21.15.87:0/3897522790 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdbb8065470 0x7fdbb8067920 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4163050 tx=0x7fdbc0006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:08.811 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.805+0000 7fdbd17fa700 1 -- 172.21.15.87:0/3897522790 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fdbc80521e0 con 0x7fdbd40aea30 2023-03-30T19:36:08.978 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.973+0000 7fdbd9fdc700 1 -- 172.21.15.87:0/3897522790 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbd40b3240 con 0x7fdbb8065470 2023-03-30T19:36:08.979 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.973+0000 7fdbd17fa700 1 -- 172.21.15.87:0/3897522790 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdbc0013400 con 0x7fdbb8065470 2023-03-30T19:36:08.981 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.977+0000 7fdbd9fdc700 1 -- 172.21.15.87:0/3897522790 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdbb8065470 msgr2=0x7fdbb8067920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:08.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.977+0000 7fdbd9fdc700 1 --2- 172.21.15.87:0/3897522790 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdbb8065470 0x7fdbb8067920 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4163050 tx=0x7fdbc0006c90 comp rx=0 tx=0).stop 2023-03-30T19:36:08.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.977+0000 7fdbd9fdc700 1 -- 172.21.15.87:0/3897522790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbd40aea30 msgr2=0x7fdbd41fa400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:08.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.977+0000 7fdbd9fdc700 1 --2- 172.21.15.87:0/3897522790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbd40aea30 0x7fdbd41fa400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdbd406ff40 tx=0x7fdbc8004770 comp rx=0 tx=0).stop 2023-03-30T19:36:08.982 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.977+0000 7fdbd9fdc700 1 -- 172.21.15.87:0/3897522790 shutdown_connections 2023-03-30T19:36:08.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.977+0000 7fdbd9fdc700 1 --2- 172.21.15.87:0/3897522790 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fdbb8065470 0x7fdbb8067920 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.977+0000 7fdbd9fdc700 1 --2- 172.21.15.87:0/3897522790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbd4164190 0x7fdbd41f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.977+0000 7fdbd9fdc700 1 --2- 172.21.15.87:0/3897522790 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdbd4163dc0 0x7fdbd40c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.977+0000 7fdbd9fdc700 1 --2- 172.21.15.87:0/3897522790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdbd40aea30 0x7fdbd41fa400 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:08.983 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.977+0000 7fdbd9fdc700 1 -- 172.21.15.87:0/3897522790 >> 172.21.15.87:0/3897522790 conn(0x7fdbd40cf410 msgr2=0x7fdbd40c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:08.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.977+0000 7fdbd9fdc700 1 -- 172.21.15.87:0/3897522790 shutdown_connections 2023-03-30T19:36:08.984 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:08.977+0000 7fdbd9fdc700 1 -- 172.21.15.87:0/3897522790 wait complete. 2023-03-30T19:36:08.984 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 3 to deep-scrub 2023-03-30T19:36:09.002 INFO:tasks.ceph:Scrubbing osd.4 2023-03-30T19:36:09.002 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-03-30T19:36:09.172 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.169+0000 7f1488b2d700 1 Processor -- start 2023-03-30T19:36:09.172 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.169+0000 7f1488b2d700 1 -- start start 2023-03-30T19:36:09.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.169+0000 7f1488b2d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f14840b8460 0x7f14840b4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:09.175 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.169+0000 7f1488b2d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f14840cd7e0 0x7f14840b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:09.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.169+0000 7f1488b2d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14840d27d0 0x7f1484069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:09.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.169+0000 7f1488b2d700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1484160f50 con 0x7f14840cd7e0 2023-03-30T19:36:09.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.169+0000 7f1488b2d700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148406c320 con 0x7f14840b8460 2023-03-30T19:36:09.176 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.169+0000 7f1488b2d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14840cd350 con 0x7f14840d27d0 2023-03-30T19:36:09.177 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.169+0000 7f1479d9b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f14840cd7e0 0x7f14840b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:09.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1479d9b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f14840cd7e0 0x7f14840b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55494/0 (socket says 172.21.15.87:55494) 2023-03-30T19:36:09.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1479d9b700 1 -- 172.21.15.87:0/1107660223 learned_addr learned my addr 172.21.15.87:0/1107660223 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:09.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1482d9d700 1 --2- 172.21.15.87:0/1107660223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14840d27d0 0x7f1484069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:09.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f148259c700 1 --2- 172.21.15.87:0/1107660223 >> v2:172.21.15.115:3300/0 conn(0x7f14840b8460 0x7f14840b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:09.178 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1479d9b700 1 -- 172.21.15.87:0/1107660223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14840d27d0 msgr2=0x7f1484069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:09.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1479d9b700 1 --2- 172.21.15.87:0/1107660223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14840d27d0 0x7f1484069cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:09.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1479d9b700 1 -- 172.21.15.87:0/1107660223 >> v2:172.21.15.115:3300/0 conn(0x7f14840b8460 msgr2=0x7f14840b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:09.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1479d9b700 1 --2- 172.21.15.87:0/1107660223 >> v2:172.21.15.115:3300/0 conn(0x7f14840b8460 0x7f14840b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:09.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1479d9b700 1 -- 172.21.15.87:0/1107660223 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14840b8830 con 0x7f14840cd7e0 2023-03-30T19:36:09.179 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1479d9b700 1 --2- 172.21.15.87:0/1107660223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14840cd7e0 0x7f14840b4cc0 secure :-1 s=READY pgs=3355 cs=0 l=1 rev1=1 crypto rx=0x7f148408bf80 tx=0x7f146c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7381ae543fb360a7 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:09.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1481d9b700 1 -- 172.21.15.87:0/1107660223 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c00e070 con 0x7f14840cd7e0 2023-03-30T19:36:09.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1481d9b700 1 -- 172.21.15.87:0/1107660223 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c00b8d0 con 0x7f14840cd7e0 2023-03-30T19:36:09.180 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1481d9b700 1 -- 172.21.15.87:0/1107660223 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c00bc80 con 0x7f14840cd7e0 2023-03-30T19:36:09.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1488b2d700 1 -- 172.21.15.87:0/1107660223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14840cd7e0 msgr2=0x7f14840b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:09.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1488b2d700 1 --2- 172.21.15.87:0/1107660223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14840cd7e0 0x7f14840b4cc0 secure :-1 s=READY pgs=3355 cs=0 l=1 rev1=1 crypto rx=0x7f148408bf80 tx=0x7f146c00b330 comp rx=0 tx=0).stop 2023-03-30T19:36:09.181 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1488b2d700 1 -- 172.21.15.87:0/1107660223 shutdown_connections 2023-03-30T19:36:09.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1488b2d700 1 --2- 172.21.15.87:0/1107660223 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14840d27d0 0x7f1484069cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:09.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1488b2d700 1 --2- 172.21.15.87:0/1107660223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14840cd7e0 0x7f14840b4cc0 unknown :-1 s=CLOSED pgs=3355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:09.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1488b2d700 1 --2- 172.21.15.87:0/1107660223 >> v2:172.21.15.115:3300/0 conn(0x7f14840b8460 0x7f14840b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:09.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1488b2d700 1 -- 172.21.15.87:0/1107660223 >> 172.21.15.87:0/1107660223 conn(0x7f14840cf780 msgr2=0x7f14840cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:09.182 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1488b2d700 1 -- 172.21.15.87:0/1107660223 shutdown_connections 2023-03-30T19:36:09.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.173+0000 7f1488b2d700 1 -- 172.21.15.87:0/1107660223 wait complete. 2023-03-30T19:36:09.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.177+0000 7f1488b2d700 1 Processor -- start 2023-03-30T19:36:09.183 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.177+0000 7f1488b2d700 1 -- start start 2023-03-30T19:36:09.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1488b2d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14840b8460 0x7f1484157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:09.184 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1488b2d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14840cd7e0 0x7f148414d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:09.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1488b2d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14840d27d0 0x7f14840c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:09.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1488b2d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14840b2280 con 0x7f14840d27d0 2023-03-30T19:36:09.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1488b2d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14840c7a60 con 0x7f14840cd7e0 2023-03-30T19:36:09.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1488b2d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14840c83f0 con 0x7f14840b8460 2023-03-30T19:36:09.185 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1482d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14840d27d0 0x7f14840c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:09.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1482d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14840d27d0 0x7f14840c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55500/0 (socket says 172.21.15.87:55500) 2023-03-30T19:36:09.186 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1482d9d700 1 -- 172.21.15.87:0/271622619 learned_addr learned my addr 172.21.15.87:0/271622619 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:09.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f148259c700 1 --2- 172.21.15.87:0/271622619 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14840b8460 0x7f1484157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:09.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1479d9b700 1 --2- 172.21.15.87:0/271622619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14840cd7e0 0x7f148414d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:09.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1482d9d700 1 -- 172.21.15.87:0/271622619 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14840b8460 msgr2=0x7f1484157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:09.187 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1482d9d700 1 --2- 172.21.15.87:0/271622619 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14840b8460 0x7f1484157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:09.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1482d9d700 1 -- 172.21.15.87:0/271622619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14840cd7e0 msgr2=0x7f148414d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:09.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1482d9d700 1 --2- 172.21.15.87:0/271622619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14840cd7e0 0x7f148414d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:09.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1482d9d700 1 -- 172.21.15.87:0/271622619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c009b30 con 0x7f14840d27d0 2023-03-30T19:36:09.188 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1482d9d700 1 --2- 172.21.15.87:0/271622619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14840d27d0 0x7f14840c8e40 secure :-1 s=READY pgs=3356 cs=0 l=1 rev1=1 crypto rx=0x7f147c00e820 tx=0x7f147c00eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:09.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f147b7fe700 1 -- 172.21.15.87:0/271622619 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c0095c0 con 0x7f14840d27d0 2023-03-30T19:36:09.189 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f147b7fe700 1 -- 172.21.15.87:0/271622619 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c013680 con 0x7f14840d27d0 2023-03-30T19:36:09.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f147b7fe700 1 -- 172.21.15.87:0/271622619 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c013a10 con 0x7f14840d27d0 2023-03-30T19:36:09.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1488b2d700 1 -- 172.21.15.87:0/271622619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14841609b0 con 0x7f14840d27d0 2023-03-30T19:36:09.190 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1488b2d700 1 -- 172.21.15.87:0/271622619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14840ceeb0 con 0x7f14840d27d0 2023-03-30T19:36:09.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.181+0000 7f1488b2d700 1 -- 172.21.15.87:0/271622619 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1484160c70 con 0x7f14840d27d0 2023-03-30T19:36:09.191 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.185+0000 7f147b7fe700 1 -- 172.21.15.87:0/271622619 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f147c013b70 con 0x7f14840d27d0 2023-03-30T19:36:09.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.185+0000 7f147b7fe700 1 --2- 172.21.15.87:0/271622619 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f14640653f0 0x7f14640678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:09.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.185+0000 7f147b7fe700 1 -- 172.21.15.87:0/271622619 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f147c082440 con 0x7f14840d27d0 2023-03-30T19:36:09.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.185+0000 7f148259c700 1 --2- 172.21.15.87:0/271622619 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f14640653f0 0x7f14640678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:09.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.185+0000 7f147b7fe700 1 --2- 172.21.15.87:0/271622619 >> [v2:172.21.15.115:6800/33985,v1:172.21.15.115:6801/33985] conn(0x7f146406bd00 0x7f146406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:09.192 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.185+0000 7f147b7fe700 1 -- 172.21.15.87:0/271622619 --> [v2:172.21.15.115:6800/33985,v1:172.21.15.115:6801/33985] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f146406e800 con 0x7f146406bd00 2023-03-30T19:36:09.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.185+0000 7f147b7fe700 1 -- 172.21.15.87:0/271622619 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f147c084a20 con 0x7f14840d27d0 2023-03-30T19:36:09.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.185+0000 7f1479d9b700 1 --2- 172.21.15.87:0/271622619 >> [v2:172.21.15.115:6800/33985,v1:172.21.15.115:6801/33985] conn(0x7f146406bd00 0x7f146406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:09.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.185+0000 7f148259c700 1 --2- 172.21.15.87:0/271622619 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f14640653f0 0x7f14640678a0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f14841f5640 tx=0x7f1474008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:09.193 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.189+0000 7f1479d9b700 1 --2- 172.21.15.87:0/271622619 >> [v2:172.21.15.115:6800/33985,v1:172.21.15.115:6801/33985] conn(0x7f146406bd00 0x7f146406e130 crc :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:09.804 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.801+0000 7f147b7fe700 1 -- 172.21.15.87:0/271622619 <== osd.4 v2:172.21.15.115:6800/33985 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f146406e800 con 0x7f146406bd00 2023-03-30T19:36:09.825 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.821+0000 7f1488b2d700 1 -- 172.21.15.87:0/271622619 --> [v2:172.21.15.115:6800/33985,v1:172.21.15.115:6801/33985] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1484073ee0 con 0x7f146406bd00 2023-03-30T19:36:09.889 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.885+0000 7f147b7fe700 1 -- 172.21.15.87:0/271622619 <== osd.4 v2:172.21.15.115:6800/33985 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1484073ee0 con 0x7f146406bd00 2023-03-30T19:36:09.890 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-03-30T19:36:09.891 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-03-30T19:36:09.891 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-03-30T19:36:09.893 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.885+0000 7f1488b2d700 1 -- 172.21.15.87:0/271622619 >> [v2:172.21.15.115:6800/33985,v1:172.21.15.115:6801/33985] conn(0x7f146406bd00 msgr2=0x7f146406e130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:09.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.885+0000 7f1488b2d700 1 --2- 172.21.15.87:0/271622619 >> [v2:172.21.15.115:6800/33985,v1:172.21.15.115:6801/33985] conn(0x7f146406bd00 0x7f146406e130 crc :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:09.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.885+0000 7f1488b2d700 1 -- 172.21.15.87:0/271622619 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f14640653f0 msgr2=0x7f14640678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:09.895 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.885+0000 7f1488b2d700 1 --2- 172.21.15.87:0/271622619 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f14640653f0 0x7f14640678a0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f14841f5640 tx=0x7f1474008040 comp rx=0 tx=0).stop 2023-03-30T19:36:09.895 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.885+0000 7f1488b2d700 1 -- 172.21.15.87:0/271622619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14840d27d0 msgr2=0x7f14840c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:09.895 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.885+0000 7f1488b2d700 1 --2- 172.21.15.87:0/271622619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f14840d27d0 0x7f14840c8e40 secure :-1 s=READY pgs=3356 cs=0 l=1 rev1=1 crypto rx=0x7f147c00e820 tx=0x7f147c00eb30 comp rx=0 tx=0).stop 2023-03-30T19:36:09.896 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.885+0000 7f1482d9d700 1 -- 172.21.15.87:0/271622619 reap_dead start 2023-03-30T19:36:09.896 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.885+0000 7f1488b2d700 1 -- 172.21.15.87:0/271622619 shutdown_connections 2023-03-30T19:36:09.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.885+0000 7f1488b2d700 1 -- 172.21.15.87:0/271622619 >> 172.21.15.87:0/271622619 conn(0x7f14840cf780 msgr2=0x7f14840d2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:09.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.885+0000 7f1488b2d700 1 -- 172.21.15.87:0/271622619 shutdown_connections 2023-03-30T19:36:09.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:09.885+0000 7f1488b2d700 1 -- 172.21.15.87:0/271622619 wait complete. 2023-03-30T19:36:09.917 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-03-30T19:36:10.085 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.081+0000 7f383105b700 1 Processor -- start 2023-03-30T19:36:10.086 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.081+0000 7f383105b700 1 -- start start 2023-03-30T19:36:10.088 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.081+0000 7f383105b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f382c0cd8e0 0x7f382c070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:10.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.081+0000 7f383105b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f382c0cc980 0x7f382c070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:10.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.081+0000 7f383105b700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382c06c710 con 0x7f382c0adb80 2023-03-30T19:36:10.089 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.081+0000 7f383105b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c06be20 con 0x7f382c0cd8e0 2023-03-30T19:36:10.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.081+0000 7f383105b700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c0adf50 con 0x7f382c0cc980 2023-03-30T19:36:10.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f382b59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f382c0cc980 0x7f382c070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:10.090 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f382b59e700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f382c0cc980 0x7f382c070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:41824/0 (socket says 172.21.15.87:41824) 2023-03-30T19:36:10.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f382b59e700 1 -- 172.21.15.87:0/2405114640 learned_addr learned my addr 172.21.15.87:0/2405114640 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:10.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f382a59c700 1 --2- 172.21.15.87:0/2405114640 >> v2:172.21.15.87:3300/0 conn(0x7f382c0cd8e0 0x7f382c070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:10.091 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f382ad9d700 1 --1- 172.21.15.87:0/2405114640 >> v1:172.21.15.115:6789/0 conn(0x7f382c0adb80 0x7f382c06cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:35868/0 (socket says 172.21.15.87:35868) 2023-03-30T19:36:10.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f382b59e700 1 -- 172.21.15.87:0/2405114640 >> v2:172.21.15.87:3300/0 conn(0x7f382c0cd8e0 msgr2=0x7f382c070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:10.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f382b59e700 1 --2- 172.21.15.87:0/2405114640 >> v2:172.21.15.87:3300/0 conn(0x7f382c0cd8e0 0x7f382c070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f3829d9b700 1 -- 172.21.15.87:0/2405114640 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389346610 0 0) 0x7f382c06c710 con 0x7f382c0adb80 2023-03-30T19:36:10.094 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f382b59e700 1 -- 172.21.15.87:0/2405114640 >> v1:172.21.15.115:6789/0 conn(0x7f382c0adb80 legacy=0x7f382c06cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:10.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f382b59e700 1 -- 172.21.15.87:0/2405114640 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c06c0c0 con 0x7f382c0cc980 2023-03-30T19:36:10.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f382b59e700 1 --2- 172.21.15.87:0/2405114640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f382c0cc980 0x7f382c070960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f382c06d830 tx=0x7f382400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e3974acc351fa6 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:10.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f3829d9b700 1 -- 172.21.15.87:0/2405114640 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382400e070 con 0x7f382c0cc980 2023-03-30T19:36:10.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f3829d9b700 1 -- 172.21.15.87:0/2405114640 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382400b910 con 0x7f382c0cc980 2023-03-30T19:36:10.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f3829d9b700 1 -- 172.21.15.87:0/2405114640 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382400bcc0 con 0x7f382c0cc980 2023-03-30T19:36:10.095 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f383105b700 1 -- 172.21.15.87:0/2405114640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f382c0cc980 msgr2=0x7f382c070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:10.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f383105b700 1 --2- 172.21.15.87:0/2405114640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f382c0cc980 0x7f382c070960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f382c06d830 tx=0x7f382400b330 comp rx=0 tx=0).stop 2023-03-30T19:36:10.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f383105b700 1 -- 172.21.15.87:0/2405114640 shutdown_connections 2023-03-30T19:36:10.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f383105b700 1 --2- 172.21.15.87:0/2405114640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f382c0cc980 0x7f382c070960 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f383105b700 1 --2- 172.21.15.87:0/2405114640 >> v2:172.21.15.87:3300/0 conn(0x7f382c0cd8e0 0x7f382c070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.096 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f383105b700 1 -- 172.21.15.87:0/2405114640 >> 172.21.15.87:0/2405114640 conn(0x7f382c0ce960 msgr2=0x7f382c0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:10.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f383105b700 1 -- 172.21.15.87:0/2405114640 shutdown_connections 2023-03-30T19:36:10.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.085+0000 7f383105b700 1 -- 172.21.15.87:0/2405114640 wait complete. 2023-03-30T19:36:10.097 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.089+0000 7f383105b700 1 Processor -- start 2023-03-30T19:36:10.098 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.089+0000 7f383105b700 1 -- start start 2023-03-30T19:36:10.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.089+0000 7f383105b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f382c0adb80 0x7f382c0ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:10.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f382ad9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f382c0adb80 0x7f382c0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:10.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f383105b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f382c0cc980 0x7f382c0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:10.099 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f382ad9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f382c0adb80 0x7f382c0ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54262/0 (socket says 172.21.15.87:54262) 2023-03-30T19:36:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f383105b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f382c0cd8e0 0x7f382c0c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f382ad9d700 1 -- 172.21.15.87:0/2494372709 learned_addr learned my addr 172.21.15.87:0/2494372709 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f383105b700 1 -- 172.21.15.87:0/2494372709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0aca80 con 0x7f382c0adb80 2023-03-30T19:36:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f383105b700 1 -- 172.21.15.87:0/2494372709 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0abf00 con 0x7f382c0cd8e0 2023-03-30T19:36:10.100 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f383105b700 1 -- 172.21.15.87:0/2494372709 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0ac1e0 con 0x7f382c0cc980 2023-03-30T19:36:10.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f382ad9d700 1 -- 172.21.15.87:0/2494372709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f382c0cc980 msgr2=0x7f382c0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:10.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f382ad9d700 1 --2- 172.21.15.87:0/2494372709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f382c0cc980 0x7f382c0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f382ad9d700 1 -- 172.21.15.87:0/2494372709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f382c0cd8e0 msgr2=0x7f382c0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:10.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f382ad9d700 1 --2- 172.21.15.87:0/2494372709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f382c0cd8e0 0x7f382c0c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.101 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f382ad9d700 1 -- 172.21.15.87:0/2494372709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3824009b30 con 0x7f382c0adb80 2023-03-30T19:36:10.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f382ad9d700 1 --2- 172.21.15.87:0/2494372709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f382c0adb80 0x7f382c0ab8e0 secure :-1 s=READY pgs=3357 cs=0 l=1 rev1=1 crypto rx=0x7f381c001eb0 tx=0x7f381c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:10.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f38137fe700 1 -- 172.21.15.87:0/2494372709 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c004c80 con 0x7f382c0adb80 2023-03-30T19:36:10.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f38137fe700 1 -- 172.21.15.87:0/2494372709 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c004de0 con 0x7f382c0adb80 2023-03-30T19:36:10.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f383105b700 1 -- 172.21.15.87:0/2494372709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382c0cde30 con 0x7f382c0adb80 2023-03-30T19:36:10.102 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f38137fe700 1 -- 172.21.15.87:0/2494372709 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c0062f0 con 0x7f382c0adb80 2023-03-30T19:36:10.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f383105b700 1 -- 172.21.15.87:0/2494372709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c06c3a0 con 0x7f382c0adb80 2023-03-30T19:36:10.103 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.093+0000 7f383105b700 1 -- 172.21.15.87:0/2494372709 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c0cdfc0 con 0x7f382c0adb80 2023-03-30T19:36:10.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.097+0000 7f38137fe700 1 -- 172.21.15.87:0/2494372709 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f381c006450 con 0x7f382c0adb80 2023-03-30T19:36:10.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.097+0000 7f38137fe700 1 --2- 172.21.15.87:0/2494372709 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f38180653f0 0x7f38180678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:10.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.097+0000 7f38137fe700 1 -- 172.21.15.87:0/2494372709 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f381c081ca0 con 0x7f382c0adb80 2023-03-30T19:36:10.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.097+0000 7f382a59c700 1 --2- 172.21.15.87:0/2494372709 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f38180653f0 0x7f38180678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:10.104 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.097+0000 7f382a59c700 1 --2- 172.21.15.87:0/2494372709 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f38180653f0 0x7f38180678a0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f382c1f4d30 tx=0x7f38200095b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:10.110 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.105+0000 7f38137fe700 1 -- 172.21.15.87:0/2494372709 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f381c04fa60 con 0x7f382c0adb80 2023-03-30T19:36:10.279 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.273+0000 7f383105b700 1 -- 172.21.15.87:0/2494372709 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f382c073ee0 con 0x7f38180653f0 2023-03-30T19:36:10.280 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.277+0000 7f38137fe700 1 -- 172.21.15.87:0/2494372709 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f382c073ee0 con 0x7f38180653f0 2023-03-30T19:36:10.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.277+0000 7f383105b700 1 -- 172.21.15.87:0/2494372709 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f38180653f0 msgr2=0x7f38180678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:10.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.277+0000 7f383105b700 1 --2- 172.21.15.87:0/2494372709 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f38180653f0 0x7f38180678a0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f382c1f4d30 tx=0x7f38200095b0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.277+0000 7f383105b700 1 -- 172.21.15.87:0/2494372709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f382c0adb80 msgr2=0x7f382c0ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:10.283 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.277+0000 7f383105b700 1 --2- 172.21.15.87:0/2494372709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f382c0adb80 0x7f382c0ab8e0 secure :-1 s=READY pgs=3357 cs=0 l=1 rev1=1 crypto rx=0x7f381c001eb0 tx=0x7f381c00c8b0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.277+0000 7f383105b700 1 -- 172.21.15.87:0/2494372709 shutdown_connections 2023-03-30T19:36:10.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.277+0000 7f383105b700 1 --2- 172.21.15.87:0/2494372709 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f38180653f0 0x7f38180678a0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.277+0000 7f383105b700 1 --2- 172.21.15.87:0/2494372709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f382c0cd8e0 0x7f382c0c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.277+0000 7f383105b700 1 --2- 172.21.15.87:0/2494372709 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f382c0cc980 0x7f382c0c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.284 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.277+0000 7f383105b700 1 --2- 172.21.15.87:0/2494372709 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f382c0adb80 0x7f382c0ab8e0 unknown :-1 s=CLOSED pgs=3357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.277+0000 7f383105b700 1 -- 172.21.15.87:0/2494372709 >> 172.21.15.87:0/2494372709 conn(0x7f382c0ce960 msgr2=0x7f382c0ae3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:10.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.277+0000 7f383105b700 1 -- 172.21.15.87:0/2494372709 shutdown_connections 2023-03-30T19:36:10.285 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.277+0000 7f383105b700 1 -- 172.21.15.87:0/2494372709 wait complete. 2023-03-30T19:36:10.286 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 4 to deep-scrub 2023-03-30T19:36:10.304 INFO:tasks.ceph:Scrubbing osd.5 2023-03-30T19:36:10.304 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-03-30T19:36:10.469 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.465+0000 7f0fa05f2700 1 Processor -- start 2023-03-30T19:36:10.470 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.465+0000 7f0fa05f2700 1 -- start start 2023-03-30T19:36:10.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0fa05f2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f980adb80 0x7f0f9806cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:10.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0fa05f2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0f980cd8e0 0x7f0f98070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:10.472 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0fa05f2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0f980cc980 0x7f0f98070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:10.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0fa05f2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9806c710 con 0x7f0f980cd8e0 2023-03-30T19:36:10.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0fa05f2700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9806be20 con 0x7f0f980cc980 2023-03-30T19:36:10.473 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0fa05f2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f980adf50 con 0x7f0f980adb80 2023-03-30T19:36:10.474 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0f9db8d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0f980cd8e0 0x7f0f98070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:10.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0f9db8d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0f980cd8e0 0x7f0f98070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54276/0 (socket says 172.21.15.87:54276) 2023-03-30T19:36:10.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0f9db8d700 1 -- 172.21.15.87:0/508742630 learned_addr learned my addr 172.21.15.87:0/508742630 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:10.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0f9eb8f700 1 --2- 172.21.15.87:0/508742630 >> v2:172.21.15.115:3300/0 conn(0x7f0f980cc980 0x7f0f98070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:10.475 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0f9e38e700 1 --2- 172.21.15.87:0/508742630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f980adb80 0x7f0f9806cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:10.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0f9db8d700 1 -- 172.21.15.87:0/508742630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f980adb80 msgr2=0x7f0f9806cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:10.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0f9db8d700 1 --2- 172.21.15.87:0/508742630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f980adb80 0x7f0f9806cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0f9db8d700 1 -- 172.21.15.87:0/508742630 >> v2:172.21.15.115:3300/0 conn(0x7f0f980cc980 msgr2=0x7f0f98070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:10.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0f9db8d700 1 --2- 172.21.15.87:0/508742630 >> v2:172.21.15.115:3300/0 conn(0x7f0f980cc980 0x7f0f98070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0f9db8d700 1 -- 172.21.15.87:0/508742630 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9806c0c0 con 0x7f0f980cd8e0 2023-03-30T19:36:10.476 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0f9e38e700 1 --2- 172.21.15.87:0/508742630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f980adb80 0x7f0f9806cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-30T19:36:10.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0f9db8d700 1 --2- 172.21.15.87:0/508742630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f980cd8e0 0x7f0f98070420 secure :-1 s=READY pgs=3358 cs=0 l=1 rev1=1 crypto rx=0x7f0f98070fe0 tx=0x7f0f88009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e594c8e57fd34078 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:10.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0f9d38c700 1 -- 172.21.15.87:0/508742630 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8800b8a0 con 0x7f0f980cd8e0 2023-03-30T19:36:10.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0f9d38c700 1 -- 172.21.15.87:0/508742630 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8800ba00 con 0x7f0f980cd8e0 2023-03-30T19:36:10.477 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0f9d38c700 1 -- 172.21.15.87:0/508742630 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8800bd90 con 0x7f0f980cd8e0 2023-03-30T19:36:10.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0fa05f2700 1 -- 172.21.15.87:0/508742630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f980cd8e0 msgr2=0x7f0f98070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:10.478 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.469+0000 7f0fa05f2700 1 --2- 172.21.15.87:0/508742630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f980cd8e0 0x7f0f98070420 secure :-1 s=READY pgs=3358 cs=0 l=1 rev1=1 crypto rx=0x7f0f98070fe0 tx=0x7f0f88009bf0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.473+0000 7f0fa05f2700 1 -- 172.21.15.87:0/508742630 shutdown_connections 2023-03-30T19:36:10.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.473+0000 7f0fa05f2700 1 --2- 172.21.15.87:0/508742630 >> v2:172.21.15.115:3300/0 conn(0x7f0f980cc980 0x7f0f98070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.473+0000 7f0fa05f2700 1 --2- 172.21.15.87:0/508742630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f980cd8e0 0x7f0f98070420 unknown :-1 s=CLOSED pgs=3358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.473+0000 7f0fa05f2700 1 --2- 172.21.15.87:0/508742630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f980adb80 0x7f0f9806cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.479 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.473+0000 7f0fa05f2700 1 -- 172.21.15.87:0/508742630 >> 172.21.15.87:0/508742630 conn(0x7f0f980ce960 msgr2=0x7f0f980ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:10.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.473+0000 7f0fa05f2700 1 -- 172.21.15.87:0/508742630 shutdown_connections 2023-03-30T19:36:10.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.473+0000 7f0fa05f2700 1 -- 172.21.15.87:0/508742630 wait complete. 2023-03-30T19:36:10.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.473+0000 7f0fa05f2700 1 Processor -- start 2023-03-30T19:36:10.480 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.473+0000 7f0fa05f2700 1 -- start start 2023-03-30T19:36:10.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.473+0000 7f0fa05f2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f980adb80 0x7f0f981509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:10.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.473+0000 7f0fa05f2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f980cc980 0x7f0f980ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:10.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.473+0000 7f0fa05f2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f980cd8e0 0x7f0f980aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:10.482 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0fa05f2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f98165710 con 0x7f0f980cd8e0 2023-03-30T19:36:10.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0fa05f2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f981519e0 con 0x7f0f980adb80 2023-03-30T19:36:10.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0fa05f2700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f98165430 con 0x7f0f980cc980 2023-03-30T19:36:10.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0f9eb8f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f980cd8e0 0x7f0f980aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:10.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0f9eb8f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f980cd8e0 0x7f0f980aeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54290/0 (socket says 172.21.15.87:54290) 2023-03-30T19:36:10.483 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0f9eb8f700 1 -- 172.21.15.87:0/2882562879 learned_addr learned my addr 172.21.15.87:0/2882562879 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:10.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0f9e38e700 1 --2- 172.21.15.87:0/2882562879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f980adb80 0x7f0f981509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:10.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0f9db8d700 1 --2- 172.21.15.87:0/2882562879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f980cc980 0x7f0f980ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:10.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0f9eb8f700 1 -- 172.21.15.87:0/2882562879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f980cc980 msgr2=0x7f0f980ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:10.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0f9eb8f700 1 --2- 172.21.15.87:0/2882562879 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0f980cc980 0x7f0f980ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.484 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0f9eb8f700 1 -- 172.21.15.87:0/2882562879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f980adb80 msgr2=0x7f0f981509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:10.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0f9eb8f700 1 --2- 172.21.15.87:0/2882562879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f980adb80 0x7f0f981509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0f9eb8f700 1 -- 172.21.15.87:0/2882562879 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f88009570 con 0x7f0f980cd8e0 2023-03-30T19:36:10.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0f9eb8f700 1 --2- 172.21.15.87:0/2882562879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f980cd8e0 0x7f0f980aeac0 secure :-1 s=READY pgs=3359 cs=0 l=1 rev1=1 crypto rx=0x7f0f90007e70 tx=0x7f0f9000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:10.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0f8effd700 1 -- 172.21.15.87:0/2882562879 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9000ee50 con 0x7f0f980cd8e0 2023-03-30T19:36:10.485 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0f8effd700 1 -- 172.21.15.87:0/2882562879 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f90014420 con 0x7f0f980cd8e0 2023-03-30T19:36:10.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0f8effd700 1 -- 172.21.15.87:0/2882562879 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f900147d0 con 0x7f0f980cd8e0 2023-03-30T19:36:10.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0fa05f2700 1 -- 172.21.15.87:0/2882562879 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9806d0e0 con 0x7f0f980cd8e0 2023-03-30T19:36:10.486 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0fa05f2700 1 -- 172.21.15.87:0/2882562879 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9806c3a0 con 0x7f0f980cd8e0 2023-03-30T19:36:10.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.477+0000 7f0fa05f2700 1 -- 172.21.15.87:0/2882562879 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f980cde30 con 0x7f0f980cd8e0 2023-03-30T19:36:10.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.481+0000 7f0f8effd700 1 -- 172.21.15.87:0/2882562879 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f0f90014930 con 0x7f0f980cd8e0 2023-03-30T19:36:10.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.481+0000 7f0f8effd700 1 --2- 172.21.15.87:0/2882562879 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0f7c0653f0 0x7f0f7c0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:10.487 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.481+0000 7f0f8effd700 1 -- 172.21.15.87:0/2882562879 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0f90082de0 con 0x7f0f980cd8e0 2023-03-30T19:36:10.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.481+0000 7f0f9e38e700 1 --2- 172.21.15.87:0/2882562879 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0f7c0653f0 0x7f0f7c0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:10.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.481+0000 7f0f8effd700 1 --2- 172.21.15.87:0/2882562879 >> [v2:172.21.15.115:6816/33989,v1:172.21.15.115:6817/33989] conn(0x7f0f7c06bd00 0x7f0f7c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:10.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.481+0000 7f0f8effd700 1 -- 172.21.15.87:0/2882562879 --> [v2:172.21.15.115:6816/33989,v1:172.21.15.115:6817/33989] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f7c06e800 con 0x7f0f7c06bd00 2023-03-30T19:36:10.488 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.481+0000 7f0f8effd700 1 -- 172.21.15.87:0/2882562879 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f90085480 con 0x7f0f980cd8e0 2023-03-30T19:36:10.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.481+0000 7f0f9db8d700 1 --2- 172.21.15.87:0/2882562879 >> [v2:172.21.15.115:6816/33989,v1:172.21.15.115:6817/33989] conn(0x7f0f7c06bd00 0x7f0f7c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:10.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.485+0000 7f0f9e38e700 1 --2- 172.21.15.87:0/2882562879 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0f7c0653f0 0x7f0f7c0678a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f0f94006fd0 tx=0x7f0f94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:10.489 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.485+0000 7f0f9db8d700 1 --2- 172.21.15.87:0/2882562879 >> [v2:172.21.15.115:6816/33989,v1:172.21.15.115:6817/33989] conn(0x7f0f7c06bd00 0x7f0f7c06e130 crc :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:10.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.713+0000 7f0f8effd700 1 -- 172.21.15.87:0/2882562879 <== osd.5 v2:172.21.15.115:6816/33989 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0f7c06e800 con 0x7f0f7c06bd00 2023-03-30T19:36:10.738 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.733+0000 7f0fa05f2700 1 -- 172.21.15.87:0/2882562879 --> [v2:172.21.15.115:6816/33989,v1:172.21.15.115:6817/33989] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0f98073ee0 con 0x7f0f7c06bd00 2023-03-30T19:36:10.826 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.821+0000 7f0f8effd700 1 -- 172.21.15.87:0/2882562879 <== osd.5 v2:172.21.15.115:6816/33989 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0f98073ee0 con 0x7f0f7c06bd00 2023-03-30T19:36:10.826 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-03-30T19:36:10.827 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-03-30T19:36:10.827 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-03-30T19:36:10.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.821+0000 7f0fa05f2700 1 -- 172.21.15.87:0/2882562879 >> [v2:172.21.15.115:6816/33989,v1:172.21.15.115:6817/33989] conn(0x7f0f7c06bd00 msgr2=0x7f0f7c06e130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:10.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.821+0000 7f0fa05f2700 1 --2- 172.21.15.87:0/2882562879 >> [v2:172.21.15.115:6816/33989,v1:172.21.15.115:6817/33989] conn(0x7f0f7c06bd00 0x7f0f7c06e130 crc :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.828 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.821+0000 7f0fa05f2700 1 -- 172.21.15.87:0/2882562879 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0f7c0653f0 msgr2=0x7f0f7c0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:10.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.821+0000 7f0fa05f2700 1 --2- 172.21.15.87:0/2882562879 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f0f7c0653f0 0x7f0f7c0678a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f0f94006fd0 tx=0x7f0f94008040 comp rx=0 tx=0).stop 2023-03-30T19:36:10.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.821+0000 7f0fa05f2700 1 -- 172.21.15.87:0/2882562879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f980cd8e0 msgr2=0x7f0f980aeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:10.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.821+0000 7f0fa05f2700 1 --2- 172.21.15.87:0/2882562879 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0f980cd8e0 0x7f0f980aeac0 secure :-1 s=READY pgs=3359 cs=0 l=1 rev1=1 crypto rx=0x7f0f90007e70 tx=0x7f0f9000e3c0 comp rx=0 tx=0).stop 2023-03-30T19:36:10.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.821+0000 7f0f9eb8f700 1 -- 172.21.15.87:0/2882562879 reap_dead start 2023-03-30T19:36:10.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.821+0000 7f0fa05f2700 1 -- 172.21.15.87:0/2882562879 shutdown_connections 2023-03-30T19:36:10.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.821+0000 7f0fa05f2700 1 -- 172.21.15.87:0/2882562879 >> 172.21.15.87:0/2882562879 conn(0x7f0f980ce960 msgr2=0x7f0f980ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:10.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.825+0000 7f0fa05f2700 1 -- 172.21.15.87:0/2882562879 shutdown_connections 2023-03-30T19:36:10.830 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:10.825+0000 7f0fa05f2700 1 -- 172.21.15.87:0/2882562879 wait complete. 2023-03-30T19:36:10.852 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-03-30T19:36:11.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.017+0000 7fee35701700 1 Processor -- start 2023-03-30T19:36:11.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.017+0000 7fee35701700 1 -- start start 2023-03-30T19:36:11.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee35701700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fee30159050 0x7fee30069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee35701700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee3015cba0 0x7fee300cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee35701700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee300afca0 con 0x7fee300ca4b0 2023-03-30T19:36:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee35701700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee300afb10 con 0x7fee30159050 2023-03-30T19:36:11.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee35701700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3015d110 con 0x7fee3015cba0 2023-03-30T19:36:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee2effd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fee30159050 0x7fee30069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee2f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fee300ca4b0 0x7fee300b0130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:35878/0 (socket says 172.21.15.87:35878) 2023-03-30T19:36:11.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee2f7fe700 1 -- 172.21.15.87:0/714067325 learned_addr learned my addr 172.21.15.87:0/714067325 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:36:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee27fff700 1 --2- 172.21.15.87:0/714067325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee3015cba0 0x7fee300cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee2e7fc700 1 -- 172.21.15.87:0/714067325 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587628911 0 0) 0x7fee300afca0 con 0x7fee300ca4b0 2023-03-30T19:36:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee2e7fc700 1 -- 172.21.15.87:0/714067325 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee1c0035d0 con 0x7fee300ca4b0 2023-03-30T19:36:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee2effd700 1 -- 172.21.15.87:0/714067325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee3015cba0 msgr2=0x7fee300cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:11.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee2effd700 1 --2- 172.21.15.87:0/714067325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee3015cba0 0x7fee300cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee2effd700 1 -- 172.21.15.87:0/714067325 >> v1:172.21.15.115:6789/0 conn(0x7fee300ca4b0 legacy=0x7fee300b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee2effd700 1 -- 172.21.15.87:0/714067325 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3015d3f0 con 0x7fee30159050 2023-03-30T19:36:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee2effd700 1 --2- 172.21.15.87:0/714067325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee30159050 0x7fee30069cd0 secure :-1 s=READY pgs=3360 cs=0 l=1 rev1=1 crypto rx=0x7fee2000baf0 tx=0x7fee2000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3883c60f4471ec40 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee2e7fc700 1 -- 172.21.15.87:0/714067325 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2000dc70 con 0x7fee30159050 2023-03-30T19:36:11.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee2e7fc700 1 -- 172.21.15.87:0/714067325 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2000ddd0 con 0x7fee30159050 2023-03-30T19:36:11.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.021+0000 7fee2e7fc700 1 -- 172.21.15.87:0/714067325 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20010690 con 0x7fee30159050 2023-03-30T19:36:11.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.025+0000 7fee35701700 1 -- 172.21.15.87:0/714067325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee30159050 msgr2=0x7fee30069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.025+0000 7fee35701700 1 --2- 172.21.15.87:0/714067325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee30159050 0x7fee30069cd0 secure :-1 s=READY pgs=3360 cs=0 l=1 rev1=1 crypto rx=0x7fee2000baf0 tx=0x7fee2000be00 comp rx=0 tx=0).stop 2023-03-30T19:36:11.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.025+0000 7fee35701700 1 -- 172.21.15.87:0/714067325 shutdown_connections 2023-03-30T19:36:11.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.025+0000 7fee35701700 1 --2- 172.21.15.87:0/714067325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee3015cba0 0x7fee300cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.025+0000 7fee35701700 1 --2- 172.21.15.87:0/714067325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee30159050 0x7fee30069cd0 unknown :-1 s=CLOSED pgs=3360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.025+0000 7fee35701700 1 -- 172.21.15.87:0/714067325 >> 172.21.15.87:0/714067325 conn(0x7fee300cf410 msgr2=0x7fee300cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:11.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.025+0000 7fee35701700 1 -- 172.21.15.87:0/714067325 shutdown_connections 2023-03-30T19:36:11.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.025+0000 7fee35701700 1 -- 172.21.15.87:0/714067325 wait complete. 2023-03-30T19:36:11.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.025+0000 7fee35701700 1 Processor -- start 2023-03-30T19:36:11.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.025+0000 7fee35701700 1 -- start start 2023-03-30T19:36:11.033 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee35701700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee300ca4b0 0x7fee30158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee35701700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee30159050 0x7fee300c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee35701700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3015cba0 0x7fee300c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee35701700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3014b4b0 con 0x7fee300ca4b0 2023-03-30T19:36:11.034 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee35701700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee301588d0 con 0x7fee3015cba0 2023-03-30T19:36:11.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee35701700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee301e39e0 con 0x7fee30159050 2023-03-30T19:36:11.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee2effd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee300ca4b0 0x7fee30158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee2effd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee300ca4b0 0x7fee30158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54318/0 (socket says 172.21.15.87:54318) 2023-03-30T19:36:11.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee2effd700 1 -- 172.21.15.87:0/1686813128 learned_addr learned my addr 172.21.15.87:0/1686813128 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:11.035 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee2f7fe700 1 --2- 172.21.15.87:0/1686813128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3015cba0 0x7fee300c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.036 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee27fff700 1 --2- 172.21.15.87:0/1686813128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee30159050 0x7fee300c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee2effd700 1 -- 172.21.15.87:0/1686813128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee30159050 msgr2=0x7fee300c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee2effd700 1 --2- 172.21.15.87:0/1686813128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee30159050 0x7fee300c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee2effd700 1 -- 172.21.15.87:0/1686813128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3015cba0 msgr2=0x7fee300c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee2effd700 1 --2- 172.21.15.87:0/1686813128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3015cba0 0x7fee300c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee2effd700 1 -- 172.21.15.87:0/1686813128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2000b750 con 0x7fee300ca4b0 2023-03-30T19:36:11.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee2effd700 1 --2- 172.21.15.87:0/1686813128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee300ca4b0 0x7fee30158390 secure :-1 s=READY pgs=3361 cs=0 l=1 rev1=1 crypto rx=0x7fee2000b2c0 tx=0x7fee20004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:11.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee277fe700 1 -- 172.21.15.87:0/1686813128 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20003c10 con 0x7fee300ca4b0 2023-03-30T19:36:11.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee277fe700 1 -- 172.21.15.87:0/1686813128 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee20003d70 con 0x7fee300ca4b0 2023-03-30T19:36:11.038 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee277fe700 1 -- 172.21.15.87:0/1686813128 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20010670 con 0x7fee300ca4b0 2023-03-30T19:36:11.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee35701700 1 -- 172.21.15.87:0/1686813128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3015d9b0 con 0x7fee300ca4b0 2023-03-30T19:36:11.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.029+0000 7fee35701700 1 -- 172.21.15.87:0/1686813128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3015d6d0 con 0x7fee300ca4b0 2023-03-30T19:36:11.039 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.033+0000 7fee35701700 1 -- 172.21.15.87:0/1686813128 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee30159420 con 0x7fee300ca4b0 2023-03-30T19:36:11.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.033+0000 7fee277fe700 1 -- 172.21.15.87:0/1686813128 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fee20019400 con 0x7fee300ca4b0 2023-03-30T19:36:11.040 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.033+0000 7fee277fe700 1 --2- 172.21.15.87:0/1686813128 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fee100653f0 0x7fee100678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.037+0000 7fee277fe700 1 -- 172.21.15.87:0/1686813128 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fee20083fe0 con 0x7fee300ca4b0 2023-03-30T19:36:11.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.037+0000 7fee27fff700 1 --2- 172.21.15.87:0/1686813128 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fee100653f0 0x7fee100678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.041 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.037+0000 7fee27fff700 1 --2- 172.21.15.87:0/1686813128 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fee100653f0 0x7fee100678a0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fee300ad740 tx=0x7fee18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:11.045 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.041+0000 7fee277fe700 1 -- 172.21.15.87:0/1686813128 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fee20051e10 con 0x7fee300ca4b0 2023-03-30T19:36:11.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.213+0000 7fee35701700 1 -- 172.21.15.87:0/1686813128 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fee3014bed0 con 0x7fee100653f0 2023-03-30T19:36:11.220 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.213+0000 7fee277fe700 1 -- 172.21.15.87:0/1686813128 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fee18011720 con 0x7fee100653f0 2023-03-30T19:36:11.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.217+0000 7fee35701700 1 -- 172.21.15.87:0/1686813128 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fee100653f0 msgr2=0x7fee100678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.217+0000 7fee35701700 1 --2- 172.21.15.87:0/1686813128 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fee100653f0 0x7fee100678a0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fee300ad740 tx=0x7fee18008040 comp rx=0 tx=0).stop 2023-03-30T19:36:11.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.217+0000 7fee35701700 1 -- 172.21.15.87:0/1686813128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee300ca4b0 msgr2=0x7fee30158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.217+0000 7fee35701700 1 --2- 172.21.15.87:0/1686813128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee300ca4b0 0x7fee30158390 secure :-1 s=READY pgs=3361 cs=0 l=1 rev1=1 crypto rx=0x7fee2000b2c0 tx=0x7fee20004770 comp rx=0 tx=0).stop 2023-03-30T19:36:11.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.217+0000 7fee35701700 1 -- 172.21.15.87:0/1686813128 shutdown_connections 2023-03-30T19:36:11.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.217+0000 7fee35701700 1 --2- 172.21.15.87:0/1686813128 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fee100653f0 0x7fee100678a0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.217+0000 7fee35701700 1 --2- 172.21.15.87:0/1686813128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee3015cba0 0x7fee300c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.217+0000 7fee35701700 1 --2- 172.21.15.87:0/1686813128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee30159050 0x7fee300c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.217+0000 7fee35701700 1 --2- 172.21.15.87:0/1686813128 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fee300ca4b0 0x7fee30158390 unknown :-1 s=CLOSED pgs=3361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.217+0000 7fee35701700 1 -- 172.21.15.87:0/1686813128 >> 172.21.15.87:0/1686813128 conn(0x7fee300cf410 msgr2=0x7fee300cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:11.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.217+0000 7fee35701700 1 -- 172.21.15.87:0/1686813128 shutdown_connections 2023-03-30T19:36:11.225 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.217+0000 7fee35701700 1 -- 172.21.15.87:0/1686813128 wait complete. 2023-03-30T19:36:11.226 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 5 to deep-scrub 2023-03-30T19:36:11.242 INFO:tasks.ceph:Scrubbing osd.6 2023-03-30T19:36:11.243 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-03-30T19:36:11.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.405+0000 7f0316adc700 1 Processor -- start 2023-03-30T19:36:11.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.405+0000 7f0316adc700 1 -- start start 2023-03-30T19:36:11.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.409+0000 7f0316adc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03100b8380 0x7f03100d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.409+0000 7f0316adc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f03100d27e0 0x7f0310069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.409+0000 7f0316adc700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0310160ef0 con 0x7f03101609f0 2023-03-30T19:36:11.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.409+0000 7f0316adc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03100cd6a0 con 0x7f03100d27e0 2023-03-30T19:36:11.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.409+0000 7f0316adc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03100cd3a0 con 0x7f03100b8380 2023-03-30T19:36:11.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.409+0000 7f03152d9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f03100d27e0 0x7f0310069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.409+0000 7f03152d9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f03100d27e0 0x7f0310069cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54320/0 (socket says 172.21.15.87:54320) 2023-03-30T19:36:11.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.409+0000 7f03152d9700 1 -- 172.21.15.87:0/215258234 learned_addr learned my addr 172.21.15.87:0/215258234 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:11.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.409+0000 7f0315ada700 1 --2- 172.21.15.87:0/215258234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03100b8380 0x7f03100d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.409+0000 7f03152d9700 1 -- 172.21.15.87:0/215258234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03100b8380 msgr2=0x7f03100d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:11.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.409+0000 7f03152d9700 1 --2- 172.21.15.87:0/215258234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03100b8380 0x7f03100d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.409+0000 7f03152d9700 1 -- 172.21.15.87:0/215258234 >> v1:172.21.15.87:6789/0 conn(0x7f03101609f0 legacy=0x7f031006b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:11.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.409+0000 7f03152d9700 1 -- 172.21.15.87:0/215258234 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03100cef00 con 0x7f03100d27e0 2023-03-30T19:36:11.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.417+0000 7f03152d9700 1 --2- 172.21.15.87:0/215258234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03100d27e0 0x7f0310069cd0 secure :-1 s=READY pgs=3362 cs=0 l=1 rev1=1 crypto rx=0x7f0300009910 tx=0x7f0300009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2308be339a152c4 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:11.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.417+0000 7f0314ad8700 1 -- 172.21.15.87:0/215258234 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0300004230 con 0x7f03100d27e0 2023-03-30T19:36:11.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.417+0000 7f0314ad8700 1 -- 172.21.15.87:0/215258234 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0300004390 con 0x7f03100d27e0 2023-03-30T19:36:11.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.417+0000 7f0314ad8700 1 -- 172.21.15.87:0/215258234 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03000036c0 con 0x7f03100d27e0 2023-03-30T19:36:11.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.421+0000 7f0316adc700 1 -- 172.21.15.87:0/215258234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03100d27e0 msgr2=0x7f0310069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.421+0000 7f0316adc700 1 --2- 172.21.15.87:0/215258234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03100d27e0 0x7f0310069cd0 secure :-1 s=READY pgs=3362 cs=0 l=1 rev1=1 crypto rx=0x7f0300009910 tx=0x7f0300009c20 comp rx=0 tx=0).stop 2023-03-30T19:36:11.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.421+0000 7f0316adc700 1 -- 172.21.15.87:0/215258234 shutdown_connections 2023-03-30T19:36:11.426 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.421+0000 7f0316adc700 1 --2- 172.21.15.87:0/215258234 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03100d27e0 0x7f0310069cd0 unknown :-1 s=CLOSED pgs=3362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.421+0000 7f0316adc700 1 --2- 172.21.15.87:0/215258234 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03100b8380 0x7f03100d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.421+0000 7f0316adc700 1 -- 172.21.15.87:0/215258234 >> 172.21.15.87:0/215258234 conn(0x7f03100b53f0 msgr2=0x7f03100cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:11.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.421+0000 7f0316adc700 1 -- 172.21.15.87:0/215258234 shutdown_connections 2023-03-30T19:36:11.427 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.421+0000 7f0316adc700 1 -- 172.21.15.87:0/215258234 wait complete. 2023-03-30T19:36:11.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0316adc700 1 Processor -- start 2023-03-30T19:36:11.428 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0316adc700 1 -- start start 2023-03-30T19:36:11.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0316adc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03100b8380 0x7f0310151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.429 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0316adc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03101609f0 0x7f031015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0316adc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f031015aee0 0x7f031015e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0316adc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0310151770 con 0x7f03100b8380 2023-03-30T19:36:11.430 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0316adc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031015b360 con 0x7f03101609f0 2023-03-30T19:36:11.431 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0316adc700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031015ed50 con 0x7f031015aee0 2023-03-30T19:36:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0315ada700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03100b8380 0x7f0310151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0315ada700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03100b8380 0x7f0310151230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54336/0 (socket says 172.21.15.87:54336) 2023-03-30T19:36:11.432 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0315ada700 1 -- 172.21.15.87:0/1600934487 learned_addr learned my addr 172.21.15.87:0/1600934487 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f03162db700 1 --2- 172.21.15.87:0/1600934487 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f031015aee0 0x7f031015e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f03152d9700 1 --2- 172.21.15.87:0/1600934487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03101609f0 0x7f031015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0315ada700 1 -- 172.21.15.87:0/1600934487 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f031015aee0 msgr2=0x7f031015e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0315ada700 1 --2- 172.21.15.87:0/1600934487 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f031015aee0 0x7f031015e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0315ada700 1 -- 172.21.15.87:0/1600934487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03101609f0 msgr2=0x7f031015a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0315ada700 1 --2- 172.21.15.87:0/1600934487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03101609f0 0x7f031015a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0315ada700 1 -- 172.21.15.87:0/1600934487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300009570 con 0x7f03100b8380 2023-03-30T19:36:11.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.425+0000 7f0315ada700 1 --2- 172.21.15.87:0/1600934487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03100b8380 0x7f0310151230 secure :-1 s=READY pgs=3363 cs=0 l=1 rev1=1 crypto rx=0x7f030c00ebe0 tx=0x7f030c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:11.434 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.429+0000 7f03067fc700 1 -- 172.21.15.87:0/1600934487 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c009740 con 0x7f03100b8380 2023-03-30T19:36:11.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.429+0000 7f03067fc700 1 -- 172.21.15.87:0/1600934487 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030c00c850 con 0x7f03100b8380 2023-03-30T19:36:11.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.429+0000 7f0316adc700 1 -- 172.21.15.87:0/1600934487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03100cf480 con 0x7f03100b8380 2023-03-30T19:36:11.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.429+0000 7f03067fc700 1 -- 172.21.15.87:0/1600934487 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c00cbe0 con 0x7f03100b8380 2023-03-30T19:36:11.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.429+0000 7f0316adc700 1 -- 172.21.15.87:0/1600934487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03100cf1a0 con 0x7f03100b8380 2023-03-30T19:36:11.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.429+0000 7f0316adc700 1 -- 172.21.15.87:0/1600934487 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f03100b8750 con 0x7f03100b8380 2023-03-30T19:36:11.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.433+0000 7f03067fc700 1 -- 172.21.15.87:0/1600934487 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f030c00cd40 con 0x7f03100b8380 2023-03-30T19:36:11.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.433+0000 7f03067fc700 1 --2- 172.21.15.87:0/1600934487 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02f40653f0 0x7f02f40678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.433+0000 7f03067fc700 1 -- 172.21.15.87:0/1600934487 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f030c082680 con 0x7f03100b8380 2023-03-30T19:36:11.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.433+0000 7f03067fc700 1 --2- 172.21.15.87:0/1600934487 >> [v2:172.21.15.115:6824/33987,v1:172.21.15.115:6825/33987] conn(0x7f02f406bd00 0x7f02f406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.433+0000 7f03067fc700 1 -- 172.21.15.87:0/1600934487 --> [v2:172.21.15.115:6824/33987,v1:172.21.15.115:6825/33987] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f02f406e800 con 0x7f02f406bd00 2023-03-30T19:36:11.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.433+0000 7f03067fc700 1 -- 172.21.15.87:0/1600934487 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f030c084d20 con 0x7f03100b8380 2023-03-30T19:36:11.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.433+0000 7f03152d9700 1 --2- 172.21.15.87:0/1600934487 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02f40653f0 0x7f02f40678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.439 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.433+0000 7f03162db700 1 --2- 172.21.15.87:0/1600934487 >> [v2:172.21.15.115:6824/33987,v1:172.21.15.115:6825/33987] conn(0x7f02f406bd00 0x7f02f406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.433+0000 7f03152d9700 1 --2- 172.21.15.87:0/1600934487 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02f40653f0 0x7f02f40678a0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f03100d3db0 tx=0x7f0300008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:11.440 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.433+0000 7f03162db700 1 --2- 172.21.15.87:0/1600934487 >> [v2:172.21.15.115:6824/33987,v1:172.21.15.115:6825/33987] conn(0x7f02f406bd00 0x7f02f406e130 crc :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:11.611 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.605+0000 7f03067fc700 1 -- 172.21.15.87:0/1600934487 <== osd.6 v2:172.21.15.115:6824/33987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f02f406e800 con 0x7f02f406bd00 2023-03-30T19:36:11.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.625+0000 7f0316adc700 1 -- 172.21.15.87:0/1600934487 --> [v2:172.21.15.115:6824/33987,v1:172.21.15.115:6825/33987] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f03100733a0 con 0x7f02f406bd00 2023-03-30T19:36:11.712 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.709+0000 7f03067fc700 1 -- 172.21.15.87:0/1600934487 <== osd.6 v2:172.21.15.115:6824/33987 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f03100733a0 con 0x7f02f406bd00 2023-03-30T19:36:11.713 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-03-30T19:36:11.713 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-03-30T19:36:11.713 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-03-30T19:36:11.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.709+0000 7f0316adc700 1 -- 172.21.15.87:0/1600934487 >> [v2:172.21.15.115:6824/33987,v1:172.21.15.115:6825/33987] conn(0x7f02f406bd00 msgr2=0x7f02f406e130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.709+0000 7f0316adc700 1 --2- 172.21.15.87:0/1600934487 >> [v2:172.21.15.115:6824/33987,v1:172.21.15.115:6825/33987] conn(0x7f02f406bd00 0x7f02f406e130 crc :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.714 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.709+0000 7f0316adc700 1 -- 172.21.15.87:0/1600934487 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02f40653f0 msgr2=0x7f02f40678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.709+0000 7f0316adc700 1 --2- 172.21.15.87:0/1600934487 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f02f40653f0 0x7f02f40678a0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f03100d3db0 tx=0x7f0300008030 comp rx=0 tx=0).stop 2023-03-30T19:36:11.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.709+0000 7f0316adc700 1 -- 172.21.15.87:0/1600934487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03100b8380 msgr2=0x7f0310151230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.709+0000 7f0316adc700 1 --2- 172.21.15.87:0/1600934487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f03100b8380 0x7f0310151230 secure :-1 s=READY pgs=3363 cs=0 l=1 rev1=1 crypto rx=0x7f030c00ebe0 tx=0x7f030c00eef0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.709+0000 7f03162db700 1 -- 172.21.15.87:0/1600934487 reap_dead start 2023-03-30T19:36:11.715 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.709+0000 7f0316adc700 1 -- 172.21.15.87:0/1600934487 shutdown_connections 2023-03-30T19:36:11.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.709+0000 7f0316adc700 1 -- 172.21.15.87:0/1600934487 >> 172.21.15.87:0/1600934487 conn(0x7f03100b53f0 msgr2=0x7f031006b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:11.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.709+0000 7f0316adc700 1 -- 172.21.15.87:0/1600934487 shutdown_connections 2023-03-30T19:36:11.716 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.709+0000 7f0316adc700 1 -- 172.21.15.87:0/1600934487 wait complete. 2023-03-30T19:36:11.738 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-03-30T19:36:11.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.889+0000 7fda39db4700 1 Processor -- start 2023-03-30T19:36:11.895 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.889+0000 7fda39db4700 1 -- start start 2023-03-30T19:36:11.895 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.889+0000 7fda39db4700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fda340b8380 0x7fda340d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.896 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.889+0000 7fda39db4700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda34160ef0 con 0x7fda340d27e0 2023-03-30T19:36:11.896 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.889+0000 7fda39db4700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda340cd6a0 con 0x7fda3406a3e0 2023-03-30T19:36:11.896 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.889+0000 7fda39db4700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda340cd3a0 con 0x7fda340b8380 2023-03-30T19:36:11.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda38db2700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fda340b8380 0x7fda340d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda395b3700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fda3406a3e0 0x7fda340d0880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.87:35882/0 (socket says 172.21.15.87:35882) 2023-03-30T19:36:11.897 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda395b3700 1 -- 172.21.15.87:0/2540865896 learned_addr learned my addr 172.21.15.87:0/2540865896 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:36:11.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda337fe700 1 -- 172.21.15.87:0/2540865896 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394911869 0 0) 0x7fda340cd6a0 con 0x7fda3406a3e0 2023-03-30T19:36:11.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda337fe700 1 -- 172.21.15.87:0/2540865896 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda240035d0 con 0x7fda3406a3e0 2023-03-30T19:36:11.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda38db2700 1 -- 172.21.15.87:0/2540865896 >> v1:172.21.15.115:6789/0 conn(0x7fda3406a3e0 legacy=0x7fda340d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda38db2700 1 -- 172.21.15.87:0/2540865896 >> v1:172.21.15.87:6789/0 conn(0x7fda340d27e0 legacy=0x7fda34069cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.898 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda337fe700 1 -- 172.21.15.87:0/2540865896 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154380187 0 0) 0x7fda34160ef0 con 0x7fda340d27e0 2023-03-30T19:36:11.899 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda38db2700 1 -- 172.21.15.87:0/2540865896 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda340cef00 con 0x7fda340b8380 2023-03-30T19:36:11.900 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda38db2700 1 --2- 172.21.15.87:0/2540865896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda340b8380 0x7fda340d2200 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fda28009880 tx=0x7fda28009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9f066f4242f5a09 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:11.900 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda337fe700 1 -- 172.21.15.87:0/2540865896 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28011830 con 0x7fda340b8380 2023-03-30T19:36:11.900 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda337fe700 1 -- 172.21.15.87:0/2540865896 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda28011990 con 0x7fda340b8380 2023-03-30T19:36:11.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda337fe700 1 -- 172.21.15.87:0/2540865896 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28011d00 con 0x7fda340b8380 2023-03-30T19:36:11.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda39db4700 1 -- 172.21.15.87:0/2540865896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda340b8380 msgr2=0x7fda340d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda39db4700 1 --2- 172.21.15.87:0/2540865896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda340b8380 0x7fda340d2200 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fda28009880 tx=0x7fda28009b90 comp rx=0 tx=0).stop 2023-03-30T19:36:11.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda39db4700 1 -- 172.21.15.87:0/2540865896 shutdown_connections 2023-03-30T19:36:11.901 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda39db4700 1 --2- 172.21.15.87:0/2540865896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda340b8380 0x7fda340d2200 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.893+0000 7fda39db4700 1 -- 172.21.15.87:0/2540865896 >> 172.21.15.87:0/2540865896 conn(0x7fda340b53f0 msgr2=0x7fda340cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:11.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.897+0000 7fda39db4700 1 -- 172.21.15.87:0/2540865896 shutdown_connections 2023-03-30T19:36:11.902 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.897+0000 7fda39db4700 1 -- 172.21.15.87:0/2540865896 wait complete. 2023-03-30T19:36:11.903 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.897+0000 7fda39db4700 1 Processor -- start 2023-03-30T19:36:11.904 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda39db4700 1 -- start start 2023-03-30T19:36:11.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda39db4700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda3406a3e0 0x7fda340ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.905 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda39db4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda340b8380 0x7fda340c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda39db4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda340c8450 0x7fda340b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda39db4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda340cb850 con 0x7fda340c8450 2023-03-30T19:36:11.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda39db4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda340cbb30 con 0x7fda340b8380 2023-03-30T19:36:11.906 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda39db4700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda340cbe10 con 0x7fda3406a3e0 2023-03-30T19:36:11.908 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda395b3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda340c8450 0x7fda340b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.908 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda38db2700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda3406a3e0 0x7fda340ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda33fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda340b8380 0x7fda340c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.909 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda395b3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda340c8450 0x7fda340b3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54348/0 (socket says 172.21.15.87:54348) 2023-03-30T19:36:11.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda395b3700 1 -- 172.21.15.87:0/1052784848 learned_addr learned my addr 172.21.15.87:0/1052784848 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:11.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda395b3700 1 -- 172.21.15.87:0/1052784848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda3406a3e0 msgr2=0x7fda340ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.910 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda395b3700 1 --2- 172.21.15.87:0/1052784848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda3406a3e0 0x7fda340ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.911 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda395b3700 1 -- 172.21.15.87:0/1052784848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda340b8380 msgr2=0x7fda340c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:11.914 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda395b3700 1 --2- 172.21.15.87:0/1052784848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda340b8380 0x7fda340c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:11.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda395b3700 1 -- 172.21.15.87:0/1052784848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda280094b0 con 0x7fda340c8450 2023-03-30T19:36:11.915 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda395b3700 1 --2- 172.21.15.87:0/1052784848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda340c8450 0x7fda340b3250 secure :-1 s=READY pgs=3365 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00caa0 tx=0x7fda2c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:11.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda317fa700 1 -- 172.21.15.87:0/1052784848 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c007480 con 0x7fda340c8450 2023-03-30T19:36:11.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda39db4700 1 -- 172.21.15.87:0/1052784848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda340cf480 con 0x7fda340c8450 2023-03-30T19:36:11.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda317fa700 1 -- 172.21.15.87:0/1052784848 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2c0075e0 con 0x7fda340c8450 2023-03-30T19:36:11.916 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda317fa700 1 -- 172.21.15.87:0/1052784848 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c007970 con 0x7fda340c8450 2023-03-30T19:36:11.917 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.901+0000 7fda39db4700 1 -- 172.21.15.87:0/1052784848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda340cf1a0 con 0x7fda340c8450 2023-03-30T19:36:11.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.905+0000 7fda39db4700 1 -- 172.21.15.87:0/1052784848 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda340b8750 con 0x7fda340c8450 2023-03-30T19:36:11.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.905+0000 7fda317fa700 1 -- 172.21.15.87:0/1052784848 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fda2c01b3b0 con 0x7fda340c8450 2023-03-30T19:36:11.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.909+0000 7fda317fa700 1 --2- 172.21.15.87:0/1052784848 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fda180653f0 0x7fda180678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:11.918 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.909+0000 7fda317fa700 1 -- 172.21.15.87:0/1052784848 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fda2c081f70 con 0x7fda340c8450 2023-03-30T19:36:11.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.909+0000 7fda38db2700 1 --2- 172.21.15.87:0/1052784848 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fda180653f0 0x7fda180678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:11.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.909+0000 7fda38db2700 1 --2- 172.21.15.87:0/1052784848 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fda180653f0 0x7fda180678a0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fda28009850 tx=0x7fda28008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:11.919 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:11.913+0000 7fda317fa700 1 -- 172.21.15.87:0/1052784848 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fda2c04fd60 con 0x7fda340c8450 2023-03-30T19:36:12.218 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.213+0000 7fda39db4700 1 -- 172.21.15.87:0/1052784848 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fda34072cf0 con 0x7fda180653f0 2023-03-30T19:36:12.219 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.213+0000 7fda317fa700 1 -- 172.21.15.87:0/1052784848 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fda34072cf0 con 0x7fda180653f0 2023-03-30T19:36:12.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.217+0000 7fda39db4700 1 -- 172.21.15.87:0/1052784848 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fda180653f0 msgr2=0x7fda180678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:12.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.217+0000 7fda39db4700 1 --2- 172.21.15.87:0/1052784848 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fda180653f0 0x7fda180678a0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fda28009850 tx=0x7fda28008030 comp rx=0 tx=0).stop 2023-03-30T19:36:12.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.217+0000 7fda39db4700 1 -- 172.21.15.87:0/1052784848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda340c8450 msgr2=0x7fda340b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:12.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.217+0000 7fda39db4700 1 --2- 172.21.15.87:0/1052784848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda340c8450 0x7fda340b3250 secure :-1 s=READY pgs=3365 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00caa0 tx=0x7fda2c00cad0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.217+0000 7fda39db4700 1 -- 172.21.15.87:0/1052784848 shutdown_connections 2023-03-30T19:36:12.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.217+0000 7fda39db4700 1 --2- 172.21.15.87:0/1052784848 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fda180653f0 0x7fda180678a0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.217+0000 7fda39db4700 1 --2- 172.21.15.87:0/1052784848 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda340c8450 0x7fda340b3250 unknown :-1 s=CLOSED pgs=3365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.217+0000 7fda39db4700 1 --2- 172.21.15.87:0/1052784848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda340b8380 0x7fda340c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.217+0000 7fda39db4700 1 --2- 172.21.15.87:0/1052784848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda3406a3e0 0x7fda340ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.217+0000 7fda39db4700 1 -- 172.21.15.87:0/1052784848 >> 172.21.15.87:0/1052784848 conn(0x7fda340b53f0 msgr2=0x7fda34069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:12.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.217+0000 7fda39db4700 1 -- 172.21.15.87:0/1052784848 shutdown_connections 2023-03-30T19:36:12.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.217+0000 7fda39db4700 1 -- 172.21.15.87:0/1052784848 wait complete. 2023-03-30T19:36:12.224 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 6 to deep-scrub 2023-03-30T19:36:12.247 INFO:tasks.ceph:Scrubbing osd.7 2023-03-30T19:36:12.248 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-03-30T19:36:12.406 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.401+0000 7f280c9bf700 1 Processor -- start 2023-03-30T19:36:12.406 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.401+0000 7f280c9bf700 1 -- start start 2023-03-30T19:36:12.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.401+0000 7f280c9bf700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2808158bf0 0x7f280815cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:12.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.401+0000 7f280c9bf700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f28080cceb0 0x7f2808070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:12.407 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.401+0000 7f280c9bf700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280815d480 con 0x7f2808158820 2023-03-30T19:36:12.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.401+0000 7f280c9bf700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280806c190 con 0x7f28080cceb0 2023-03-30T19:36:12.408 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.401+0000 7f280c9bf700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280806c4f0 con 0x7f2808158bf0 2023-03-30T19:36:12.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.401+0000 7f2806d9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f28080cceb0 0x7f2808070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:12.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.401+0000 7f2806d9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f28080cceb0 0x7f2808070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54362/0 (socket says 172.21.15.87:54362) 2023-03-30T19:36:12.409 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.401+0000 7f2806d9d700 1 -- 172.21.15.87:0/1980056029 learned_addr learned my addr 172.21.15.87:0/1980056029 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:12.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f2805d9b700 1 --2- 172.21.15.87:0/1980056029 >> v2:172.21.15.115:3300/0 conn(0x7f2808158bf0 0x7f280815cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:12.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f2806d9d700 1 -- 172.21.15.87:0/1980056029 >> v2:172.21.15.115:3300/0 conn(0x7f2808158bf0 msgr2=0x7f280815cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:12.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f2806d9d700 1 --2- 172.21.15.87:0/1980056029 >> v2:172.21.15.115:3300/0 conn(0x7f2808158bf0 0x7f280815cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f2806d9d700 1 -- 172.21.15.87:0/1980056029 >> v1:172.21.15.115:6789/0 conn(0x7f2808158820 legacy=0x7f28080c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:12.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f2806d9d700 1 -- 172.21.15.87:0/1980056029 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280806cd90 con 0x7f28080cceb0 2023-03-30T19:36:12.410 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f2806d9d700 1 --2- 172.21.15.87:0/1980056029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28080cceb0 0x7f2808070cb0 secure :-1 s=READY pgs=3366 cs=0 l=1 rev1=1 crypto rx=0x7f280806fed0 tx=0x7f2800009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9bbd2b16d1f1b3a server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:12.411 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f280559a700 1 -- 172.21.15.87:0/1980056029 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800011830 con 0x7f28080cceb0 2023-03-30T19:36:12.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f280559a700 1 -- 172.21.15.87:0/1980056029 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2800011990 con 0x7f28080cceb0 2023-03-30T19:36:12.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f280559a700 1 -- 172.21.15.87:0/1980056029 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800011d20 con 0x7f28080cceb0 2023-03-30T19:36:12.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f280c9bf700 1 -- 172.21.15.87:0/1980056029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28080cceb0 msgr2=0x7f2808070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:12.412 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f280c9bf700 1 --2- 172.21.15.87:0/1980056029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28080cceb0 0x7f2808070cb0 secure :-1 s=READY pgs=3366 cs=0 l=1 rev1=1 crypto rx=0x7f280806fed0 tx=0x7f2800009bf0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f280c9bf700 1 -- 172.21.15.87:0/1980056029 shutdown_connections 2023-03-30T19:36:12.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f280c9bf700 1 --2- 172.21.15.87:0/1980056029 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28080cceb0 0x7f2808070cb0 unknown :-1 s=CLOSED pgs=3366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f280c9bf700 1 --2- 172.21.15.87:0/1980056029 >> v2:172.21.15.115:3300/0 conn(0x7f2808158bf0 0x7f280815cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f280c9bf700 1 -- 172.21.15.87:0/1980056029 >> 172.21.15.87:0/1980056029 conn(0x7f28080ce960 msgr2=0x7f28080ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:12.413 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f280c9bf700 1 -- 172.21.15.87:0/1980056029 shutdown_connections 2023-03-30T19:36:12.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.405+0000 7f280c9bf700 1 -- 172.21.15.87:0/1980056029 wait complete. 2023-03-30T19:36:12.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.409+0000 7f280c9bf700 1 Processor -- start 2023-03-30T19:36:12.414 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.409+0000 7f280c9bf700 1 -- start start 2023-03-30T19:36:12.415 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.409+0000 7f280c9bf700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28080cceb0 0x7f280814d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:12.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.409+0000 7f280c9bf700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2808158820 0x7f280815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:12.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.409+0000 7f280c9bf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2808158bf0 0x7f280815a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:12.416 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.409+0000 7f280c9bf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28080c8610 con 0x7f2808158bf0 2023-03-30T19:36:12.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.409+0000 7f280c9bf700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28080c88f0 con 0x7f28080cceb0 2023-03-30T19:36:12.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.409+0000 7f280c9bf700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28080c5ad0 con 0x7f2808158820 2023-03-30T19:36:12.417 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f2806d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2808158bf0 0x7f280815a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:12.418 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f2805d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2808158820 0x7f280815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:12.418 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f280659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28080cceb0 0x7f280814d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:12.418 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f2806d9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2808158bf0 0x7f280815a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54364/0 (socket says 172.21.15.87:54364) 2023-03-30T19:36:12.418 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f2806d9d700 1 -- 172.21.15.87:0/955854666 learned_addr learned my addr 172.21.15.87:0/955854666 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:12.419 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f2806d9d700 1 -- 172.21.15.87:0/955854666 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2808158820 msgr2=0x7f280815b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:12.419 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f2806d9d700 1 --2- 172.21.15.87:0/955854666 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2808158820 0x7f280815b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f2806d9d700 1 -- 172.21.15.87:0/955854666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28080cceb0 msgr2=0x7f280814d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:12.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f2806d9d700 1 --2- 172.21.15.87:0/955854666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28080cceb0 0x7f280814d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f2806d9d700 1 -- 172.21.15.87:0/955854666 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2800009570 con 0x7f2808158bf0 2023-03-30T19:36:12.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f280659c700 1 --2- 172.21.15.87:0/955854666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28080cceb0 0x7f280814d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-30T19:36:12.420 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f2806d9d700 1 --2- 172.21.15.87:0/955854666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2808158bf0 0x7f280815a350 secure :-1 s=READY pgs=3367 cs=0 l=1 rev1=1 crypto rx=0x7f280806e850 tx=0x7f2800004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:12.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f27feffd700 1 -- 172.21.15.87:0/955854666 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800004450 con 0x7f2808158bf0 2023-03-30T19:36:12.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f27feffd700 1 -- 172.21.15.87:0/955854666 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28000045b0 con 0x7f2808158bf0 2023-03-30T19:36:12.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f280c9bf700 1 -- 172.21.15.87:0/955854666 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280806c740 con 0x7f2808158bf0 2023-03-30T19:36:12.421 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f27feffd700 1 -- 172.21.15.87:0/955854666 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800003900 con 0x7f2808158bf0 2023-03-30T19:36:12.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f280c9bf700 1 -- 172.21.15.87:0/955854666 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28080cd430 con 0x7f2808158bf0 2023-03-30T19:36:12.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.413+0000 7f280c9bf700 1 -- 172.21.15.87:0/955854666 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f280806ca20 con 0x7f2808158bf0 2023-03-30T19:36:12.422 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.417+0000 7f27feffd700 1 -- 172.21.15.87:0/955854666 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f2800003a60 con 0x7f2808158bf0 2023-03-30T19:36:12.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.417+0000 7f27feffd700 1 --2- 172.21.15.87:0/955854666 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f27e8065420 0x7f27e80678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:12.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.417+0000 7f27feffd700 1 -- 172.21.15.87:0/955854666 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f2800021030 con 0x7f2808158bf0 2023-03-30T19:36:12.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.417+0000 7f27feffd700 1 --2- 172.21.15.87:0/955854666 >> [v2:172.21.15.115:6808/33986,v1:172.21.15.115:6809/33986] conn(0x7f27e806bd30 0x7f27e806e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:12.423 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.417+0000 7f27feffd700 1 -- 172.21.15.87:0/955854666 --> [v2:172.21.15.115:6808/33986,v1:172.21.15.115:6809/33986] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27e806e830 con 0x7f27e806bd30 2023-03-30T19:36:12.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.417+0000 7f27feffd700 1 -- 172.21.15.87:0/955854666 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28000882a0 con 0x7f2808158bf0 2023-03-30T19:36:12.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.417+0000 7f280659c700 1 --2- 172.21.15.87:0/955854666 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f27e8065420 0x7f27e80678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:12.424 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.417+0000 7f2805d9b700 1 --2- 172.21.15.87:0/955854666 >> [v2:172.21.15.115:6808/33986,v1:172.21.15.115:6809/33986] conn(0x7f27e806bd30 0x7f27e806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:12.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.417+0000 7f280659c700 1 --2- 172.21.15.87:0/955854666 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f27e8065420 0x7f27e80678d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f27f8002230 tx=0x7f27f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:12.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.421+0000 7f2805d9b700 1 --2- 172.21.15.87:0/955854666 >> [v2:172.21.15.115:6808/33986,v1:172.21.15.115:6809/33986] conn(0x7f27e806bd30 0x7f27e806e160 crc :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:12.603 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.597+0000 7f27feffd700 1 -- 172.21.15.87:0/955854666 <== osd.7 v2:172.21.15.115:6808/33986 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f27e806e830 con 0x7f27e806bd30 2023-03-30T19:36:12.622 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.617+0000 7f280c9bf700 1 -- 172.21.15.87:0/955854666 --> [v2:172.21.15.115:6808/33986,v1:172.21.15.115:6809/33986] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2808073ee0 con 0x7f27e806bd30 2023-03-30T19:36:12.661 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.657+0000 7f27feffd700 1 -- 172.21.15.87:0/955854666 <== osd.7 v2:172.21.15.115:6808/33986 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2808073ee0 con 0x7f27e806bd30 2023-03-30T19:36:12.662 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2023-03-30T19:36:12.662 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-03-30T19:36:12.663 INFO:teuthology.orchestra.run.smithi087.stdout:} 2023-03-30T19:36:12.663 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.657+0000 7f280c9bf700 1 -- 172.21.15.87:0/955854666 >> [v2:172.21.15.115:6808/33986,v1:172.21.15.115:6809/33986] conn(0x7f27e806bd30 msgr2=0x7f27e806e160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:12.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.657+0000 7f280c9bf700 1 --2- 172.21.15.87:0/955854666 >> [v2:172.21.15.115:6808/33986,v1:172.21.15.115:6809/33986] conn(0x7f27e806bd30 0x7f27e806e160 crc :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.657+0000 7f280c9bf700 1 -- 172.21.15.87:0/955854666 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f27e8065420 msgr2=0x7f27e80678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:12.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.657+0000 7f280c9bf700 1 --2- 172.21.15.87:0/955854666 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f27e8065420 0x7f27e80678d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f27f8002230 tx=0x7f27f8009040 comp rx=0 tx=0).stop 2023-03-30T19:36:12.664 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.657+0000 7f280c9bf700 1 -- 172.21.15.87:0/955854666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2808158bf0 msgr2=0x7f280815a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:12.665 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.657+0000 7f280c9bf700 1 --2- 172.21.15.87:0/955854666 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2808158bf0 0x7f280815a350 secure :-1 s=READY pgs=3367 cs=0 l=1 rev1=1 crypto rx=0x7f280806e850 tx=0x7f2800004770 comp rx=0 tx=0).stop 2023-03-30T19:36:12.665 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.657+0000 7f2806d9d700 1 -- 172.21.15.87:0/955854666 reap_dead start 2023-03-30T19:36:12.665 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.657+0000 7f280c9bf700 1 -- 172.21.15.87:0/955854666 shutdown_connections 2023-03-30T19:36:12.666 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.657+0000 7f280c9bf700 1 -- 172.21.15.87:0/955854666 >> 172.21.15.87:0/955854666 conn(0x7f28080ce960 msgr2=0x7f28080ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:12.666 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.657+0000 7f280c9bf700 1 -- 172.21.15.87:0/955854666 shutdown_connections 2023-03-30T19:36:12.666 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.657+0000 7f280c9bf700 1 -- 172.21.15.87:0/955854666 wait complete. 2023-03-30T19:36:12.685 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-03-30T19:36:12.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.849+0000 7f1325c28700 1 Processor -- start 2023-03-30T19:36:12.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.853+0000 7f1325c28700 1 -- start start 2023-03-30T19:36:12.860 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.853+0000 7f1325c28700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13200b3f30 0x7f13200b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:12.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.853+0000 7f1325c28700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f132006a6e0 0x7f13200aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:12.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.853+0000 7f1325c28700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f132006b670 con 0x7f13200af180 2023-03-30T19:36:12.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.853+0000 7f1325c28700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13200af600 con 0x7f132006a6e0 2023-03-30T19:36:12.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.853+0000 7f1325c28700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132006b0b0 con 0x7f13200b3f30 2023-03-30T19:36:12.861 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.853+0000 7f131ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f132006a6e0 0x7f13200aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:12.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.853+0000 7f131ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f132006a6e0 0x7f13200aec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54366/0 (socket says 172.21.15.87:54366) 2023-03-30T19:36:12.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.853+0000 7f131ffff700 1 -- 172.21.15.87:0/1890945607 learned_addr learned my addr 172.21.15.87:0/1890945607 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:12.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.853+0000 7f1324c26700 1 --2- 172.21.15.87:0/1890945607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13200b3f30 0x7f13200b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:12.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.853+0000 7f131ffff700 1 -- 172.21.15.87:0/1890945607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13200b3f30 msgr2=0x7f13200b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:12.862 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.853+0000 7f131ffff700 1 --2- 172.21.15.87:0/1890945607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13200b3f30 0x7f13200b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.853+0000 7f131ffff700 1 -- 172.21.15.87:0/1890945607 >> v1:172.21.15.87:6789/0 conn(0x7f13200af180 legacy=0x7f132015ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:12.863 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.853+0000 7f131ffff700 1 -- 172.21.15.87:0/1890945607 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132006b390 con 0x7f132006a6e0 2023-03-30T19:36:12.875 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.869+0000 7f131ffff700 1 --2- 172.21.15.87:0/1890945607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f132006a6e0 0x7f13200aec40 secure :-1 s=READY pgs=3369 cs=0 l=1 rev1=1 crypto rx=0x7f130c009910 tx=0x7f130c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc20f193e07ae server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:12.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.869+0000 7f131f7fe700 1 -- 172.21.15.87:0/1890945607 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c00ba60 con 0x7f132006a6e0 2023-03-30T19:36:12.876 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.873+0000 7f131f7fe700 1 -- 172.21.15.87:0/1890945607 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c00bbc0 con 0x7f132006a6e0 2023-03-30T19:36:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.873+0000 7f131f7fe700 1 -- 172.21.15.87:0/1890945607 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c009e60 con 0x7f132006a6e0 2023-03-30T19:36:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.873+0000 7f1325c28700 1 -- 172.21.15.87:0/1890945607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f132006a6e0 msgr2=0x7f13200aec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.873+0000 7f1325c28700 1 --2- 172.21.15.87:0/1890945607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f132006a6e0 0x7f13200aec40 secure :-1 s=READY pgs=3369 cs=0 l=1 rev1=1 crypto rx=0x7f130c009910 tx=0x7f130c009c20 comp rx=0 tx=0).stop 2023-03-30T19:36:12.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.873+0000 7f1325c28700 1 -- 172.21.15.87:0/1890945607 shutdown_connections 2023-03-30T19:36:12.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.873+0000 7f1325c28700 1 --2- 172.21.15.87:0/1890945607 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f132006a6e0 0x7f13200aec40 unknown :-1 s=CLOSED pgs=3369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.873+0000 7f1325c28700 1 --2- 172.21.15.87:0/1890945607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13200b3f30 0x7f13200b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.873+0000 7f1325c28700 1 -- 172.21.15.87:0/1890945607 >> 172.21.15.87:0/1890945607 conn(0x7f13200cf410 msgr2=0x7f13200cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:12.878 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.873+0000 7f1325c28700 1 -- 172.21.15.87:0/1890945607 shutdown_connections 2023-03-30T19:36:12.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.873+0000 7f1325c28700 1 -- 172.21.15.87:0/1890945607 wait complete. 2023-03-30T19:36:12.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.873+0000 7f1325c28700 1 Processor -- start 2023-03-30T19:36:12.879 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.873+0000 7f1325c28700 1 -- start start 2023-03-30T19:36:12.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1325c28700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f132006a6e0 0x7f13200c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:12.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1325c28700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13200af180 0x7f13200c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:12.880 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1325c28700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13200b3f30 0x7f13200c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1325c28700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13200c4bf0 con 0x7f132006a6e0 2023-03-30T19:36:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1325c28700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13200c3b50 con 0x7f13200b3f30 2023-03-30T19:36:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1325c28700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13200c3e30 con 0x7f13200af180 2023-03-30T19:36:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1324c26700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f132006a6e0 0x7f13200c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:12.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1324c26700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f132006a6e0 0x7f13200c3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54372/0 (socket says 172.21.15.87:54372) 2023-03-30T19:36:12.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1324c26700 1 -- 172.21.15.87:0/2403693561 learned_addr learned my addr 172.21.15.87:0/2403693561 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:12.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f131ffff700 1 --2- 172.21.15.87:0/2403693561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13200af180 0x7f13200c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:12.883 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1325427700 1 --2- 172.21.15.87:0/2403693561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13200b3f30 0x7f13200c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:12.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1324c26700 1 -- 172.21.15.87:0/2403693561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13200af180 msgr2=0x7f13200c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:12.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1324c26700 1 --2- 172.21.15.87:0/2403693561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13200af180 0x7f13200c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.884 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1324c26700 1 -- 172.21.15.87:0/2403693561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13200b3f30 msgr2=0x7f13200c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:12.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1324c26700 1 --2- 172.21.15.87:0/2403693561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13200b3f30 0x7f13200c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:12.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1324c26700 1 -- 172.21.15.87:0/2403693561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c009570 con 0x7f132006a6e0 2023-03-30T19:36:12.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1325427700 1 --2- 172.21.15.87:0/2403693561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13200b3f30 0x7f13200c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-30T19:36:12.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1324c26700 1 --2- 172.21.15.87:0/2403693561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f132006a6e0 0x7f13200c3300 secure :-1 s=READY pgs=3370 cs=0 l=1 rev1=1 crypto rx=0x7f131400d800 tx=0x7f131400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:12.885 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f131d7fa700 1 -- 172.21.15.87:0/2403693561 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140125f0 con 0x7f132006a6e0 2023-03-30T19:36:12.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f131d7fa700 1 -- 172.21.15.87:0/2403693561 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1314012750 con 0x7f132006a6e0 2023-03-30T19:36:12.886 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1325c28700 1 -- 172.21.15.87:0/2403693561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13200ae1b0 con 0x7f132006a6e0 2023-03-30T19:36:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f131d7fa700 1 -- 172.21.15.87:0/2403693561 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314012ac0 con 0x7f132006a6e0 2023-03-30T19:36:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.877+0000 7f1325c28700 1 -- 172.21.15.87:0/2403693561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13200aded0 con 0x7f132006a6e0 2023-03-30T19:36:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.881+0000 7f1325c28700 1 -- 172.21.15.87:0/2403693561 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13200b4300 con 0x7f132006a6e0 2023-03-30T19:36:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.881+0000 7f131d7fa700 1 -- 172.21.15.87:0/2403693561 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f1314012c20 con 0x7f132006a6e0 2023-03-30T19:36:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.881+0000 7f131d7fa700 1 --2- 172.21.15.87:0/2403693561 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1304065420 0x7f13040678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.881+0000 7f131d7fa700 1 -- 172.21.15.87:0/2403693561 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f13140827a0 con 0x7f132006a6e0 2023-03-30T19:36:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.885+0000 7f131ffff700 1 --2- 172.21.15.87:0/2403693561 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1304065420 0x7f13040678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:12.889 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.885+0000 7f131ffff700 1 --2- 172.21.15.87:0/2403693561 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1304065420 0x7f13040678d0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f130c000c00 tx=0x7f130c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:12.894 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:12.889+0000 7f131d7fa700 1 -- 172.21.15.87:0/2403693561 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f1314050560 con 0x7f132006a6e0 2023-03-30T19:36:13.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.061+0000 7f1325c28700 1 -- 172.21.15.87:0/2403693561 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f13200733a0 con 0x7f1304065420 2023-03-30T19:36:13.066 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.061+0000 7f131d7fa700 1 -- 172.21.15.87:0/2403693561 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f13200733a0 con 0x7f1304065420 2023-03-30T19:36:13.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.065+0000 7f1325c28700 1 -- 172.21.15.87:0/2403693561 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1304065420 msgr2=0x7f13040678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:13.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.065+0000 7f1325c28700 1 --2- 172.21.15.87:0/2403693561 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1304065420 0x7f13040678d0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f130c000c00 tx=0x7f130c008030 comp rx=0 tx=0).stop 2023-03-30T19:36:13.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.065+0000 7f1325c28700 1 -- 172.21.15.87:0/2403693561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f132006a6e0 msgr2=0x7f13200c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:13.071 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.065+0000 7f1325c28700 1 --2- 172.21.15.87:0/2403693561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f132006a6e0 0x7f13200c3300 secure :-1 s=READY pgs=3370 cs=0 l=1 rev1=1 crypto rx=0x7f131400d800 tx=0x7f131400db10 comp rx=0 tx=0).stop 2023-03-30T19:36:13.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.065+0000 7f1325c28700 1 -- 172.21.15.87:0/2403693561 shutdown_connections 2023-03-30T19:36:13.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.065+0000 7f1325c28700 1 --2- 172.21.15.87:0/2403693561 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f1304065420 0x7f13040678d0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.065+0000 7f1325c28700 1 --2- 172.21.15.87:0/2403693561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13200b3f30 0x7f13200c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.065+0000 7f1325c28700 1 --2- 172.21.15.87:0/2403693561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f13200af180 0x7f13200c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.072 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.065+0000 7f1325c28700 1 --2- 172.21.15.87:0/2403693561 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f132006a6e0 0x7f13200c3300 unknown :-1 s=CLOSED pgs=3370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.065+0000 7f1325c28700 1 -- 172.21.15.87:0/2403693561 >> 172.21.15.87:0/2403693561 conn(0x7f13200cf410 msgr2=0x7f13200cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.065+0000 7f1325c28700 1 -- 172.21.15.87:0/2403693561 shutdown_connections 2023-03-30T19:36:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.065+0000 7f1325c28700 1 -- 172.21.15.87:0/2403693561 wait complete. 2023-03-30T19:36:13.074 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 7 to deep-scrub 2023-03-30T19:36:13.092 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-30T19:36:13.249 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.245+0000 7fccef08a700 1 Processor -- start 2023-03-30T19:36:13.250 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.245+0000 7fccef08a700 1 -- start start 2023-03-30T19:36:13.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccef08a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcce80d0340 0x7fcce815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:13.252 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccef08a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcce80d0710 0x7fcce80cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:13.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccef08a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcce80b2560 0x7fcce80b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:13.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccef08a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce80b2f00 con 0x7fcce80d0340 2023-03-30T19:36:13.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccef08a700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce80cb670 con 0x7fcce80d0710 2023-03-30T19:36:13.253 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccef08a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce815ab60 con 0x7fcce80b2560 2023-03-30T19:36:13.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccece26700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcce80d0340 0x7fcce815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:13.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fcce7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcce80d0710 0x7fcce80cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:13.256 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccece26700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcce80d0340 0x7fcce815ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54384/0 (socket says 172.21.15.87:54384) 2023-03-30T19:36:13.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccece26700 1 -- 172.21.15.87:0/640184516 learned_addr learned my addr 172.21.15.87:0/640184516 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:13.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fcced627700 1 --2- 172.21.15.87:0/640184516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcce80b2560 0x7fcce80b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:13.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fcce7fff700 1 -- 172.21.15.87:0/640184516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcce80b2560 msgr2=0x7fcce80b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:13.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fcce7fff700 1 --2- 172.21.15.87:0/640184516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcce80b2560 0x7fcce80b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.257 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fcce7fff700 1 -- 172.21.15.87:0/640184516 >> v2:172.21.15.87:3300/0 conn(0x7fcce80d0340 msgr2=0x7fcce815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:13.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fcce7fff700 1 --2- 172.21.15.87:0/640184516 >> v2:172.21.15.87:3300/0 conn(0x7fcce80d0340 0x7fcce815ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fcce7fff700 1 -- 172.21.15.87:0/640184516 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce815ae40 con 0x7fcce80d0710 2023-03-30T19:36:13.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fcce7fff700 1 --2- 172.21.15.87:0/640184516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcce80d0710 0x7fcce80cb130 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcce80c45e0 tx=0x7fccd4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d4ccc5744c53e18 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:13.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fcce77fe700 1 -- 172.21.15.87:0/640184516 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4011830 con 0x7fcce80d0710 2023-03-30T19:36:13.258 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fcce77fe700 1 -- 172.21.15.87:0/640184516 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd4011990 con 0x7fcce80d0710 2023-03-30T19:36:13.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fcce77fe700 1 -- 172.21.15.87:0/640184516 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4011d20 con 0x7fcce80d0710 2023-03-30T19:36:13.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccef08a700 1 -- 172.21.15.87:0/640184516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcce80d0710 msgr2=0x7fcce80cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:13.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccef08a700 1 --2- 172.21.15.87:0/640184516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcce80d0710 0x7fcce80cb130 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcce80c45e0 tx=0x7fccd4009b30 comp rx=0 tx=0).stop 2023-03-30T19:36:13.259 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccef08a700 1 -- 172.21.15.87:0/640184516 shutdown_connections 2023-03-30T19:36:13.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccef08a700 1 --2- 172.21.15.87:0/640184516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcce80b2560 0x7fcce80b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccef08a700 1 --2- 172.21.15.87:0/640184516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcce80d0710 0x7fcce80cb130 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.260 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccef08a700 1 --2- 172.21.15.87:0/640184516 >> v2:172.21.15.87:3300/0 conn(0x7fcce80d0340 0x7fcce815ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccef08a700 1 -- 172.21.15.87:0/640184516 >> 172.21.15.87:0/640184516 conn(0x7fcce806f340 msgr2=0x7fcce80cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:13.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccef08a700 1 -- 172.21.15.87:0/640184516 shutdown_connections 2023-03-30T19:36:13.261 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.249+0000 7fccef08a700 1 -- 172.21.15.87:0/640184516 wait complete. 2023-03-30T19:36:13.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.253+0000 7fccef08a700 1 Processor -- start 2023-03-30T19:36:13.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.253+0000 7fccef08a700 1 -- start start 2023-03-30T19:36:13.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.253+0000 7fccef08a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcce80b2560 0x7fcce80c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:13.263 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.253+0000 7fccef08a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcce80d0340 0x7fcce81f5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:13.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.253+0000 7fccef08a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcce80d0710 0x7fcce81f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:13.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.253+0000 7fccef08a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce81504b0 con 0x7fcce80d0710 2023-03-30T19:36:13.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.253+0000 7fccef08a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8150760 con 0x7fcce80d0340 2023-03-30T19:36:13.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.253+0000 7fccef08a700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8150a40 con 0x7fcce80b2560 2023-03-30T19:36:13.264 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.253+0000 7fcced627700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcce80d0710 0x7fcce81f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:13.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.253+0000 7fcced627700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcce80d0710 0x7fcce81f5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:54388/0 (socket says 172.21.15.87:54388) 2023-03-30T19:36:13.265 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.253+0000 7fcced627700 1 -- 172.21.15.87:0/2501373630 learned_addr learned my addr 172.21.15.87:0/2501373630 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:13.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.253+0000 7fccece26700 1 --2- 172.21.15.87:0/2501373630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcce80b2560 0x7fcce80c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:13.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.253+0000 7fcce7fff700 1 --2- 172.21.15.87:0/2501373630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcce80d0340 0x7fcce81f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:13.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.257+0000 7fcced627700 1 -- 172.21.15.87:0/2501373630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcce80b2560 msgr2=0x7fcce80c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:13.266 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.257+0000 7fcced627700 1 --2- 172.21.15.87:0/2501373630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcce80b2560 0x7fcce80c9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.257+0000 7fcced627700 1 -- 172.21.15.87:0/2501373630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcce80d0340 msgr2=0x7fcce81f5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:13.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.257+0000 7fcced627700 1 --2- 172.21.15.87:0/2501373630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcce80d0340 0x7fcce81f5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.257+0000 7fcced627700 1 -- 172.21.15.87:0/2501373630 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40094b0 con 0x7fcce80d0710 2023-03-30T19:36:13.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.257+0000 7fcced627700 1 --2- 172.21.15.87:0/2501373630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcce80d0710 0x7fcce81f5b80 secure :-1 s=READY pgs=3371 cs=0 l=1 rev1=1 crypto rx=0x7fcce000efc0 tx=0x7fcce000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:13.267 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.257+0000 7fcce57fa700 1 -- 172.21.15.87:0/2501373630 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0009ea0 con 0x7fcce80d0710 2023-03-30T19:36:13.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.257+0000 7fcce57fa700 1 -- 172.21.15.87:0/2501373630 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce000f040 con 0x7fcce80d0710 2023-03-30T19:36:13.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.257+0000 7fccef08a700 1 -- 172.21.15.87:0/2501373630 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce815b400 con 0x7fcce80d0710 2023-03-30T19:36:13.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.257+0000 7fcce57fa700 1 -- 172.21.15.87:0/2501373630 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce000ced0 con 0x7fcce80d0710 2023-03-30T19:36:13.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.257+0000 7fccef08a700 1 -- 172.21.15.87:0/2501373630 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce815b120 con 0x7fcce80d0710 2023-03-30T19:36:13.268 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.257+0000 7fccef08a700 1 -- 172.21.15.87:0/2501373630 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce815b920 con 0x7fcce80d0710 2023-03-30T19:36:13.269 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.261+0000 7fcce57fa700 1 -- 172.21.15.87:0/2501373630 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fcce0014480 con 0x7fcce80d0710 2023-03-30T19:36:13.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.261+0000 7fcce57fa700 1 --2- 172.21.15.87:0/2501373630 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcccc0653f0 0x7fcccc0678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:13.270 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.261+0000 7fcce57fa700 1 -- 172.21.15.87:0/2501373630 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fcce0082e30 con 0x7fcce80d0710 2023-03-30T19:36:13.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.261+0000 7fccece26700 1 --2- 172.21.15.87:0/2501373630 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcccc0653f0 0x7fcccc0678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:13.271 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.261+0000 7fccece26700 1 --2- 172.21.15.87:0/2501373630 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcccc0653f0 0x7fcccc0678a0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fcce80cf960 tx=0x7fccdc0092e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:13.272 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.264+0000 7fcce57fa700 1 -- 172.21.15.87:0/2501373630 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fcce0050c10 con 0x7fcce80d0710 2023-03-30T19:36:13.425 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.420+0000 7fccef08a700 1 -- 172.21.15.87:0/2501373630 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcce8073ee0 con 0x7fcccc0653f0 2023-03-30T19:36:13.433 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.428+0000 7fcce57fa700 1 -- 172.21.15.87:0/2501373630 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71015 (secure 0 0 0) 0x7fcce8073ee0 con 0x7fcccc0653f0 2023-03-30T19:36:13.434 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:36:13.435 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.428+0000 7fccef08a700 1 -- 172.21.15.87:0/2501373630 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcccc0653f0 msgr2=0x7fcccc0678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:13.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.428+0000 7fccef08a700 1 --2- 172.21.15.87:0/2501373630 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcccc0653f0 0x7fcccc0678a0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fcce80cf960 tx=0x7fccdc0092e0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.428+0000 7fccef08a700 1 -- 172.21.15.87:0/2501373630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcce80d0710 msgr2=0x7fcce81f5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:13.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.428+0000 7fccef08a700 1 --2- 172.21.15.87:0/2501373630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcce80d0710 0x7fcce81f5b80 secure :-1 s=READY pgs=3371 cs=0 l=1 rev1=1 crypto rx=0x7fcce000efc0 tx=0x7fcce000c3a0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.428+0000 7fccef08a700 1 -- 172.21.15.87:0/2501373630 shutdown_connections 2023-03-30T19:36:13.436 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.428+0000 7fccef08a700 1 --2- 172.21.15.87:0/2501373630 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fcccc0653f0 0x7fcccc0678a0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.428+0000 7fccef08a700 1 --2- 172.21.15.87:0/2501373630 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcce80d0710 0x7fcce81f5b80 unknown :-1 s=CLOSED pgs=3371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.428+0000 7fccef08a700 1 --2- 172.21.15.87:0/2501373630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcce80d0340 0x7fcce81f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.428+0000 7fccef08a700 1 --2- 172.21.15.87:0/2501373630 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcce80b2560 0x7fcce80c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:13.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.428+0000 7fccef08a700 1 -- 172.21.15.87:0/2501373630 >> 172.21.15.87:0/2501373630 conn(0x7fcce806f340 msgr2=0x7fcce80ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:13.437 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.428+0000 7fccef08a700 1 -- 172.21.15.87:0/2501373630 shutdown_connections 2023-03-30T19:36:13.438 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:13.432+0000 7fccef08a700 1 -- 172.21.15.87:0/2501373630 wait complete. 2023-03-30T19:36:13.438 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-03-30T19:36:13.455 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":20595,"stamp":"2023-03-30T19:36:12.276842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":7543132,"kb_used_data":282332,"kb_used_omap":31256,"kb_used_meta":7229479,"kb_avail":747431588,"statfs":{"total":773094113280,"available":765369946112,"internally_reserved":0,"allocated":289107968,"data_stored":286588829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32006444,"internal_metadata":7402987220},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6005,"apply_latency_ms":6005,"commit_latency_ns":6005000000,"apply_latency_ns":6005000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002866"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":351,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-03-30T19:35:42.494192+0000","last_change":"2023-03-30T08:10:52.871133+0000","last_active":"2023-03-30T19:35:42.494192+0000","last_peered":"2023-03-30T19:35:42.494192+0000","last_clean":"2023-03-30T19:35:42.494192+0000","last_became_active":"2023-03-30T08:10:52.870678+0000","last_became_peered":"2023-03-30T08:10:52.870678+0000","last_unstale":"2023-03-30T19:35:42.494192+0000","last_undegraded":"2023-03-30T19:35:42.494192+0000","last_fullsized":"2023-03-30T19:35:42.494192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:30:51.162618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":355,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-03-30T19:35:43.482546+0000","last_change":"2023-03-30T08:10:52.871548+0000","last_active":"2023-03-30T19:35:43.482546+0000","last_peered":"2023-03-30T19:35:43.482546+0000","last_clean":"2023-03-30T19:35:43.482546+0000","last_became_active":"2023-03-30T08:10:52.871152+0000","last_became_peered":"2023-03-30T08:10:52.871152+0000","last_unstale":"2023-03-30T19:35:43.482546+0000","last_undegraded":"2023-03-30T19:35:43.482546+0000","last_fullsized":"2023-03-30T19:35:43.482546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":360,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-03-30T19:35:43.378517+0000","last_change":"2023-03-30T08:10:52.921525+0000","last_active":"2023-03-30T19:35:43.378517+0000","last_peered":"2023-03-30T19:35:43.378517+0000","last_clean":"2023-03-30T19:35:43.378517+0000","last_became_active":"2023-03-30T08:10:52.920885+0000","last_became_peered":"2023-03-30T08:10:52.920885+0000","last_unstale":"2023-03-30T19:35:43.378517+0000","last_undegraded":"2023-03-30T19:35:43.378517+0000","last_fullsized":"2023-03-30T19:35:43.378517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T17:38:27.041880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":377,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-03-30T19:36:08.061894+0000","last_change":"2023-03-30T19:36:08.062092+0000","last_active":"2023-03-30T19:36:08.061894+0000","last_peered":"2023-03-30T19:36:08.061894+0000","last_clean":"2023-03-30T19:36:08.061894+0000","last_became_active":"2023-03-30T08:10:52.921234+0000","last_became_peered":"2023-03-30T08:10:52.921234+0000","last_unstale":"2023-03-30T19:36:08.061894+0000","last_undegraded":"2023-03-30T19:36:08.061894+0000","last_fullsized":"2023-03-30T19:36:08.061894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T19:36:08.061867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T19:36:08.061867+0000","last_clean_scrub_stamp":"2023-03-30T19:36:08.061867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-04-01T04:59:21.168669+0000","scrub_duration":0.41929230699999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":361,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-03-30T19:35:41.976668+0000","last_change":"2023-03-30T08:10:52.866272+0000","last_active":"2023-03-30T19:35:41.976668+0000","last_peered":"2023-03-30T19:35:41.976668+0000","last_clean":"2023-03-30T19:35:41.976668+0000","last_became_active":"2023-03-30T08:10:52.865919+0000","last_became_peered":"2023-03-30T08:10:52.865919+0000","last_unstale":"2023-03-30T19:35:41.976668+0000","last_undegraded":"2023-03-30T19:35:41.976668+0000","last_fullsized":"2023-03-30T19:35:41.976668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:55:16.146420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":363,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-03-30T19:35:41.861081+0000","last_change":"2023-03-30T08:10:52.920796+0000","last_active":"2023-03-30T19:35:41.861081+0000","last_peered":"2023-03-30T19:35:41.861081+0000","last_clean":"2023-03-30T19:35:41.861081+0000","last_became_active":"2023-03-30T08:10:52.920327+0000","last_became_peered":"2023-03-30T08:10:52.920327+0000","last_unstale":"2023-03-30T19:35:41.861081+0000","last_undegraded":"2023-03-30T19:35:41.861081+0000","last_fullsized":"2023-03-30T19:35:41.861081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T11:29:17.416386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":373,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-03-30T19:35:42.361791+0000","last_change":"2023-03-30T08:10:52.866412+0000","last_active":"2023-03-30T19:35:42.361791+0000","last_peered":"2023-03-30T19:35:42.361791+0000","last_clean":"2023-03-30T19:35:42.361791+0000","last_became_active":"2023-03-30T08:10:52.866055+0000","last_became_peered":"2023-03-30T08:10:52.866055+0000","last_unstale":"2023-03-30T19:35:42.361791+0000","last_undegraded":"2023-03-30T19:35:42.361791+0000","last_fullsized":"2023-03-30T19:35:42.361791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T18:47:39.045010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":361,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-03-30T19:35:41.893998+0000","last_change":"2023-03-30T08:10:52.868170+0000","last_active":"2023-03-30T19:35:41.893998+0000","last_peered":"2023-03-30T19:35:41.893998+0000","last_clean":"2023-03-30T19:35:41.893998+0000","last_became_active":"2023-03-30T08:10:52.867790+0000","last_became_peered":"2023-03-30T08:10:52.867790+0000","last_unstale":"2023-03-30T19:35:41.893998+0000","last_undegraded":"2023-03-30T19:35:41.893998+0000","last_fullsized":"2023-03-30T19:35:41.893998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:51.832838+0000","last_clean_scrub_stamp":"2023-03-30T08:10:51.832838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T14:01:39.131460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":526,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-03-30T19:35:42.362048+0000","last_change":"2023-03-30T08:10:45.713084+0000","last_active":"2023-03-30T19:35:42.362048+0000","last_peered":"2023-03-30T19:35:42.362048+0000","last_clean":"2023-03-30T19:35:42.362048+0000","last_became_active":"2023-03-30T08:10:45.711645+0000","last_became_peered":"2023-03-30T08:10:45.711645+0000","last_unstale":"2023-03-30T19:35:42.362048+0000","last_undegraded":"2023-03-30T19:35:42.362048+0000","last_fullsized":"2023-03-30T19:35:42.362048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T08:10:44.620691+0000","last_clean_scrub_stamp":"2023-03-30T08:10:44.620691+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T16:58:12.738262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424517652,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1005424,"kb_used_data":552,"kb_used_omap":4629,"kb_used_meta":1000234,"kb_avail":93366416,"statfs":{"total":96636764160,"available":95607209984,"internally_reserved":0,"allocated":565248,"data_stored":255063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4740435,"internal_metadata":1024240301},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:50 2023","interfaces":[{"interface":"back","average":{"1min":4.1740000000000004,"5min":1.54,"15min":1.0309999999999999},"min":{"1min":0.39700000000000002,"5min":0.311,"15min":0.311},"max":{"1min":30.640000000000001,"5min":30.640000000000001,"15min":30.640000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":3.7360000000000002,"5min":1.4530000000000001,"15min":1.0629999999999999},"min":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.34599999999999997},"max":{"1min":30.814,"5min":30.814,"15min":30.814},"last":1.601}]},{"osd":1,"last update":"Thu Mar 30 19:35:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9359999999999999,"5min":1.248,"15min":1.0329999999999999},"min":{"1min":0.46400000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":7.0839999999999996,"5min":10.169,"15min":10.169},"last":0.747},{"interface":"front","average":{"1min":1.542,"5min":1.1619999999999999,"15min":0.94799999999999995},"min":{"1min":0.52800000000000002,"5min":0.40000000000000002,"15min":0.377},"max":{"1min":5.3380000000000001,"5min":8.5220000000000002,"15min":8.5220000000000002},"last":1.379}]},{"osd":2,"last update":"Thu Mar 30 19:35:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.1419999999999999,"15min":1.004},"min":{"1min":0.372,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":4.2999999999999998,"5min":11.26,"15min":11.26},"last":1.526},{"interface":"front","average":{"1min":2.48,"5min":1.411,"15min":1.145},"min":{"1min":0.497,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":9.718,"5min":10.236000000000001,"15min":10.236000000000001},"last":1.0269999999999999}]},{"osd":3,"last update":"Thu Mar 30 19:35:50 2023","interfaces":[{"interface":"back","average":{"1min":5.6390000000000002,"5min":2.0739999999999998,"15min":1.7310000000000001},"min":{"1min":0.59099999999999997,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":25.382999999999999,"5min":25.382999999999999,"15min":113.637},"last":1.464},{"interface":"front","average":{"1min":2.3210000000000002,"5min":1.387,"15min":1.5489999999999999},"min":{"1min":0.52900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":17.134,"5min":17.134,"15min":113.90600000000001},"last":1.3420000000000001}]},{"osd":4,"last update":"Thu Mar 30 19:35:50 2023","interfaces":[{"interface":"back","average":{"1min":2.5,"5min":1.4330000000000001,"15min":1.073},"min":{"1min":0.42999999999999999,"5min":0.42699999999999999,"15min":0.36599999999999999},"max":{"1min":18.821000000000002,"5min":18.821000000000002,"15min":18.821000000000002},"last":1.264},{"interface":"front","average":{"1min":0.73599999999999999,"5min":1.099,"15min":1.01},"min":{"1min":0.56499999999999995,"5min":0.45800000000000002,"15min":0.40699999999999997},"max":{"1min":1.198,"5min":6.5819999999999999,"15min":6.5819999999999999},"last":1.22}]},{"osd":5,"last update":"Thu Mar 30 19:35:50 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.236,"15min":1.107},"min":{"1min":0.55500000000000005,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":6.149,"5min":6.6079999999999997,"15min":9.1270000000000007},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.4450000000000001,"15min":1.175},"min":{"1min":0.59999999999999998,"5min":0.49199999999999999,"15min":0.435},"max":{"1min":5.7910000000000004,"5min":9.0079999999999991,"15min":9.3379999999999992},"last":1.5549999999999999}]},{"osd":7,"last update":"Thu Mar 30 19:35:50 2023","interfaces":[{"interface":"back","average":{"1min":2.5990000000000002,"5min":1.4830000000000001,"15min":1.236},"min":{"1min":0.59999999999999998,"5min":0.54400000000000004,"15min":0.50900000000000001},"max":{"1min":28.132999999999999,"5min":28.132999999999999,"15min":28.132999999999999},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.724,"5min":1.6559999999999999,"15min":1.2509999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.48599999999999999},"max":{"1min":11.228999999999999,"5min":22.887,"15min":22.887},"last":1.1970000000000001}]}]},{"osd":7,"up_from":14,"seq":60129550364,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245428,"kb_used_data":1132,"kb_used_omap":4609,"kb_used_meta":239678,"kb_avail":94126412,"statfs":{"total":96636764160,"available":96385445888,"internally_reserved":0,"allocated":1159168,"data_stored":845431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4719691,"internal_metadata":245431221},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88700000000000001,"15min":0.872},"min":{"1min":0.308,"5min":0.308,"15min":0.29399999999999998},"max":{"1min":2.2799999999999998,"5min":4.5439999999999996,"15min":7.5529999999999999},"last":1.032},{"interface":"front","average":{"1min":1.01,"5min":0.98199999999999998,"15min":0.89800000000000002},"min":{"1min":0.42299999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.9350000000000001,"5min":5.2569999999999997,"15min":5.819},"last":1.0640000000000001}]},{"osd":1,"last update":"Thu Mar 30 19:36:02 2023","interfaces":[{"interface":"back","average":{"1min":1.8500000000000001,"5min":1.181,"15min":1.0269999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.437},"max":{"1min":12.445,"5min":12.445,"15min":12.445},"last":1.244},{"interface":"front","average":{"1min":1.95,"5min":1.2050000000000001,"15min":1.073},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":17.225000000000001,"5min":17.225000000000001,"15min":17.225000000000001},"last":1.429}]},{"osd":2,"last update":"Thu Mar 30 19:36:02 2023","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":1.403,"15min":1.105},"min":{"1min":0.53900000000000003,"5min":0.40200000000000002,"15min":0.39400000000000002},"max":{"1min":17.498000000000001,"5min":17.498000000000001,"15min":17.498000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.718,"5min":1.2430000000000001,"15min":1.0620000000000001},"min":{"1min":0.48299999999999998,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":12.510999999999999,"5min":12.510999999999999,"15min":12.510999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Mar 30 19:36:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2549999999999999,"15min":1.4950000000000001},"min":{"1min":0.54300000000000004,"5min":0.44600000000000001,"15min":0.43099999999999999},"max":{"1min":3.2360000000000002,"5min":6.3849999999999998,"15min":111.13800000000001},"last":1.353},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.163,"15min":1.488},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.45700000000000002},"max":{"1min":3.1040000000000001,"5min":5.3259999999999996,"15min":109.63800000000001},"last":1.1739999999999999}]},{"osd":4,"last update":"Thu Mar 30 19:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.194,"15min":1.1719999999999999},"min":{"1min":0.47799999999999998,"5min":0.46300000000000002,"15min":0.34799999999999998},"max":{"1min":2.3239999999999998,"5min":8.7940000000000005,"15min":9.3409999999999993},"last":1.46},{"interface":"front","average":{"1min":1.05,"5min":1.3360000000000001,"15min":1.1739999999999999},"min":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.36399999999999999},"max":{"1min":2.3719999999999999,"5min":7.3090000000000002,"15min":7.3090000000000002},"last":0.94699999999999995}]},{"osd":5,"last update":"Thu Mar 30 19:36:02 2023","interfaces":[{"interface":"back","average":{"1min":2.698,"5min":1.6859999999999999,"15min":1.2789999999999999},"min":{"1min":0.63500000000000001,"5min":0.503,"15min":0.41299999999999998},"max":{"1min":17.449000000000002,"5min":17.449000000000002,"15min":17.449000000000002},"last":1.2769999999999999},{"interface":"front","average":{"1min":2.4630000000000001,"5min":1.5649999999999999,"15min":1.3129999999999999},"min":{"1min":0.58299999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":17.146000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":1.379}]},{"osd":6,"last update":"Thu Mar 30 19:36:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.4690000000000001,"15min":1.246},"min":{"1min":0.55900000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":4.468,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.1439999999999999,"15min":1.081},"min":{"1min":0.50600000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":3.0600000000000001,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":1.3180000000000001}]}]},{"osd":5,"up_from":14,"seq":60129550361,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1089456,"kb_used_data":552,"kb_used_omap":1498,"kb_used_meta":1087397,"kb_avail":93282384,"statfs":{"total":96636764160,"available":95521161216,"internally_reserved":0,"allocated":565248,"data_stored":255063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1534458,"internal_metadata":1113495046},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":1.1779999999999999,"15min":0.96499999999999997},"min":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.956,"5min":12.332000000000001,"15min":12.332000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.1519999999999999,"15min":0.96299999999999997},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":8.4359999999999999,"5min":12.897,"15min":12.897},"last":0.82299999999999995}]},{"osd":1,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":3.4329999999999998,"5min":1.46,"15min":1.1679999999999999},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.373},"max":{"1min":30.469000000000001,"5min":30.469000000000001,"15min":30.469000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.623,"5min":1.2789999999999999,"15min":1.044},"min":{"1min":0.41399999999999998,"5min":0.41199999999999998,"15min":0.40899999999999997},"max":{"1min":14.49,"5min":14.49,"15min":14.49},"last":1.0609999999999999}]},{"osd":2,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":1.3799999999999999,"15min":1.204},"min":{"1min":0.45000000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":30.507999999999999,"5min":30.507999999999999,"15min":30.507999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.379,"5min":1.2669999999999999,"15min":1.1060000000000001},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":8.4849999999999994,"5min":12.944000000000001,"15min":12.944000000000001},"last":1.153}]},{"osd":3,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.3640000000000001,"15min":1.145},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":8.5139999999999993,"5min":13.007,"15min":13.007},"last":1.1799999999999999},{"interface":"front","average":{"1min":2.6459999999999999,"5min":1.512,"15min":1.282},"min":{"1min":0.55500000000000005,"5min":0.503,"15min":0.46300000000000002},"max":{"1min":30.402999999999999,"5min":30.402999999999999,"15min":30.402999999999999},"last":1.175}]},{"osd":4,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":2.9380000000000002,"5min":1.5169999999999999,"15min":1.2410000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.38800000000000001},"max":{"1min":30.547999999999998,"5min":30.547999999999998,"15min":30.547999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.3069999999999999,"15min":1.153},"min":{"1min":0.46400000000000002,"5min":0.441,"15min":0.438},"max":{"1min":3.1739999999999999,"5min":7.3079999999999998,"15min":9.2870000000000008},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":1.6599999999999999,"15min":1.284},"min":{"1min":0.51200000000000001,"5min":0.501,"15min":0.501},"max":{"1min":33.402000000000001,"5min":33.402000000000001,"15min":33.402000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":3.4630000000000001,"5min":1.8069999999999999,"15min":1.327},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":33.673999999999999,"5min":33.673999999999999,"15min":33.673999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Mar 30 19:35:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.5529999999999999,"15min":1.3089999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.496},"max":{"1min":8.5419999999999998,"5min":12.976000000000001,"15min":12.976000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":2.681,"5min":1.621,"15min":1.343},"min":{"1min":0.59899999999999998,"5min":0.504,"15min":0.47799999999999998},"max":{"1min":24.754000000000001,"5min":24.754000000000001,"15min":24.754000000000001},"last":0.80700000000000005}]}]},{"osd":4,"up_from":14,"seq":60129550356,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1125040,"kb_used_data":552,"kb_used_omap":3500,"kb_used_meta":1120979,"kb_avail":93246800,"statfs":{"total":96636764160,"available":95484723200,"internally_reserved":0,"allocated":565248,"data_stored":255063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3584019,"internal_metadata":1147883501},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":1.0740000000000001,"15min":0.96699999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.313},"max":{"1min":1.3720000000000001,"5min":5.8579999999999997,"15min":5.8579999999999997},"last":1.044},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.0069999999999999,"15min":0.995},"min":{"1min":0.39800000000000002,"5min":0.36499999999999999,"15min":0.34300000000000003},"max":{"1min":6.4989999999999997,"5min":6.4989999999999997,"15min":7.2930000000000001},"last":0.96999999999999997}]},{"osd":1,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.96399999999999997,"15min":0.94699999999999995},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":5.141,"5min":5.141,"15min":5.141},"last":0.88},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.3149999999999999,"15min":1.133},"min":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.376},"max":{"1min":2.6389999999999998,"5min":5.7889999999999997,"15min":8.8740000000000006},"last":1.3169999999999999}]},{"osd":2,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":1.2190000000000001,"15min":1.113},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":1.728,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.28,"5min":1.159,"15min":1.117},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.41899999999999998},"max":{"1min":6.4009999999999998,"5min":7.1639999999999997,"15min":7.3869999999999996},"last":1.075}]},{"osd":3,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":2.5499999999999998,"15min":1.5700000000000001},"min":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.434},"max":{"1min":2.214,"5min":116.221,"15min":116.221},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":2.4460000000000002,"15min":1.5649999999999999},"min":{"1min":0.56899999999999995,"5min":0.436,"15min":0.436},"max":{"1min":6.5339999999999998,"5min":116.306,"15min":116.306},"last":1.1240000000000001}]},{"osd":5,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":4.484,"5min":1.6040000000000001,"15min":1.1879999999999999},"min":{"1min":0.45600000000000002,"5min":0.42299999999999999,"15min":0.39400000000000002},"max":{"1min":69.498000000000005,"5min":69.498000000000005,"15min":69.498000000000005},"last":1.169},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.278,"15min":1.179},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.42299999999999999},"max":{"1min":2.0470000000000002,"5min":6.024,"15min":10.057},"last":1.484}]},{"osd":6,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.109,"15min":1.1799999999999999},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.42399999999999999},"max":{"1min":1.6719999999999999,"5min":6.1879999999999997,"15min":15.928000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.3400000000000001,"15min":1.2929999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46000000000000002},"max":{"1min":1.583,"5min":5.9260000000000002,"15min":15.566000000000001},"last":1.5369999999999999}]},{"osd":7,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.238,"15min":1.204},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.4589999999999996,"5min":6.4589999999999996,"15min":7.3460000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.093,"15min":1.1679999999999999},"min":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.47599999999999998},"max":{"1min":1.9059999999999999,"5min":6.7160000000000002,"15min":6.7160000000000002},"last":1.4339999999999999}]}]},{"osd":3,"up_from":14,"seq":60129550330,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1306056,"kb_used_data":211072,"kb_used_omap":7240,"kb_used_meta":1087735,"kb_avail":93065784,"statfs":{"total":96636764160,"available":95299362816,"internally_reserved":0,"allocated":216137728,"data_stored":215803422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7414054,"internal_metadata":1113841370},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1285,"apply_latency_ms":1285,"commit_latency_ns":1285000000,"apply_latency_ns":1285000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.73999999999999999,"15min":0.77500000000000002},"min":{"1min":0.38100000000000001,"5min":0.27500000000000002,"15min":0.25900000000000001},"max":{"1min":2.976,"5min":2.976,"15min":8.0690000000000008},"last":0.436},{"interface":"front","average":{"1min":1.244,"5min":0.878,"15min":0.93500000000000005},"min":{"1min":0.33700000000000002,"5min":0.315,"15min":0.27800000000000002},"max":{"1min":4.5380000000000003,"5min":4.5380000000000003,"15min":6.7160000000000002},"last":0.74099999999999999}]},{"osd":1,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.88300000000000001,"15min":0.95499999999999996},"min":{"1min":0.434,"5min":0.31,"15min":0.31},"max":{"1min":5.7549999999999999,"5min":5.7549999999999999,"15min":8.7319999999999993},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.86899999999999999,"15min":0.88800000000000001},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.315},"max":{"1min":2.9710000000000001,"5min":3.109,"15min":4.1879999999999997},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.2829999999999999,"15min":1.1060000000000001},"min":{"1min":0.56299999999999994,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6459999999999999,"5min":25.440999999999999,"15min":25.440999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.2,"15min":1.179},"min":{"1min":0.56899999999999995,"5min":0.41699999999999998,"15min":0.41599999999999998},"max":{"1min":2.641,"5min":25.34,"15min":25.34},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.1779999999999999,"15min":1.05},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.42799999999999999},"max":{"1min":8.4390000000000001,"5min":8.4390000000000001,"15min":8.4390000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.383,"5min":1.0900000000000001,"15min":1.0249999999999999},"min":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.45700000000000002},"max":{"1min":4.4119999999999999,"5min":4.6699999999999999,"15min":4.71},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":2.3839999999999999,"5min":1.4850000000000001,"15min":1.331},"min":{"1min":0.55500000000000005,"5min":0.51200000000000001,"15min":0.46999999999999997},"max":{"1min":23.702999999999999,"5min":23.702999999999999,"15min":23.702999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":2.0680000000000001,"5min":1.4159999999999999,"15min":1.2230000000000001},"min":{"1min":0.67900000000000005,"5min":0.56599999999999995,"15min":0.495},"max":{"1min":13.728999999999999,"5min":13.728999999999999,"15min":18.079999999999998},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.292,"15min":1.3240000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":4.6130000000000004,"5min":4.6349999999999998,"15min":57.677999999999997},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.294,"15min":1.361},"min":{"1min":0.66900000000000004,"5min":0.51700000000000002,"15min":0.50800000000000001},"max":{"1min":4.4980000000000002,"5min":5.4269999999999996,"15min":57.828000000000003},"last":0.82499999999999996}]},{"osd":7,"last update":"Thu Mar 30 19:35:14 2023","interfaces":[{"interface":"back","average":{"1min":2.399,"5min":1.4770000000000001,"15min":1.276},"min":{"1min":0.60599999999999998,"5min":0.56200000000000006,"15min":0.52600000000000002},"max":{"1min":5.4649999999999999,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":1.075},{"interface":"front","average":{"1min":1.575,"5min":1.258,"15min":1.2330000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":5.681,"5min":5.681,"15min":7.0529999999999999},"last":0.58199999999999996}]}]},{"osd":2,"up_from":14,"seq":60129550342,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1028912,"kb_used_data":66792,"kb_used_omap":2179,"kb_used_meta":959932,"kb_avail":93342928,"statfs":{"total":96636764160,"available":95583158272,"internally_reserved":0,"allocated":68395008,"data_stored":68075636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2231691,"internal_metadata":982970997},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4720,"apply_latency_ms":4720,"commit_latency_ns":4720000000,"apply_latency_ns":4720000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:52 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":0.89300000000000002,"15min":1.2549999999999999},"min":{"1min":0.28199999999999997,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":3.492,"5min":4.0259999999999998,"15min":97.593999999999994},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.2589999999999999,"5min":0.93799999999999994,"15min":1.347},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27500000000000002},"max":{"1min":9.1110000000000007,"5min":9.1110000000000007,"15min":97.484999999999999},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Mar 30 19:35:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.83899999999999997,"15min":1.3600000000000001},"min":{"1min":0.30599999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":3.145,"5min":3.145,"15min":139.036},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0029999999999999,"15min":1.4399999999999999},"min":{"1min":0.40200000000000002,"5min":0.34200000000000003,"15min":0.33500000000000002},"max":{"1min":4.0049999999999999,"5min":4.673,"15min":139.107},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Mar 30 19:35:52 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.0269999999999999,"15min":1.833},"min":{"1min":0.39900000000000002,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":9.1449999999999996,"5min":9.1449999999999996,"15min":142.262},"last":0.749},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.01,"15min":1.8400000000000001},"min":{"1min":0.47199999999999998,"5min":0.41899999999999998,"15min":0.36399999999999999},"max":{"1min":3.1899999999999999,"5min":3.3860000000000001,"15min":141.92599999999999},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Mar 30 19:35:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.204,"15min":1.1539999999999999},"min":{"1min":0.46999999999999997,"5min":0.42899999999999999,"15min":0.39200000000000002},"max":{"1min":5.359,"5min":7.6879999999999997,"15min":10.942},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.2190000000000001,"15min":1.2170000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.47699999999999998},"max":{"1min":9.0600000000000005,"5min":9.0600000000000005,"15min":9.5009999999999994},"last":1.079}]},{"osd":5,"last update":"Thu Mar 30 19:35:52 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.0840000000000001,"15min":1.1779999999999999},"min":{"1min":0.47899999999999998,"5min":0.46800000000000003,"15min":0.45000000000000001},"max":{"1min":3.274,"5min":4.6550000000000002,"15min":24.672000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.345,"5min":1.294,"15min":1.258},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.44900000000000001},"max":{"1min":5.5759999999999996,"5min":5.6870000000000003,"15min":13.996},"last":1.014}]},{"osd":6,"last update":"Thu Mar 30 19:35:52 2023","interfaces":[{"interface":"back","average":{"1min":2.0950000000000002,"5min":1.492,"15min":1.363},"min":{"1min":0.499,"5min":0.499,"15min":0.49199999999999999},"max":{"1min":21.402999999999999,"5min":21.402999999999999,"15min":21.402999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.55,"5min":1.246,"15min":1.2390000000000001},"min":{"1min":0.66000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":9.327,"5min":9.327,"15min":18.489000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Thu Mar 30 19:35:52 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":1.6180000000000001,"15min":1.4259999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.44900000000000001},"max":{"1min":10.426,"5min":20.303999999999998,"15min":20.303999999999998},"last":1.2549999999999999},{"interface":"front","average":{"1min":2.0529999999999999,"5min":1.6419999999999999,"15min":1.492},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":12.316000000000001,"5min":21.478999999999999,"15min":24.937000000000001},"last":1.157}]}]},{"osd":1,"up_from":14,"seq":60129550350,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1013872,"kb_used_data":552,"kb_used_omap":4451,"kb_used_meta":1008860,"kb_avail":93357968,"statfs":{"total":96636764160,"available":95598559232,"internally_reserved":0,"allocated":565248,"data_stored":255063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558838,"internal_metadata":1033072650},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":0.97399999999999998,"15min":1.0469999999999999},"min":{"1min":0.33800000000000002,"5min":0.26800000000000002,"15min":0.252},"max":{"1min":12.628,"5min":12.628,"15min":25.765000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.997,"5min":0.93000000000000005,"15min":1.075},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28000000000000003},"max":{"1min":7.4470000000000001,"5min":7.4470000000000001,"15min":25.527999999999999},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.8879999999999999,"5min":1.0509999999999999,"15min":1.0740000000000001},"min":{"1min":0.36699999999999999,"5min":0.313,"15min":0.313},"max":{"1min":15.252000000000001,"5min":15.252000000000001,"15min":15.252000000000001},"last":1.127},{"interface":"front","average":{"1min":2.177,"5min":1.117,"15min":1.0740000000000001},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.34499999999999997},"max":{"1min":15.206,"5min":15.206,"15min":15.206},"last":0.92900000000000005}]},{"osd":3,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.0029999999999999,"15min":1.1100000000000001},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":8.1920000000000002,"5min":8.1920000000000002,"15min":18.219000000000001},"last":0.999},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.044,"15min":1.1739999999999999},"min":{"1min":0.438,"5min":0.378,"15min":0.36599999999999999},"max":{"1min":7.7439999999999998,"5min":7.7439999999999998,"15min":25.456},"last":0.86299999999999999}]},{"osd":4,"last update":"Thu Mar 30 19:35:38 2023","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":1.0920000000000001,"15min":1.135},"min":{"1min":0.50600000000000001,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":6.0220000000000002,"5min":6.0220000000000002,"15min":13.728},"last":1.236},{"interface":"front","average":{"1min":1.466,"5min":1.105,"15min":1.1140000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":8.2230000000000008,"5min":8.2230000000000008,"15min":10.217000000000001},"last":1.159}]},{"osd":5,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.746,"5min":1.242,"15min":1.423},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":7.6749999999999998,"5min":7.6749999999999998,"15min":81.075999999999993},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.8340000000000001,"5min":1.2889999999999999,"15min":1.5109999999999999},"min":{"1min":0.54200000000000004,"5min":0.48899999999999999,"15min":0.44800000000000001},"max":{"1min":6.093,"5min":6.093,"15min":81.012},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":2.8410000000000002,"5min":1.5049999999999999,"15min":1.284},"min":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.51400000000000001},"max":{"1min":26.280999999999999,"5min":26.280999999999999,"15min":26.280999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":2.661,"5min":1.5309999999999999,"15min":1.3480000000000001},"min":{"1min":0.57099999999999995,"5min":0.52300000000000002,"15min":0.47999999999999998},"max":{"1min":26.742999999999999,"5min":26.742999999999999,"15min":26.742999999999999},"last":1.1910000000000001}]},{"osd":7,"last update":"Thu Mar 30 19:35:16 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.361,"15min":1.26},"min":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.53000000000000003},"max":{"1min":7.7119999999999997,"5min":7.7119999999999997,"15min":8.9290000000000003},"last":1.2150000000000001},{"interface":"front","average":{"1min":2.2509999999999999,"5min":1.4970000000000001,"15min":1.365},"min":{"1min":0.64100000000000001,"5min":0.54700000000000004,"15min":0.50900000000000001},"max":{"1min":16.645,"5min":16.645,"15min":16.645},"last":1.0349999999999999}]}]},{"osd":0,"up_from":14,"seq":60129550319,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":728944,"kb_used_data":1128,"kb_used_omap":3147,"kb_used_meta":724660,"kb_avail":93642896,"statfs":{"total":96636764160,"available":95890325504,"internally_reserved":0,"allocated":1155072,"data_stored":844088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3223258,"internal_metadata":742052134},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":0.91900000000000004,"15min":0.86599999999999999},"min":{"1min":0.32500000000000001,"5min":0.29899999999999999,"15min":0.23400000000000001},"max":{"1min":10.074,"5min":10.074,"15min":12.294},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.177,"5min":0.95199999999999996,"15min":0.97099999999999997},"min":{"1min":0.442,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":10.473000000000001,"5min":10.473000000000001,"15min":10.473000000000001},"last":1.054}]},{"osd":2,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":3.3029999999999999,"5min":1.3959999999999999,"15min":1.117},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":46.451999999999998,"5min":46.451999999999998,"15min":46.451999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":2.3530000000000002,"5min":1.159,"15min":1.056},"min":{"1min":0.44600000000000001,"5min":0.34799999999999998,"15min":0.32200000000000001},"max":{"1min":33.904000000000003,"5min":33.904000000000003,"15min":33.904000000000003},"last":0.85599999999999998}]},{"osd":3,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":3.5760000000000001,"5min":1.4910000000000001,"15min":1.2110000000000001},"min":{"1min":0.41899999999999998,"5min":0.371,"15min":0.34599999999999997},"max":{"1min":50.244999999999997,"5min":50.244999999999997,"15min":50.244999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.0940000000000001,"5min":0.95999999999999996,"15min":0.96799999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.6280000000000001,"5min":4.5270000000000001,"15min":12.481999999999999},"last":0.623}]},{"osd":4,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.2290000000000001,"15min":1.397},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.46100000000000002},"max":{"1min":10.550000000000001,"5min":10.550000000000001,"15min":77.847999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":3.8540000000000001,"5min":1.76,"15min":1.573},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":61.817,"5min":61.817,"15min":77.653999999999996},"last":1.0669999999999999}]},{"osd":5,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":3.613,"5min":1.855,"15min":1.3700000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":55.627000000000002,"5min":55.627000000000002,"15min":55.627000000000002},"last":0.75},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.0700000000000001,"15min":1.032},"min":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.44800000000000001},"max":{"1min":3.71,"5min":4.4880000000000004,"15min":12.173999999999999},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":4.7460000000000004,"5min":1.98,"15min":2.581},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":52.380000000000003,"5min":52.380000000000003,"15min":211.46600000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":2.0489999999999999,"5min":1.5680000000000001,"15min":2.3759999999999999},"min":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.50600000000000001},"max":{"1min":20.934999999999999,"5min":20.934999999999999,"15min":210.86699999999999},"last":0.88400000000000001}]},{"osd":7,"last update":"Thu Mar 30 19:35:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.401,"15min":1.3100000000000001},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":10.84,"5min":10.84,"15min":10.84},"last":1.002},{"interface":"front","average":{"1min":3.73,"5min":1.8320000000000001,"15min":1.4770000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":50.421999999999997,"5min":50.421999999999997,"15min":50.421999999999997},"last":0.90000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-30T19:36:13.460 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-03-30T08:10:51.832838+0000 time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=8, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=19, tm_min=35, tm_sec=51, tm_wday=3, tm_yday=89, tm_isdst=0) 2023-03-30T19:36:13.460 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-03-30T08:10:51.832838+0000 time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=8, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=19, tm_min=35, tm_sec=51, tm_wday=3, tm_yday=89, tm_isdst=0) 2023-03-30T19:36:13.461 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-03-30T08:10:51.832838+0000 time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=8, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=19, tm_min=35, tm_sec=51, tm_wday=3, tm_yday=89, tm_isdst=0) 2023-03-30T19:36:13.461 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-03-30T08:10:51.832838+0000 time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=8, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=19, tm_min=35, tm_sec=51, tm_wday=3, tm_yday=89, tm_isdst=0) 2023-03-30T19:36:13.461 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-03-30T08:10:51.832838+0000 time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=8, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=19, tm_min=35, tm_sec=51, tm_wday=3, tm_yday=89, tm_isdst=0) 2023-03-30T19:36:13.462 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-03-30T08:10:51.832838+0000 time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=8, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=19, tm_min=35, tm_sec=51, tm_wday=3, tm_yday=89, tm_isdst=0) 2023-03-30T19:36:13.462 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-03-30T08:10:51.832838+0000 time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=8, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=19, tm_min=35, tm_sec=51, tm_wday=3, tm_yday=89, tm_isdst=0) 2023-03-30T19:36:13.462 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-03-30T08:10:44.620691+0000 time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=8, tm_min=10, tm_sec=44, tm_wday=3, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=3, tm_mday=30, tm_hour=19, tm_min=35, tm_sec=51, tm_wday=3, tm_yday=89, tm_isdst=0) 2023-03-30T19:36:13.463 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-03-30T19:36:33.464 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-30T19:36:33.626 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.620+0000 7fb031546700 1 Processor -- start 2023-03-30T19:36:33.627 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.620+0000 7fb031546700 1 -- start start 2023-03-30T19:36:33.628 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb031546700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb02c15c9b0 0x7fb02c06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:33.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb031546700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c0b4740 con 0x7fb02c0b61e0 2023-03-30T19:36:33.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb031546700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c0ceb70 con 0x7fb02c06c3d0 2023-03-30T19:36:33.629 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb031546700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0cee50 con 0x7fb02c15c9b0 2023-03-30T19:36:33.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb02b7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb02c0b61e0 0x7fb02c0b4030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34688/0 (socket says 172.21.15.87:34688) 2023-03-30T19:36:33.630 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb02b7fe700 1 -- 172.21.15.87:0/3376371560 learned_addr learned my addr 172.21.15.87:0/3376371560 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:36:33.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb02affd700 1 --2- 172.21.15.87:0/3376371560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb02c15c9b0 0x7fb02c06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:33.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb029ffb700 1 -- 172.21.15.87:0/3376371560 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876979206 0 0) 0x7fb02c0b4740 con 0x7fb02c0b61e0 2023-03-30T19:36:33.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb029ffb700 1 -- 172.21.15.87:0/3376371560 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0140035d0 con 0x7fb02c0b61e0 2023-03-30T19:36:33.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb029ffb700 1 -- 172.21.15.87:0/3376371560 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505840291 0 0) 0x7fb02c0ceb70 con 0x7fb02c06c3d0 2023-03-30T19:36:33.631 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb029ffb700 1 -- 172.21.15.87:0/3376371560 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb02c0b4740 con 0x7fb02c06c3d0 2023-03-30T19:36:33.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb029ffb700 1 -- 172.21.15.87:0/3376371560 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1270168477 0 0) 0x7fb0140035d0 con 0x7fb02c0b61e0 2023-03-30T19:36:33.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb02affd700 1 -- 172.21.15.87:0/3376371560 >> v1:172.21.15.115:6789/0 conn(0x7fb02c06c3d0 legacy=0x7fb02c0b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:33.632 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb02affd700 1 -- 172.21.15.87:0/3376371560 >> v1:172.21.15.87:6789/0 conn(0x7fb02c0b61e0 legacy=0x7fb02c0b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:33.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb02affd700 1 -- 172.21.15.87:0/3376371560 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0b49d0 con 0x7fb02c15c9b0 2023-03-30T19:36:33.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.624+0000 7fb02affd700 1 --2- 172.21.15.87:0/3376371560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb02c15c9b0 0x7fb02c06ade0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009870 tx=0x7fb01c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b6ce074e45687ab server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:33.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.628+0000 7fb029ffb700 1 -- 172.21.15.87:0/3376371560 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0240019f0 con 0x7fb02c15c9b0 2023-03-30T19:36:33.633 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.628+0000 7fb029ffb700 1 -- 172.21.15.87:0/3376371560 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c004030 con 0x7fb02c15c9b0 2023-03-30T19:36:33.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.628+0000 7fb029ffb700 1 -- 172.21.15.87:0/3376371560 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c0043c0 con 0x7fb02c15c9b0 2023-03-30T19:36:33.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.628+0000 7fb031546700 1 -- 172.21.15.87:0/3376371560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb02c15c9b0 msgr2=0x7fb02c06ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:33.634 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.628+0000 7fb031546700 1 --2- 172.21.15.87:0/3376371560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb02c15c9b0 0x7fb02c06ade0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009870 tx=0x7fb01c009b80 comp rx=0 tx=0).stop 2023-03-30T19:36:33.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.628+0000 7fb031546700 1 -- 172.21.15.87:0/3376371560 shutdown_connections 2023-03-30T19:36:33.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.628+0000 7fb031546700 1 --2- 172.21.15.87:0/3376371560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb02c15c9b0 0x7fb02c06ade0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:33.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.628+0000 7fb031546700 1 -- 172.21.15.87:0/3376371560 >> 172.21.15.87:0/3376371560 conn(0x7fb02c099dc0 msgr2=0x7fb02c0d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:33.635 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.628+0000 7fb031546700 1 -- 172.21.15.87:0/3376371560 shutdown_connections 2023-03-30T19:36:33.636 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.628+0000 7fb031546700 1 -- 172.21.15.87:0/3376371560 wait complete. 2023-03-30T19:36:33.637 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.632+0000 7fb031546700 1 Processor -- start 2023-03-30T19:36:33.638 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.632+0000 7fb031546700 1 -- start start 2023-03-30T19:36:33.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.632+0000 7fb031546700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb02c06c3d0 0x7fb02c0cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:33.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.632+0000 7fb031546700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb02c0b61e0 0x7fb02c15b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:33.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.632+0000 7fb031546700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb02c15c9b0 0x7fb02c06e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:33.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.632+0000 7fb031546700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0cda60 con 0x7fb02c06c3d0 2023-03-30T19:36:33.639 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.632+0000 7fb031546700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0700a0 con 0x7fb02c0b61e0 2023-03-30T19:36:33.640 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.632+0000 7fb031546700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c070380 con 0x7fb02c15c9b0 2023-03-30T19:36:33.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.632+0000 7fb02a7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb02c0b61e0 0x7fb02c15b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:33.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.632+0000 7fb02affd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb02c06c3d0 0x7fb02c0cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:33.641 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.632+0000 7fb02a7fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb02c0b61e0 0x7fb02c15b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.87:55116/0 (socket says 172.21.15.87:55116) 2023-03-30T19:36:33.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.632+0000 7fb02a7fc700 1 -- 172.21.15.87:0/235937868 learned_addr learned my addr 172.21.15.87:0/235937868 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:33.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.632+0000 7fb02b7fe700 1 --2- 172.21.15.87:0/235937868 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb02c15c9b0 0x7fb02c06e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:33.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.636+0000 7fb02a7fc700 1 -- 172.21.15.87:0/235937868 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb02c15c9b0 msgr2=0x7fb02c06e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:33.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.636+0000 7fb02a7fc700 1 --2- 172.21.15.87:0/235937868 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb02c15c9b0 0x7fb02c06e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:33.642 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.636+0000 7fb02a7fc700 1 -- 172.21.15.87:0/235937868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb02c06c3d0 msgr2=0x7fb02c0cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:33.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.636+0000 7fb02a7fc700 1 --2- 172.21.15.87:0/235937868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb02c06c3d0 0x7fb02c0cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:33.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.636+0000 7fb02a7fc700 1 -- 172.21.15.87:0/235937868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c009450 con 0x7fb02c0b61e0 2023-03-30T19:36:33.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.636+0000 7fb02a7fc700 1 --2- 172.21.15.87:0/235937868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb02c0b61e0 0x7fb02c15b2a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c4c0 tx=0x7fb02000c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:33.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.636+0000 7fb0137fe700 1 -- 172.21.15.87:0/235937868 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200052d0 con 0x7fb02c0b61e0 2023-03-30T19:36:33.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.636+0000 7fb0137fe700 1 -- 172.21.15.87:0/235937868 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02000ce90 con 0x7fb02c0b61e0 2023-03-30T19:36:33.643 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.636+0000 7fb031546700 1 -- 172.21.15.87:0/235937868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c09a2c0 con 0x7fb02c0b61e0 2023-03-30T19:36:33.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.636+0000 7fb0137fe700 1 -- 172.21.15.87:0/235937868 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200036a0 con 0x7fb02c0b61e0 2023-03-30T19:36:33.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.636+0000 7fb031546700 1 -- 172.21.15.87:0/235937868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c0b4cb0 con 0x7fb02c0b61e0 2023-03-30T19:36:33.644 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.636+0000 7fb031546700 1 -- 172.21.15.87:0/235937868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c0cf130 con 0x7fb02c0b61e0 2023-03-30T19:36:33.645 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.640+0000 7fb0137fe700 1 -- 172.21.15.87:0/235937868 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fb020003800 con 0x7fb02c0b61e0 2023-03-30T19:36:33.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.640+0000 7fb0137fe700 1 --2- 172.21.15.87:0/235937868 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb0180653f0 0x7fb0180678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:33.646 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.640+0000 7fb0137fe700 1 -- 172.21.15.87:0/235937868 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fb020081aa0 con 0x7fb02c0b61e0 2023-03-30T19:36:33.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.640+0000 7fb02affd700 1 --2- 172.21.15.87:0/235937868 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb0180653f0 0x7fb0180678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:33.647 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.640+0000 7fb02affd700 1 --2- 172.21.15.87:0/235937868 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb0180653f0 0x7fb0180678a0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fb02c15d8d0 tx=0x7fb01c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:33.653 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.648+0000 7fb0137fe700 1 -- 172.21.15.87:0/235937868 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7fb02004f800 con 0x7fb02c0b61e0 2023-03-30T19:36:33.822 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.816+0000 7fb031546700 1 -- 172.21.15.87:0/235937868 --> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb02c072cf0 con 0x7fb0180653f0 2023-03-30T19:36:33.829 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.824+0000 7fb0137fe700 1 -- 172.21.15.87:0/235937868 <== mgr.4105 v2:172.21.15.87:6832/33667 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71258 (secure 0 0 0) 0x7fb02c072cf0 con 0x7fb0180653f0 2023-03-30T19:36:33.831 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:36:33.834 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.828+0000 7fb031546700 1 -- 172.21.15.87:0/235937868 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb0180653f0 msgr2=0x7fb0180678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.828+0000 7fb031546700 1 --2- 172.21.15.87:0/235937868 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb0180653f0 0x7fb0180678a0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fb02c15d8d0 tx=0x7fb01c008030 comp rx=0 tx=0).stop 2023-03-30T19:36:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.828+0000 7fb031546700 1 -- 172.21.15.87:0/235937868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb02c0b61e0 msgr2=0x7fb02c15b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.828+0000 7fb031546700 1 --2- 172.21.15.87:0/235937868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb02c0b61e0 0x7fb02c15b2a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c4c0 tx=0x7fb02000c7d0 comp rx=0 tx=0).stop 2023-03-30T19:36:33.836 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.828+0000 7fb031546700 1 -- 172.21.15.87:0/235937868 shutdown_connections 2023-03-30T19:36:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.828+0000 7fb031546700 1 --2- 172.21.15.87:0/235937868 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7fb0180653f0 0x7fb0180678a0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.828+0000 7fb031546700 1 --2- 172.21.15.87:0/235937868 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb02c15c9b0 0x7fb02c06e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.828+0000 7fb031546700 1 --2- 172.21.15.87:0/235937868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb02c0b61e0 0x7fb02c15b2a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.828+0000 7fb031546700 1 --2- 172.21.15.87:0/235937868 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb02c06c3d0 0x7fb02c0cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:33.837 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.828+0000 7fb031546700 1 -- 172.21.15.87:0/235937868 >> 172.21.15.87:0/235937868 conn(0x7fb02c099dc0 msgr2=0x7fb02c0b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.828+0000 7fb031546700 1 -- 172.21.15.87:0/235937868 shutdown_connections 2023-03-30T19:36:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:33.828+0000 7fb031546700 1 -- 172.21.15.87:0/235937868 wait complete. 2023-03-30T19:36:33.838 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2023-03-30T19:36:33.855 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":20605,"stamp":"2023-03-30T19:36:32.282841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":7277508,"kb_used_data":5572,"kb_used_omap":31256,"kb_used_meta":7240615,"kb_avail":747697212,"statfs":{"total":773094113280,"available":765641945088,"internally_reserved":0,"allocated":5705728,"data_stored":3219897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32006444,"internal_metadata":7414390484},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003591"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":364,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-03-30T19:36:14.911963+0000","last_change":"2023-03-30T19:36:14.911963+0000","last_active":"2023-03-30T19:36:14.911963+0000","last_peered":"2023-03-30T19:36:14.911963+0000","last_clean":"2023-03-30T19:36:14.911963+0000","last_became_active":"2023-03-30T08:10:52.870678+0000","last_became_peered":"2023-03-30T08:10:52.870678+0000","last_unstale":"2023-03-30T19:36:14.911963+0000","last_undegraded":"2023-03-30T19:36:14.911963+0000","last_fullsized":"2023-03-30T19:36:14.911963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T19:36:14.911746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T19:36:14.911746+0000","last_clean_scrub_stamp":"2023-03-30T19:36:14.911746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-04-01T06:59:51.303029+0000","scrub_duration":0.47283867499999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":366,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-03-30T19:36:14.063158+0000","last_change":"2023-03-30T19:36:14.063446+0000","last_active":"2023-03-30T19:36:14.063158+0000","last_peered":"2023-03-30T19:36:14.063158+0000","last_clean":"2023-03-30T19:36:14.063158+0000","last_became_active":"2023-03-30T08:10:52.871152+0000","last_became_peered":"2023-03-30T08:10:52.871152+0000","last_unstale":"2023-03-30T19:36:14.063158+0000","last_undegraded":"2023-03-30T19:36:14.063158+0000","last_fullsized":"2023-03-30T19:36:14.063158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T19:36:14.063117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T19:36:14.063117+0000","last_clean_scrub_stamp":"2023-03-30T19:36:14.063117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-04-01T04:21:00.021801+0000","scrub_duration":0.43735259500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":372,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-03-30T19:36:27.019072+0000","last_change":"2023-03-30T19:36:27.019293+0000","last_active":"2023-03-30T19:36:27.019072+0000","last_peered":"2023-03-30T19:36:27.019072+0000","last_clean":"2023-03-30T19:36:27.019072+0000","last_became_active":"2023-03-30T08:10:52.920885+0000","last_became_peered":"2023-03-30T08:10:52.920885+0000","last_unstale":"2023-03-30T19:36:27.019072+0000","last_undegraded":"2023-03-30T19:36:27.019072+0000","last_fullsized":"2023-03-30T19:36:27.019072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T19:36:27.019031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T19:36:27.019031+0000","last_clean_scrub_stamp":"2023-03-30T19:36:27.019031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T19:52:02.329770+0000","scrub_duration":0.37473963700000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":378,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-03-30T19:36:08.062092+0000","last_change":"2023-03-30T19:36:08.062092+0000","last_active":"2023-03-30T19:36:08.062092+0000","last_peered":"2023-03-30T19:36:08.062092+0000","last_clean":"2023-03-30T19:36:08.062092+0000","last_became_active":"2023-03-30T08:10:52.921234+0000","last_became_peered":"2023-03-30T08:10:52.921234+0000","last_unstale":"2023-03-30T19:36:08.062092+0000","last_undegraded":"2023-03-30T19:36:08.062092+0000","last_fullsized":"2023-03-30T19:36:08.062092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T19:36:08.061867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T19:36:08.061867+0000","last_clean_scrub_stamp":"2023-03-30T19:36:08.061867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-04-01T04:59:21.168669+0000","scrub_duration":0.41929230699999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":374,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-03-30T19:36:19.529541+0000","last_change":"2023-03-30T19:36:19.529782+0000","last_active":"2023-03-30T19:36:19.529541+0000","last_peered":"2023-03-30T19:36:19.529541+0000","last_clean":"2023-03-30T19:36:19.529541+0000","last_became_active":"2023-03-30T08:10:52.865919+0000","last_became_peered":"2023-03-30T08:10:52.865919+0000","last_unstale":"2023-03-30T19:36:19.529541+0000","last_undegraded":"2023-03-30T19:36:19.529541+0000","last_fullsized":"2023-03-30T19:36:19.529541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T19:36:19.529502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T19:36:19.529502+0000","last_clean_scrub_stamp":"2023-03-30T19:36:19.529502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-03-31T21:43:00.718210+0000","scrub_duration":0.4425752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":376,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-03-30T19:36:12.446409+0000","last_change":"2023-03-30T19:36:12.446644+0000","last_active":"2023-03-30T19:36:12.446409+0000","last_peered":"2023-03-30T19:36:12.446409+0000","last_clean":"2023-03-30T19:36:12.446409+0000","last_became_active":"2023-03-30T08:10:52.920327+0000","last_became_peered":"2023-03-30T08:10:52.920327+0000","last_unstale":"2023-03-30T19:36:12.446409+0000","last_undegraded":"2023-03-30T19:36:12.446409+0000","last_fullsized":"2023-03-30T19:36:12.446409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T19:36:12.446345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T19:36:12.446345+0000","last_clean_scrub_stamp":"2023-03-30T19:36:12.446345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-04-01T05:21:59.019917+0000","scrub_duration":0.56818379900000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":385,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-03-30T19:36:23.927735+0000","last_change":"2023-03-30T19:36:23.928008+0000","last_active":"2023-03-30T19:36:23.927735+0000","last_peered":"2023-03-30T19:36:23.927735+0000","last_clean":"2023-03-30T19:36:23.927735+0000","last_became_active":"2023-03-30T08:10:52.866055+0000","last_became_peered":"2023-03-30T08:10:52.866055+0000","last_unstale":"2023-03-30T19:36:23.927735+0000","last_undegraded":"2023-03-30T19:36:23.927735+0000","last_fullsized":"2023-03-30T19:36:23.927735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T19:36:23.927697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T19:36:23.927697+0000","last_clean_scrub_stamp":"2023-03-30T19:36:23.927697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-04-01T04:19:47.019741+0000","scrub_duration":0.29133928999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":374,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-03-30T19:36:16.499232+0000","last_change":"2023-03-30T19:36:16.499353+0000","last_active":"2023-03-30T19:36:16.499232+0000","last_peered":"2023-03-30T19:36:16.499232+0000","last_clean":"2023-03-30T19:36:16.499232+0000","last_became_active":"2023-03-30T08:10:52.867790+0000","last_became_peered":"2023-03-30T08:10:52.867790+0000","last_unstale":"2023-03-30T19:36:16.499232+0000","last_undegraded":"2023-03-30T19:36:16.499232+0000","last_fullsized":"2023-03-30T19:36:16.499232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-30T19:36:16.499215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-30T19:36:16.499215+0000","last_clean_scrub_stamp":"2023-03-30T19:36:16.499215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-04-01T03:37:34.309682+0000","scrub_duration":0.472587647,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"48'119","reported_seq":541,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-03-30T19:36:22.201695+0000","last_change":"2023-03-30T19:36:22.201937+0000","last_active":"2023-03-30T19:36:22.201695+0000","last_peered":"2023-03-30T19:36:22.201695+0000","last_clean":"2023-03-30T19:36:22.201695+0000","last_became_active":"2023-03-30T08:10:45.711645+0000","last_became_peered":"2023-03-30T08:10:45.711645+0000","last_unstale":"2023-03-30T19:36:22.201695+0000","last_undegraded":"2023-03-30T19:36:22.201695+0000","last_fullsized":"2023-03-30T19:36:22.201695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'119","last_scrub_stamp":"2023-03-30T19:36:22.201650+0000","last_deep_scrub":"48'119","last_deep_scrub_stamp":"2023-03-30T19:36:22.201650+0000","last_clean_scrub_stamp":"2023-03-30T19:36:22.201650+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-04-01T03:31:11.731323+0000","scrub_duration":1.5759953790000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424517656,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1005424,"kb_used_data":552,"kb_used_omap":4629,"kb_used_meta":1000234,"kb_avail":93366416,"statfs":{"total":96636764160,"available":95607209984,"internally_reserved":0,"allocated":565248,"data_stored":255063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4740435,"internal_metadata":1024240301},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:50 2023","interfaces":[{"interface":"back","average":{"1min":4.1740000000000004,"5min":1.54,"15min":1.0309999999999999},"min":{"1min":0.39700000000000002,"5min":0.311,"15min":0.311},"max":{"1min":30.640000000000001,"5min":30.640000000000001,"15min":30.640000000000001},"last":1.028},{"interface":"front","average":{"1min":3.7360000000000002,"5min":1.4530000000000001,"15min":1.0629999999999999},"min":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.34599999999999997},"max":{"1min":30.814,"5min":30.814,"15min":30.814},"last":1.274}]},{"osd":1,"last update":"Thu Mar 30 19:35:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9359999999999999,"5min":1.248,"15min":1.0329999999999999},"min":{"1min":0.46400000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":7.0839999999999996,"5min":10.169,"15min":10.169},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.542,"5min":1.1619999999999999,"15min":0.94799999999999995},"min":{"1min":0.52800000000000002,"5min":0.40000000000000002,"15min":0.377},"max":{"1min":5.3380000000000001,"5min":8.5220000000000002,"15min":8.5220000000000002},"last":1.135}]},{"osd":2,"last update":"Thu Mar 30 19:35:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.1419999999999999,"15min":1.004},"min":{"1min":0.372,"5min":0.372,"15min":0.35899999999999999},"max":{"1min":4.2999999999999998,"5min":11.26,"15min":11.26},"last":1.0940000000000001},{"interface":"front","average":{"1min":2.48,"5min":1.411,"15min":1.145},"min":{"1min":0.497,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":9.718,"5min":10.236000000000001,"15min":10.236000000000001},"last":1.302}]},{"osd":3,"last update":"Thu Mar 30 19:35:50 2023","interfaces":[{"interface":"back","average":{"1min":5.6390000000000002,"5min":2.0739999999999998,"15min":1.7310000000000001},"min":{"1min":0.59099999999999997,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":25.382999999999999,"5min":25.382999999999999,"15min":113.637},"last":1.387},{"interface":"front","average":{"1min":2.3210000000000002,"5min":1.387,"15min":1.5489999999999999},"min":{"1min":0.52900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":17.134,"5min":17.134,"15min":113.90600000000001},"last":1.351}]},{"osd":4,"last update":"Thu Mar 30 19:35:50 2023","interfaces":[{"interface":"back","average":{"1min":2.5,"5min":1.4330000000000001,"15min":1.073},"min":{"1min":0.42999999999999999,"5min":0.42699999999999999,"15min":0.36599999999999999},"max":{"1min":18.821000000000002,"5min":18.821000000000002,"15min":18.821000000000002},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":1.099,"15min":1.01},"min":{"1min":0.56499999999999995,"5min":0.45800000000000002,"15min":0.40699999999999997},"max":{"1min":1.198,"5min":6.5819999999999999,"15min":6.5819999999999999},"last":1.1639999999999999}]},{"osd":5,"last update":"Thu Mar 30 19:35:50 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.236,"15min":1.107},"min":{"1min":0.55500000000000005,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":6.149,"5min":6.6079999999999997,"15min":9.1270000000000007},"last":1.069},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.4450000000000001,"15min":1.175},"min":{"1min":0.59999999999999998,"5min":0.49199999999999999,"15min":0.435},"max":{"1min":5.7910000000000004,"5min":9.0079999999999991,"15min":9.3379999999999992},"last":1.4950000000000001}]},{"osd":7,"last update":"Thu Mar 30 19:35:50 2023","interfaces":[{"interface":"back","average":{"1min":2.5990000000000002,"5min":1.4830000000000001,"15min":1.236},"min":{"1min":0.59999999999999998,"5min":0.54400000000000004,"15min":0.50900000000000001},"max":{"1min":28.132999999999999,"5min":28.132999999999999,"15min":28.132999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.724,"5min":1.6559999999999999,"15min":1.2509999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.48599999999999999},"max":{"1min":11.228999999999999,"5min":22.887,"15min":22.887},"last":1.1930000000000001}]}]},{"osd":7,"up_from":14,"seq":60129550368,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245428,"kb_used_data":1132,"kb_used_omap":4609,"kb_used_meta":239678,"kb_avail":94126412,"statfs":{"total":96636764160,"available":96385445888,"internally_reserved":0,"allocated":1159168,"data_stored":845431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4719691,"internal_metadata":245431221},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88700000000000001,"15min":0.872},"min":{"1min":0.308,"5min":0.308,"15min":0.29399999999999998},"max":{"1min":2.2799999999999998,"5min":4.5439999999999996,"15min":7.5529999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.01,"5min":0.98199999999999998,"15min":0.89800000000000002},"min":{"1min":0.42299999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.9350000000000001,"5min":5.2569999999999997,"15min":5.819},"last":0.85299999999999998}]},{"osd":1,"last update":"Thu Mar 30 19:36:02 2023","interfaces":[{"interface":"back","average":{"1min":1.8500000000000001,"5min":1.181,"15min":1.0269999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.437},"max":{"1min":12.445,"5min":12.445,"15min":12.445},"last":1.081},{"interface":"front","average":{"1min":1.95,"5min":1.2050000000000001,"15min":1.073},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":17.225000000000001,"5min":17.225000000000001,"15min":17.225000000000001},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Mar 30 19:36:02 2023","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":1.403,"15min":1.105},"min":{"1min":0.53900000000000003,"5min":0.40200000000000002,"15min":0.39400000000000002},"max":{"1min":17.498000000000001,"5min":17.498000000000001,"15min":17.498000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.718,"5min":1.2430000000000001,"15min":1.0620000000000001},"min":{"1min":0.48299999999999998,"5min":0.45100000000000001,"15min":0.442},"max":{"1min":12.510999999999999,"5min":12.510999999999999,"15min":12.510999999999999},"last":1.173}]},{"osd":3,"last update":"Thu Mar 30 19:36:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2549999999999999,"15min":1.4950000000000001},"min":{"1min":0.54300000000000004,"5min":0.44600000000000001,"15min":0.43099999999999999},"max":{"1min":3.2360000000000002,"5min":6.3849999999999998,"15min":111.13800000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.163,"15min":1.488},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.45700000000000002},"max":{"1min":3.1040000000000001,"5min":5.3259999999999996,"15min":109.63800000000001},"last":1.2509999999999999}]},{"osd":4,"last update":"Thu Mar 30 19:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":1.194,"15min":1.1719999999999999},"min":{"1min":0.47799999999999998,"5min":0.46300000000000002,"15min":0.34799999999999998},"max":{"1min":2.3239999999999998,"5min":8.7940000000000005,"15min":9.3409999999999993},"last":1.123},{"interface":"front","average":{"1min":1.05,"5min":1.3360000000000001,"15min":1.1739999999999999},"min":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.36399999999999999},"max":{"1min":2.3719999999999999,"5min":7.3090000000000002,"15min":7.3090000000000002},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Mar 30 19:36:02 2023","interfaces":[{"interface":"back","average":{"1min":2.698,"5min":1.6859999999999999,"15min":1.2789999999999999},"min":{"1min":0.63500000000000001,"5min":0.503,"15min":0.41299999999999998},"max":{"1min":17.449000000000002,"5min":17.449000000000002,"15min":17.449000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":2.4630000000000001,"5min":1.5649999999999999,"15min":1.3129999999999999},"min":{"1min":0.58299999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":17.146000000000001,"5min":17.146000000000001,"15min":17.146000000000001},"last":1.0409999999999999}]},{"osd":6,"last update":"Thu Mar 30 19:36:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.4690000000000001,"15min":1.246},"min":{"1min":0.55900000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":4.468,"5min":6.5579999999999998,"15min":6.5579999999999998},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.02,"5min":1.1439999999999999,"15min":1.081},"min":{"1min":0.50600000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":3.0600000000000001,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":1.335}]}]},{"osd":5,"up_from":14,"seq":60129550365,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1089456,"kb_used_data":552,"kb_used_omap":1498,"kb_used_meta":1087397,"kb_avail":93282384,"statfs":{"total":96636764160,"available":95521161216,"internally_reserved":0,"allocated":565248,"data_stored":255063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1534458,"internal_metadata":1113495046},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0369999999999999,"15min":0.96499999999999997},"min":{"1min":0.39600000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.7210000000000001,"5min":7.2210000000000001,"15min":12.332000000000001},"last":1.3180000000000001},{"interface":"front","average":{"1min":8.9109999999999996,"5min":2.6059999999999999,"15min":1.4950000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":200.92699999999999,"5min":200.92699999999999,"15min":200.92699999999999},"last":0.95699999999999996}]},{"osd":1,"last update":"Thu Mar 30 19:36:27 2023","interfaces":[{"interface":"back","average":{"1min":9.0079999999999991,"5min":3.0750000000000002,"15min":1.7070000000000001},"min":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.373},"max":{"1min":200.94800000000001,"5min":200.94800000000001,"15min":200.94800000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":9.0289999999999999,"5min":2.7919999999999998,"15min":1.5760000000000001},"min":{"1min":0.438,"5min":0.41199999999999998,"15min":0.40899999999999997},"max":{"1min":200.90199999999999,"5min":200.90199999999999,"15min":200.90199999999999},"last":1.2370000000000001}]},{"osd":2,"last update":"Thu Mar 30 19:36:27 2023","interfaces":[{"interface":"back","average":{"1min":9.0749999999999993,"5min":3.0049999999999999,"15min":1.73},"min":{"1min":0.52700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":200.99100000000001,"5min":200.99100000000001,"15min":200.99100000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.141,"15min":1.1339999999999999},"min":{"1min":0.433,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.851,"5min":8.4849999999999994,"15min":12.944000000000001},"last":0.86899999999999999}]},{"osd":3,"last update":"Thu Mar 30 19:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.254,"15min":1.169},"min":{"1min":0.745,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":5.6790000000000003,"5min":8.5139999999999993,"15min":13.007},"last":1.139},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.498,"15min":1.2889999999999999},"min":{"1min":0.56599999999999995,"5min":0.51000000000000001,"15min":0.46300000000000002},"max":{"1min":5.6689999999999996,"5min":30.402999999999999,"15min":30.402999999999999},"last":1.1919999999999999}]},{"osd":4,"last update":"Thu Mar 30 19:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.4930000000000001,"15min":1.234},"min":{"1min":0.50700000000000001,"5min":0.442,"15min":0.40899999999999997},"max":{"1min":2.2909999999999999,"5min":30.547999999999998,"15min":30.547999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.258,"15min":1.1579999999999999},"min":{"1min":0.57699999999999996,"5min":0.441,"15min":0.441},"max":{"1min":5.907,"5min":7.3079999999999998,"15min":9.2870000000000008},"last":1.151}]},{"osd":6,"last update":"Thu Mar 30 19:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.5449999999999999,"15min":1.2629999999999999},"min":{"1min":0.56999999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.575,"5min":33.402000000000001,"15min":33.402000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.581,"15min":1.335},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.863,"5min":33.673999999999999,"15min":33.673999999999999},"last":1.014}]},{"osd":7,"last update":"Thu Mar 30 19:36:27 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.3640000000000001,"15min":1.3160000000000001},"min":{"1min":0.55000000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.7709999999999999,"5min":8.5419999999999998,"15min":12.976000000000001},"last":1.349},{"interface":"front","average":{"1min":1.05,"5min":1.4830000000000001,"15min":1.335},"min":{"1min":0.58899999999999997,"5min":0.504,"15min":0.504},"max":{"1min":1.9059999999999999,"5min":24.754000000000001,"15min":24.754000000000001},"last":1.3819999999999999}]}]},{"osd":4,"up_from":14,"seq":60129550360,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1125040,"kb_used_data":552,"kb_used_omap":3500,"kb_used_meta":1120979,"kb_avail":93246800,"statfs":{"total":96636764160,"available":95484723200,"internally_reserved":0,"allocated":565248,"data_stored":255063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3584019,"internal_metadata":1147883501},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":1.0740000000000001,"15min":0.96699999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.313},"max":{"1min":1.3720000000000001,"5min":5.8579999999999997,"15min":5.8579999999999997},"last":1.268},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.0069999999999999,"15min":0.995},"min":{"1min":0.39800000000000002,"5min":0.36499999999999999,"15min":0.34300000000000003},"max":{"1min":6.4989999999999997,"5min":6.4989999999999997,"15min":7.2930000000000001},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.96399999999999997,"15min":0.94699999999999995},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":5.141,"5min":5.141,"15min":5.141},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.3149999999999999,"15min":1.133},"min":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.376},"max":{"1min":2.6389999999999998,"5min":5.7889999999999997,"15min":8.8740000000000006},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":1.2190000000000001,"15min":1.113},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":1.728,"5min":5.7160000000000002,"15min":5.7160000000000002},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.28,"5min":1.159,"15min":1.117},"min":{"1min":0.45300000000000001,"5min":0.433,"15min":0.41899999999999998},"max":{"1min":6.4009999999999998,"5min":7.1639999999999997,"15min":7.3869999999999996},"last":0.89800000000000002}]},{"osd":3,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":2.5499999999999998,"15min":1.5700000000000001},"min":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.434},"max":{"1min":2.214,"5min":116.221,"15min":116.221},"last":1.319},{"interface":"front","average":{"1min":1.3160000000000001,"5min":2.4460000000000002,"15min":1.5649999999999999},"min":{"1min":0.56899999999999995,"5min":0.436,"15min":0.436},"max":{"1min":6.5339999999999998,"5min":116.306,"15min":116.306},"last":1.0740000000000001}]},{"osd":5,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":4.484,"5min":1.6040000000000001,"15min":1.1879999999999999},"min":{"1min":0.45600000000000002,"5min":0.42299999999999999,"15min":0.39400000000000002},"max":{"1min":69.498000000000005,"5min":69.498000000000005,"15min":69.498000000000005},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.278,"15min":1.179},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.42299999999999999},"max":{"1min":2.0470000000000002,"5min":6.024,"15min":10.057},"last":1.1020000000000001}]},{"osd":6,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.109,"15min":1.1799999999999999},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.42399999999999999},"max":{"1min":1.6719999999999999,"5min":6.1879999999999997,"15min":15.928000000000001},"last":1.087},{"interface":"front","average":{"1min":0.83799999999999997,"5min":1.3400000000000001,"15min":1.2929999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.46000000000000002},"max":{"1min":1.583,"5min":5.9260000000000002,"15min":15.566000000000001},"last":1.1910000000000001}]},{"osd":7,"last update":"Thu Mar 30 19:35:40 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.238,"15min":1.204},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.4589999999999996,"5min":6.4589999999999996,"15min":7.3460000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":1.032,"5min":1.093,"15min":1.1679999999999999},"min":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.47599999999999998},"max":{"1min":1.9059999999999999,"5min":6.7160000000000002,"15min":6.7160000000000002},"last":1.244}]}]},{"osd":3,"up_from":14,"seq":60129550334,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1101552,"kb_used_data":552,"kb_used_omap":7240,"kb_used_meta":1093751,"kb_avail":93270288,"statfs":{"total":96636764160,"available":95508774912,"internally_reserved":0,"allocated":565248,"data_stored":255063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7414054,"internal_metadata":1120001754},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:36:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.78400000000000003,"15min":0.78600000000000003},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.25900000000000001},"max":{"1min":3.6850000000000001,"5min":3.6850000000000001,"15min":8.0690000000000008},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.89500000000000002,"15min":0.94199999999999995},"min":{"1min":0.36199999999999999,"5min":0.315,"15min":0.27800000000000002},"max":{"1min":2.6989999999999998,"5min":4.5380000000000003,"15min":6.7160000000000002},"last":1.1559999999999999}]},{"osd":1,"last update":"Thu Mar 30 19:36:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.88600000000000001,"15min":0.93600000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.5149999999999999,"5min":5.7549999999999999,"15min":8.7319999999999993},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88900000000000001,"15min":0.89100000000000001},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.315},"max":{"1min":2.5110000000000001,"5min":3.109,"15min":4.1879999999999997},"last":1.2030000000000001}]},{"osd":2,"last update":"Thu Mar 30 19:36:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.252,"15min":1.1080000000000001},"min":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.9900000000000002,"5min":25.440999999999999,"15min":25.440999999999999},"last":1.24},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.198,"15min":1.1679999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.952,"5min":25.34,"15min":25.34},"last":1.1879999999999999}]},{"osd":4,"last update":"Thu Mar 30 19:36:17 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.1930000000000001,"15min":1.0589999999999999},"min":{"1min":0.52400000000000002,"5min":0.44900000000000001,"15min":0.42799999999999999},"max":{"1min":2.597,"5min":8.4390000000000001,"15min":8.4390000000000001},"last":1.716},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0900000000000001,"15min":1.042},"min":{"1min":0.495,"5min":0.49199999999999999,"15min":0.45700000000000002},"max":{"1min":2.359,"5min":4.6699999999999999,"15min":4.71},"last":1.026}]},{"osd":5,"last update":"Thu Mar 30 19:36:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.4850000000000001,"15min":1.3260000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.46999999999999997},"max":{"1min":1.615,"5min":23.702999999999999,"15min":23.702999999999999},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.4139999999999999,"15min":1.23},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.495},"max":{"1min":2.677,"5min":13.728999999999999,"15min":18.079999999999998},"last":1.829}]},{"osd":6,"last update":"Thu Mar 30 19:36:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.298,"15min":1.3360000000000001},"min":{"1min":0.53100000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.3210000000000002,"5min":4.6349999999999998,"15min":57.677999999999997},"last":1.29},{"interface":"front","average":{"1min":1.129,"5min":1.3109999999999999,"15min":1.3660000000000001},"min":{"1min":0.63100000000000001,"5min":0.51700000000000002,"15min":0.50800000000000001},"max":{"1min":2.4790000000000001,"5min":5.4269999999999996,"15min":57.828000000000003},"last":1.331}]},{"osd":7,"last update":"Thu Mar 30 19:36:17 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.4630000000000001,"15min":1.2909999999999999},"min":{"1min":0.63200000000000001,"5min":0.56200000000000006,"15min":0.52600000000000002},"max":{"1min":3.9359999999999999,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.296,"15min":1.23},"min":{"1min":0.58199999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.7069999999999999,"5min":5.681,"15min":7.0529999999999999},"last":1.3680000000000001}]}]},{"osd":2,"up_from":14,"seq":60129550346,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":967792,"kb_used_data":552,"kb_used_omap":2179,"kb_used_meta":965052,"kb_avail":93404048,"statfs":{"total":96636764160,"available":95645745152,"internally_reserved":0,"allocated":565248,"data_stored":255063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2231691,"internal_metadata":988213877},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:35:52 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":0.89300000000000002,"15min":1.2549999999999999},"min":{"1min":0.28199999999999997,"5min":0.27100000000000002,"15min":0.26200000000000001},"max":{"1min":3.492,"5min":4.0259999999999998,"15min":97.593999999999994},"last":1.252},{"interface":"front","average":{"1min":1.2589999999999999,"5min":0.93799999999999994,"15min":1.347},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.27500000000000002},"max":{"1min":9.1110000000000007,"5min":9.1110000000000007,"15min":97.484999999999999},"last":0.86299999999999999}]},{"osd":1,"last update":"Thu Mar 30 19:35:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.83899999999999997,"15min":1.3600000000000001},"min":{"1min":0.30599999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":3.145,"5min":3.145,"15min":139.036},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0029999999999999,"15min":1.4399999999999999},"min":{"1min":0.40200000000000002,"5min":0.34200000000000003,"15min":0.33500000000000002},"max":{"1min":4.0049999999999999,"5min":4.673,"15min":139.107},"last":0.98799999999999999}]},{"osd":3,"last update":"Thu Mar 30 19:35:52 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.0269999999999999,"15min":1.833},"min":{"1min":0.39900000000000002,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":9.1449999999999996,"5min":9.1449999999999996,"15min":142.262},"last":1.083},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.01,"15min":1.8400000000000001},"min":{"1min":0.47199999999999998,"5min":0.41899999999999998,"15min":0.36399999999999999},"max":{"1min":3.1899999999999999,"5min":3.3860000000000001,"15min":141.92599999999999},"last":1.0649999999999999}]},{"osd":4,"last update":"Thu Mar 30 19:35:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.204,"15min":1.1539999999999999},"min":{"1min":0.46999999999999997,"5min":0.42899999999999999,"15min":0.39200000000000002},"max":{"1min":5.359,"5min":7.6879999999999997,"15min":10.942},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.2190000000000001,"15min":1.2170000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.47699999999999998},"max":{"1min":9.0600000000000005,"5min":9.0600000000000005,"15min":9.5009999999999994},"last":1.2110000000000001}]},{"osd":5,"last update":"Thu Mar 30 19:35:52 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.0840000000000001,"15min":1.1779999999999999},"min":{"1min":0.47899999999999998,"5min":0.46800000000000003,"15min":0.45000000000000001},"max":{"1min":3.274,"5min":4.6550000000000002,"15min":24.672000000000001},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.294,"15min":1.258},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.44900000000000001},"max":{"1min":5.5759999999999996,"5min":5.6870000000000003,"15min":13.996},"last":1.4670000000000001}]},{"osd":6,"last update":"Thu Mar 30 19:35:52 2023","interfaces":[{"interface":"back","average":{"1min":2.0950000000000002,"5min":1.492,"15min":1.363},"min":{"1min":0.499,"5min":0.499,"15min":0.49199999999999999},"max":{"1min":21.402999999999999,"5min":21.402999999999999,"15min":21.402999999999999},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.55,"5min":1.246,"15min":1.2390000000000001},"min":{"1min":0.66000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":9.327,"5min":9.327,"15min":18.489000000000001},"last":1.5960000000000001}]},{"osd":7,"last update":"Thu Mar 30 19:35:52 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":1.6180000000000001,"15min":1.4259999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.44900000000000001},"max":{"1min":10.426,"5min":20.303999999999998,"15min":20.303999999999998},"last":1.2949999999999999},{"interface":"front","average":{"1min":2.0529999999999999,"5min":1.6419999999999999,"15min":1.492},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":12.316000000000001,"5min":21.478999999999999,"15min":24.937000000000001},"last":1.51}]}]},{"osd":1,"up_from":14,"seq":60129550354,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1013872,"kb_used_data":552,"kb_used_omap":4451,"kb_used_meta":1008860,"kb_avail":93357968,"statfs":{"total":96636764160,"available":95598559232,"internally_reserved":0,"allocated":565248,"data_stored":255063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4558838,"internal_metadata":1033072650},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 30 19:36:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.998,"15min":1.0169999999999999},"min":{"1min":0.48699999999999999,"5min":0.26800000000000002,"15min":0.252},"max":{"1min":1.9990000000000001,"5min":12.628,"15min":25.765000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.92100000000000004,"15min":1.054},"min":{"1min":0.34599999999999997,"5min":0.30599999999999999,"15min":0.28000000000000003},"max":{"1min":1.7789999999999999,"5min":7.4470000000000001,"15min":25.527999999999999},"last":1.2929999999999999}]},{"osd":2,"last update":"Thu Mar 30 19:36:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.1439999999999999,"15min":1.0609999999999999},"min":{"1min":0.33000000000000002,"5min":0.313,"15min":0.313},"max":{"1min":9.048,"5min":15.252000000000001,"15min":15.252000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.1970000000000001,"15min":1.0569999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":6.742,"5min":15.206,"15min":15.206},"last":1.1399999999999999}]},{"osd":3,"last update":"Thu Mar 30 19:36:16 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.069,"15min":1.127},"min":{"1min":0.39600000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":5.3070000000000004,"5min":8.1920000000000002,"15min":18.219000000000001},"last":1.238},{"interface":"front","average":{"1min":0.79000000000000004,"5min":1.0009999999999999,"15min":1.1619999999999999},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.36599999999999999},"max":{"1min":1.238,"5min":7.7439999999999998,"15min":25.456},"last":1.1910000000000001}]},{"osd":4,"last update":"Thu Mar 30 19:35:38 2023","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":1.0920000000000001,"15min":1.135},"min":{"1min":0.50600000000000001,"5min":0.44500000000000001,"15min":0.40999999999999998},"max":{"1min":6.0220000000000002,"5min":6.0220000000000002,"15min":13.728},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.466,"5min":1.105,"15min":1.1140000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":8.2230000000000008,"5min":8.2230000000000008,"15min":10.217000000000001},"last":1.0840000000000001}]},{"osd":5,"last update":"Thu Mar 30 19:36:16 2023","interfaces":[{"interface":"back","average":{"1min":45.343000000000004,"5min":10.102,"15min":4.3799999999999999},"min":{"1min":0.501,"5min":0.49299999999999999,"15min":0.47199999999999998},"max":{"1min":794.95799999999997,"5min":794.95799999999997,"15min":794.95799999999997},"last":1.4390000000000001},{"interface":"front","average":{"1min":45.475999999999999,"5min":10.183999999999999,"15min":4.4539999999999997},"min":{"1min":0.58099999999999996,"5min":0.48899999999999999,"15min":0.44800000000000001},"max":{"1min":794.93299999999999,"5min":794.93299999999999,"15min":794.93299999999999},"last":1.341}]},{"osd":6,"last update":"Thu Mar 30 19:36:16 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.5109999999999999,"15min":1.292},"min":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.51400000000000001},"max":{"1min":2.0449999999999999,"5min":26.280999999999999,"15min":26.280999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.5449999999999999,"15min":1.3180000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.47999999999999998},"max":{"1min":2.169,"5min":26.742999999999999,"15min":26.742999999999999},"last":1.167}]},{"osd":7,"last update":"Thu Mar 30 19:36:16 2023","interfaces":[{"interface":"back","average":{"1min":2.1469999999999998,"5min":1.583,"15min":1.331},"min":{"1min":0.56599999999999995,"5min":0.56000000000000005,"15min":0.53000000000000003},"max":{"1min":20.292000000000002,"5min":20.292000000000002,"15min":20.292000000000002},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.524,"15min":1.343},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.50900000000000001},"max":{"1min":1.8100000000000001,"5min":16.645,"15min":16.645},"last":1.2569999999999999}]}]},{"osd":0,"up_from":14,"seq":60129550323,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":728944,"kb_used_data":1128,"kb_used_omap":3147,"kb_used_meta":724660,"kb_avail":93642896,"statfs":{"total":96636764160,"available":95890325504,"internally_reserved":0,"allocated":1155072,"data_stored":844088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3223258,"internal_metadata":742052134},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 30 19:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.012,"15min":0.86799999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.26900000000000002},"max":{"1min":6.1779999999999999,"5min":10.074,"15min":12.294},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.0549999999999999,"15min":0.96399999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.29299999999999998},"max":{"1min":5.9059999999999997,"5min":10.473000000000001,"15min":10.473000000000001},"last":1.2889999999999999}]},{"osd":2,"last update":"Thu Mar 30 19:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.7110000000000001,"5min":1.5640000000000001,"15min":1.1579999999999999},"min":{"1min":0.35699999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":12.819000000000001,"5min":46.451999999999998,"15min":46.451999999999998},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.325,"15min":1.0760000000000001},"min":{"1min":0.47899999999999998,"5min":0.34999999999999998,"15min":0.32200000000000001},"max":{"1min":9.907,"5min":33.904000000000003,"15min":33.904000000000003},"last":1.103}]},{"osd":3,"last update":"Thu Mar 30 19:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.4910000000000001,"15min":1.177},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34599999999999997},"max":{"1min":6.085,"5min":50.244999999999997,"15min":50.244999999999997},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.25,"5min":1.044,"15min":0.96399999999999997},"min":{"1min":0.40100000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":6.2619999999999996,"5min":6.2619999999999996,"15min":12.481999999999999},"last":1.4059999999999999}]},{"osd":4,"last update":"Thu Mar 30 19:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.2549999999999999,"15min":1.3999999999999999},"min":{"1min":0.495,"5min":0.49099999999999999,"15min":0.46100000000000002},"max":{"1min":6.9489999999999998,"5min":10.550000000000001,"15min":77.847999999999999},"last":1.444},{"interface":"front","average":{"1min":1.29,"5min":1.7589999999999999,"15min":1.5469999999999999},"min":{"1min":0.58499999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":6.3209999999999997,"5min":61.817,"15min":77.653999999999996},"last":1.534}]},{"osd":5,"last update":"Thu Mar 30 19:36:11 2023","interfaces":[{"interface":"back","average":{"1min":10.397,"5min":3.665,"15min":1.9530000000000001},"min":{"1min":0.65000000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":224.126,"5min":224.126,"15min":224.126},"last":1.1659999999999999},{"interface":"front","average":{"1min":10.167,"5min":2.919,"15min":1.6459999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":222.91399999999999,"5min":222.91399999999999,"15min":222.91399999999999},"last":1.484}]},{"osd":6,"last update":"Thu Mar 30 19:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.9650000000000001,"15min":2.5600000000000001},"min":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":6.3609999999999998,"5min":52.380000000000003,"15min":211.46600000000001},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.423,"5min":1.6200000000000001,"15min":2.3860000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.50600000000000001},"max":{"1min":6.3499999999999996,"5min":20.934999999999999,"15min":210.86699999999999},"last":1.6850000000000001}]},{"osd":7,"last update":"Thu Mar 30 19:36:11 2023","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.4219999999999999,"15min":1.323},"min":{"1min":0.59099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.3010000000000002,"5min":10.84,"15min":10.84},"last":1.514},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.8520000000000001,"15min":1.458},"min":{"1min":0.64600000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.4020000000000001,"5min":50.421999999999997,"15min":50.421999999999997},"last":1.8919999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-30T19:36:33.858 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-03-30T19:36:34.011 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.004+0000 7f11914e6700 1 Processor -- start 2023-03-30T19:36:34.012 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.004+0000 7f11914e6700 1 -- start start 2023-03-30T19:36:34.014 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.008+0000 7f11914e6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f118c06c840 0x7f118c0b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.008+0000 7f11914e6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c146280 con 0x7f118c145eb0 2023-03-30T19:36:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.008+0000 7f11914e6700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c06ade0 con 0x7f118c0b2440 2023-03-30T19:36:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.008+0000 7f11914e6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0b2e20 con 0x7f118c06c840 2023-03-30T19:36:34.015 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.008+0000 7f118affd700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f118c145eb0 0x7f118c160190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34704/0 (socket says 172.21.15.87:34704) 2023-03-30T19:36:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.008+0000 7f118affd700 1 -- 172.21.15.87:0/1585250839 learned_addr learned my addr 172.21.15.87:0/1585250839 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:36:34.016 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.008+0000 7f118b7fe700 1 --2- 172.21.15.87:0/1585250839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f118c06c840 0x7f118c0b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.008+0000 7f1189ffb700 1 -- 172.21.15.87:0/1585250839 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861337924 0 0) 0x7f118c146280 con 0x7f118c145eb0 2023-03-30T19:36:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f1189ffb700 1 -- 172.21.15.87:0/1585250839 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11740035d0 con 0x7f118c145eb0 2023-03-30T19:36:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f1189ffb700 1 -- 172.21.15.87:0/1585250839 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2712386441 0 0) 0x7f11740035d0 con 0x7f118c145eb0 2023-03-30T19:36:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f118b7fe700 1 -- 172.21.15.87:0/1585250839 >> v1:172.21.15.115:6789/0 conn(0x7f118c0b2440 legacy=0x7f118c0cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:34.017 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f118b7fe700 1 -- 172.21.15.87:0/1585250839 >> v1:172.21.15.87:6789/0 conn(0x7f118c145eb0 legacy=0x7f118c160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:34.018 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f118b7fe700 1 -- 172.21.15.87:0/1585250839 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c06b3a0 con 0x7f118c06c840 2023-03-30T19:36:34.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f118b7fe700 1 --2- 172.21.15.87:0/1585250839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f118c06c840 0x7f118c0b28e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1184009dc0 tx=0x7f118400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95bea18655c4e986 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:34.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f1189ffb700 1 -- 172.21.15.87:0/1585250839 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118400e070 con 0x7f118c06c840 2023-03-30T19:36:34.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f1189ffb700 1 -- 172.21.15.87:0/1585250839 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1184003a40 con 0x7f118c06c840 2023-03-30T19:36:34.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f1189ffb700 1 -- 172.21.15.87:0/1585250839 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c001670 con 0x7f118c06c840 2023-03-30T19:36:34.019 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f11914e6700 1 -- 172.21.15.87:0/1585250839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f118c06c840 msgr2=0x7f118c0b28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f11914e6700 1 --2- 172.21.15.87:0/1585250839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f118c06c840 0x7f118c0b28e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1184009dc0 tx=0x7f118400b330 comp rx=0 tx=0).stop 2023-03-30T19:36:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f11914e6700 1 -- 172.21.15.87:0/1585250839 shutdown_connections 2023-03-30T19:36:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f11914e6700 1 --2- 172.21.15.87:0/1585250839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f118c06c840 0x7f118c0b28e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f11914e6700 1 -- 172.21.15.87:0/1585250839 >> 172.21.15.87:0/1585250839 conn(0x7f118c06e560 msgr2=0x7f118c06e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:34.020 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f11914e6700 1 -- 172.21.15.87:0/1585250839 shutdown_connections 2023-03-30T19:36:34.021 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.012+0000 7f11914e6700 1 -- 172.21.15.87:0/1585250839 wait complete. 2023-03-30T19:36:34.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.016+0000 7f11914e6700 1 Processor -- start 2023-03-30T19:36:34.022 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.016+0000 7f11914e6700 1 -- start start 2023-03-30T19:36:34.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f11914e6700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f118c06c840 0x7f118c1f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:34.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f11914e6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f118c0b2440 0x7f118c0b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:34.024 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f11914e6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f118c145eb0 0x7f118c1f6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:34.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f11914e6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c1f6fb0 con 0x7f118c0b2440 2023-03-30T19:36:34.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f11914e6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0b58a0 con 0x7f118c145eb0 2023-03-30T19:36:34.025 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f11914e6700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0b5b80 con 0x7f118c06c840 2023-03-30T19:36:34.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f118a7fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f118c0b2440 0x7f118c0b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:34.026 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f118affd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f118c06c840 0x7f118c1f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:34.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f118a7fc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f118c0b2440 0x7f118c0b51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44650/0 (socket says 172.21.15.87:44650) 2023-03-30T19:36:34.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f118a7fc700 1 -- 172.21.15.87:0/3593394039 learned_addr learned my addr 172.21.15.87:0/3593394039 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:34.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f118a7fc700 1 -- 172.21.15.87:0/3593394039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f118c06c840 msgr2=0x7f118c1f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:34.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f118a7fc700 1 --2- 172.21.15.87:0/3593394039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f118c06c840 0x7f118c1f8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.027 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f118a7fc700 1 -- 172.21.15.87:0/3593394039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f118c145eb0 msgr2=0x7f118c1f6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f118a7fc700 1 --2- 172.21.15.87:0/3593394039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f118c145eb0 0x7f118c1f6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f118a7fc700 1 -- 172.21.15.87:0/3593394039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1184009a70 con 0x7f118c0b2440 2023-03-30T19:36:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f118a7fc700 1 --2- 172.21.15.87:0/3593394039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f118c0b2440 0x7f118c0b51e0 secure :-1 s=READY pgs=3374 cs=0 l=1 rev1=1 crypto rx=0x7f118000b4a0 tx=0x7f118000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f11737fe700 1 -- 172.21.15.87:0/3593394039 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180011830 con 0x7f118c0b2440 2023-03-30T19:36:34.028 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f11737fe700 1 -- 172.21.15.87:0/3593394039 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11800119b0 con 0x7f118c0b2440 2023-03-30T19:36:34.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f11737fe700 1 -- 172.21.15.87:0/3593394039 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180011d60 con 0x7f118c0b2440 2023-03-30T19:36:34.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f11914e6700 1 -- 172.21.15.87:0/3593394039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c160c30 con 0x7f118c0b2440 2023-03-30T19:36:34.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.020+0000 7f11914e6700 1 -- 172.21.15.87:0/3593394039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c15da70 con 0x7f118c0b2440 2023-03-30T19:36:34.029 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.024+0000 7f11914e6700 1 -- 172.21.15.87:0/3593394039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c160f10 con 0x7f118c0b2440 2023-03-30T19:36:34.030 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.024+0000 7f11737fe700 1 -- 172.21.15.87:0/3593394039 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f118001a400 con 0x7f118c0b2440 2023-03-30T19:36:34.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.024+0000 7f11737fe700 1 --2- 172.21.15.87:0/3593394039 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f11780653f0 0x7f11780678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:34.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.024+0000 7f11737fe700 1 -- 172.21.15.87:0/3593394039 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f11800825f0 con 0x7f118c0b2440 2023-03-30T19:36:34.031 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.024+0000 7f118affd700 1 --2- 172.21.15.87:0/3593394039 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f11780653f0 0x7f11780678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:34.032 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.028+0000 7f118affd700 1 --2- 172.21.15.87:0/3593394039 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f11780653f0 0x7f11780678a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f117c0017a0 tx=0x7f117c001230 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:34.037 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.032+0000 7f11737fe700 1 -- 172.21.15.87:0/3593394039 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f11800503e0 con 0x7f118c0b2440 2023-03-30T19:36:34.207 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.200+0000 7f11914e6700 1 -- 172.21.15.87:0/3593394039 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f118c072cf0 con 0x7f118c0b2440 2023-03-30T19:36:34.216 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.212+0000 7f11737fe700 1 -- 172.21.15.87:0/3593394039 <== mon.0 v2:172.21.15.87:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f11800092c0 con 0x7f118c0b2440 2023-03-30T19:36:34.217 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.212+0000 7f11737fe700 1 -- 172.21.15.87:0/3593394039 <== mon.0 v2:172.21.15.87:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1180053a00 con 0x7f118c0b2440 2023-03-30T19:36:34.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.216+0000 7f11914e6700 1 -- 172.21.15.87:0/3593394039 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f11780653f0 msgr2=0x7f11780678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:34.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.216+0000 7f11914e6700 1 --2- 172.21.15.87:0/3593394039 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f11780653f0 0x7f11780678a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f117c0017a0 tx=0x7f117c001230 comp rx=0 tx=0).stop 2023-03-30T19:36:34.222 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.216+0000 7f11914e6700 1 -- 172.21.15.87:0/3593394039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f118c0b2440 msgr2=0x7f118c0b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:34.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.216+0000 7f11914e6700 1 --2- 172.21.15.87:0/3593394039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f118c0b2440 0x7f118c0b51e0 secure :-1 s=READY pgs=3374 cs=0 l=1 rev1=1 crypto rx=0x7f118000b4a0 tx=0x7f118000b7b0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.216+0000 7f11914e6700 1 -- 172.21.15.87:0/3593394039 shutdown_connections 2023-03-30T19:36:34.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.216+0000 7f11914e6700 1 --2- 172.21.15.87:0/3593394039 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f11780653f0 0x7f11780678a0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.216+0000 7f11914e6700 1 --2- 172.21.15.87:0/3593394039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f118c145eb0 0x7f118c1f6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.223 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.216+0000 7f11914e6700 1 --2- 172.21.15.87:0/3593394039 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f118c0b2440 0x7f118c0b51e0 unknown :-1 s=CLOSED pgs=3374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.216+0000 7f11914e6700 1 --2- 172.21.15.87:0/3593394039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f118c06c840 0x7f118c1f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.216+0000 7f11914e6700 1 -- 172.21.15.87:0/3593394039 >> 172.21.15.87:0/3593394039 conn(0x7f118c06e560 msgr2=0x7f118c0cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:34.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.216+0000 7f11914e6700 1 -- 172.21.15.87:0/3593394039 shutdown_connections 2023-03-30T19:36:34.224 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.216+0000 7f11914e6700 1 -- 172.21.15.87:0/3593394039 wait complete. 2023-03-30T19:36:34.238 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-03-30T19:36:34.239 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-30T19:36:34.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62b09f1700 1 Processor -- start 2023-03-30T19:36:34.364 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62b09f1700 1 -- start start 2023-03-30T19:36:34.365 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62b09f1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac0cf9c0 0x7f62ac06d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:34.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62b09f1700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f62ac071290 0x7f62ac1601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:34.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62b09f1700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ac0717d0 con 0x7f62ac15c5d0 2023-03-30T19:36:34.366 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62b09f1700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac0ccc70 con 0x7f62ac071290 2023-03-30T19:36:34.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62b09f1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac0cfe80 con 0x7f62ac0cf9c0 2023-03-30T19:36:34.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62aad9d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f62ac15c5d0 0x7f62ac070b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34710/0 (socket says 172.21.15.87:34710) 2023-03-30T19:36:34.367 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62aad9d700 1 -- 172.21.15.87:0/955781742 learned_addr learned my addr 172.21.15.87:0/955781742 (peer_addr_for_me v1:172.21.15.87:0/0) 2023-03-30T19:36:34.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62aa59c700 1 --2- 172.21.15.87:0/955781742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac0cf9c0 0x7f62ac06d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:34.368 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62ab59e700 1 --2- 172.21.15.87:0/955781742 >> v2:172.21.15.115:3300/0 conn(0x7f62ac071290 0x7f62ac1601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:34.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62a9d9b700 1 -- 172.21.15.87:0/955781742 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081997744 0 0) 0x7f62ac0717d0 con 0x7f62ac15c5d0 2023-03-30T19:36:34.370 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62a9d9b700 1 -- 172.21.15.87:0/955781742 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62940035d0 con 0x7f62ac15c5d0 2023-03-30T19:36:34.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62ab59e700 1 -- 172.21.15.87:0/955781742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac0cf9c0 msgr2=0x7f62ac06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-30T19:36:34.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62ab59e700 1 --2- 172.21.15.87:0/955781742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac0cf9c0 0x7f62ac06d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.371 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62ab59e700 1 -- 172.21.15.87:0/955781742 >> v1:172.21.15.87:6789/0 conn(0x7f62ac15c5d0 legacy=0x7f62ac070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:34.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62ab59e700 1 -- 172.21.15.87:0/955781742 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac071a20 con 0x7f62ac071290 2023-03-30T19:36:34.372 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62ab59e700 1 --2- 172.21.15.87:0/955781742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62ac071290 0x7f62ac1601d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009d90 tx=0x7f62a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f84d29834295bfa server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:34.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62a9d9b700 1 -- 172.21.15.87:0/955781742 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a400e070 con 0x7f62ac071290 2023-03-30T19:36:34.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62a9d9b700 1 -- 172.21.15.87:0/955781742 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f62a400bb20 con 0x7f62ac071290 2023-03-30T19:36:34.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62a9d9b700 1 -- 172.21.15.87:0/955781742 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4012430 con 0x7f62ac071290 2023-03-30T19:36:34.373 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62b09f1700 1 -- 172.21.15.87:0/955781742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62ac071290 msgr2=0x7f62ac1601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:34.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.360+0000 7f62b09f1700 1 --2- 172.21.15.87:0/955781742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62ac071290 0x7f62ac1601d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009d90 tx=0x7f62a400b330 comp rx=0 tx=0).stop 2023-03-30T19:36:34.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62b09f1700 1 -- 172.21.15.87:0/955781742 shutdown_connections 2023-03-30T19:36:34.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62b09f1700 1 --2- 172.21.15.87:0/955781742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62ac071290 0x7f62ac1601d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.374 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62b09f1700 1 --2- 172.21.15.87:0/955781742 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac0cf9c0 0x7f62ac06d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62b09f1700 1 -- 172.21.15.87:0/955781742 >> 172.21.15.87:0/955781742 conn(0x7f62ac0cc7b0 msgr2=0x7f62ac0cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:34.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62b09f1700 1 -- 172.21.15.87:0/955781742 shutdown_connections 2023-03-30T19:36:34.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62b09f1700 1 -- 172.21.15.87:0/955781742 wait complete. 2023-03-30T19:36:34.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62b09f1700 1 Processor -- start 2023-03-30T19:36:34.375 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62b09f1700 1 -- start start 2023-03-30T19:36:34.377 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62b09f1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62ac071290 0x7f62ac0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:34.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62b09f1700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac0cf9c0 0x7f62ac0b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:34.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62b09f1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ac15c5d0 0x7f62ac1f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:34.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62b09f1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac1f1d90 con 0x7f62ac15c5d0 2023-03-30T19:36:34.378 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62b09f1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac0ac110 con 0x7f62ac071290 2023-03-30T19:36:34.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62b09f1700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac0ac3f0 con 0x7f62ac0cf9c0 2023-03-30T19:36:34.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62ab59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ac15c5d0 0x7f62ac1f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:34.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62ab59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ac15c5d0 0x7f62ac1f5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44664/0 (socket says 172.21.15.87:44664) 2023-03-30T19:36:34.379 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62ab59e700 1 -- 172.21.15.87:0/3389605789 learned_addr learned my addr 172.21.15.87:0/3389605789 (peer_addr_for_me v2:172.21.15.87:0/0) 2023-03-30T19:36:34.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62aa59c700 1 --2- 172.21.15.87:0/3389605789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac0cf9c0 0x7f62ac0b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:34.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62aad9d700 1 --2- 172.21.15.87:0/3389605789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62ac071290 0x7f62ac0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:34.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62ab59e700 1 -- 172.21.15.87:0/3389605789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac0cf9c0 msgr2=0x7f62ac0b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:34.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62ab59e700 1 --2- 172.21.15.87:0/3389605789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac0cf9c0 0x7f62ac0b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.380 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62ab59e700 1 -- 172.21.15.87:0/3389605789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62ac071290 msgr2=0x7f62ac0ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:34.381 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62ab59e700 1 --2- 172.21.15.87:0/3389605789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62ac071290 0x7f62ac0ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.381 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.364+0000 7f62ab59e700 1 -- 172.21.15.87:0/3389605789 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a4009a70 con 0x7f62ac15c5d0 2023-03-30T19:36:34.381 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.368+0000 7f62ab59e700 1 --2- 172.21.15.87:0/3389605789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ac15c5d0 0x7f62ac1f5480 secure :-1 s=READY pgs=3376 cs=0 l=1 rev1=1 crypto rx=0x7f62a4014040 tx=0x7f62a4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:34.381 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.368+0000 7f62937fe700 1 -- 172.21.15.87:0/3389605789 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4012430 con 0x7f62ac15c5d0 2023-03-30T19:36:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.368+0000 7f62937fe700 1 -- 172.21.15.87:0/3389605789 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f62a4020070 con 0x7f62ac15c5d0 2023-03-30T19:36:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.368+0000 7f62b09f1700 1 -- 172.21.15.87:0/3389605789 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac15c9a0 con 0x7f62ac15c5d0 2023-03-30T19:36:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.368+0000 7f62937fe700 1 -- 172.21.15.87:0/3389605789 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40042a0 con 0x7f62ac15c5d0 2023-03-30T19:36:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.368+0000 7f62b09f1700 1 -- 172.21.15.87:0/3389605789 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac071d00 con 0x7f62ac15c5d0 2023-03-30T19:36:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.368+0000 7f62b09f1700 1 -- 172.21.15.87:0/3389605789 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ac0ceb70 con 0x7f62ac15c5d0 2023-03-30T19:36:34.382 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.368+0000 7f62937fe700 1 -- 172.21.15.87:0/3389605789 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f62a4004400 con 0x7f62ac15c5d0 2023-03-30T19:36:34.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.368+0000 7f62937fe700 1 --2- 172.21.15.87:0/3389605789 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f62980653f0 0x7f62980678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-30T19:36:34.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.368+0000 7f62937fe700 1 -- 172.21.15.87:0/3389605789 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f62a4022070 con 0x7f62ac15c5d0 2023-03-30T19:36:34.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.368+0000 7f62aad9d700 1 --2- 172.21.15.87:0/3389605789 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f62980653f0 0x7f62980678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-30T19:36:34.383 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.372+0000 7f62aad9d700 1 --2- 172.21.15.87:0/3389605789 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f62980653f0 0x7f62980678a0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f629c0011e0 tx=0x7f629c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-30T19:36:34.384 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.372+0000 7f62937fe700 1 -- 172.21.15.87:0/3389605789 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169419 (secure 0 0 0) 0x7f62a40523d0 con 0x7f62ac15c5d0 2023-03-30T19:36:34.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.568+0000 7f62b09f1700 1 -- 172.21.15.87:0/3389605789 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62ac072cf0 con 0x7f62ac15c5d0 2023-03-30T19:36:34.576 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.572+0000 7f62937fe700 1 -- 172.21.15.87:0/3389605789 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f62a40559f0 con 0x7f62ac15c5d0 2023-03-30T19:36:34.598 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-03-30T19:36:34.598 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4958,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/474261391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":474261391},{"type":"v1","addr":"172.21.15.115:6833","nonce":474261391}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5201,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/2955450437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":2955450437},{"type":"v1","addr":"172.21.15.115:6835","nonce":2955450437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6836/2626542689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2626542689},{"type":"v1","addr":"172.21.15.87:6836","nonce":2626542689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5334,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6837/3981806958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6835","nonce":3981806958},{"type":"v1","addr":"172.21.15.87:6837","nonce":3981806958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[]} 2023-03-30T19:36:34.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.572+0000 7f62b09f1700 1 -- 172.21.15.87:0/3389605789 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f62980653f0 msgr2=0x7f62980678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:34.599 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.572+0000 7f62b09f1700 1 --2- 172.21.15.87:0/3389605789 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f62980653f0 0x7f62980678a0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f629c0011e0 tx=0x7f629c009040 comp rx=0 tx=0).stop 2023-03-30T19:36:34.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.572+0000 7f62b09f1700 1 -- 172.21.15.87:0/3389605789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ac15c5d0 msgr2=0x7f62ac1f5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-30T19:36:34.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.572+0000 7f62b09f1700 1 --2- 172.21.15.87:0/3389605789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ac15c5d0 0x7f62ac1f5480 secure :-1 s=READY pgs=3376 cs=0 l=1 rev1=1 crypto rx=0x7f62a4014040 tx=0x7f62a4004af0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.572+0000 7f62b09f1700 1 -- 172.21.15.87:0/3389605789 shutdown_connections 2023-03-30T19:36:34.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.572+0000 7f62b09f1700 1 --2- 172.21.15.87:0/3389605789 >> [v2:172.21.15.87:6832/33667,v1:172.21.15.87:6833/33667] conn(0x7f62980653f0 0x7f62980678a0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.600 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.572+0000 7f62b09f1700 1 --2- 172.21.15.87:0/3389605789 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62ac15c5d0 0x7f62ac1f5480 unknown :-1 s=CLOSED pgs=3376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.572+0000 7f62b09f1700 1 --2- 172.21.15.87:0/3389605789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62ac0cf9c0 0x7f62ac0b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.572+0000 7f62b09f1700 1 --2- 172.21.15.87:0/3389605789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62ac071290 0x7f62ac0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-30T19:36:34.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.572+0000 7f62b09f1700 1 -- 172.21.15.87:0/3389605789 >> 172.21.15.87:0/3389605789 conn(0x7f62ac0cc7b0 msgr2=0x7f62ac069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-30T19:36:34.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.572+0000 7f62b09f1700 1 -- 172.21.15.87:0/3389605789 shutdown_connections 2023-03-30T19:36:34.601 INFO:teuthology.orchestra.run.smithi087.stderr:2023-03-30T19:36:34.572+0000 7f62b09f1700 1 -- 172.21.15.87:0/3389605789 wait complete. 2023-03-30T19:36:34.602 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 20 2023-03-30T19:36:34.602 DEBUG:tasks.cephfs.filesystem:already dead... 2023-03-30T19:36:34.603 INFO:teuthology.misc:Shutting down mds daemons... 2023-03-30T19:36:34.603 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-03-30T19:36:34.604 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:36:40.706 INFO:tasks.ceph.mds.a:Stopped 2023-03-30T19:36:40.707 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-03-30T19:36:40.707 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:36:40.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-03-30T19:36:46.809 INFO:tasks.ceph.mds.c:Stopped 2023-03-30T19:36:46.810 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-03-30T19:36:46.811 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:36:47.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-03-30T19:36:52.913 INFO:tasks.ceph.mds.b:Stopped 2023-03-30T19:36:52.915 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-03-30T19:36:52.915 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:36:53.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-03-30T19:36:59.018 INFO:tasks.ceph.mds.d:Stopped 2023-03-30T19:36:59.019 INFO:teuthology.misc:Shutting down osd daemons... 2023-03-30T19:36:59.020 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-03-30T19:36:59.020 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:37:00.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-03-30T19:37:05.123 INFO:tasks.ceph.osd.0:Stopped 2023-03-30T19:37:05.124 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-03-30T19:37:05.124 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:37:11.226 INFO:tasks.ceph.osd.1:Stopped 2023-03-30T19:37:11.227 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-03-30T19:37:11.228 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:37:17.330 INFO:tasks.ceph.osd.2:Stopped 2023-03-30T19:37:17.331 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-03-30T19:37:17.332 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:37:23.434 INFO:tasks.ceph.osd.3:Stopped 2023-03-30T19:37:23.435 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-03-30T19:37:23.436 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:37:23.699 INFO:teuthology.orchestra.run.smithi115.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.b.log.1: 2023-03-30T19:37:23.699 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: stdin: file size changed while zipping 2023-03-30T19:37:29.538 INFO:tasks.ceph.osd.4:Stopped 2023-03-30T19:37:29.539 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-03-30T19:37:29.539 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:37:30.185 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-03-30T19:37:35.641 INFO:tasks.ceph.osd.5:Stopped 2023-03-30T19:37:35.642 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-03-30T19:37:35.643 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:37:35.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-03-30T19:37:35.893 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-03-30T19:37:41.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-03-30T19:37:41.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-03-30T19:37:41.745 INFO:tasks.ceph.osd.6:Stopped 2023-03-30T19:37:41.746 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-03-30T19:37:41.746 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:37:47.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-03-30T19:37:47.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-03-30T19:37:47.848 INFO:tasks.ceph.osd.7:Stopped 2023-03-30T19:37:47.849 INFO:teuthology.misc:Shutting down mgr daemons... 2023-03-30T19:37:47.849 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-03-30T19:37:47.850 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:37:52.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-03-30T19:37:52.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-03-30T19:37:53.952 INFO:tasks.ceph.mgr.y:Stopped 2023-03-30T19:37:53.953 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-03-30T19:37:53.953 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:37:56.769 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:37:56.775 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:37:57.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-03-30T19:37:57.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-03-30T19:38:00.055 INFO:tasks.ceph.mgr.x:Stopped 2023-03-30T19:38:00.056 INFO:teuthology.misc:Shutting down mon daemons... 2023-03-30T19:38:00.057 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-03-30T19:38:00.057 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:38:02.913 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-03-30T19:38:02.914 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-03-30T19:38:06.161 INFO:tasks.ceph.mon.a:Stopped 2023-03-30T19:38:06.162 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-03-30T19:38:06.162 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:38:08.016 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-03-30T19:38:08.016 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-03-30T19:38:12.264 INFO:tasks.ceph.mon.b:Stopped 2023-03-30T19:38:12.265 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-03-30T19:38:12.265 INFO:teuthology.orchestra.run:waiting for 300 2023-03-30T19:38:13.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-03-30T19:38:13.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-03-30T19:38:18.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~5s 2023-03-30T19:38:18.367 INFO:tasks.ceph.mon.c:Stopped 2023-03-30T19:38:18.368 INFO:tasks.ceph:Checking cluster log for badness... 2023-03-30T19:38:18.369 DEBUG:teuthology.orchestra.run.smithi087:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-03-30T19:38:18.570 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi087.front.sepia.ceph.com 2023-03-30T19:38:18.570 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-03-30T19:38:19.196 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi087.front.sepia.ceph.com 2023-03-30T19:38:19.197 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-03-30T19:38:19.988 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi087.front.sepia.ceph.com 2023-03-30T19:38:19.989 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-03-30T19:38:20.652 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi087.front.sepia.ceph.com 2023-03-30T19:38:20.653 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-03-30T19:38:21.420 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi115.front.sepia.ceph.com 2023-03-30T19:38:21.421 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-03-30T19:38:22.136 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi115.front.sepia.ceph.com 2023-03-30T19:38:22.136 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-03-30T19:38:22.943 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi115.front.sepia.ceph.com 2023-03-30T19:38:22.944 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-03-30T19:38:23.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-03-30T19:38:23.659 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi115.front.sepia.ceph.com 2023-03-30T19:38:23.660 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-03-30T19:38:24.449 INFO:tasks.ceph:Archiving mon data... 2023-03-30T19:38:24.450 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7225993/data/mon.a.tgz 2023-03-30T19:38:24.451 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2023-03-30T19:38:24.469 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.h137CbXEAn 2023-03-30T19:38:24.469 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.h137CbXEAn 2023-03-30T19:38:24.757 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.h137CbXEAn 2023-03-30T19:38:24.948 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.h137CbXEAn is 594KB 2023-03-30T19:38:24.984 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.h137CbXEAn 2023-03-30T19:38:25.000 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7225993/data/mon.b.tgz 2023-03-30T19:38:25.000 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2023-03-30T19:38:25.014 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.TZLn9ShvUl 2023-03-30T19:38:25.015 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.TZLn9ShvUl 2023-03-30T19:38:25.317 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.TZLn9ShvUl 2023-03-30T19:38:25.450 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.TZLn9ShvUl is 594KB 2023-03-30T19:38:25.541 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.TZLn9ShvUl 2023-03-30T19:38:25.559 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7225993/data/mon.c.tgz 2023-03-30T19:38:25.560 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2023-03-30T19:38:25.621 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.loBu0gXs0p 2023-03-30T19:38:25.621 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.loBu0gXs0p 2023-03-30T19:38:25.802 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.loBu0gXs0p 2023-03-30T19:38:25.905 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.loBu0gXs0p is 594KB 2023-03-30T19:38:25.987 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.loBu0gXs0p 2023-03-30T19:38:26.005 INFO:tasks.ceph:Cleaning ceph cluster... 2023-03-30T19:38:26.005 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-03-30T19:38:26.012 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-03-30T19:38:26.288 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-03-30T19:38:26.289 DEBUG:teuthology.orchestra.run.smithi087:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-03-30T19:38:26.293 DEBUG:teuthology.orchestra.run.smithi115:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-03-30T19:38:26.345 INFO:teuthology.orchestra.run.smithi087.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-03-30T19:38:26.345 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-03-30T19:38:26.357 INFO:tasks.ceph:Archiving crash dumps... 2023-03-30T19:38:26.362 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7225993/remote/smithi087/crash 2023-03-30T19:38:26.364 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2023-03-30T19:38:26.398 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7225993/remote/smithi115/crash 2023-03-30T19:38:26.400 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2023-03-30T19:38:26.440 INFO:tasks.ceph:Shutting down logrotate 2023-03-30T19:38:26.441 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:38:26.448 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-30T19:38:26.543 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-03-30T19:38:26.594 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-03-30T19:38:26.640 INFO:tasks.ceph:Compressing logs... 2023-03-30T19:38:26.640 DEBUG:teuthology.orchestra.run.smithi087:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-03-30T19:38:26.646 DEBUG:teuthology.orchestra.run.smithi115:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-03-30T19:44:06.317 INFO:tasks.ceph:Archiving logs... 2023-03-30T19:44:06.319 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-03-30_04:16:29-fs-wip-vshankar-testing-20230317.095222-testing-default-smithi/7225993/remote/smithi087/log 2023-03-30T19:44:06.320 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/log/ceph -- . 2023-03-30T19:56:57.683 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-03-30T19:56:57.785 DEBUG:teuthology.task.console_log:Killing console logger for smithi087 2023-03-30T19:56:57.805 DEBUG:teuthology.task.console_log:Killing console logger for smithi115 2023-03-30T19:56:57.806 DEBUG:teuthology.exit:Finished running handlers